May 19 04:31:22.758407 np0000001025 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service.
May 19 04:31:23.038181 np0000001025 nova-compute[97981]: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:41: EventletDeprecationWarning:
May 19 04:31:23.038181 np0000001025 nova-compute[97981]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 19 04:31:23.038181 np0000001025 nova-compute[97981]: we strongly recommend against using it for new projects.
May 19 04:31:23.038181 np0000001025 nova-compute[97981]: If you are already using Eventlet, we recommend migrating to a different
May 19 04:31:23.038181 np0000001025 nova-compute[97981]: framework.  For more detail see
May 19 04:31:23.038181 np0000001025 nova-compute[97981]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 19 04:31:23.038181 np0000001025 nova-compute[97981]:   import eventlet
May 19 04:31:24.439553 np0000001025 nova-compute[97981]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=97981) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:44}}
May 19 04:31:24.440120 np0000001025 nova-compute[97981]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=97981) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:44}}
May 19 04:31:24.440120 np0000001025 nova-compute[97981]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=97981) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:44}}
May 19 04:31:24.440120 np0000001025 nova-compute[97981]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
May 19 04:31:24.557135 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:31:24.570679 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.014s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:31:24.614684 np0000001025 nova-compute[97981]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative
May 19 04:31:25.481144 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks.
May 19 04:31:25.481144 np0000001025 nova-compute[97981]: INFO nova.utils [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] The long task thread pool MainProcess.long_task is initialized
May 19 04:31:25.481572 np0000001025 nova-compute[97981]: INFO nova.virt.driver [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Loading compute driver 'libvirt.LibvirtDriver'
May 19 04:31:25.571660 np0000001025 nova-compute[97981]: INFO nova.compute.provider_config [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
May 19 04:31:26.073674 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Acquiring lock "singleton_lock" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:31:26.073774 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Acquired lock "singleton_lock" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:31:26.073964 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Releasing lock "singleton_lock" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:31:26.074129 np0000001025 nova-compute[97981]: WARNING oslo_service.backend._threading.service [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] no_fork=True: running service in main process
May 19 04:31:26.074386 np0000001025 nova-compute[97981]: INFO nova.service [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Starting compute node (version 33.1.0)
May 19 04:31:26.577807 np0000001025 nova-compute[97981]: INFO nova.utils [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] The default thread pool MainProcess.default is initialized
May 19 04:31:26.578402 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:31:26.578654 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Starting event thread {{(pid=97981) start /opt/stack/nova/nova/virt/libvirt/host.py:252}}
May 19 04:31:26.579298 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Starting connection event dispatch thread {{(pid=97981) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:553}}
May 19 04:31:26.579791 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Connecting to libvirt: qemu:///system {{(pid=97981) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:558}}
May 19 04:31:27.395006 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x721852b3c050> {{(pid=97981) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:564}}
May 19 04:31:27.395866 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x721852b3c050> {{(pid=97981) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:585}}
May 19 04:31:27.396502 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Connection event '1' reason 'None'
May 19 04:31:27.902707 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Cannot update service status on host "np0000001025" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000001025 could not be found.
May 19 04:31:27.903128 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.mount [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Initialising _HostMountState generation 0 {{(pid=97981) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
May 19 04:31:37.822692 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host capabilities <capabilities>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:   <host>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:     <uuid>a17133d4-4f5c-43fc-9abf-8886a3512454</uuid>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:     <cpu>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <arch>x86_64</arch>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <model>EPYC-Milan</model>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <vendor>AMD</vendor>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <microcode version='16777317'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <signature family='25' model='1' stepping='1'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <topology sockets='12' dies='1' cores='1' threads='1'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <maxphysaddr mode='emulate' bits='40'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='x2apic'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='tsc-deadline'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='osxsave'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='hypervisor'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='tsc_adjust'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='ospke'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='vaes'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='vpclmulqdq'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='spec-ctrl'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='stibp'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='arch-capabilities'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='ssbd'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='cmp_legacy'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='topoext'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='stibp-always-on'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='virt-ssbd'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='amd-psfd'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='lbrv'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='tsc-scale'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='vmcb-clean'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='flushbyasid'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='pause-filter'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='pfthreshold'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='v-vmsave-vmload'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='vgif'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='no-nested-data-bp'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='lfence-always-serializing'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='null-sel-clr-base'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='rdctl-no'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='skip-l1dfl-vmentry'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='mds-no'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='pschange-mc-no'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <feature name='gds-no'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <pages unit='KiB' size='4'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <pages unit='KiB' size='2048'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <pages unit='KiB' size='1048576'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:     </cpu>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:     <power_management/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:     <iommu support='no'/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:     <migration_features>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <live/>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       <uri_transports>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:         <uri_transport>tcp</uri_transport>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:         <uri_transport>rdma</uri_transport>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:       </uri_transports>
May 19 04:31:37.822692 np0000001025 nova-compute[97981]:     </migration_features>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:     <topology>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:       <cells num='1'>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:         <cell id='0'>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:           <memory unit='KiB'>24607188</memory>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:           <pages unit='KiB' size='4'>6151797</pages>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:           <pages unit='KiB' size='2048'>0</pages>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:           <pages unit='KiB' size='1048576'>0</pages>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:           <distances>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:             <sibling id='0' value='10'/>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:           </distances>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:           <cpus num='12'>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:             <cpu id='1' socket_id='1' die_id='1' core_id='0' siblings='1'/>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:             <cpu id='2' socket_id='2' die_id='2' core_id='0' siblings='2'/>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:             <cpu id='3' socket_id='3' die_id='3' core_id='0' siblings='3'/>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:             <cpu id='4' socket_id='4' die_id='4' core_id='0' siblings='4'/>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:             <cpu id='5' socket_id='5' die_id='5' core_id='0' siblings='5'/>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:             <cpu id='6' socket_id='6' die_id='6' core_id='0' siblings='6'/>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:             <cpu id='7' socket_id='7' die_id='7' core_id='0' siblings='7'/>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:             <cpu id='8' socket_id='8' die_id='8' core_id='0' siblings='8'/>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:             <cpu id='9' socket_id='9' die_id='9' core_id='0' siblings='9'/>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:             <cpu id='10' socket_id='10' die_id='10' core_id='0' siblings='10'/>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:             <cpu id='11' socket_id='11' die_id='11' core_id='0' siblings='11'/>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:           </cpus>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:         </cell>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:       </cells>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:     </topology>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:     <cache>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:       <bank id='0' level='3' type='both' size='32' unit='MiB' cpus='0'/>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:       <bank id='1' level='3' type='both' size='32' unit='MiB' cpus='1'/>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:       <bank id='2' level='3' type='both' size='32' unit='MiB' cpus='2'/>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:       <bank id='3' level='3' type='both' size='32' unit='MiB' cpus='3'/>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:       <bank id='4' level='3' type='both' size='32' unit='MiB' cpus='4'/>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:       <bank id='5' level='3' type='both' size='32' unit='MiB' cpus='5'/>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:       <bank id='6' level='3' type='both' size='32' unit='MiB' cpus='6'/>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:       <bank id='7' level='3' type='both' size='32' unit='MiB' cpus='7'/>
May 19 04:31:37.824750 np0000001025 nova-compute[97981]:       <bank id='8' level='3' type='both' size='32' unit='MiB' cpus='8'/>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <bank id='9' level='3' type='both' size='32' unit='MiB' cpus='9'/>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <bank id='10' level='3' type='both' size='32' unit='MiB' cpus='10'/>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <bank id='11' level='3' type='both' size='32' unit='MiB' cpus='11'/>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:     </cache>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:     <secmodel>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <model>apparmor</model>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <doi>0</doi>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:     </secmodel>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:     <secmodel>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <model>dac</model>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <doi>0</doi>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <baselabel type='kvm'>+64055:+993</baselabel>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <baselabel type='qemu'>+64055:+993</baselabel>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:     </secmodel>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:   </host>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:     <arch name='alpha'>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <wordsize>64</wordsize>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>clipper</machine>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:     <arch name='armv6l'>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <wordsize>32</wordsize>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-8.2</machine>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>mori-bmc</machine>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>ast2600-evb</machine>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>borzoi</machine>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>spitz</machine>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>virt-2.7</machine>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>nuri</machine>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>romulus-bmc</machine>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-3.0</machine>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-5.0</machine>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>npcm750-evb</machine>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>virt-2.10</machine>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>rainier-bmc</machine>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mps3-an547</machine>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>musca-b1</machine>
May 19 04:31:37.825675 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>versatileab</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>kzm</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>virt-2.8</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>fby35-bmc</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>musca-a</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-3.1</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-5.1</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>smdkc210</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>sx1</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>virt-2.11</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>imx25-pdk</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>virt-2.9</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>orangepi-pc</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>z2</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-5.2</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>tosa</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mps2-an500</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>virt-2.12</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>mps2-an521</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>sabrelite</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mps2-an511</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>canon-a1100</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>realview-eb</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-7.0</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-4.0</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>raspi1ap</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>sx1-v1</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>n810</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>g220a-bmc</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>n800</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-7.1</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 19 04:31:37.827054 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-4.1</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>quanta-gsj</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>versatilepb</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>terrier</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mainstone</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>integratorcp</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-7.2</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-4.2</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>mps3-an524</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>kudo-bmc</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>vexpress-a9</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>midway</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>musicpal</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>lm3s811evb</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>microbit</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='3'>fby35</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mps2-an505</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mps2-an385</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-6.0</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-8.0</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>cubieboard</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>ast1030-evb</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>verdex</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>bpim2u</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>netduino2</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mps2-an386</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-6.1</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-8.1</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>raspi2b</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>vexpress-a15</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>fuji-bmc</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-6.2</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>cheetah</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>virt-2.6</machine>
May 19 04:31:37.828093 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>ast2500-evb</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>highbank</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>akita</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>connex</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>netduinoplus2</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>collie</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>raspi0</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:     <arch name='armv7l'>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <wordsize>32</wordsize>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-8.2</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>mori-bmc</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>ast2600-evb</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>borzoi</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>spitz</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>virt-2.7</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>nuri</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>romulus-bmc</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-3.0</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-5.0</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>npcm750-evb</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>virt-2.10</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>rainier-bmc</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mps3-an547</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>musca-b1</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>versatileab</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>kzm</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>virt-2.8</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>fby35-bmc</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>musca-a</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-3.1</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 19 04:31:37.829242 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-5.1</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>smdkc210</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>sx1</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>virt-2.11</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>imx25-pdk</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>virt-2.9</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>orangepi-pc</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>z2</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-5.2</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>tosa</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mps2-an500</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>virt-2.12</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>mps2-an521</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>sabrelite</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mps2-an511</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>canon-a1100</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>realview-eb</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-7.0</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-4.0</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>raspi1ap</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>sx1-v1</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>n810</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>g220a-bmc</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>n800</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-7.1</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-4.1</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>quanta-gsj</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>versatilepb</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>terrier</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mainstone</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>integratorcp</machine>
May 19 04:31:37.830339 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-7.2</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-4.2</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>mps3-an524</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>kudo-bmc</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>vexpress-a9</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>midway</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>musicpal</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>lm3s811evb</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>microbit</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='3'>fby35</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mps2-an505</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mps2-an385</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-6.0</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-8.0</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>cubieboard</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>ast1030-evb</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>verdex</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>bpim2u</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>netduino2</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mps2-an386</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-6.1</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-8.1</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>raspi2b</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>vexpress-a15</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>fuji-bmc</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-6.2</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>cheetah</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>virt-2.6</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>ast2500-evb</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>highbank</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>akita</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>connex</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>netduinoplus2</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>collie</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>raspi0</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 19 04:31:37.831309 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:     <arch name='aarch64'>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <wordsize>64</wordsize>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-8.2</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>mori-bmc</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>ast2600-evb</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>borzoi</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>spitz</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>virt-2.7</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>nuri</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>romulus-bmc</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-3.0</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-5.0</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>npcm750-evb</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>virt-2.10</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>rainier-bmc</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mps3-an547</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>virt-2.8</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>musca-b1</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>versatileab</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>kzm</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>fby35-bmc</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>musca-a</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-3.1</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-5.1</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>smdkc210</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>sx1</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>virt-2.11</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>imx25-pdk</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>virt-2.9</machine>
May 19 04:31:37.832288 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>orangepi-pc</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>z2</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-5.2</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='6'>xlnx-zcu102</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>tosa</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mps2-an500</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>virt-2.12</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>mps2-an521</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>sabrelite</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mps2-an511</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>canon-a1100</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>realview-eb</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>sbsa-ref</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-7.0</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-4.0</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>raspi1ap</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>sx1-v1</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>n810</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>g220a-bmc</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>n800</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-7.1</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-4.1</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>quanta-gsj</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>versatilepb</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>terrier</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mainstone</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>integratorcp</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-7.2</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-4.2</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 19 04:31:37.833441 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>mps3-an524</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>kudo-bmc</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>vexpress-a9</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>midway</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>musicpal</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>lm3s811evb</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>microbit</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='3'>fby35</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mps2-an505</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mps2-an385</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-6.0</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-8.0</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>raspi3ap</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>cubieboard</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>ast1030-evb</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>verdex</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>bpim2u</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>netduino2</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>xlnx-versal-virt</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mps2-an386</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-6.1</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-8.1</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>raspi3b</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>raspi2b</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>vexpress-a15</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='2'>fuji-bmc</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt-6.2</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>cheetah</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>virt-2.6</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>ast2500-evb</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>highbank</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>akita</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>connex</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>netduinoplus2</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>collie</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>raspi0</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <acpi default='on' toggle='yes'/>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.834449 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:     <arch name='cris'>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <wordsize>32</wordsize>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-cris</emulator>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>axis-dev88</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:     <arch name='i686'>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <wordsize>32</wordsize>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-i386</emulator>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 19 04:31:37.835575 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>x-remote</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 19 04:31:37.836804 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>isapc</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 19 04:31:37.837786 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>microvm</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 19 04:31:37.838724 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <domain type='kvm'/>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <pae/>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <nonpae/>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <acpi default='on' toggle='yes'/>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <apic default='on' toggle='no'/>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:     <arch name='m68k'>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <wordsize>32</wordsize>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mcf5208evb</machine>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>virt-7.0</machine>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>an5206</machine>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>virt-6.0</machine>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>q800</machine>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>virt-8.1</machine>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>virt-7.2</machine>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>virt-6.2</machine>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>virt-8.0</machine>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>next-cube</machine>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>virt-7.1</machine>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>virt-6.1</machine>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>virt-8.2</machine>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <machine canonical='virt-8.2' maxCpus='1'>virt</machine>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:     <arch name='microblaze'>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <wordsize>32</wordsize>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:     <arch name='microblazeel'>
May 19 04:31:37.839710 np0000001025 nova-compute[97981]:       <wordsize>32</wordsize>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:     <arch name='mips'>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <wordsize>32</wordsize>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-mips</emulator>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <machine maxCpus='16'>malta</machine>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mipssim</machine>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:     <arch name='mipsel'>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <wordsize>32</wordsize>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <machine maxCpus='16'>malta</machine>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mipssim</machine>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:     <arch name='mips64'>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <wordsize>64</wordsize>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <machine maxCpus='16'>malta</machine>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mipssim</machine>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>pica61</machine>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>magnum</machine>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:     <arch name='mips64el'>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <wordsize>64</wordsize>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
May 19 04:31:37.841437 np0000001025 nova-compute[97981]:       <machine maxCpus='16'>malta</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='16'>loongson3-virt</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mipssim</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>pica61</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>magnum</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='16'>boston</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>fuloong2e</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:     <arch name='ppc'>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <wordsize>32</wordsize>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>g3beige</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>amigaone</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>virtex-ml507</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mac99</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='32'>ppce500</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>sam460ex</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>pegasos2</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>bamboo</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>40p</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>ref405ep</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='15'>mpc8544ds</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:     <arch name='ppc64'>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <wordsize>64</wordsize>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-noble</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>amigaone</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='2048'>powernv9</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='15'>mpc8544ds</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 19 04:31:37.843043 np0000001025 nova-compute[97981]:       <machine maxCpus='2048'>powernv10</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='32'>ppce500</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>40p</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>pegasos2</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>bamboo</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-focal</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>g3beige</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-disco</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>virtex-ml507</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 19 04:31:37.844439 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mac99</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-impish</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-artful</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>sam460ex</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>ref405ep</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='2048'>powernv8</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:     <arch name='ppc64le'>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <wordsize>64</wordsize>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-noble</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>amigaone</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='2048'>powernv9</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='15'>mpc8544ds</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='2048'>powernv10</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='32'>ppce500</machine>
May 19 04:31:37.845440 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>40p</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>pegasos2</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>bamboo</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-focal</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>g3beige</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-disco</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>virtex-ml507</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>mac99</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-impish</machine>
May 19 04:31:37.846490 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-artful</machine>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>sam460ex</machine>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>ref405ep</machine>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <machine maxCpus='2048'>powernv8</machine>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:     <arch name='riscv32'>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <wordsize>32</wordsize>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt</machine>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <machine maxCpus='8'>spike</machine>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>opentitan</machine>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <machine maxCpus='5'>sifive_u</machine>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>sifive_e</machine>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:     <arch name='riscv64'>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <wordsize>64</wordsize>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <machine maxCpus='512'>virt</machine>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <machine maxCpus='8'>spike</machine>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <machine maxCpus='5'>sifive_u</machine>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>shakti_c</machine>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>sifive_e</machine>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:     <arch name='s390x'>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <wordsize>64</wordsize>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
May 19 04:31:37.847356 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-noble</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine canonical='s390-ccw-virtio-noble' maxCpus='248'>s390-ccw-virtio</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-8.0</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-7.0</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-mantic</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-8.2</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-7.2</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-lunar</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-kinetic</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-8.1</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
May 19 04:31:37.848893 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-7.1</machine>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:     <arch name='sh4'>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <wordsize>32</wordsize>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>shix</machine>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>r2d</machine>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:     <arch name='sh4eb'>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <wordsize>64</wordsize>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>shix</machine>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>r2d</machine>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:     <arch name='sparc'>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <wordsize>32</wordsize>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>SS-5</machine>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>SS-20</machine>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>LX</machine>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>SPARCClassic</machine>
May 19 04:31:37.849775 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>leon3_generic</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>SPARCbook</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>SS-4</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>SS-600MP</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>SS-10</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>Voyager</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:     <arch name='sparc64'>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <wordsize>64</wordsize>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>sun4u</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>niagara</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>sun4v</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:     <arch name='x86_64'>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <wordsize>64</wordsize>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 19 04:31:37.851301 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>x-remote</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 19 04:31:37.852584 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='1'>isapc</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 19 04:31:37.853448 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>microvm</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 19 04:31:37.854291 np0000001025 nova-compute[97981]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <domain type='kvm'/>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <acpi default='on' toggle='yes'/>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <apic default='on' toggle='no'/>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:     <arch name='xtensa'>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <wordsize>32</wordsize>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>sim</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='32'>kc705</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='32'>ml605</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='32'>ml605-nommu</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='32'>virt</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='32'>lx60-nommu</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='32'>lx200</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='32'>lx200-nommu</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='32'>lx60</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='32'>kc705-nommu</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:   <guest>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:     <os_type>hvm</os_type>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:     <arch name='xtensaeb'>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <wordsize>32</wordsize>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='4'>sim</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='32'>kc705</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='32'>ml605</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='32'>ml605-nommu</machine>
May 19 04:31:37.855094 np0000001025 nova-compute[97981]:       <machine maxCpus='32'>virt</machine>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:       <machine maxCpus='32'>lx60-nommu</machine>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:       <machine maxCpus='32'>lx200</machine>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:       <machine maxCpus='32'>lx200-nommu</machine>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:       <machine maxCpus='32'>lx60</machine>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:       <machine maxCpus='32'>kc705-nommu</machine>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:       <domain type='qemu'/>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:     </arch>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:     <features>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:       <cpuselection/>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:       <deviceboot/>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:       <disksnapshot default='on' toggle='no'/>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:       <externalSnapshot/>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:     </features>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:   </guest>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]: </capabilities>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]: 
May 19 04:31:37.856386 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.856386 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None:
May 19 04:31:37.856386 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-alpha</path>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:   <machine>clipper</machine>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:   <arch>alpha</arch>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:   <vcpu max='4'/>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='no'/>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:     <mode name='custom' supported='no'/>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.856386 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:     <tpm supported='no'/>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.857897 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='no'/>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.859857 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.859857 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None:
May 19 04:31:37.859857 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-arm</path>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:   <machine>virt-8.2</machine>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:   <arch>armv6l</arch>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:   <vcpu max='512'/>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.859857 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='yes'>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <enum name='maximumMigratable'>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:         <value>on</value>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:         <value>off</value>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:     <mode name='custom' supported='yes'>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>max</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 19 04:31:37.861265 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>ramfb</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.862227 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:     <tpm supported='yes'>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>tpm-tis</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>passthrough</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>emulator</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>external</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       <enum name='backendVersion'>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>1.2</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>2.0</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:     </tpm>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:     <gic supported='yes'>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       <enum name='version'>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>2</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:         <value>3</value>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:     </gic>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='yes'/>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.863745 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.865717 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt:
May 19 04:31:37.865717 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-arm</path>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:   <machine>virt-8.2</machine>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:   <arch>armv6l</arch>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:   <vcpu max='512'/>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='yes'>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:       <enum name='maximumMigratable'>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:         <value>on</value>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:         <value>off</value>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:     <mode name='custom' supported='yes'>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 19 04:31:37.865717 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>max</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.866917 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>ramfb</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:     <tpm supported='yes'>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>tpm-tis</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>passthrough</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>emulator</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>external</value>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:       <enum name='backendVersion'>
May 19 04:31:37.867996 np0000001025 nova-compute[97981]:         <value>1.2</value>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:         <value>2.0</value>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:     </tpm>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:     <gic supported='yes'>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:       <enum name='version'>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:         <value>2</value>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:         <value>3</value>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:     </gic>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='yes'/>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.870271 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.870271 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt:
May 19 04:31:37.870271 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-arm</path>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:   <machine>virt-8.2</machine>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:   <arch>armv7l</arch>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:   <vcpu max='512'/>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:     <enum name='firmware'>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:       <value>efi</value>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.870271 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='yes'>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <enum name='maximumMigratable'>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:         <value>on</value>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:         <value>off</value>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:     <mode name='custom' supported='yes'>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 19 04:31:37.871692 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>max</model>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:         <value>ramfb</value>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.872631 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:     <tpm supported='yes'>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>tpm-tis</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>passthrough</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>emulator</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>external</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       <enum name='backendVersion'>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>1.2</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>2.0</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:     </tpm>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:     <gic supported='yes'>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       <enum name='version'>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>2</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:         <value>3</value>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.874105 np0000001025 nova-compute[97981]:     </gic>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='yes'/>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.876022 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.876022 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt:
May 19 04:31:37.876022 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-aarch64</path>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:   <machine>virt-8.2</machine>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:   <arch>aarch64</arch>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:   <vcpu max='512'/>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:     <enum name='firmware'>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:       <value>efi</value>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.ms.fd</value>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.secboot.fd</value>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.no-secboot.fd</value>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='yes'>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:       <enum name='maximumMigratable'>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:         <value>on</value>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:         <value>off</value>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:     <mode name='custom' supported='yes'>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>neoverse-n2</model>
May 19 04:31:37.876022 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-a57</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-a76</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>a64fx</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>neoverse-v1</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-a710</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>max</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-a53</model>
May 19 04:31:37.877310 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-a72</model>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-a55</model>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>neoverse-n1</model>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-a35</model>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.878055 np0000001025 nova-compute[97981]:         <value>ramfb</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:     <tpm supported='yes'>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>tpm-tis</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>passthrough</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>emulator</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>external</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       <enum name='backendVersion'>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>1.2</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>2.0</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:     </tpm>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:     <gic supported='yes'>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:       <enum name='version'>
May 19 04:31:37.879504 np0000001025 nova-compute[97981]:         <value>2</value>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:         <value>3</value>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:     </gic>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='yes'/>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.881312 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for cris via machine types: {None} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.881312 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None:
May 19 04:31:37.881312 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-cris</path>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:   <machine>axis-dev88</machine>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:   <arch>cris</arch>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:   <vcpu max='1'/>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='no'/>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:     <mode name='custom' supported='no'/>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.881312 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       <enum name='model'/>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:     <tpm supported='no'/>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:     <redirdev supported='no'/>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       <enum name='model'/>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='no'/>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.882721 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.884646 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.884646 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
May 19 04:31:37.884646 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-i386</path>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:   <machine>pc-q35-noble</machine>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:   <arch>i686</arch>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:   <vcpu max='1024'/>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='yes'>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:       <enum name='maximumMigratable'>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:         <value>on</value>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:         <value>off</value>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='yes'>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:       <model fallback='forbid'>EPYC</model>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:       <vendor>AMD</vendor>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:       <feature policy='require' name='acpi'/>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:       <feature policy='require' name='ss'/>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:       <feature policy='require' name='monitor'/>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:       <feature policy='require' name='hypervisor'/>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:       <feature policy='require' name='erms'/>
May 19 04:31:37.884646 np0000001025 nova-compute[97981]:       <feature policy='require' name='mpx'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='require' name='pcommit'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='require' name='clwb'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='require' name='umip'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='require' name='pku'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='require' name='vaes'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='require' name='la57'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='require' name='rdpid'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='require' name='pks'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrm'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='require' name='fzrm'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrs'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrc'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='require' name='3dnowext'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='require' name='3dnow'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='require' name='xsaveerptr'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='require' name='wbnoinvd'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='require' name='npt'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='require' name='vgif'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='require' name='svme-addr-chk'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='disable' name='vme'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='disable' name='xsavec'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='disable' name='fxsr_opt'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='disable' name='lm'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='disable' name='misalignsse'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='disable' name='osvw'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='disable' name='topoext'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <feature policy='disable' name='nrip-save'/>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:     <mode name='custom' supported='yes'>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <model usable='no' vendor='unknown'>qemu64</model>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>phenom</model>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium</model>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>n270</model>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <model usable='no' vendor='unknown'>kvm64</model>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>core2duo</model>
May 19 04:31:37.885845 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='AMD'>athlon</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Westmere</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Penryn</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 19 04:31:37.886862 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC</model>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Conroe</model>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>486</model>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>vmvga</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>qxl</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>ramfb</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.888156 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:     <tpm supported='yes'>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>tpm-tis</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>tpm-crb</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>passthrough</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>emulator</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>external</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       <enum name='backendVersion'>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>1.2</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>2.0</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:     </tpm>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='yes'/>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:     <genid supported='yes'/>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.889669 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:     <hyperv supported='yes'>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:       <enum name='features'>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:         <value>relaxed</value>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:         <value>vapic</value>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:         <value>spinlocks</value>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:         <value>vpindex</value>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:         <value>runtime</value>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:         <value>synic</value>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:         <value>stimer</value>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:         <value>reset</value>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:         <value>vendor_id</value>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:         <value>frequencies</value>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:         <value>reenlightenment</value>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:         <value>tlbflush</value>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:         <value>ipi</value>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:         <value>avic</value>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:     </hyperv>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.891541 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
May 19 04:31:37.891541 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-i386</path>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:   <machine>pc-i440fx-noble</machine>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:   <arch>i686</arch>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:   <vcpu max='255'/>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='yes'>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:       <enum name='maximumMigratable'>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:         <value>on</value>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:         <value>off</value>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='yes'>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:       <model fallback='forbid'>EPYC</model>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:       <vendor>AMD</vendor>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:       <feature policy='require' name='acpi'/>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:       <feature policy='require' name='ss'/>
May 19 04:31:37.891541 np0000001025 nova-compute[97981]:       <feature policy='require' name='monitor'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='require' name='hypervisor'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='require' name='erms'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='require' name='mpx'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='require' name='pcommit'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='require' name='clwb'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='require' name='umip'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='require' name='pku'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='require' name='vaes'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='require' name='la57'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='require' name='rdpid'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='require' name='pks'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrm'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='require' name='fzrm'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrs'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrc'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='require' name='3dnowext'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='require' name='3dnow'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='require' name='xsaveerptr'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='require' name='wbnoinvd'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='require' name='npt'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='require' name='vgif'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='require' name='svme-addr-chk'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='disable' name='vme'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='disable' name='xsavec'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='disable' name='fxsr_opt'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='disable' name='lm'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='disable' name='misalignsse'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='disable' name='osvw'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='disable' name='topoext'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <feature policy='disable' name='nrip-save'/>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:     <mode name='custom' supported='yes'>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <model usable='no' vendor='unknown'>qemu64</model>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>phenom</model>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium</model>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>n270</model>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <model usable='no' vendor='unknown'>kvm64</model>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 19 04:31:37.893567 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>core2duo</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='AMD'>athlon</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Westmere</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Penryn</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 19 04:31:37.894548 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC</model>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Conroe</model>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>486</model>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>ide</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>vmvga</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>qxl</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:         <value>ramfb</value>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.895428 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:     <tpm supported='yes'>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>tpm-tis</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>tpm-crb</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>passthrough</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>emulator</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>external</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       <enum name='backendVersion'>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>1.2</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>2.0</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:     </tpm>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='yes'/>
May 19 04:31:37.896846 np0000001025 nova-compute[97981]:     <genid supported='yes'/>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:     <hyperv supported='yes'>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:       <enum name='features'>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:         <value>relaxed</value>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:         <value>vapic</value>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:         <value>spinlocks</value>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:         <value>vpindex</value>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:         <value>runtime</value>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:         <value>synic</value>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:         <value>stimer</value>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:         <value>reset</value>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:         <value>vendor_id</value>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:         <value>frequencies</value>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:         <value>reenlightenment</value>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:         <value>tlbflush</value>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:         <value>ipi</value>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:         <value>avic</value>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:     </hyperv>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.898696 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
May 19 04:31:37.898696 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-i386</path>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:   <machine>pc-q35-noble-v2</machine>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:   <arch>i686</arch>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:   <vcpu max='1024'/>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='yes'>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:       <enum name='maximumMigratable'>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:         <value>on</value>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:         <value>off</value>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='yes'>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:       <model fallback='forbid'>EPYC</model>
May 19 04:31:37.898696 np0000001025 nova-compute[97981]:       <vendor>AMD</vendor>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='acpi'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='ss'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='monitor'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='hypervisor'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='erms'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='mpx'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='pcommit'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='clwb'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='umip'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='pku'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='vaes'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='la57'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='rdpid'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='pks'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrm'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='fzrm'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrs'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrc'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='3dnowext'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='3dnow'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='xsaveerptr'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='wbnoinvd'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='npt'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='vgif'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='require' name='svme-addr-chk'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='disable' name='vme'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='disable' name='xsavec'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='disable' name='fxsr_opt'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='disable' name='lm'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='disable' name='misalignsse'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='disable' name='osvw'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='disable' name='topoext'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <feature policy='disable' name='nrip-save'/>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:     <mode name='custom' supported='yes'>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <model usable='no' vendor='unknown'>qemu64</model>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>phenom</model>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium</model>
May 19 04:31:37.900517 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>n270</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='unknown'>kvm64</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>core2duo</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='AMD'>athlon</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Westmere</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Penryn</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 19 04:31:37.901611 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell</model>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC</model>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Conroe</model>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>486</model>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:         <value>vmvga</value>
May 19 04:31:37.902448 np0000001025 nova-compute[97981]:         <value>qxl</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>ramfb</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:     <tpm supported='yes'>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>tpm-tis</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>tpm-crb</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>passthrough</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>emulator</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>external</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       <enum name='backendVersion'>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>1.2</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>2.0</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:     </tpm>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.903908 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='yes'/>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:     <genid supported='yes'/>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:     <hyperv supported='yes'>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:       <enum name='features'>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:         <value>relaxed</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:         <value>vapic</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:         <value>spinlocks</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:         <value>vpindex</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:         <value>runtime</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:         <value>synic</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:         <value>stimer</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:         <value>reset</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:         <value>vendor_id</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:         <value>frequencies</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:         <value>reenlightenment</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:         <value>tlbflush</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:         <value>ipi</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:         <value>avic</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:     </hyperv>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.905790 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
May 19 04:31:37.905790 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-i386</path>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:   <machine>pc-i440fx-noble-v2</machine>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:   <arch>i686</arch>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:   <vcpu max='255'/>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='yes'>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:       <enum name='maximumMigratable'>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:         <value>on</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:         <value>off</value>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.905790 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='yes'>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <model fallback='forbid'>EPYC</model>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <vendor>AMD</vendor>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='acpi'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='ss'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='monitor'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='hypervisor'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='erms'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='mpx'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='pcommit'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='clwb'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='umip'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='pku'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='vaes'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='la57'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='rdpid'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='pks'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrm'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='fzrm'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrs'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrc'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='3dnowext'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='3dnow'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='xsaveerptr'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='wbnoinvd'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='npt'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='vgif'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='require' name='svme-addr-chk'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='disable' name='vme'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='disable' name='xsavec'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='disable' name='fxsr_opt'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='disable' name='lm'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='disable' name='misalignsse'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='disable' name='osvw'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='disable' name='topoext'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <feature policy='disable' name='nrip-save'/>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:     <mode name='custom' supported='yes'>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <model usable='no' vendor='unknown'>qemu64</model>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>phenom</model>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 19 04:31:37.907451 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>n270</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='unknown'>kvm64</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>core2duo</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='AMD'>athlon</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Westmere</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Penryn</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 19 04:31:37.908484 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell</model>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC</model>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Conroe</model>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>486</model>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:         <value>ide</value>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.909311 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>vmvga</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>qxl</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>ramfb</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:     <tpm supported='yes'>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>tpm-tis</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>tpm-crb</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>passthrough</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>emulator</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>external</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       <enum name='backendVersion'>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>1.2</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>2.0</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:     </tpm>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.910705 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='yes'/>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:     <genid supported='yes'/>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:     <hyperv supported='yes'>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:       <enum name='features'>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:         <value>relaxed</value>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:         <value>vapic</value>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:         <value>spinlocks</value>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:         <value>vpindex</value>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:         <value>runtime</value>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:         <value>synic</value>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:         <value>stimer</value>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:         <value>reset</value>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:         <value>vendor_id</value>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:         <value>frequencies</value>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:         <value>reenlightenment</value>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:         <value>tlbflush</value>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:         <value>ipi</value>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:         <value>avic</value>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:     </hyperv>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.912412 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.912412 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None:
May 19 04:31:37.912412 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-m68k</path>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:   <machine>mcf5208evb</machine>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:   <arch>m68k</arch>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:   <vcpu max='1'/>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.912412 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='no'/>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:     <mode name='custom' supported='no'/>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.913722 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:     <tpm supported='no'/>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:     <redirdev supported='no'/>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='no'/>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.915643 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt:
May 19 04:31:37.915643 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-m68k</path>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:   <machine>virt-8.2</machine>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:   <arch>m68k</arch>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:   <vcpu max='1'/>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.915643 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='no'/>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:     <mode name='custom' supported='no'/>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:     <tpm supported='no'/>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:     <redirdev supported='no'/>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.917236 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='no'/>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.919118 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.919118 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None:
May 19 04:31:37.919118 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-microblaze</path>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:   <machine>petalogix-s3adsp1800</machine>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:   <arch>microblaze</arch>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:   <vcpu max='1'/>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.919118 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='no'/>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:     <mode name='custom' supported='no'/>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       <enum name='model'/>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:     <tpm supported='no'/>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:     <redirdev supported='no'/>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.920505 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:       <enum name='model'/>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='no'/>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.922252 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.922252 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None:
May 19 04:31:37.922252 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-microblazeel</path>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:   <machine>petalogix-s3adsp1800</machine>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:   <arch>microblazeel</arch>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:   <vcpu max='1'/>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='no'/>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:     <mode name='custom' supported='no'/>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.922252 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       <enum name='model'/>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:     <tpm supported='no'/>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:     <redirdev supported='no'/>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       <enum name='model'/>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.923538 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='no'/>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.925387 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for mips via machine types: {None} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.925387 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None:
May 19 04:31:37.925387 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-mips</path>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:   <machine>malta</machine>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:   <arch>mips</arch>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:   <vcpu max='16'/>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='no'/>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:     <mode name='custom' supported='no'/>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.925387 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>ide</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>vmvga</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.926749 np0000001025 nova-compute[97981]:     <tpm supported='no'/>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='no'/>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.928569 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.928569 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None:
May 19 04:31:37.928569 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-mipsel</path>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:   <machine>malta</machine>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:   <arch>mipsel</arch>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:   <vcpu max='16'/>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.928569 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='no'/>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:     <mode name='custom' supported='no'/>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>ide</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>vmvga</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.930012 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:     <tpm supported='no'/>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='no'/>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.931844 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.931844 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None:
May 19 04:31:37.931844 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-mips64</path>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:   <machine>malta</machine>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:   <arch>mips64</arch>
May 19 04:31:37.931844 np0000001025 nova-compute[97981]:   <vcpu max='16'/>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='no'/>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:     <mode name='custom' supported='no'/>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>ide</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>vmvga</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.933211 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:     <tpm supported='no'/>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='no'/>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.934846 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.936363 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.936363 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None:
May 19 04:31:37.936363 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-mips64el</path>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:   <machine>malta</machine>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:   <arch>mips64el</arch>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:   <vcpu max='16'/>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='no'/>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:     <mode name='custom' supported='no'/>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:         <value>ide</value>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.936363 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>vmvga</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:     <tpm supported='no'/>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.937680 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='no'/>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.939393 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.939393 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None:
May 19 04:31:37.939393 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-ppc</path>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:   <machine>g3beige</machine>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:   <arch>ppc</arch>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:   <vcpu max='1'/>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='no'/>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:     <mode name='custom' supported='no'/>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.939393 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>ide</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:     <tpm supported='no'/>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.940737 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='no'/>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.942503 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for ppc64 via machine types: {None, 'powernv', 'pseries'} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.942503 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None:
May 19 04:31:37.942503 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-ppc64</path>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:   <machine>pseries-noble</machine>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:   <arch>ppc64</arch>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:   <vcpu max='4096'/>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.942503 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='no'/>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:     <mode name='custom' supported='yes'>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.943894 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:     <tpm supported='yes'>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:         <value>tpm-spapr</value>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:         <value>spapr-tpm-proxy</value>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:         <value>passthrough</value>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:         <value>emulator</value>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:         <value>external</value>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:       <enum name='backendVersion'>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:         <value>1.2</value>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:         <value>2.0</value>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:     </tpm>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='no'/>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.945663 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.947384 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv:
May 19 04:31:37.947384 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-ppc64</path>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:   <machine>powernv9</machine>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:   <arch>ppc64</arch>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:   <vcpu max='2048'/>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='no'/>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:     <mode name='custom' supported='yes'>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.947384 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:     <tpm supported='yes'>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>tpm-spapr</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>spapr-tpm-proxy</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>passthrough</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>emulator</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>external</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       <enum name='backendVersion'>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>1.2</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>2.0</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:     </tpm>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.949023 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='no'/>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.950943 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries:
May 19 04:31:37.950943 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-ppc64</path>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:   <machine>pseries-noble</machine>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:   <arch>ppc64</arch>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:   <vcpu max='4096'/>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='no'/>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:     <mode name='custom' supported='yes'>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.950943 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.952561 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:     <tpm supported='yes'>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:         <value>tpm-spapr</value>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:         <value>spapr-tpm-proxy</value>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:         <value>passthrough</value>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:         <value>emulator</value>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:         <value>external</value>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:       <enum name='backendVersion'>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:         <value>1.2</value>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:         <value>2.0</value>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:     </tpm>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='no'/>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.954461 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.954461 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv:
May 19 04:31:37.954461 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.954461 np0000001025 nova-compute[97981]:   <machine>powernv9</machine>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:   <arch>ppc64le</arch>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:   <vcpu max='2048'/>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='no'/>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:     <mode name='custom' supported='yes'>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.955954 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:     <tpm supported='yes'>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>tpm-spapr</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>spapr-tpm-proxy</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>passthrough</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>emulator</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>external</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       <enum name='backendVersion'>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>1.2</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>2.0</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:     </tpm>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.957624 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='no'/>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.959485 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries:
May 19 04:31:37.959485 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:   <machine>pseries-noble</machine>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:   <arch>ppc64le</arch>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:   <vcpu max='4096'/>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='no'/>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:     <mode name='custom' supported='yes'>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.959485 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:     <tpm supported='yes'>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>tpm-spapr</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:         <value>spapr-tpm-proxy</value>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.961017 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:         <value>passthrough</value>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:         <value>emulator</value>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:         <value>external</value>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:       <enum name='backendVersion'>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:         <value>1.2</value>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:         <value>2.0</value>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:     </tpm>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='no'/>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.962945 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.962945 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None:
May 19 04:31:37.962945 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-riscv32</path>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:   <machine>virt</machine>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:   <arch>riscv32</arch>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:   <vcpu max='512'/>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.962945 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='yes'>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:       <enum name='maximumMigratable'>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>on</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>off</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:     <mode name='custom' supported='no'/>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>ramfb</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.964459 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:     <tpm supported='yes'>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>tpm-tis</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>passthrough</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>emulator</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>external</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       <enum name='backendVersion'>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>1.2</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>2.0</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:     </tpm>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='yes'/>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.966367 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.968271 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.968271 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None:
May 19 04:31:37.968271 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-riscv64</path>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:   <machine>virt</machine>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:   <arch>riscv64</arch>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:   <vcpu max='512'/>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='yes'>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:       <enum name='maximumMigratable'>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:         <value>on</value>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:         <value>off</value>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:     <mode name='custom' supported='yes'>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>rv64</model>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>sifive-e51</model>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>any</model>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>x-rv128</model>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>shakti-c</model>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>max</model>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>thead-c906</model>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>sifive-u54</model>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:       <model usable='unknown' vendor='unknown'>veyron-v1</model>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.968271 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>ramfb</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.969512 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:     <tpm supported='yes'>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:         <value>tpm-tis</value>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:         <value>passthrough</value>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:         <value>emulator</value>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:         <value>external</value>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:       <enum name='backendVersion'>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:         <value>1.2</value>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:         <value>2.0</value>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:     </tpm>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='yes'/>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.971371 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.971371 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio:
May 19 04:31:37.971371 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-s390x</path>
May 19 04:31:37.971371 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:   <machine>s390-ccw-virtio-noble</machine>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:   <arch>s390x</arch>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:   <vcpu max='248'/>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='yes'>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <enum name='maximumMigratable'>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:         <value>on</value>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:         <value>off</value>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:     <mode name='custom' supported='yes'>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z13</model>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z990.3</model>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z13-base</model>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z990.2</model>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z196.2-base</model>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z14</model>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z14.2-base</model>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z990.4</model>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z196</model>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z10BC.2-base</model>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z114-base</model>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>gen16b</model>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z890.3-base</model>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>gen16a</model>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z990.5</model>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z196.2</model>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>zEC12</model>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>zEC12.2</model>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z9EC.2</model>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z9BC</model>
May 19 04:31:37.972884 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z9EC.3-base</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='IBM'>z800-base</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z14ZR1-base</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z890</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z990.4-base</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z9EC.3</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z13.2</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z10BC.2</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>gen15a-base</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z14.2</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>zBC12-base</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>gen16a-base</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='IBM'>z900.3</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z196-base</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z990</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z14-base</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='IBM'>z900.2</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='IBM'>z800</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z10EC</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z14ZR1</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='IBM'>z900</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z10EC.2</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z10EC.2-base</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='IBM'>z900.2-base</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='IBM'>z900-base</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z10EC.3</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z990.5-base</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>max</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>gen15b</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z9BC.2-base</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>gen15a</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z990.2-base</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z10EC-base</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>gen16b-base</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z114</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z9EC-base</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z13s</model>
May 19 04:31:37.974302 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>qemu</model>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>gen15b-base</model>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>zEC12-base</model>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z890.3</model>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z10EC.3-base</model>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z890.2-base</model>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z890.2</model>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z10BC-base</model>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>zEC12.2-base</model>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z890-base</model>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z9BC-base</model>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z10BC</model>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z9EC</model>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z9EC.2-base</model>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z13.2-base</model>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='IBM'>z900.3-base</model>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z990.3-base</model>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z13s-base</model>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>zBC12</model>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z990-base</model>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <model usable='no' vendor='IBM'>z9BC.2</model>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.975307 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     <tpm supported='no'/>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='no'/>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     <s390-pv supported='no'/>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.976756 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.978645 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.978645 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None:
May 19 04:31:37.978645 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-sh4</path>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:   <machine>shix</machine>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:   <arch>sh4</arch>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:   <vcpu max='1'/>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='no'/>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:     <mode name='custom' supported='no'/>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.978645 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:     <tpm supported='no'/>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.979714 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='no'/>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.980993 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.980993 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None:
May 19 04:31:37.980993 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-sh4eb</path>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:   <machine>shix</machine>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:   <arch>sh4eb</arch>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:   <vcpu max='1'/>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='no'/>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:     <mode name='custom' supported='no'/>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.980993 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:     <tpm supported='no'/>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.981953 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='no'/>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.983232 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.983232 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None:
May 19 04:31:37.983232 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-sparc</path>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:   <machine>SS-5</machine>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:   <arch>sparc</arch>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:   <vcpu max='1'/>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.983232 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='no'/>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:     <mode name='custom' supported='no'/>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       <enum name='model'/>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:     <tpm supported='no'/>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:     <redirdev supported='no'/>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.984500 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:       <enum name='model'/>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='no'/>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.985882 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.985882 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None:
May 19 04:31:37.985882 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-sparc64</path>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:   <machine>sun4u</machine>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:   <arch>sparc64</arch>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:   <vcpu max='1'/>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='no'/>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:37.985882 np0000001025 nova-compute[97981]:     <mode name='custom' supported='no'/>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>ide</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.987576 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:     <tpm supported='no'/>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='no'/>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.988822 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:37.988822 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
May 19 04:31:37.988822 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-x86_64</path>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:   <machine>pc-q35-noble</machine>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:   <arch>x86_64</arch>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:   <vcpu max='1024'/>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:     <enum name='firmware'>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:       <value>efi</value>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.988822 np0000001025 nova-compute[97981]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='yes'>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <enum name='maximumMigratable'>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:         <value>on</value>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:         <value>off</value>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='yes'>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <model fallback='forbid'>EPYC</model>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <vendor>AMD</vendor>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='acpi'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='ss'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='monitor'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='hypervisor'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='erms'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='mpx'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='pcommit'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='clwb'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='umip'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='pku'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='vaes'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='la57'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='rdpid'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='pks'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrm'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='fzrm'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrs'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrc'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='3dnowext'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='3dnow'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='xsaveerptr'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='wbnoinvd'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='npt'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='vgif'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='require' name='svme-addr-chk'/>
May 19 04:31:37.989840 np0000001025 nova-compute[97981]:       <feature policy='disable' name='vme'/>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <feature policy='disable' name='xsavec'/>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <feature policy='disable' name='fxsr_opt'/>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <feature policy='disable' name='misalignsse'/>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <feature policy='disable' name='osvw'/>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <feature policy='disable' name='topoext'/>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <feature policy='disable' name='nrip-save'/>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:     <mode name='custom' supported='yes'>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>phenom</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>n270</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='AMD'>athlon</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 19 04:31:37.990664 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>486</model>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.991262 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>vmvga</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>qxl</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>ramfb</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:     <tpm supported='yes'>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>tpm-tis</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:         <value>tpm-crb</value>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.991953 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>passthrough</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>emulator</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>external</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:       <enum name='backendVersion'>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>1.2</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>2.0</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:     </tpm>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='yes'/>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:     <genid supported='yes'/>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:     <hyperv supported='yes'>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:       <enum name='features'>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>relaxed</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>vapic</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>spinlocks</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>vpindex</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>runtime</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>synic</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>stimer</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>reset</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>vendor_id</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>frequencies</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>reenlightenment</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>tlbflush</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>ipi</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:         <value>avic</value>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:     </hyperv>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.993117 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
May 19 04:31:37.993117 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-x86_64</path>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:   <machine>pc-i440fx-noble</machine>
May 19 04:31:37.993117 np0000001025 nova-compute[97981]:   <arch>x86_64</arch>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:   <vcpu max='255'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:     <enum name='firmware'>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <value>efi</value>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='yes'>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <enum name='maximumMigratable'>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:         <value>on</value>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:         <value>off</value>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='yes'>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <model fallback='forbid'>EPYC</model>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <vendor>AMD</vendor>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='acpi'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='ss'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='monitor'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='hypervisor'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='erms'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='mpx'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='pcommit'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='clwb'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='umip'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='pku'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='vaes'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='la57'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='rdpid'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='pks'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrm'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='fzrm'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrs'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrc'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='3dnowext'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='3dnow'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='xsaveerptr'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='wbnoinvd'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='npt'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='vgif'/>
May 19 04:31:37.994264 np0000001025 nova-compute[97981]:       <feature policy='require' name='svme-addr-chk'/>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <feature policy='disable' name='vme'/>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <feature policy='disable' name='xsavec'/>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <feature policy='disable' name='fxsr_opt'/>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <feature policy='disable' name='misalignsse'/>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <feature policy='disable' name='osvw'/>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <feature policy='disable' name='topoext'/>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <feature policy='disable' name='nrip-save'/>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:     <mode name='custom' supported='yes'>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>phenom</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>n270</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='AMD'>athlon</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 19 04:31:37.995138 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>486</model>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:37.995709 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>ide</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>vmvga</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>qxl</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>ramfb</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:     <tpm supported='yes'>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.996406 np0000001025 nova-compute[97981]:         <value>tpm-tis</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>tpm-crb</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>passthrough</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>emulator</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>external</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:       <enum name='backendVersion'>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>1.2</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>2.0</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:     </tpm>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='yes'/>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:     <genid supported='yes'/>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:     <hyperv supported='yes'>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:       <enum name='features'>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>relaxed</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>vapic</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>spinlocks</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>vpindex</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>runtime</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>synic</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>stimer</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>reset</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>vendor_id</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>frequencies</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>reenlightenment</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>tlbflush</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>ipi</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:         <value>avic</value>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:     </hyperv>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:37.997642 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
May 19 04:31:37.997642 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:37.997642 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-x86_64</path>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:   <machine>pc-q35-noble-v2</machine>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:   <arch>x86_64</arch>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:   <vcpu max='1024'/>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:     <enum name='firmware'>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <value>efi</value>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='yes'>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <enum name='maximumMigratable'>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:         <value>on</value>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:         <value>off</value>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='yes'>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <model fallback='forbid'>EPYC</model>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <vendor>AMD</vendor>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <feature policy='require' name='acpi'/>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <feature policy='require' name='ss'/>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <feature policy='require' name='monitor'/>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <feature policy='require' name='hypervisor'/>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <feature policy='require' name='erms'/>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <feature policy='require' name='mpx'/>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <feature policy='require' name='pcommit'/>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <feature policy='require' name='clwb'/>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <feature policy='require' name='umip'/>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <feature policy='require' name='pku'/>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <feature policy='require' name='vaes'/>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <feature policy='require' name='la57'/>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <feature policy='require' name='rdpid'/>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <feature policy='require' name='pks'/>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrm'/>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <feature policy='require' name='fzrm'/>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrs'/>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrc'/>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <feature policy='require' name='3dnowext'/>
May 19 04:31:37.998768 np0000001025 nova-compute[97981]:       <feature policy='require' name='3dnow'/>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <feature policy='require' name='xsaveerptr'/>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <feature policy='require' name='wbnoinvd'/>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <feature policy='require' name='npt'/>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <feature policy='require' name='vgif'/>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <feature policy='require' name='svme-addr-chk'/>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <feature policy='disable' name='vme'/>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <feature policy='disable' name='xsavec'/>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <feature policy='disable' name='fxsr_opt'/>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <feature policy='disable' name='misalignsse'/>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <feature policy='disable' name='osvw'/>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <feature policy='disable' name='topoext'/>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <feature policy='disable' name='nrip-save'/>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:     <mode name='custom' supported='yes'>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>phenom</model>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium</model>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>n270</model>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='AMD'>athlon</model>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 19 04:31:37.999691 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>486</model>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:38.000265 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>vmvga</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>qxl</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>ramfb</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:38.000821 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:     <tpm supported='yes'>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>tpm-tis</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>tpm-crb</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>passthrough</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>emulator</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>external</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:       <enum name='backendVersion'>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>1.2</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>2.0</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:     </tpm>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='yes'/>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:     <genid supported='yes'/>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:     <hyperv supported='yes'>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:       <enum name='features'>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>relaxed</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>vapic</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>spinlocks</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>vpindex</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>runtime</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>synic</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>stimer</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>reset</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>vendor_id</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>frequencies</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>reenlightenment</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>tlbflush</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>ipi</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:         <value>avic</value>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:     </hyperv>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:38.002165 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:38.003597 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
May 19 04:31:38.003597 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-x86_64</path>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:   <machine>pc-i440fx-noble-v2</machine>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:   <arch>x86_64</arch>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:   <vcpu max='255'/>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:     <enum name='firmware'>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <value>efi</value>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='yes'>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <enum name='maximumMigratable'>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:         <value>on</value>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:         <value>off</value>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='yes'>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <model fallback='forbid'>EPYC</model>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <vendor>AMD</vendor>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <feature policy='require' name='acpi'/>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <feature policy='require' name='ss'/>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <feature policy='require' name='monitor'/>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <feature policy='require' name='hypervisor'/>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <feature policy='require' name='erms'/>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <feature policy='require' name='mpx'/>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <feature policy='require' name='pcommit'/>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <feature policy='require' name='clwb'/>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <feature policy='require' name='umip'/>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <feature policy='require' name='pku'/>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <feature policy='require' name='vaes'/>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <feature policy='require' name='la57'/>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <feature policy='require' name='rdpid'/>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <feature policy='require' name='pks'/>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrm'/>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <feature policy='require' name='fzrm'/>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrs'/>
May 19 04:31:38.003597 np0000001025 nova-compute[97981]:       <feature policy='require' name='fsrc'/>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <feature policy='require' name='3dnowext'/>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <feature policy='require' name='3dnow'/>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <feature policy='require' name='xsaveerptr'/>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <feature policy='require' name='wbnoinvd'/>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <feature policy='require' name='npt'/>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <feature policy='require' name='vgif'/>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <feature policy='require' name='svme-addr-chk'/>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <feature policy='disable' name='vme'/>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <feature policy='disable' name='xsavec'/>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <feature policy='disable' name='fxsr_opt'/>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <feature policy='disable' name='misalignsse'/>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <feature policy='disable' name='osvw'/>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <feature policy='disable' name='topoext'/>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <feature policy='disable' name='nrip-save'/>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:     <mode name='custom' supported='yes'>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>phenom</model>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>pentium</model>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>n270</model>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='AMD'>athlon</model>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 19 04:31:38.004612 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Haswell</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='AMD'>EPYC</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 19 04:31:38.005456 np0000001025 nova-compute[97981]:       <model usable='yes' vendor='unknown'>486</model>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:     </mode>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>ide</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>vmvga</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>qxl</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>ramfb</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:38.005979 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:     <tpm supported='yes'>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>tpm-tis</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>tpm-crb</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>passthrough</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>emulator</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>external</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:       <enum name='backendVersion'>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>1.2</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>2.0</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:     </tpm>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='yes'/>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:     <genid supported='yes'/>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:     <hyperv supported='yes'>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:       <enum name='features'>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>relaxed</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>vapic</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>spinlocks</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>vpindex</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>runtime</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>synic</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>stimer</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>reset</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>vendor_id</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>frequencies</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>reenlightenment</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>tlbflush</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>ipi</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:         <value>avic</value>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:     </hyperv>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:38.007191 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:38.008405 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:38.008405 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None:
May 19 04:31:38.008405 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-xtensa</path>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:   <machine>sim</machine>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:   <arch>xtensa</arch>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:   <vcpu max='4'/>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='no'/>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:     <mode name='custom' supported='no'/>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:38.008405 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:     <tpm supported='no'/>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:38.009347 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='no'/>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:38.010610 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=97981) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 19 04:31:38.010610 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None:
May 19 04:31:38.010610 np0000001025 nova-compute[97981]: <domainCapabilities>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:   <path>/usr/bin/qemu-system-xtensaeb</path>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:   <domain>qemu</domain>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:   <machine>sim</machine>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:   <arch>xtensaeb</arch>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:   <vcpu max='4'/>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:   <iothreads supported='yes'/>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:   <os supported='yes'>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:     <enum name='firmware'/>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:     <loader supported='yes'>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:         <value>rom</value>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:         <value>pflash</value>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:       <enum name='readonly'>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:         <value>yes</value>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:       <enum name='secure'>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:         <value>no</value>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:     </loader>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:   </os>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:   <cpu>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:     <mode name='host-passthrough' supported='no'/>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:     <mode name='maximum' supported='no'/>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:     <mode name='host-model' supported='no'/>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:     <mode name='custom' supported='no'/>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:   <memoryBacking supported='yes'>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:     <enum name='sourceType'>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:       <value>file</value>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:       <value>anonymous</value>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:       <value>memfd</value>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:     </enum>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:   </memoryBacking>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:   <devices>
May 19 04:31:38.010610 np0000001025 nova-compute[97981]:     <disk supported='yes'>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       <enum name='diskDevice'>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>disk</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>cdrom</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>floppy</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>lun</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>fdc</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>sata</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:     </disk>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:     <graphics supported='yes'>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>sdl</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>vnc</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>spice</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>egl-headless</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>dbus</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:     <video supported='yes'>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       <enum name='modelType'>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>vga</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>cirrus</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>none</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>bochs</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:     </video>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:     <hostdev supported='yes'>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       <enum name='mode'>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>subsystem</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       <enum name='startupPolicy'>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>default</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>mandatory</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>requisite</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>optional</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       <enum name='subsysType'>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>pci</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>scsi</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       <enum name='capsType'/>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       <enum name='pciBackend'/>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:     </hostdev>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:     <rng supported='yes'>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>virtio-transitional</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>virtio-non-transitional</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>random</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>egd</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:     </rng>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:     <filesystem supported='yes'>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       <enum name='driverType'>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>path</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>handle</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:         <value>virtiofs</value>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:     </filesystem>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:     <tpm supported='no'/>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:     <redirdev supported='yes'>
May 19 04:31:38.011580 np0000001025 nova-compute[97981]:       <enum name='bus'>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:         <value>usb</value>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:     </redirdev>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:     <channel supported='yes'>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:         <value>pty</value>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:         <value>unix</value>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:         <value>spicevmc</value>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:     </channel>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:     <crypto supported='yes'>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:       <enum name='model'>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:         <value>virtio</value>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:       <enum name='type'>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:         <value>qemu</value>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:       <enum name='backendModel'>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:         <value>builtin</value>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:       </enum>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:     </crypto>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:   </devices>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:   <features>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:     <gic supported='no'/>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:     <vmcoreinfo supported='no'/>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:     <genid supported='no'/>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:     <backingStoreInput supported='yes'/>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:     <backup supported='yes'/>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:     <async-teardown supported='yes'/>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:     <sev supported='no'/>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:     <sgx supported='no'/>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:   </features>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]: </domainCapabilities>
May 19 04:31:38.012845 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 19 04:31:38.012845 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Checking secure boot support for host arch (x86_64) {{(pid=97981) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 19 04:31:38.012845 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Secure Boot support detected
May 19 04:31:38.432286 np0000001025 nova-compute[97981]: INFO nova.virt.node [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Generated node identity 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6
May 19 04:31:38.432501 np0000001025 nova-compute[97981]: INFO nova.virt.node [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Wrote node identity 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 to /opt/stack/data/nova/compute_id
May 19 04:31:38.935403 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Compute nodes ['086d5ca1-60c6-4d3b-acd3-87b1868e2eb6'] for host np0000001025 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
May 19 04:31:39.939025 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
May 19 04:31:40.943462 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] No compute node record found for host np0000001025. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000001025 could not be found.
May 19 04:31:40.943946 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:31:40.943946 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:31:40.943946 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:31:40.943946 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:31:41.003937 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:31:41.005085 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:31:41.019876 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] CMD "env LANG=C uptime" returned: 0 in 0.015s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:31:41.020268 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Hypervisor/Node resource view: name=np0000001025 free_ram=16685MB free_disk=75.25357055664062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:31:41.020476 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:31:41.020769 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:31:41.523745 np0000001025 nova-compute[97981]: WARNING nova.compute.resource_tracker [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] No compute node record for np0000001025:086d5ca1-60c6-4d3b-acd3-87b1868e2eb6: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 could not be found.
May 19 04:31:42.028033 np0000001025 nova-compute[97981]: INFO nova.compute.resource_tracker [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Compute node record created for np0000001025:np0000001025 with uuid: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6
May 19 04:31:43.535046 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:31:43.535509 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:31:41 up 22 min,  2 users,  load average: 2.62, 1.50, 0.75\n'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:31:44.041365 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] [req-5531b4e1-1522-42aa-944a-6e6500634431] Created resource provider record via placement API for resource provider with UUID 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 and name np0000001025.
May 19 04:31:44.091327 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] /sys/module/kvm_amd/parameters/sev contains [N
May 19 04:31:44.091327 np0000001025 nova-compute[97981]: ] {{(pid=97981) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2038}}
May 19 04:31:44.091484 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.host [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] kernel doesn't support AMD SEV
May 19 04:31:44.091708 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:31:44.091926 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Updating inventory in ProviderTree for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 with inventory: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 19 04:31:44.092264 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:31:44.096426 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Libvirt baseline CPU <cpu>
May 19 04:31:44.096426 np0000001025 nova-compute[97981]:   <arch>x86_64</arch>
May 19 04:31:44.096426 np0000001025 nova-compute[97981]:   <model>Nehalem</model>
May 19 04:31:44.096426 np0000001025 nova-compute[97981]:   <vendor>AMD</vendor>
May 19 04:31:44.096426 np0000001025 nova-compute[97981]:   <topology sockets="12" cores="1" threads="1"/>
May 19 04:31:44.096426 np0000001025 nova-compute[97981]:   <maxphysaddr mode="emulate" bits="40"/>
May 19 04:31:44.096426 np0000001025 nova-compute[97981]: </cpu>
May 19 04:31:44.096426 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13740}}
May 19 04:31:44.666487 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Updated inventory for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
May 19 04:31:44.666955 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Updating resource provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 generation from 0 to 1 during operation: update_inventory {{(pid=97981) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 19 04:31:44.666955 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Updating inventory in ProviderTree for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 with inventory: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 19 04:31:44.813316 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Updating resource provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 generation from 1 to 2 during operation: update_traits {{(pid=97981) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 19 04:31:45.320928 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:31:45.321682 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.300s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:31:45.321682 np0000001025 nova-compute[97981]: DEBUG nova.service [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=97981) start /opt/stack/nova/nova/service.py:195}}
May 19 04:31:45.337927 np0000001025 nova-compute[97981]: DEBUG nova.service [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=97981) start /opt/stack/nova/nova/service.py:211}}
May 19 04:31:45.352222 np0000001025 nova-compute[97981]: DEBUG nova.service [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] Join ServiceGroup membership for this service compute {{(pid=97981) start /opt/stack/nova/nova/service.py:221}}
May 19 04:31:45.352388 np0000001025 nova-compute[97981]: DEBUG nova.servicegroup.drivers.db [None req-c8b8d0ae-dc3f-4637-8d81-19efd36041ee None None] DB_Driver: join new ServiceGroup member np0000001025 to the compute group, service = <Service: host=np0000001025, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=97981) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
May 19 04:31:50.855879 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:32:20.354120 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._sync_power_states {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:32:20.856635 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:32:20.857614 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.76 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:32:24.615950 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:32:24.616555 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:32:24.616555 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:32:24.616819 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:32:24.616918 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:32:24.617133 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:32:24.617320 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:32:24.617449 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:32:24.617614 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:32:25.121194 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:32:25.122086 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:32:25.122086 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:32:25.122086 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:32:25.132124 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:32:25.132124 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:32:25.144306 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.014s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:32:25.145091 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=16459MB free_disk=75.130859375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:32:25.145550 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:32:25.145973 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:32:26.213806 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:32:26.214268 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:32:25 up 23 min,  2 users,  load average: 1.90, 1.47, 0.78\n'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:32:26.254451 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:32:26.254654 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:32:26.757212 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:32:27.263102 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:32:27.263544 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.117s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:32:27.263702 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 59.99 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:33:27.257630 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:33:27.258334 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:33:27.258334 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:33:27.258334 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:33:27.258490 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:33:27.258710 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:33:27.258892 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:33:27.259060 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:33:27.259201 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:33:27.259397 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:33:27.763523 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:33:27.763752 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:33:27.763924 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:33:27.764085 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:33:27.772317 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:33:27.773200 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:33:27.788800 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.015s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:33:27.789151 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=16562MB free_disk=74.92574691772461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:33:27.789290 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:33:27.789508 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:33:28.840684 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:33:28.841274 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:33:27 up 24 min,  2 users,  load average: 1.18, 1.35, 0.79\n'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:33:28.885995 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:33:28.886212 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:33:29.388940 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:33:29.896582 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:33:29.897075 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.107s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:33:29.897075 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:33:50.858722 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:34:04.289527 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:04.290065 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:04.716046 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Acquiring lock "13ba1e00-08ad-4da8-8258-92154f5925d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:04.716303 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "13ba1e00-08ad-4da8-8258-92154f5925d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:04.791973 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:34:05.218612 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:34:05.404827 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:05.405265 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:05.409048 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:34:05.409048 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Claim successful on node np0000001025
May 19 04:34:05.807203 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:05.918942 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:05.918942 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:06.433581 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:34:06.632868 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:34:06.633187 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:34:06.998215 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:07.136402 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:34:07.642257 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.237s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:07.645214 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:34:07.646467 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.836s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:07.649925 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:34:07.650083 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Claim successful on node np0000001025
May 19 04:34:08.150568 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:34:08.151176 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:34:08.152207 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:08.155244 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:08.655883 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:34:08.846527 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:34:08.846792 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:34:09.159721 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:34:09.349509 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:34:09.416567 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cdf106961084f0e941b5b65911c9b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b83c8d3714844830f961673658b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:34:09.857423 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.215s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:09.858148 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.860s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:09.858215 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:34:09.862803 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:34:09.863081 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Claim successful on node np0000001025
May 19 04:34:10.168889 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:34:10.171352 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:34:10.171639 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Creating image(s)
May 19 04:34:10.172334 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "/opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:10.172479 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "/opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:10.172921 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "/opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:10.176412 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:10.178003 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:10.374384 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:34:10.374637 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:34:10.375320 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:10.375547 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:10.556200 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:10.558745 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:10.559097 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c.part --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:10.626568 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c.part --force-share --output=json" returned: 0 in 0.067s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:10.627320 np0000001025 nova-compute[97981]: DEBUG nova.virt.images [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] 76f2afbb-2235-45f3-9168-d64aadd6e71e was qcow2, converting to raw {{(pid=97981) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 19 04:34:10.628554 np0000001025 nova-compute[97981]: DEBUG nova.privsep.utils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97981) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 19 04:34:10.628830 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c.part /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c.converted {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:10.763772 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c.part /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c.converted" returned: 0 in 0.134s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:10.769077 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c.converted --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:10.849282 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c.converted --force-share --output=json" returned: 0 in 0.080s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:10.850931 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.672s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:10.850931 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:10.854022 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:10.854947 np0000001025 nova-compute[97981]: INFO oslo.privsep.daemon [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpb_ge409l/privsep.sock']
May 19 04:34:10.863953 np0000001025 sudo[109345]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpb_ge409l/privsep.sock
May 19 04:34:10.864849 np0000001025 sudo[109345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 19 04:34:10.884246 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:34:11.113757 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:34:11.113757 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:34:11.146471 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 19 04:34:11.146636 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 19 04:34:11.146636 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 19 04:34:11.146636 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: 
May 19 04:34:11.146770 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 19 04:34:11.146770 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 19 04:34:11.146770 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 19 04:34:11.146863 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: 
May 19 04:34:11.146863 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 19 04:34:11.308422 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4760ff7f5fb748adb8f905519b7d139d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d20e935bfe484890e9cc58ce28186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:34:11.313840 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Successfully created port: 13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:34:11.390684 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:34:11.485740 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 19 04:34:11.485740 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 19 04:34:11.485740 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 19 04:34:11.485740 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: 
May 19 04:34:11.485740 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 19 04:34:11.485740 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 19 04:34:11.485740 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 19 04:34:11.485740 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: 
May 19 04:34:11.485740 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 19 04:34:11.616164 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:34:11.738753 np0000001025 sudo[109345]: pam_unix(sudo:session): session closed for user root
May 19 04:34:11.740557 np0000001025 nova-compute[97981]: INFO oslo.privsep.daemon [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Spawned new privsep daemon via rootwrap
May 19 04:34:11.741692 np0000001025 nova-compute[97981]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 19 04:34:11.741819 np0000001025 nova-compute[97981]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 19 04:34:11.742088 np0000001025 nova-compute[97981]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
May 19 04:34:11.742088 np0000001025 nova-compute[97981]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109351
May 19 04:34:11.834577 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:11.902487 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.068s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:11.902937 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:11.903448 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:11.903978 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:11.907130 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:11.907528 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:11.980636 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.073s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:11.981365 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:12.007177 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk 1073741824" returned: 0 in 0.026s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:12.007668 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.104s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:12.008046 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:12.072056 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.064s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:12.073587 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:34:12.073587 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:12.125033 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.266s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:12.125033 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:34:12.134573 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk --force-share --output=json" returned: 0 in 0.062s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:12.134949 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Cannot resize image /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:34:12.135512 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:34:12.135697 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Ensure instance console log exists: /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:34:12.135983 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:12.136233 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:12.136388 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:12.401069 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:34:12.401998 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:34:12.402385 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Creating image(s)
May 19 04:34:12.402706 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Acquiring lock "/opt/stack/data/nova/instances/13ba1e00-08ad-4da8-8258-92154f5925d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:12.402870 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "/opt/stack/data/nova/instances/13ba1e00-08ad-4da8-8258-92154f5925d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:12.403266 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "/opt/stack/data/nova/instances/13ba1e00-08ad-4da8-8258-92154f5925d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:12.403891 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:12.406644 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:12.407643 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:12.446596 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Successfully created port: 4709f63b-e1e2-40a4-b2eb-e246f257e437 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:34:12.483607 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.076s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:12.483941 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:12.484390 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:12.486427 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:12.489763 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:12.490057 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:12.552367 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.062s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:12.552640 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/13ba1e00-08ad-4da8-8258-92154f5925d2/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:12.578976 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/13ba1e00-08ad-4da8-8258-92154f5925d2/disk 1073741824" returned: 0 in 0.024s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:12.579525 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.095s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:12.579825 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:12.632946 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:34:12.633399 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:34:12.633888 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:12.634207 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:12.637838 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.058s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:12.638246 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Checking if we can resize image /opt/stack/data/nova/instances/13ba1e00-08ad-4da8-8258-92154f5925d2/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:34:12.638448 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13ba1e00-08ad-4da8-8258-92154f5925d2/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:12.706091 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13ba1e00-08ad-4da8-8258-92154f5925d2/disk --force-share --output=json" returned: 0 in 0.067s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:12.706612 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Cannot resize image /opt/stack/data/nova/instances/13ba1e00-08ad-4da8-8258-92154f5925d2/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:34:12.707013 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:34:12.707276 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Ensure instance console log exists: /opt/stack/data/nova/instances/13ba1e00-08ad-4da8-8258-92154f5925d2/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:34:12.708036 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:12.708036 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:12.709622 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:13.137438 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:34:13.199509 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Successfully updated port: 13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:34:13.641733 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:34:13.702855 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "refresh_cache-4866cabb-0595-4fe5-8be5-ebf4ed9c8f94" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:34:13.703027 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquired lock "refresh_cache-4866cabb-0595-4fe5-8be5-ebf4ed9c8f94" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:34:13.703294 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:34:13.973768 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-80eec800-187d-4c6a-9eb4-bdec5f592ad7 req-8171d521-766a-4f9b-a6b2-4cdf8b1f6e21 service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received event network-changed-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:13.974319 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-80eec800-187d-4c6a-9eb4-bdec5f592ad7 req-8171d521-766a-4f9b-a6b2-4cdf8b1f6e21 service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Refreshing instance network info cache due to event network-changed-13c0c2a4-ed11-438d-a852-17bc610c6269. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:34:13.974471 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-80eec800-187d-4c6a-9eb4-bdec5f592ad7 req-8171d521-766a-4f9b-a6b2-4cdf8b1f6e21 service nova] Acquiring lock "refresh_cache-4866cabb-0595-4fe5-8be5-ebf4ed9c8f94" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:34:14.449624 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cdf106961084f0e941b5b65911c9b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b83c8d3714844830f961673658b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:34:14.648420 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:34:14.649170 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:34:14.649366 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Creating image(s)
May 19 04:34:14.649766 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:14.649897 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "/opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:14.650331 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "/opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:14.650751 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:14.653519 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:14.654571 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:14.729934 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.075s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:14.730430 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:14.731026 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:14.731459 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:14.736131 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:14.736131 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:14.804247 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.068s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:14.807189 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:14.837149 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk 1073741824" returned: 0 in 0.032s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:14.837717 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.107s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:14.838153 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:14.899158 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.061s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:14.900165 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:34:14.900444 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:14.971028 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk --force-share --output=json" returned: 0 in 0.070s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:14.971557 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Cannot resize image /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:34:14.972152 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:34:14.972430 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Ensure instance console log exists: /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:34:14.972789 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:14.973124 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:14.973337 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:15.161149 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Successfully updated port: 4709f63b-e1e2-40a4-b2eb-e246f257e437 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:34:15.563875 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:34:15.664236 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Acquiring lock "refresh_cache-13ba1e00-08ad-4da8-8258-92154f5925d2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:34:15.664370 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Acquired lock "refresh_cache-13ba1e00-08ad-4da8-8258-92154f5925d2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:34:15.664584 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:34:15.926342 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-72fa778d-0c01-4816-80b6-a4fcbf865441 req-222d2203-c7d6-4b64-b566-f97d7b93a56b service nova] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Received event network-changed-4709f63b-e1e2-40a4-b2eb-e246f257e437 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:15.926499 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-72fa778d-0c01-4816-80b6-a4fcbf865441 req-222d2203-c7d6-4b64-b566-f97d7b93a56b service nova] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Refreshing instance network info cache due to event network-changed-4709f63b-e1e2-40a4-b2eb-e246f257e437. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:34:15.926787 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72fa778d-0c01-4816-80b6-a4fcbf865441 req-222d2203-c7d6-4b64-b566-f97d7b93a56b service nova] Acquiring lock "refresh_cache-13ba1e00-08ad-4da8-8258-92154f5925d2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:34:16.177052 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Successfully created port: 91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:34:16.826490 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:34:17.248788 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Successfully updated port: 91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:34:17.332041 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:17.433058 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:17.547748 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Updating instance_info_cache with network_info: [{"id": "13c0c2a4-ed11-438d-a852-17bc610c6269", "address": "fa:16:3e:81:21:90", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c0c2a4-ed", "ovs_interfaceid": "13c0c2a4-ed11-438d-a852-17bc610c6269", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:17.751045 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "refresh_cache-5f3f7abc-978d-4a0e-8ae1-0d813ad77f35" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:34:17.751233 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquired lock "refresh_cache-5f3f7abc-978d-4a0e-8ae1-0d813ad77f35" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:34:17.751560 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:34:17.755006 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Updating instance_info_cache with network_info: [{"id": "4709f63b-e1e2-40a4-b2eb-e246f257e437", "address": "fa:16:3e:c3:ab:f5", "network": {"id": "5dba6c16-14eb-438d-a91c-e4f4c65a6894", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1814314607-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45d20e935bfe484890e9cc58ce28186e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4709f63b-e1", "ovs_interfaceid": "4709f63b-e1e2-40a4-b2eb-e246f257e437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:18.043362 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a7a0b004-4b7d-499c-97ec-3d79dbe5002a req-00dee351-16fe-4e94-b118-728739b8c76a service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received event network-changed-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:18.043362 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a7a0b004-4b7d-499c-97ec-3d79dbe5002a req-00dee351-16fe-4e94-b118-728739b8c76a service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Refreshing instance network info cache due to event network-changed-91a50f4f-e3ff-4e6f-80f9-472e706603f0. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:34:18.044174 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a7a0b004-4b7d-499c-97ec-3d79dbe5002a req-00dee351-16fe-4e94-b118-728739b8c76a service nova] Acquiring lock "refresh_cache-5f3f7abc-978d-4a0e-8ae1-0d813ad77f35" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:34:18.053924 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Releasing lock "refresh_cache-4866cabb-0595-4fe5-8be5-ebf4ed9c8f94" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:34:18.053924 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Instance network_info: |[{"id": "13c0c2a4-ed11-438d-a852-17bc610c6269", "address": "fa:16:3e:81:21:90", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c0c2a4-ed", "ovs_interfaceid": "13c0c2a4-ed11-438d-a852-17bc610c6269", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:34:18.053924 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-80eec800-187d-4c6a-9eb4-bdec5f592ad7 req-8171d521-766a-4f9b-a6b2-4cdf8b1f6e21 service nova] Acquired lock "refresh_cache-4866cabb-0595-4fe5-8be5-ebf4ed9c8f94" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:34:18.053924 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-80eec800-187d-4c6a-9eb4-bdec5f592ad7 req-8171d521-766a-4f9b-a6b2-4cdf8b1f6e21 service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Refreshing network info cache for port 13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:34:18.055439 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Start _get_guest_xml network_info=[{"id": "13c0c2a4-ed11-438d-a852-17bc610c6269", "address": "fa:16:3e:81:21:90", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c0c2a4-ed", "ovs_interfaceid": "13c0c2a4-ed11-438d-a852-17bc610c6269", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:34:18.060969 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:34:18.065229 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-21819966', uuid='4866cabb-0595-4fe5-8be5-ebf4ed9c8f94'), owner=OwnerMeta(userid='7cdf106961084f0e941b5b65911c9b76', username='tempest-ServerRescueNegativeTestJSON-1305117099-project-member', projectid='334b83c8d3714844830f961673658b20', projectname='tempest-ServerRescueNegativeTestJSON-1305117099'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "13c0c2a4-ed11-438d-a852-17bc610c6269", "address": "fa:16:3e:81:21:90", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c0c2a4-ed", "ovs_interfaceid": "13c0c2a4-ed11-438d-a852-17bc610c6269", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165258.062484) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:34:18.065229 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:34:18.065497 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:34:18.066873 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:34:18.067346 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:34:18.068927 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:34:18.069378 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:34:18.069575 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:34:18.069720 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:34:18.069916 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:34:18.070048 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:34:18.070359 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:34:18.070589 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:34:18.070771 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:34:18.071449 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:34:18.071596 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:34:18.071756 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:34:18.086983 np0000001025 nova-compute[97981]: DEBUG nova.privsep.utils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97981) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 19 04:34:18.088900 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-21819966',display_name='tempest-ServerRescueNegativeTestJSON-server-21819966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverrescuenegativetestjson-server-21819966',id=1,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='334b83c8d3714844830f961673658b20',ramdisk_id='',reservation_id='r-zwug52jp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1305117099',owner_user_name='tempest-ServerRescueNegativeTestJSON-1305117099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:34:09Z,user_data=None,user_id='7cdf106961084f0e941b5b65911c9b76',uuid=4866cabb-0595-4fe5-8be5-ebf4ed9c8f94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13c0c2a4-ed11-438d-a852-17bc610c6269", "address": "fa:16:3e:81:21:90", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c0c2a4-ed", "ovs_interfaceid": "13c0c2a4-ed11-438d-a852-17bc610c6269", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:34:18.088900 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converting VIF {"id": "13c0c2a4-ed11-438d-a852-17bc610c6269", "address": "fa:16:3e:81:21:90", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c0c2a4-ed", "ovs_interfaceid": "13c0c2a4-ed11-438d-a852-17bc610c6269", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:34:18.090769 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:21:90,bridge_name='br-int',has_traffic_filtering=True,id=13c0c2a4-ed11-438d-a852-17bc610c6269,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c0c2a4-ed') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:34:18.091382 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'pci_devices' on Instance uuid 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:18.200881 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Acquiring lock "95780667-2e87-4bef-ab7f-f98ab044c03e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:18.201043 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:18.258962 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Releasing lock "refresh_cache-13ba1e00-08ad-4da8-8258-92154f5925d2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:34:18.259420 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Instance network_info: |[{"id": "4709f63b-e1e2-40a4-b2eb-e246f257e437", "address": "fa:16:3e:c3:ab:f5", "network": {"id": "5dba6c16-14eb-438d-a91c-e4f4c65a6894", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1814314607-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45d20e935bfe484890e9cc58ce28186e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4709f63b-e1", "ovs_interfaceid": "4709f63b-e1e2-40a4-b2eb-e246f257e437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:34:18.259780 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72fa778d-0c01-4816-80b6-a4fcbf865441 req-222d2203-c7d6-4b64-b566-f97d7b93a56b service nova] Acquired lock "refresh_cache-13ba1e00-08ad-4da8-8258-92154f5925d2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:34:18.262275 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Start _get_guest_xml network_info=[{"id": "4709f63b-e1e2-40a4-b2eb-e246f257e437", "address": "fa:16:3e:c3:ab:f5", "network": {"id": "5dba6c16-14eb-438d-a91c-e4f4c65a6894", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1814314607-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45d20e935bfe484890e9cc58ce28186e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4709f63b-e1", "ovs_interfaceid": "4709f63b-e1e2-40a4-b2eb-e246f257e437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:34:18.262544 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-72fa778d-0c01-4816-80b6-a4fcbf865441 req-222d2203-c7d6-4b64-b566-f97d7b93a56b service nova] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Refreshing network info cache for port 4709f63b-e1e2-40a4-b2eb-e246f257e437 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:34:18.264404 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:34:18.265411 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-1277794978', uuid='13ba1e00-08ad-4da8-8258-92154f5925d2'), owner=OwnerMeta(userid='4760ff7f5fb748adb8f905519b7d139d', username='tempest-DeleteServersTestJSON-1086734078-project-member', projectid='45d20e935bfe484890e9cc58ce28186e', projectname='tempest-DeleteServersTestJSON-1086734078'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4709f63b-e1e2-40a4-b2eb-e246f257e437", "address": "fa:16:3e:c3:ab:f5", "network": {"id": "5dba6c16-14eb-438d-a91c-e4f4c65a6894", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1814314607-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45d20e935bfe484890e9cc58ce28186e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4709f63b-e1", "ovs_interfaceid": "4709f63b-e1e2-40a4-b2eb-e246f257e437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165258.2651262) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:34:18.267191 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:34:18.267496 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:34:18.269226 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:34:18.269226 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:34:18.269926 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:34:18.270264 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:34:18.270389 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:34:18.270544 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:34:18.270660 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:34:18.271366 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:34:18.271366 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:34:18.271366 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:34:18.271366 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:34:18.271366 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:34:18.271618 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:34:18.271618 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:34:18.289059 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1277794978',display_name='tempest-DeleteServersTestJSON-server-1277794978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-deleteserverstestjson-server-1277794978',id=2,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45d20e935bfe484890e9cc58ce28186e',ramdisk_id='',reservation_id='r-filcpli6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1086734078',owner_user_name='tempest-DeleteServersTestJSON-1086734078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:34:11Z,user_data=None,user_id='4760ff7f5fb748adb8f905519b7d139d',uuid=13ba1e00-08ad-4da8-8258-92154f5925d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4709f63b-e1e2-40a4-b2eb-e246f257e437", "address": "fa:16:3e:c3:ab:f5", "network": {"id": "5dba6c16-14eb-438d-a91c-e4f4c65a6894", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1814314607-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45d20e935bfe484890e9cc58ce28186e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4709f63b-e1", "ovs_interfaceid": "4709f63b-e1e2-40a4-b2eb-e246f257e437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:34:18.289301 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Converting VIF {"id": "4709f63b-e1e2-40a4-b2eb-e246f257e437", "address": "fa:16:3e:c3:ab:f5", "network": {"id": "5dba6c16-14eb-438d-a91c-e4f4c65a6894", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1814314607-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45d20e935bfe484890e9cc58ce28186e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4709f63b-e1", "ovs_interfaceid": "4709f63b-e1e2-40a4-b2eb-e246f257e437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:34:18.289761 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ab:f5,bridge_name='br-int',has_traffic_filtering=True,id=4709f63b-e1e2-40a4-b2eb-e246f257e437,network=Network(5dba6c16-14eb-438d-a91c-e4f4c65a6894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4709f63b-e1') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:34:18.292533 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lazy-loading 'pci_devices' on Instance uuid 13ba1e00-08ad-4da8-8258-92154f5925d2 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:18.330514 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:34:18.534238 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:18.557820 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-80eec800-187d-4c6a-9eb4-bdec5f592ad7 req-8171d521-766a-4f9b-a6b2-4cdf8b1f6e21 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:18.594163 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] End _get_guest_xml xml=<domain type="qemu">
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:   <uuid>4866cabb-0595-4fe5-8be5-ebf4ed9c8f94</uuid>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:   <name>instance-00000001</name>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-21819966</nova:name>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:34:18</nova:creationTime>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:         <nova:user uuid="7cdf106961084f0e941b5b65911c9b76">tempest-ServerRescueNegativeTestJSON-1305117099-project-member</nova:user>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:         <nova:project uuid="334b83c8d3714844830f961673658b20">tempest-ServerRescueNegativeTestJSON-1305117099</nova:project>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:         <nova:port uuid="13c0c2a4-ed11-438d-a852-17bc610c6269">
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     <system>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <entry name="serial">4866cabb-0595-4fe5-8be5-ebf4ed9c8f94</entry>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <entry name="uuid">4866cabb-0595-4fe5-8be5-ebf4ed9c8f94</entry>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     </system>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:   <os>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:   </os>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:   <features>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:   </features>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:   <devices>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk"/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     </disk>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk.config"/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     </disk>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:81:21:90"/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <target dev="tap13c0c2a4-ed"/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     </interface>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/console.log" append="off"/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     </serial>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     <video>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     </video>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     </rng>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:   </devices>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]: </domain>
May 19 04:34:18.594163 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:34:18.597925 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Preparing to wait for external event network-vif-plugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:34:18.597925 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:18.597925 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:18.597925 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:18.597925 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-21819966',display_name='tempest-ServerRescueNegativeTestJSON-server-21819966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverrescuenegativetestjson-server-21819966',id=1,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='334b83c8d3714844830f961673658b20',ramdisk_id='',reservation_id='r-zwug52jp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1305117099',owner_user_name='tempest-ServerRescueNegativeTestJSON-1305117099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:34:09Z,user_data=None,user_id='7cdf106961084f0e941b5b65911c9b76',uuid=4866cabb-0595-4fe5-8be5-ebf4ed9c8f94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13c0c2a4-ed11-438d-a852-17bc610c6269", "address": "fa:16:3e:81:21:90", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c0c2a4-ed", "ovs_interfaceid": "13c0c2a4-ed11-438d-a852-17bc610c6269", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:34:18.598297 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converting VIF {"id": "13c0c2a4-ed11-438d-a852-17bc610c6269", "address": "fa:16:3e:81:21:90", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c0c2a4-ed", "ovs_interfaceid": "13c0c2a4-ed11-438d-a852-17bc610c6269", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:34:18.598297 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:21:90,bridge_name='br-int',has_traffic_filtering=True,id=13c0c2a4-ed11-438d-a852-17bc610c6269,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c0c2a4-ed') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:34:18.598297 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:21:90,bridge_name='br-int',has_traffic_filtering=True,id=13c0c2a4-ed11-438d-a852-17bc610c6269,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c0c2a4-ed') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:34:18.646705 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Created schema index Interface.name {{(pid=97981) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 19 04:34:18.646856 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Created schema index Port.name {{(pid=97981) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 19 04:34:18.646938 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Created schema index Bridge.name {{(pid=97981) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 19 04:34:18.647413 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=97981) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 19 04:34:18.647546 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [POLLOUT] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:18.647640 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97981) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 19 04:34:18.648073 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:18.689775 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:18.691099 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:18.693126 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:34:18.693126 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:18.693126 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:18.693126 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '410ebc57-3f44-58ec-a797-9074191cc722', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:18.695376 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:18.696364 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:34:18.697289 np0000001025 nova-compute[97981]: INFO oslo.privsep.daemon [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp1dq1of8l/privsep.sock']
May 19 04:34:18.703190 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:34:18.706891 np0000001025 sudo[109462]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp1dq1of8l/privsep.sock
May 19 04:34:18.707665 np0000001025 sudo[109462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 19 04:34:18.743543 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Updating instance_info_cache with network_info: [{"id": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "address": "fa:16:3e:8a:28:ef", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91a50f4f-e3", "ovs_interfaceid": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:18.765197 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-72fa778d-0c01-4816-80b6-a4fcbf865441 req-222d2203-c7d6-4b64-b566-f97d7b93a56b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:18.796702 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] End _get_guest_xml xml=<domain type="qemu">
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:   <uuid>13ba1e00-08ad-4da8-8258-92154f5925d2</uuid>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:   <name>instance-00000002</name>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <nova:name>tempest-DeleteServersTestJSON-server-1277794978</nova:name>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:34:18</nova:creationTime>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:         <nova:user uuid="4760ff7f5fb748adb8f905519b7d139d">tempest-DeleteServersTestJSON-1086734078-project-member</nova:user>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:         <nova:project uuid="45d20e935bfe484890e9cc58ce28186e">tempest-DeleteServersTestJSON-1086734078</nova:project>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:         <nova:port uuid="4709f63b-e1e2-40a4-b2eb-e246f257e437">
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     <system>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <entry name="serial">13ba1e00-08ad-4da8-8258-92154f5925d2</entry>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <entry name="uuid">13ba1e00-08ad-4da8-8258-92154f5925d2</entry>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     </system>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:   <os>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:   </os>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:   <features>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:   </features>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:   <devices>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/13ba1e00-08ad-4da8-8258-92154f5925d2/disk"/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     </disk>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/13ba1e00-08ad-4da8-8258-92154f5925d2/disk.config"/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     </disk>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:c3:ab:f5"/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <target dev="tap4709f63b-e1"/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     </interface>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/13ba1e00-08ad-4da8-8258-92154f5925d2/console.log" append="off"/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     </serial>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     <video>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     </video>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     </rng>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:   </devices>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]: </domain>
May 19 04:34:18.796702 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:34:18.798949 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Preparing to wait for external event network-vif-plugged-4709f63b-e1e2-40a4-b2eb-e246f257e437 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:34:18.798949 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Acquiring lock "13ba1e00-08ad-4da8-8258-92154f5925d2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:18.798949 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "13ba1e00-08ad-4da8-8258-92154f5925d2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:18.798949 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "13ba1e00-08ad-4da8-8258-92154f5925d2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:18.798949 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1277794978',display_name='tempest-DeleteServersTestJSON-server-1277794978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-deleteserverstestjson-server-1277794978',id=2,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45d20e935bfe484890e9cc58ce28186e',ramdisk_id='',reservation_id='r-filcpli6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1086734078',owner_user_name='tempest-DeleteServersTestJSON-1086734078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:34:11Z,user_data=None,user_id='4760ff7f5fb748adb8f905519b7d139d',uuid=13ba1e00-08ad-4da8-8258-92154f5925d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4709f63b-e1e2-40a4-b2eb-e246f257e437", "address": "fa:16:3e:c3:ab:f5", "network": {"id": "5dba6c16-14eb-438d-a91c-e4f4c65a6894", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1814314607-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45d20e935bfe484890e9cc58ce28186e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4709f63b-e1", "ovs_interfaceid": "4709f63b-e1e2-40a4-b2eb-e246f257e437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:34:18.800187 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Converting VIF {"id": "4709f63b-e1e2-40a4-b2eb-e246f257e437", "address": "fa:16:3e:c3:ab:f5", "network": {"id": "5dba6c16-14eb-438d-a91c-e4f4c65a6894", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1814314607-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45d20e935bfe484890e9cc58ce28186e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4709f63b-e1", "ovs_interfaceid": "4709f63b-e1e2-40a4-b2eb-e246f257e437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:34:18.805073 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ab:f5,bridge_name='br-int',has_traffic_filtering=True,id=4709f63b-e1e2-40a4-b2eb-e246f257e437,network=Network(5dba6c16-14eb-438d-a91c-e4f4c65a6894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4709f63b-e1') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:34:18.805576 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ab:f5,bridge_name='br-int',has_traffic_filtering=True,id=4709f63b-e1e2-40a4-b2eb-e246f257e437,network=Network(5dba6c16-14eb-438d-a91c-e4f4c65a6894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4709f63b-e1') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:34:18.806857 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:18.807195 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:18.807418 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:34:18.813492 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:18.814157 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3730747-22a0-518b-a18a-3ab176041c8b', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:18.816193 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:18.816974 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:34:18.821159 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Acquiring lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:18.821351 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:18.844252 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:18.997739 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 19 04:34:18.997739 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 19 04:34:18.997739 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 19 04:34:18.997739 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: 
May 19 04:34:18.997739 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 19 04:34:18.997739 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 19 04:34:18.997739 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 19 04:34:18.997739 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: 
May 19 04:34:18.997739 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 19 04:34:19.073587 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-80eec800-187d-4c6a-9eb4-bdec5f592ad7 req-8171d521-766a-4f9b-a6b2-4cdf8b1f6e21 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:19.121917 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-72fa778d-0c01-4816-80b6-a4fcbf865441 req-222d2203-c7d6-4b64-b566-f97d7b93a56b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:19.246791 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Releasing lock "refresh_cache-5f3f7abc-978d-4a0e-8ae1-0d813ad77f35" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:34:19.247082 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Instance network_info: |[{"id": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "address": "fa:16:3e:8a:28:ef", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91a50f4f-e3", "ovs_interfaceid": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:34:19.249205 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Start _get_guest_xml network_info=[{"id": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "address": "fa:16:3e:8a:28:ef", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91a50f4f-e3", "ovs_interfaceid": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:34:19.249678 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a7a0b004-4b7d-499c-97ec-3d79dbe5002a req-00dee351-16fe-4e94-b118-728739b8c76a service nova] Acquired lock "refresh_cache-5f3f7abc-978d-4a0e-8ae1-0d813ad77f35" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:34:19.249881 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a7a0b004-4b7d-499c-97ec-3d79dbe5002a req-00dee351-16fe-4e94-b118-728739b8c76a service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Refreshing network info cache for port 91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:34:19.256737 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:34:19.257804 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-843635983', uuid='5f3f7abc-978d-4a0e-8ae1-0d813ad77f35'), owner=OwnerMeta(userid='7cdf106961084f0e941b5b65911c9b76', username='tempest-ServerRescueNegativeTestJSON-1305117099-project-member', projectid='334b83c8d3714844830f961673658b20', projectname='tempest-ServerRescueNegativeTestJSON-1305117099'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "address": "fa:16:3e:8a:28:ef", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91a50f4f-e3", "ovs_interfaceid": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165259.257491) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:34:19.259624 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:34:19.259940 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:34:19.262354 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:34:19.262729 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:34:19.263528 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:34:19.263860 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:34:19.263994 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:34:19.264089 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:34:19.264248 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:34:19.264337 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:34:19.266130 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:34:19.266130 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:34:19.266130 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:34:19.266130 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:34:19.266130 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:34:19.266130 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:34:19.279450 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-80eec800-187d-4c6a-9eb4-bdec5f592ad7 req-8171d521-766a-4f9b-a6b2-4cdf8b1f6e21 service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Updated VIF entry in instance network info cache for port 13c0c2a4-ed11-438d-a852-17bc610c6269. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:34:19.279768 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-80eec800-187d-4c6a-9eb4-bdec5f592ad7 req-8171d521-766a-4f9b-a6b2-4cdf8b1f6e21 service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Updating instance_info_cache with network_info: [{"id": "13c0c2a4-ed11-438d-a852-17bc610c6269", "address": "fa:16:3e:81:21:90", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c0c2a4-ed", "ovs_interfaceid": "13c0c2a4-ed11-438d-a852-17bc610c6269", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:19.286480 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-843635983',display_name='tempest-ServerRescueNegativeTestJSON-server-843635983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverrescuenegativetestjson-server-843635983',id=3,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='334b83c8d3714844830f961673658b20',ramdisk_id='',reservation_id='r-gxkwrxjh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1305117099',owner_user_name='tempest-ServerRescueNegativeTestJSON-1305117099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:34:14Z,user_data=None,user_id='7cdf106961084f0e941b5b65911c9b76',uuid=5f3f7abc-978d-4a0e-8ae1-0d813ad77f35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "address": "fa:16:3e:8a:28:ef", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91a50f4f-e3", "ovs_interfaceid": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:34:19.286806 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converting VIF {"id": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "address": "fa:16:3e:8a:28:ef", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91a50f4f-e3", "ovs_interfaceid": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:34:19.287815 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:28:ef,bridge_name='br-int',has_traffic_filtering=True,id=91a50f4f-e3ff-4e6f-80f9-472e706603f0,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91a50f4f-e3') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:34:19.288863 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:19.304044 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:19.304327 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:19.307433 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:34:19.307549 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Claim successful on node np0000001025
May 19 04:34:19.324943 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:34:19.385253 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 19 04:34:19.385377 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 19 04:34:19.385496 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 19 04:34:19.385573 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: 
May 19 04:34:19.385646 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 19 04:34:19.385735 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 19 04:34:19.385808 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 19 04:34:19.385882 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: 
May 19 04:34:19.385995 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 19 04:34:19.495041 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-72fa778d-0c01-4816-80b6-a4fcbf865441 req-222d2203-c7d6-4b64-b566-f97d7b93a56b service nova] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Updated VIF entry in instance network info cache for port 4709f63b-e1e2-40a4-b2eb-e246f257e437. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:34:19.495812 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-72fa778d-0c01-4816-80b6-a4fcbf865441 req-222d2203-c7d6-4b64-b566-f97d7b93a56b service nova] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Updating instance_info_cache with network_info: [{"id": "4709f63b-e1e2-40a4-b2eb-e246f257e437", "address": "fa:16:3e:c3:ab:f5", "network": {"id": "5dba6c16-14eb-438d-a91c-e4f4c65a6894", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1814314607-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45d20e935bfe484890e9cc58ce28186e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4709f63b-e1", "ovs_interfaceid": "4709f63b-e1e2-40a4-b2eb-e246f257e437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:19.640475 np0000001025 sudo[109462]: pam_unix(sudo:session): session closed for user root
May 19 04:34:19.642130 np0000001025 nova-compute[97981]: INFO oslo.privsep.daemon [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Spawned new privsep daemon via rootwrap
May 19 04:34:19.642962 np0000001025 nova-compute[97981]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 19 04:34:19.643037 np0000001025 nova-compute[97981]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 19 04:34:19.643086 np0000001025 nova-compute[97981]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
May 19 04:34:19.643281 np0000001025 nova-compute[97981]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109485
May 19 04:34:19.644421 np0000001025 nova-compute[97981]: WARNING oslo_privsep.priv_context [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] privsep daemon already running
May 19 04:34:19.755132 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-a7a0b004-4b7d-499c-97ec-3d79dbe5002a req-00dee351-16fe-4e94-b118-728739b8c76a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:19.784770 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-80eec800-187d-4c6a-9eb4-bdec5f592ad7 req-8171d521-766a-4f9b-a6b2-4cdf8b1f6e21 service nova] Releasing lock "refresh_cache-4866cabb-0595-4fe5-8be5-ebf4ed9c8f94" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:34:19.792237 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] End _get_guest_xml xml=<domain type="qemu">
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:   <uuid>5f3f7abc-978d-4a0e-8ae1-0d813ad77f35</uuid>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:   <name>instance-00000003</name>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-843635983</nova:name>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:34:19</nova:creationTime>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:         <nova:user uuid="7cdf106961084f0e941b5b65911c9b76">tempest-ServerRescueNegativeTestJSON-1305117099-project-member</nova:user>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:         <nova:project uuid="334b83c8d3714844830f961673658b20">tempest-ServerRescueNegativeTestJSON-1305117099</nova:project>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:         <nova:port uuid="91a50f4f-e3ff-4e6f-80f9-472e706603f0">
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     <system>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <entry name="serial">5f3f7abc-978d-4a0e-8ae1-0d813ad77f35</entry>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <entry name="uuid">5f3f7abc-978d-4a0e-8ae1-0d813ad77f35</entry>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     </system>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:   <os>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:   </os>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:   <features>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:   </features>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:   <devices>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk"/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     </disk>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.config"/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     </disk>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:8a:28:ef"/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <target dev="tap91a50f4f-e3"/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     </interface>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/console.log" append="off"/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     </serial>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     <video>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     </video>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     </rng>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:   </devices>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]: </domain>
May 19 04:34:19.792237 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:34:19.795290 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Preparing to wait for external event network-vif-plugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:34:19.795290 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:19.795290 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:19.795290 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:19.795290 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-843635983',display_name='tempest-ServerRescueNegativeTestJSON-server-843635983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverrescuenegativetestjson-server-843635983',id=3,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='334b83c8d3714844830f961673658b20',ramdisk_id='',reservation_id='r-gxkwrxjh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1305117099',owner_user_name='tempest-ServerRescueNegativeTestJSON-1305117099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:34:14Z,user_data=None,user_id='7cdf106961084f0e941b5b65911c9b76',uuid=5f3f7abc-978d-4a0e-8ae1-0d813ad77f35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "address": "fa:16:3e:8a:28:ef", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91a50f4f-e3", "ovs_interfaceid": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:34:19.796123 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converting VIF {"id": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "address": "fa:16:3e:8a:28:ef", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91a50f4f-e3", "ovs_interfaceid": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:34:19.796123 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:28:ef,bridge_name='br-int',has_traffic_filtering=True,id=91a50f4f-e3ff-4e6f-80f9-472e706603f0,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91a50f4f-e3') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:34:19.796123 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:28:ef,bridge_name='br-int',has_traffic_filtering=True,id=91a50f4f-e3ff-4e6f-80f9-472e706603f0,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91a50f4f-e3') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:34:19.796123 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:19.796123 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:19.796123 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:34:19.796566 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:19.796710 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca6192b9-3264-5351-8095-a955678d1637', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:19.797431 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:19.798499 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:34:19.893642 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:19.912370 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:19.912608 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4709f63b-e1, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:19.913388 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4709f63b-e1, col_values=(('qos', UUID('49b19b4d-77a0-4185-8a6e-c49f3deb60b3')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:19.913515 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4709f63b-e1, col_values=(('external_ids', {'iface-id': '4709f63b-e1e2-40a4-b2eb-e246f257e437', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:ab:f5', 'vm-uuid': '13ba1e00-08ad-4da8-8258-92154f5925d2'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:19.914359 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:19.915914 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:34:19.924575 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:19.925444 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:19.925444 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91a50f4f-e3, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:19.927759 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap91a50f4f-e3, col_values=(('qos', UUID('e6af4a8e-ca00-4aeb-8583-7d49876d3dd6')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:19.927759 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap91a50f4f-e3, col_values=(('external_ids', {'iface-id': '91a50f4f-e3ff-4e6f-80f9-472e706603f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:28:ef', 'vm-uuid': '5f3f7abc-978d-4a0e-8ae1-0d813ad77f35'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:19.928285 np0000001025 nova-compute[97981]: INFO os_vif [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ab:f5,bridge_name='br-int',has_traffic_filtering=True,id=4709f63b-e1e2-40a4-b2eb-e246f257e437,network=Network(5dba6c16-14eb-438d-a91c-e4f4c65a6894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4709f63b-e1')
May 19 04:34:19.930155 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:34:19.939723 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:19.940744 np0000001025 nova-compute[97981]: INFO os_vif [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:28:ef,bridge_name='br-int',has_traffic_filtering=True,id=91a50f4f-e3ff-4e6f-80f9-472e706603f0,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91a50f4f-e3')
May 19 04:34:19.941192 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:19.941409 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13c0c2a4-ed, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:19.941753 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap13c0c2a4-ed, col_values=(('qos', UUID('d64fb7df-77f6-47e7-aca1-395026c27446')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:19.941888 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap13c0c2a4-ed, col_values=(('external_ids', {'iface-id': '13c0c2a4-ed11-438d-a852-17bc610c6269', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:21:90', 'vm-uuid': '4866cabb-0595-4fe5-8be5-ebf4ed9c8f94'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:19.942886 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:19.943925 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:34:19.957918 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:19.959087 np0000001025 nova-compute[97981]: INFO os_vif [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:21:90,bridge_name='br-int',has_traffic_filtering=True,id=13c0c2a4-ed11-438d-a852-17bc610c6269,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c0c2a4-ed')
May 19 04:34:19.997947 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72fa778d-0c01-4816-80b6-a4fcbf865441 req-222d2203-c7d6-4b64-b566-f97d7b93a56b service nova] Releasing lock "refresh_cache-13ba1e00-08ad-4da8-8258-92154f5925d2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:34:20.615099 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-a7a0b004-4b7d-499c-97ec-3d79dbe5002a req-00dee351-16fe-4e94-b118-728739b8c76a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:20.639053 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:34:20.639506 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:34:20.786259 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a7a0b004-4b7d-499c-97ec-3d79dbe5002a req-00dee351-16fe-4e94-b118-728739b8c76a service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Updated VIF entry in instance network info cache for port 91a50f4f-e3ff-4e6f-80f9-472e706603f0. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:34:20.786919 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a7a0b004-4b7d-499c-97ec-3d79dbe5002a req-00dee351-16fe-4e94-b118-728739b8c76a service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Updating instance_info_cache with network_info: [{"id": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "address": "fa:16:3e:8a:28:ef", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91a50f4f-e3", "ovs_interfaceid": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:21.142473 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:34:21.288683 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a7a0b004-4b7d-499c-97ec-3d79dbe5002a req-00dee351-16fe-4e94-b118-728739b8c76a service nova] Releasing lock "refresh_cache-5f3f7abc-978d-4a0e-8ae1-0d813ad77f35" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:34:21.447240 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:21.447240 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:21.447492 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] No VIF found with MAC fa:16:3e:c3:ab:f5, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:34:21.448031 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Using config drive
May 19 04:34:21.456207 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:21.456303 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:21.456404 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No VIF found with MAC fa:16:3e:8a:28:ef, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:34:21.456802 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Using config drive
May 19 04:34:21.480981 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:21.480981 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:21.480981 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No VIF found with MAC fa:16:3e:81:21:90, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:34:21.480981 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Using config drive
May 19 04:34:21.591123 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:22.046629 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:22.046629 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.346s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:22.046629 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:34:22.046629 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.762s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:22.046629 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:34:22.046629 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Claim successful on node np0000001025
May 19 04:34:22.046629 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:22.046629 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:22.046629 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:22.158979 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:34:22.159626 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:34:22.160104 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:22.160513 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:22.629019 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '66e33e6af79d44e4a3f18926a525acc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6417ad7b082a41bc9af43c57fb87ee89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:34:22.662787 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
May 19 04:34:22.691998 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Creating config drive at /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.config
May 19 04:34:22.695933 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpctnzjt7q {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:22.719313 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Creating config drive at /opt/stack/data/nova/instances/13ba1e00-08ad-4da8-8258-92154f5925d2/disk.config
May 19 04:34:22.723906 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/13ba1e00-08ad-4da8-8258-92154f5925d2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp15qbayr7 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:22.732074 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpctnzjt7q" returned: 0 in 0.035s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:22.742902 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Creating config drive at /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk.config
May 19 04:34:22.754087 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppz9mqe4c {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:22.765228 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/13ba1e00-08ad-4da8-8258-92154f5925d2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp15qbayr7" returned: 0 in 0.040s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:22.795073 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppz9mqe4c" returned: 0 in 0.042s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:22.854555 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:23.077667 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:34:23.078021 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:34:23.166774 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:34:23.460474 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Successfully created port: c1cf7ee2-df61-4771-ae64-c1eb09722516 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:34:23.581660 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:34:23.760069 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:23.789075 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:23.822012 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:23.822351 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:23.871134 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:23.871134 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:24.040601 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:24.066428 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:24.093216 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Successfully updated port: c1cf7ee2-df61-4771-ae64-c1eb09722516 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:34:24.094246 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.438s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:24.095474 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:34:24.179699 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5b817cf4-a4fb-48c5-a8e6-6c2ee6309d1c req-9a385e73-2c44-456c-b7dd-17fdcc196b1f service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Received event network-changed-c1cf7ee2-df61-4771-ae64-c1eb09722516 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:24.179699 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5b817cf4-a4fb-48c5-a8e6-6c2ee6309d1c req-9a385e73-2c44-456c-b7dd-17fdcc196b1f service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Refreshing instance network info cache due to event network-changed-c1cf7ee2-df61-4771-ae64-c1eb09722516. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:34:24.179699 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5b817cf4-a4fb-48c5-a8e6-6c2ee6309d1c req-9a385e73-2c44-456c-b7dd-17fdcc196b1f service nova] Acquiring lock "refresh_cache-95780667-2e87-4bef-ab7f-f98ab044c03e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:34:24.179699 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5b817cf4-a4fb-48c5-a8e6-6c2ee6309d1c req-9a385e73-2c44-456c-b7dd-17fdcc196b1f service nova] Acquired lock "refresh_cache-95780667-2e87-4bef-ab7f-f98ab044c03e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:34:24.179699 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5b817cf4-a4fb-48c5-a8e6-6c2ee6309d1c req-9a385e73-2c44-456c-b7dd-17fdcc196b1f service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Refreshing network info cache for port c1cf7ee2-df61-4771-ae64-c1eb09722516 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:34:24.179699 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:24.187151 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:34:24.188089 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:34:24.188392 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Creating image(s)
May 19 04:34:24.193983 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Acquiring lock "/opt/stack/data/nova/instances/95780667-2e87-4bef-ab7f-f98ab044c03e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:24.193983 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "/opt/stack/data/nova/instances/95780667-2e87-4bef-ab7f-f98ab044c03e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:24.198128 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "/opt/stack/data/nova/instances/95780667-2e87-4bef-ab7f-f98ab044c03e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:24.198128 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Acquiring lock "92e0ec57d2ee1119efa7cbdf49a325228d175146" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:24.198128 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "92e0ec57d2ee1119efa7cbdf49a325228d175146" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:24.201978 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:24.298568 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:24.317275 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:24.320192 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:24.327906 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:34:24.373856 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:34:24.413526 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:24.545067 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:24.605871 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Acquiring lock "refresh_cache-95780667-2e87-4bef-ab7f-f98ab044c03e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:34:24.610622 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:34:24.611700 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:34:24.612167 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:24.612658 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:24.636523 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:24.682072 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-5b817cf4-a4fb-48c5-a8e6-6c2ee6309d1c req-9a385e73-2c44-456c-b7dd-17fdcc196b1f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:24.791669 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38a001b8a8954c318a641c5482213944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3244e0bf71164922b7a0e4cbbf0d01db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:34:24.802862 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5b817cf4-a4fb-48c5-a8e6-6c2ee6309d1c req-9a385e73-2c44-456c-b7dd-17fdcc196b1f service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:34:24.929458 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:24.929458 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:24.947131 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:34:24.961817 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:24.965287 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Claim successful on node np0000001025
May 19 04:34:24.999785 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:25.111446 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:34:25.180257 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5b817cf4-a4fb-48c5-a8e6-6c2ee6309d1c req-9a385e73-2c44-456c-b7dd-17fdcc196b1f service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:25.324994 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:25.330223 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:25.330520 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92e0ec57d2ee1119efa7cbdf49a325228d175146.part --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:25.412542 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779165265.411319, 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:25.412542 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] VM Started (Lifecycle Event)
May 19 04:34:25.436488 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92e0ec57d2ee1119efa7cbdf49a325228d175146.part --force-share --output=json" returned: 0 in 0.106s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:25.436762 np0000001025 nova-compute[97981]: DEBUG nova.virt.images [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] 17c062fc-ea68-4cab-bf7e-28ea6cbcf35b was qcow2, converting to raw {{(pid=97981) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 19 04:34:25.438868 np0000001025 nova-compute[97981]: DEBUG nova.privsep.utils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97981) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 19 04:34:25.439191 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/92e0ec57d2ee1119efa7cbdf49a325228d175146.part /opt/stack/data/nova/instances/_base/92e0ec57d2ee1119efa7cbdf49a325228d175146.converted {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:25.616042 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:34:25.647746 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/92e0ec57d2ee1119efa7cbdf49a325228d175146.part /opt/stack/data/nova/instances/_base/92e0ec57d2ee1119efa7cbdf49a325228d175146.converted" returned: 0 in 0.208s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:25.656035 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92e0ec57d2ee1119efa7cbdf49a325228d175146.converted --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:25.683406 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Successfully created port: f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:34:25.687620 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5b817cf4-a4fb-48c5-a8e6-6c2ee6309d1c req-9a385e73-2c44-456c-b7dd-17fdcc196b1f service nova] Releasing lock "refresh_cache-95780667-2e87-4bef-ab7f-f98ab044c03e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:34:25.688392 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Acquired lock "refresh_cache-95780667-2e87-4bef-ab7f-f98ab044c03e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:34:25.688586 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:34:25.737709 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92e0ec57d2ee1119efa7cbdf49a325228d175146.converted --force-share --output=json" returned: 0 in 0.082s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:25.738253 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "92e0ec57d2ee1119efa7cbdf49a325228d175146" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.542s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:25.738670 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:25.741619 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:25.743135 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92e0ec57d2ee1119efa7cbdf49a325228d175146 --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:25.816635 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92e0ec57d2ee1119efa7cbdf49a325228d175146 --force-share --output=json" returned: 0 in 0.073s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:25.817423 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Acquiring lock "92e0ec57d2ee1119efa7cbdf49a325228d175146" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:25.817719 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "92e0ec57d2ee1119efa7cbdf49a325228d175146" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:25.821079 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:25.825380 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:25.825897 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92e0ec57d2ee1119efa7cbdf49a325228d175146 --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:25.898820 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92e0ec57d2ee1119efa7cbdf49a325228d175146 --force-share --output=json" returned: 0 in 0.073s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:25.899279 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/92e0ec57d2ee1119efa7cbdf49a325228d175146,backing_fmt=raw /opt/stack/data/nova/instances/95780667-2e87-4bef-ab7f-f98ab044c03e/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:25.924256 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:25.926781 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165265.9265094, 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:25.926913 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] VM Paused (Lifecycle Event)
May 19 04:34:25.943003 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/92e0ec57d2ee1119efa7cbdf49a325228d175146,backing_fmt=raw /opt/stack/data/nova/instances/95780667-2e87-4bef-ab7f-f98ab044c03e/disk 1073741824" returned: 0 in 0.044s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:25.943477 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "92e0ec57d2ee1119efa7cbdf49a325228d175146" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.126s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:25.943938 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92e0ec57d2ee1119efa7cbdf49a325228d175146 --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:26.027732 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92e0ec57d2ee1119efa7cbdf49a325228d175146 --force-share --output=json" returned: 0 in 0.084s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:26.030379 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Checking if we can resize image /opt/stack/data/nova/instances/95780667-2e87-4bef-ab7f-f98ab044c03e/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:34:26.030379 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95780667-2e87-4bef-ab7f-f98ab044c03e/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:26.090757 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95780667-2e87-4bef-ab7f-f98ab044c03e/disk --force-share --output=json" returned: 0 in 0.062s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:26.091474 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Cannot resize image /opt/stack/data/nova/instances/95780667-2e87-4bef-ab7f-f98ab044c03e/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:34:26.091811 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:34:26.091972 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Ensure instance console log exists: /opt/stack/data/nova/instances/95780667-2e87-4bef-ab7f-f98ab044c03e/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:34:26.092279 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:26.093741 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:26.093741 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:26.254675 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Successfully updated port: f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:34:26.292587 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:34:26.318371 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8140bb34-9f76-42b0-afcf-8e3d62f416d5 req-260978e1-471b-450a-a5b9-c8b69711e552 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Received event network-changed-f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:26.318522 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8140bb34-9f76-42b0-afcf-8e3d62f416d5 req-260978e1-471b-450a-a5b9-c8b69711e552 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Refreshing instance network info cache due to event network-changed-f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:34:26.318682 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8140bb34-9f76-42b0-afcf-8e3d62f416d5 req-260978e1-471b-450a-a5b9-c8b69711e552 service nova] Acquiring lock "refresh_cache-8926c69b-c0ce-47e5-a3b6-ddbdeff44963" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:34:26.318772 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8140bb34-9f76-42b0-afcf-8e3d62f416d5 req-260978e1-471b-450a-a5b9-c8b69711e552 service nova] Acquired lock "refresh_cache-8926c69b-c0ce-47e5-a3b6-ddbdeff44963" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:34:26.318907 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-8140bb34-9f76-42b0-afcf-8e3d62f416d5 req-260978e1-471b-450a-a5b9-c8b69711e552 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Refreshing network info cache for port f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:34:26.385637 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0e9a70d8-d19b-4e0b-b6ab-35fea4a4ed9f req-dc7c94c5-9271-4ccb-b31f-1891d040e451 service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received event network-vif-unplugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:26.385838 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0e9a70d8-d19b-4e0b-b6ab-35fea4a4ed9f req-dc7c94c5-9271-4ccb-b31f-1891d040e451 service nova] Acquiring lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:26.385986 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0e9a70d8-d19b-4e0b-b6ab-35fea4a4ed9f req-dc7c94c5-9271-4ccb-b31f-1891d040e451 service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:26.386146 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0e9a70d8-d19b-4e0b-b6ab-35fea4a4ed9f req-dc7c94c5-9271-4ccb-b31f-1891d040e451 service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:26.386284 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0e9a70d8-d19b-4e0b-b6ab-35fea4a4ed9f req-dc7c94c5-9271-4ccb-b31f-1891d040e451 service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] No event matching network-vif-unplugged-13c0c2a4-ed11-438d-a852-17bc610c6269 in dict_keys([('network-vif-plugged', '13c0c2a4-ed11-438d-a852-17bc610c6269')]) {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 19 04:34:26.386404 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-0e9a70d8-d19b-4e0b-b6ab-35fea4a4ed9f req-dc7c94c5-9271-4ccb-b31f-1891d040e451 service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received unexpected event network-vif-unplugged-13c0c2a4-ed11-438d-a852-17bc610c6269 for instance with vm_state building and task_state spawning.
May 19 04:34:26.431664 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:26.434755 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:34:26.441664 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:34:26.442019 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:34:26.552821 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:26.630180 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:34:26.631279 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:34:26.632120 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Creating image(s)
May 19 04:34:26.635588 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Acquiring lock "/opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:26.635842 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Lock "/opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:26.636493 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Lock "/opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:26.636963 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:26.640185 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:26.641617 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:26.714377 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.072s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:26.714934 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:26.715630 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:26.716339 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:26.719710 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:26.720138 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:26.752336 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Updating instance_info_cache with network_info: [{"id": "c1cf7ee2-df61-4771-ae64-c1eb09722516", "address": "fa:16:3e:94:e5:3c", "network": {"id": "5f3c92cb-a2be-4e71-9708-047a0a006bec", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1354251025-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6417ad7b082a41bc9af43c57fb87ee89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1cf7ee2-df", "ovs_interfaceid": "c1cf7ee2-df61-4771-ae64-c1eb09722516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:26.758095 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Acquiring lock "refresh_cache-8926c69b-c0ce-47e5-a3b6-ddbdeff44963" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:34:26.800992 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:26.804039 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:26.806847 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:26.809259 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.089s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:26.809739 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:26.824400 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:26.827522 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-8140bb34-9f76-42b0-afcf-8e3d62f416d5 req-260978e1-471b-450a-a5b9-c8b69711e552 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:26.843371 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/disk 1073741824" returned: 0 in 0.034s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:26.843800 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.128s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:26.844283 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:26.907058 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-8140bb34-9f76-42b0-afcf-8e3d62f416d5 req-260978e1-471b-450a-a5b9-c8b69711e552 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:34:26.920546 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.076s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:26.920670 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:34:26.920876 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:26.938078 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:34:26.938830 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165266.9385347, 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:26.938975 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] VM Started (Lifecycle Event)
May 19 04:34:26.946310 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:34:26.987495 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/disk --force-share --output=json" returned: 0 in 0.066s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:26.987711 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Cannot resize image /opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:34:26.988001 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:34:26.988206 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Ensure instance console log exists: /opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:34:26.988516 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:26.988707 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:26.988842 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:27.099437 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-8140bb34-9f76-42b0-afcf-8e3d62f416d5 req-260978e1-471b-450a-a5b9-c8b69711e552 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:27.259744 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Releasing lock "refresh_cache-95780667-2e87-4bef-ab7f-f98ab044c03e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:34:27.260262 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Instance network_info: |[{"id": "c1cf7ee2-df61-4771-ae64-c1eb09722516", "address": "fa:16:3e:94:e5:3c", "network": {"id": "5f3c92cb-a2be-4e71-9708-047a0a006bec", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1354251025-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6417ad7b082a41bc9af43c57fb87ee89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1cf7ee2-df", "ovs_interfaceid": "c1cf7ee2-df61-4771-ae64-c1eb09722516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:34:27.262394 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Start _get_guest_xml network_info=[{"id": "c1cf7ee2-df61-4771-ae64-c1eb09722516", "address": "fa:16:3e:94:e5:3c", "network": {"id": "5f3c92cb-a2be-4e71-9708-047a0a006bec", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1354251025-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6417ad7b082a41bc9af43c57fb87ee89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1cf7ee2-df", "ovs_interfaceid": "c1cf7ee2-df61-4771-ae64-c1eb09722516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:34:04Z,direct_url=<?>,disk_format='qcow2',id=17c062fc-ea68-4cab-bf7e-28ea6cbcf35b,min_disk=0,min_ram=0,name='',owner='98f651fd370f4cb0aa2b7ea887069a27',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:34:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/sda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '17c062fc-ea68-4cab-bf7e-28ea6cbcf35b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:34:27.264843 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:34:27.265566 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='17c062fc-ea68-4cab-bf7e-28ea6cbcf35b', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-951112015', uuid='95780667-2e87-4bef-ab7f-f98ab044c03e'), owner=OwnerMeta(userid='66e33e6af79d44e4a3f18926a525acc5', username='tempest-AttachSCSIVolumeTestJSON-1273604612-project-member', projectid='6417ad7b082a41bc9af43c57fb87ee89', projectname='tempest-AttachSCSIVolumeTestJSON-1273604612'), image=ImageMeta(id='17c062fc-ea68-4cab-bf7e-28ea6cbcf35b', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c1cf7ee2-df61-4771-ae64-c1eb09722516", "address": "fa:16:3e:94:e5:3c", "network": {"id": "5f3c92cb-a2be-4e71-9708-047a0a006bec", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1354251025-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6417ad7b082a41bc9af43c57fb87ee89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1cf7ee2-df", "ovs_interfaceid": "c1cf7ee2-df61-4771-ae64-c1eb09722516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165267.2651699) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:34:27.266348 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:34:27.266856 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:34:27.267494 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:34:27.267715 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:34:27.268946 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:34:27.269556 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:34:04Z,direct_url=<?>,disk_format='qcow2',id=17c062fc-ea68-4cab-bf7e-28ea6cbcf35b,min_disk=0,min_ram=0,name='',owner='98f651fd370f4cb0aa2b7ea887069a27',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:34:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:34:27.269664 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:34:27.269836 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:34:27.269912 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:34:27.270058 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:34:27.270256 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:34:27.270591 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:34:27.270640 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:34:27.270800 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:34:27.270961 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:34:27.271147 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:34:27.288163 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-951112015',display_name='tempest-AttachSCSIVolumeTestJSON-server-951112015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachscsivolumetestjson-server-951112015',id=4,image_ref='17c062fc-ea68-4cab-bf7e-28ea6cbcf35b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIU4hDVFhSAwvg2aPifvVly5RLzAbIhBSBlJoObNIrbmgxj8zF+Okm5LC3IvLoCc9eBLEbIwmOD8cNXKmIj4FWs/zKPKAIYVIJyrmhK2YhWq5ifWZSrQHW8ZQVRLuK1Bg==',key_name='tempest-keypair-954448069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6417ad7b082a41bc9af43c57fb87ee89',ramdisk_id='',reservation_id='r-sx7tulh5',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='17c062fc-ea68-4cab-bf7e-28ea6cbcf35b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1273604612',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1273604612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:34:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66e33e6af79d44e4a3f18926a525acc5',uuid=95780667-2e87-4bef-ab7f-f98ab044c03e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1cf7ee2-df61-4771-ae64-c1eb09722516", "address": "fa:16:3e:94:e5:3c", "network": {"id": "5f3c92cb-a2be-4e71-9708-047a0a006bec", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1354251025-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6417ad7b082a41bc9af43c57fb87ee89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1cf7ee2-df", "ovs_interfaceid": "c1cf7ee2-df61-4771-ae64-c1eb09722516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:34:27.288420 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Converting VIF {"id": "c1cf7ee2-df61-4771-ae64-c1eb09722516", "address": "fa:16:3e:94:e5:3c", "network": {"id": "5f3c92cb-a2be-4e71-9708-047a0a006bec", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1354251025-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6417ad7b082a41bc9af43c57fb87ee89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1cf7ee2-df", "ovs_interfaceid": "c1cf7ee2-df61-4771-ae64-c1eb09722516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:34:27.289277 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:e5:3c,bridge_name='br-int',has_traffic_filtering=True,id=c1cf7ee2-df61-4771-ae64-c1eb09722516,network=Network(5f3c92cb-a2be-4e71-9708-047a0a006bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1cf7ee2-df') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:34:27.289981 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lazy-loading 'pci_devices' on Instance uuid 95780667-2e87-4bef-ab7f-f98ab044c03e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:27.442458 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:27.444014 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165267.4437509, 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:27.444617 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] VM Paused (Lifecycle Event)
May 19 04:34:27.458835 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.530s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:27.459835 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:34:27.462844 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.465s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:27.466324 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:34:27.466468 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Claim successful on node np0000001025
May 19 04:34:27.529082 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:27.530693 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:27.534334 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:27.552911 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:27.601716 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8140bb34-9f76-42b0-afcf-8e3d62f416d5 req-260978e1-471b-450a-a5b9-c8b69711e552 service nova] Releasing lock "refresh_cache-8926c69b-c0ce-47e5-a3b6-ddbdeff44963" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:34:27.602168 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Acquired lock "refresh_cache-8926c69b-c0ce-47e5-a3b6-ddbdeff44963" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:34:27.602452 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:34:27.744989 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:27.745877 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:27.794450 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] End _get_guest_xml xml=<domain type="qemu">
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:   <uuid>95780667-2e87-4bef-ab7f-f98ab044c03e</uuid>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:   <name>instance-00000004</name>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-951112015</nova:name>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:34:27</nova:creationTime>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <nova:image uuid="17c062fc-ea68-4cab-bf7e-28ea6cbcf35b">
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:           <nova:property name="hw_cdrom_bus">scsi</nova:property>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:           <nova:property name="hw_disk_bus">scsi</nova:property>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:           <nova:property name="hw_scsi_model">virtio-scsi</nova:property>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:         <nova:user uuid="66e33e6af79d44e4a3f18926a525acc5">tempest-AttachSCSIVolumeTestJSON-1273604612-project-member</nova:user>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:         <nova:project uuid="6417ad7b082a41bc9af43c57fb87ee89">tempest-AttachSCSIVolumeTestJSON-1273604612</nova:project>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="17c062fc-ea68-4cab-bf7e-28ea6cbcf35b"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:         <nova:port uuid="c1cf7ee2-df61-4771-ae64-c1eb09722516">
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     <system>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <entry name="serial">95780667-2e87-4bef-ab7f-f98ab044c03e</entry>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <entry name="uuid">95780667-2e87-4bef-ab7f-f98ab044c03e</entry>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     </system>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:   <os>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:   </os>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:   <features>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:   </features>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:   <devices>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/95780667-2e87-4bef-ab7f-f98ab044c03e/disk"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <target dev="sda" bus="scsi"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <address type="drive" controller="0" unit="0"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     </disk>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/95780667-2e87-4bef-ab7f-f98ab044c03e/disk.config"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <target dev="sdb" bus="scsi"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <address type="drive" controller="0" unit="1"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     </disk>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     <controller type="scsi" index="0" model="virtio-scsi"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:94:e5:3c"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <target dev="tapc1cf7ee2-df"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     </interface>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/95780667-2e87-4bef-ab7f-f98ab044c03e/console.log" append="off"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     </serial>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     <video>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     </video>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     </rng>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:   </devices>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]: </domain>
May 19 04:34:27.794450 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:34:27.796280 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Preparing to wait for external event network-vif-plugged-c1cf7ee2-df61-4771-ae64-c1eb09722516 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:34:27.796280 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Acquiring lock "95780667-2e87-4bef-ab7f-f98ab044c03e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:27.796280 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:27.796280 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:27.796280 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-951112015',display_name='tempest-AttachSCSIVolumeTestJSON-server-951112015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachscsivolumetestjson-server-951112015',id=4,image_ref='17c062fc-ea68-4cab-bf7e-28ea6cbcf35b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIU4hDVFhSAwvg2aPifvVly5RLzAbIhBSBlJoObNIrbmgxj8zF+Okm5LC3IvLoCc9eBLEbIwmOD8cNXKmIj4FWs/zKPKAIYVIJyrmhK2YhWq5ifWZSrQHW8ZQVRLuK1Bg==',key_name='tempest-keypair-954448069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6417ad7b082a41bc9af43c57fb87ee89',ramdisk_id='',reservation_id='r-sx7tulh5',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='17c062fc-ea68-4cab-bf7e-28ea6cbcf35b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1273604612',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1273604612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:34:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66e33e6af79d44e4a3f18926a525acc5',uuid=95780667-2e87-4bef-ab7f-f98ab044c03e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1cf7ee2-df61-4771-ae64-c1eb09722516", "address": "fa:16:3e:94:e5:3c", "network": {"id": "5f3c92cb-a2be-4e71-9708-047a0a006bec", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1354251025-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6417ad7b082a41bc9af43c57fb87ee89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1cf7ee2-df", "ovs_interfaceid": "c1cf7ee2-df61-4771-ae64-c1eb09722516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:34:27.796544 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Converting VIF {"id": "c1cf7ee2-df61-4771-ae64-c1eb09722516", "address": "fa:16:3e:94:e5:3c", "network": {"id": "5f3c92cb-a2be-4e71-9708-047a0a006bec", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1354251025-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6417ad7b082a41bc9af43c57fb87ee89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1cf7ee2-df", "ovs_interfaceid": "c1cf7ee2-df61-4771-ae64-c1eb09722516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:34:27.796544 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:e5:3c,bridge_name='br-int',has_traffic_filtering=True,id=c1cf7ee2-df61-4771-ae64-c1eb09722516,network=Network(5f3c92cb-a2be-4e71-9708-047a0a006bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1cf7ee2-df') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:34:27.796781 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:e5:3c,bridge_name='br-int',has_traffic_filtering=True,id=c1cf7ee2-df61-4771-ae64-c1eb09722516,network=Network(5f3c92cb-a2be-4e71-9708-047a0a006bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1cf7ee2-df') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:34:27.797020 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:27.797259 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:27.797473 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:34:27.798482 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:27.798605 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d2f1ded-bfcc-54f3-b4a7-d8896a1b0f9d', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:27.799305 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:27.799986 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:34:27.802162 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:27.804355 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:27.804507 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1cf7ee2-df, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:27.804850 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc1cf7ee2-df, col_values=(('qos', UUID('fb6f62ca-c48b-459d-a6f3-66a62d5f6223')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:27.805000 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc1cf7ee2-df, col_values=(('external_ids', {'iface-id': 'c1cf7ee2-df61-4771-ae64-c1eb09722516', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:e5:3c', 'vm-uuid': '95780667-2e87-4bef-ab7f-f98ab044c03e'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:27.805785 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:27.809005 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:34:27.813636 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:27.815195 np0000001025 nova-compute[97981]: INFO os_vif [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:e5:3c,bridge_name='br-int',has_traffic_filtering=True,id=c1cf7ee2-df61-4771-ae64-c1eb09722516,network=Network(5f3c92cb-a2be-4e71-9708-047a0a006bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1cf7ee2-df')
May 19 04:34:27.859789 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:27.946818 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:27.948651 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:34:27.968149 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:34:27.968370 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:34:27.968797 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:27.969254 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:28.068276 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8208ac95cdcb4481a05d42b29f73dde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907951cd15704c2d968614f909b64ba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:34:28.191167 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:34:28.380710 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-def51a9b-df0f-4d95-872d-c909d8b2d2fa req-91f6671d-aadf-46bd-aea6-678ca6b985a3 service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received event network-vif-unplugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:28.381074 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-def51a9b-df0f-4d95-872d-c909d8b2d2fa req-91f6671d-aadf-46bd-aea6-678ca6b985a3 service nova] Acquiring lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:28.381255 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-def51a9b-df0f-4d95-872d-c909d8b2d2fa req-91f6671d-aadf-46bd-aea6-678ca6b985a3 service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:28.381281 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-def51a9b-df0f-4d95-872d-c909d8b2d2fa req-91f6671d-aadf-46bd-aea6-678ca6b985a3 service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:28.381397 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-def51a9b-df0f-4d95-872d-c909d8b2d2fa req-91f6671d-aadf-46bd-aea6-678ca6b985a3 service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] No event matching network-vif-unplugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 in dict_keys([('network-vif-plugged', '91a50f4f-e3ff-4e6f-80f9-472e706603f0')]) {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 19 04:34:28.381515 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-def51a9b-df0f-4d95-872d-c909d8b2d2fa req-91f6671d-aadf-46bd-aea6-678ca6b985a3 service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received unexpected event network-vif-unplugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 for instance with vm_state building and task_state spawning.
May 19 04:34:28.381611 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-def51a9b-df0f-4d95-872d-c909d8b2d2fa req-91f6671d-aadf-46bd-aea6-678ca6b985a3 service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received event network-vif-plugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:28.381725 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-def51a9b-df0f-4d95-872d-c909d8b2d2fa req-91f6671d-aadf-46bd-aea6-678ca6b985a3 service nova] Acquiring lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:28.381841 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-def51a9b-df0f-4d95-872d-c909d8b2d2fa req-91f6671d-aadf-46bd-aea6-678ca6b985a3 service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:28.382294 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-def51a9b-df0f-4d95-872d-c909d8b2d2fa req-91f6671d-aadf-46bd-aea6-678ca6b985a3 service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:28.382375 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-def51a9b-df0f-4d95-872d-c909d8b2d2fa req-91f6671d-aadf-46bd-aea6-678ca6b985a3 service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Processing event network-vif-plugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:34:28.382826 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:34:28.387168 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:34:28.387580 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Instance spawned successfully.
May 19 04:34:28.388449 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:34:28.424538 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:28.456824 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:34:28.457181 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165268.4569106, 13ba1e00-08ad-4da8-8258-92154f5925d2 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:28.457367 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] VM Started (Lifecycle Event)
May 19 04:34:28.479399 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:34:28.492252 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Received event network-vif-unplugged-4709f63b-e1e2-40a4-b2eb-e246f257e437 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:28.493817 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] Acquiring lock "13ba1e00-08ad-4da8-8258-92154f5925d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:28.494195 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] Lock "13ba1e00-08ad-4da8-8258-92154f5925d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:28.494594 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] Lock "13ba1e00-08ad-4da8-8258-92154f5925d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:28.495155 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] No event matching network-vif-unplugged-4709f63b-e1e2-40a4-b2eb-e246f257e437 in dict_keys([('network-vif-plugged', '4709f63b-e1e2-40a4-b2eb-e246f257e437')]) {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 19 04:34:28.495155 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Received unexpected event network-vif-unplugged-4709f63b-e1e2-40a4-b2eb-e246f257e437 for instance with vm_state building and task_state spawning.
May 19 04:34:28.496154 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Received event network-vif-unplugged-c1cf7ee2-df61-4771-ae64-c1eb09722516 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:28.496154 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] Acquiring lock "95780667-2e87-4bef-ab7f-f98ab044c03e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:28.496154 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:28.496154 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:28.496405 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] No event matching network-vif-unplugged-c1cf7ee2-df61-4771-ae64-c1eb09722516 in dict_keys([('network-vif-plugged', 'c1cf7ee2-df61-4771-ae64-c1eb09722516')]) {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 19 04:34:28.497695 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Received unexpected event network-vif-unplugged-c1cf7ee2-df61-4771-ae64-c1eb09722516 for instance with vm_state building and task_state spawning.
May 19 04:34:28.497856 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Received event network-vif-plugged-4709f63b-e1e2-40a4-b2eb-e246f257e437 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:28.499476 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] Acquiring lock "13ba1e00-08ad-4da8-8258-92154f5925d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:28.499476 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] Lock "13ba1e00-08ad-4da8-8258-92154f5925d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:28.499476 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] Lock "13ba1e00-08ad-4da8-8258-92154f5925d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:28.499476 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Processing event network-vif-plugged-4709f63b-e1e2-40a4-b2eb-e246f257e437 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:34:28.499639 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Received event network-vif-plugged-4709f63b-e1e2-40a4-b2eb-e246f257e437 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:28.500201 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:34:28.500447 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] Acquiring lock "13ba1e00-08ad-4da8-8258-92154f5925d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:28.500447 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] Lock "13ba1e00-08ad-4da8-8258-92154f5925d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:28.500587 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] Lock "13ba1e00-08ad-4da8-8258-92154f5925d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:28.500763 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] No waiting events found dispatching network-vif-plugged-4709f63b-e1e2-40a4-b2eb-e246f257e437 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:34:28.500893 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Received unexpected event network-vif-plugged-4709f63b-e1e2-40a4-b2eb-e246f257e437 for instance with vm_state building and task_state spawning.
May 19 04:34:28.501043 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received event network-vif-plugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:28.501537 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] Acquiring lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:28.501750 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:28.501905 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:28.502217 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Processing event network-vif-plugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:34:28.502812 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received event network-vif-plugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:28.502812 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] Acquiring lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:28.502812 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:28.503548 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:28.505465 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:34:28.505643 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] No waiting events found dispatching network-vif-plugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:34:28.505819 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received unexpected event network-vif-plugged-13c0c2a4-ed11-438d-a852-17bc610c6269 for instance with vm_state building and task_state spawning.
May 19 04:34:28.506002 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Received event network-vif-unplugged-f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:28.506251 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] Acquiring lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:28.506607 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:34:28.507865 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:28.508323 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:28.508686 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] No waiting events found dispatching network-vif-unplugged-f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:34:28.508910 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-a85a6052-2359-4894-a0c7-c7d583604a61 req-d2a73474-f1f4-4bb7-9344-49ee6d67c61d service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Received unexpected event network-vif-unplugged-f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01 for instance with vm_state building and task_state spawning.
May 19 04:34:28.516874 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:34:28.519615 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Instance spawned successfully.
May 19 04:34:28.520624 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:34:28.522201 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Instance spawned successfully.
May 19 04:34:28.523094 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:34:28.725670 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Successfully created port: 6849a6ab-b169-4813-800c-3348010fa7b0 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:34:28.759716 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Updating instance_info_cache with network_info: [{"id": "f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01", "address": "fa:16:3e:df:6f:5d", "network": {"id": "73aac25c-954c-49db-a0fe-58650bbb516f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-765910815-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3244e0bf71164922b7a0e4cbbf0d01db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dbf2cc-42", "ovs_interfaceid": "f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:28.897427 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:28.897593 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:28.897935 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:28.898269 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:28.898571 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:28.898924 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:28.960268 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:28.965039 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:34:28.985630 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:34:29.037752 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:29.037930 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:29.040179 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:29.040179 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:29.040179 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:29.040179 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:29.047554 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:29.047727 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:29.048196 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:29.048502 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:29.048795 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:29.049060 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:29.167086 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:34:29.169131 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:34:29.262808 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Releasing lock "refresh_cache-8926c69b-c0ce-47e5-a3b6-ddbdeff44963" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:34:29.262808 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Instance network_info: |[{"id": "f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01", "address": "fa:16:3e:df:6f:5d", "network": {"id": "73aac25c-954c-49db-a0fe-58650bbb516f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-765910815-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3244e0bf71164922b7a0e4cbbf0d01db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dbf2cc-42", "ovs_interfaceid": "f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:34:29.268124 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Start _get_guest_xml network_info=[{"id": "f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01", "address": "fa:16:3e:df:6f:5d", "network": {"id": "73aac25c-954c-49db-a0fe-58650bbb516f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-765910815-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3244e0bf71164922b7a0e4cbbf0d01db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dbf2cc-42", "ovs_interfaceid": "f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:34:29.273355 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:34:29.273769 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-1915748245', uuid='8926c69b-c0ce-47e5-a3b6-ddbdeff44963'), owner=OwnerMeta(userid='38a001b8a8954c318a641c5482213944', username='tempest-VolumesAssistedSnapshotsTest-1721889722-project-member', projectid='3244e0bf71164922b7a0e4cbbf0d01db', projectname='tempest-VolumesAssistedSnapshotsTest-1721889722'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01", "address": "fa:16:3e:df:6f:5d", "network": {"id": "73aac25c-954c-49db-a0fe-58650bbb516f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-765910815-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3244e0bf71164922b7a0e4cbbf0d01db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dbf2cc-42", "ovs_interfaceid": "f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165269.273333) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:34:29.274958 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:34:29.275363 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:34:29.277209 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:34:29.277209 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:34:29.277209 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:34:29.278486 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:34:29.278486 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:34:29.279197 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:34:29.279447 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:34:29.279580 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:34:29.279702 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:34:29.279877 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:34:29.280043 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:34:29.280242 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:34:29.280459 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:34:29.280526 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:34:29.292080 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:34:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1915748245',display_name='tempest-VolumesAssistedSnapshotsTest-server-1915748245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesassistedsnapshotstest-server-1915748245',id=5,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfzymJ4MBS2XIGF74GX7KL8frgRs+juanN45/xEsGuMoCh+QNCsGyy93h6CaHxiJ0Bnrk7SuZ9+VbkXx7zMKw8lN3lx0+s3AP4lSZvDm9OzfkomoU+i+nzjCqfxVOxc7w==',key_name='tempest-keypair-2100770679',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3244e0bf71164922b7a0e4cbbf0d01db',ramdisk_id='',reservation_id='r-pzak64ur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1721889722',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1721889722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:34:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38a001b8a8954c318a641c5482213944',uuid=8926c69b-c0ce-47e5-a3b6-ddbdeff44963,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01", "address": "fa:16:3e:df:6f:5d", "network": {"id": "73aac25c-954c-49db-a0fe-58650bbb516f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-765910815-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3244e0bf71164922b7a0e4cbbf0d01db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dbf2cc-42", "ovs_interfaceid": "f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:34:29.292376 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Converting VIF {"id": "f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01", "address": "fa:16:3e:df:6f:5d", "network": {"id": "73aac25c-954c-49db-a0fe-58650bbb516f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-765910815-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3244e0bf71164922b7a0e4cbbf0d01db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dbf2cc-42", "ovs_interfaceid": "f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:34:29.293236 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:6f:5d,bridge_name='br-int',has_traffic_filtering=True,id=f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01,network=Network(73aac25c-954c-49db-a0fe-58650bbb516f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7dbf2cc-42') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:34:29.293746 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Lazy-loading 'pci_devices' on Instance uuid 8926c69b-c0ce-47e5-a3b6-ddbdeff44963 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:29.336731 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] No BDM found with device name sda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:29.336845 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] No BDM found with device name sdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:29.336965 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] No VIF found with MAC fa:16:3e:94:e5:3c, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:34:29.338713 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Using config drive
May 19 04:34:29.405683 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Took 14.76 seconds to spawn the instance on the hypervisor.
May 19 04:34:29.405683 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:29.423804 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Successfully updated port: 6849a6ab-b169-4813-800c-3348010fa7b0 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:34:29.468526 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:34:29.468837 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165269.468594, 13ba1e00-08ad-4da8-8258-92154f5925d2 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:29.469022 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] VM Paused (Lifecycle Event)
May 19 04:34:29.545895 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Took 19.38 seconds to spawn the instance on the hypervisor.
May 19 04:34:29.546152 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:29.555449 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Took 17.15 seconds to spawn the instance on the hypervisor.
May 19 04:34:29.555652 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:29.670633 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:34:29.796826 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] End _get_guest_xml xml=<domain type="qemu">
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:   <uuid>8926c69b-c0ce-47e5-a3b6-ddbdeff44963</uuid>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:   <name>instance-00000005</name>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1915748245</nova:name>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:34:29</nova:creationTime>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:         <nova:user uuid="38a001b8a8954c318a641c5482213944">tempest-VolumesAssistedSnapshotsTest-1721889722-project-member</nova:user>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:         <nova:project uuid="3244e0bf71164922b7a0e4cbbf0d01db">tempest-VolumesAssistedSnapshotsTest-1721889722</nova:project>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:         <nova:port uuid="f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01">
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     <system>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <entry name="serial">8926c69b-c0ce-47e5-a3b6-ddbdeff44963</entry>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <entry name="uuid">8926c69b-c0ce-47e5-a3b6-ddbdeff44963</entry>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     </system>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:   <os>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:   </os>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:   <features>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:   </features>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:   <devices>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/disk"/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     </disk>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/disk.config"/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     </disk>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:df:6f:5d"/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <target dev="tapf7dbf2cc-42"/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     </interface>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/console.log" append="off"/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     </serial>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     <video>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     </video>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     </rng>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:   </devices>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]: </domain>
May 19 04:34:29.796826 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:34:29.799885 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Preparing to wait for external event network-vif-plugged-f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:34:29.799885 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Acquiring lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:29.799885 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:29.799885 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:29.799885 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:34:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1915748245',display_name='tempest-VolumesAssistedSnapshotsTest-server-1915748245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesassistedsnapshotstest-server-1915748245',id=5,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfzymJ4MBS2XIGF74GX7KL8frgRs+juanN45/xEsGuMoCh+QNCsGyy93h6CaHxiJ0Bnrk7SuZ9+VbkXx7zMKw8lN3lx0+s3AP4lSZvDm9OzfkomoU+i+nzjCqfxVOxc7w==',key_name='tempest-keypair-2100770679',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3244e0bf71164922b7a0e4cbbf0d01db',ramdisk_id='',reservation_id='r-pzak64ur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1721889722',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1721889722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:34:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38a001b8a8954c318a641c5482213944',uuid=8926c69b-c0ce-47e5-a3b6-ddbdeff44963,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01", "address": "fa:16:3e:df:6f:5d", "network": {"id": "73aac25c-954c-49db-a0fe-58650bbb516f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-765910815-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3244e0bf71164922b7a0e4cbbf0d01db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dbf2cc-42", "ovs_interfaceid": "f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:34:29.803309 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Converting VIF {"id": "f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01", "address": "fa:16:3e:df:6f:5d", "network": {"id": "73aac25c-954c-49db-a0fe-58650bbb516f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-765910815-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3244e0bf71164922b7a0e4cbbf0d01db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dbf2cc-42", "ovs_interfaceid": "f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:34:29.803309 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:6f:5d,bridge_name='br-int',has_traffic_filtering=True,id=f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01,network=Network(73aac25c-954c-49db-a0fe-58650bbb516f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7dbf2cc-42') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:34:29.803309 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:6f:5d,bridge_name='br-int',has_traffic_filtering=True,id=f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01,network=Network(73aac25c-954c-49db-a0fe-58650bbb516f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7dbf2cc-42') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:34:29.803309 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:29.803309 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:29.803309 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:34:29.803309 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:29.803309 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c26c603b-6169-5af1-998c-e79d2c90213f', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:29.806708 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:29.807063 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:34:29.811703 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:29.815396 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:29.815577 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7dbf2cc-42, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:29.815883 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf7dbf2cc-42, col_values=(('qos', UUID('37830ec7-72c1-4f0b-b312-98ec247f8ed1')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:29.816048 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf7dbf2cc-42, col_values=(('external_ids', {'iface-id': 'f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:6f:5d', 'vm-uuid': '8926c69b-c0ce-47e5-a3b6-ddbdeff44963'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:29.819935 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:29.821225 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:34:29.829856 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:29.830962 np0000001025 nova-compute[97981]: INFO os_vif [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:6f:5d,bridge_name='br-int',has_traffic_filtering=True,id=f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01,network=Network(73aac25c-954c-49db-a0fe-58650bbb516f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7dbf2cc-42')
May 19 04:34:29.845276 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:29.897518 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:34:29.897753 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:34:29.898585 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:34:29.898585 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:34:29.898585 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:34:29.898585 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:34:29.898902 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:34:29.898997 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:34:29.899144 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:34:29.925514 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Took 22.99 seconds to build instance.
May 19 04:34:29.927343 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "refresh_cache-e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:34:29.927467 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquired lock "refresh_cache-e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:34:29.927579 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:34:29.972466 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:29.978128 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165269.9777336, 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:29.978349 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] VM Resumed (Lifecycle Event)
May 19 04:34:29.998865 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:34:29.999896 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:34:30.000898 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Creating image(s)
May 19 04:34:30.002530 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "/opt/stack/data/nova/instances/e662af2e-fcc4-4739-993c-c5e7f4ddfe9c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:30.002530 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "/opt/stack/data/nova/instances/e662af2e-fcc4-4739-993c-c5e7f4ddfe9c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:30.002530 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "/opt/stack/data/nova/instances/e662af2e-fcc4-4739-993c-c5e7f4ddfe9c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:30.003025 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:30.012653 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Creating config drive at /opt/stack/data/nova/instances/95780667-2e87-4bef-ab7f-f98ab044c03e/disk.config
May 19 04:34:30.013975 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:30.019153 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:30.036449 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/95780667-2e87-4bef-ab7f-f98ab044c03e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp430u98yp {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:30.069194 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Took 24.35 seconds to build instance.
May 19 04:34:30.076490 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/95780667-2e87-4bef-ab7f-f98ab044c03e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp430u98yp" returned: 0 in 0.041s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:30.095927 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Took 24.80 seconds to build instance.
May 19 04:34:30.106261 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.086s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:30.106261 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:30.106385 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:30.108676 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:30.116198 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:30.116545 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:30.181623 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.719s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:30.182261 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:34:30.192449 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.073s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:30.192449 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/e662af2e-fcc4-4739-993c-c5e7f4ddfe9c/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:30.238728 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/e662af2e-fcc4-4739-993c-c5e7f4ddfe9c/disk 1073741824" returned: 0 in 0.048s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:30.239507 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.133s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:30.239936 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:30.334375 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:30.334873 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e662af2e-fcc4-4739-993c-c5e7f4ddfe9c/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:34:30.335907 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e662af2e-fcc4-4739-993c-c5e7f4ddfe9c/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:30.405473 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:30.405728 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:30.408635 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:30.408635 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:34:30.426918 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e662af2e-fcc4-4739-993c-c5e7f4ddfe9c/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:30.426918 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Cannot resize image /opt/stack/data/nova/instances/e662af2e-fcc4-4739-993c-c5e7f4ddfe9c/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:34:30.427446 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:34:30.427658 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Ensure instance console log exists: /opt/stack/data/nova/instances/e662af2e-fcc4-4739-993c-c5e7f4ddfe9c/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:34:30.427947 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:30.428191 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:30.428364 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:30.430549 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be1dcf38-6161-4e5e-91d0-7445cb179007 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.512s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:30.481845 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:30.489394 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:34:30.494412 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-99e4561e-6186-488a-bd8c-c41937a33a33 req-19dcf083-af7f-4ece-b297-fb88ac88d525 service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received event network-vif-plugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:30.495503 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-99e4561e-6186-488a-bd8c-c41937a33a33 req-19dcf083-af7f-4ece-b297-fb88ac88d525 service nova] Acquiring lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:30.496200 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-99e4561e-6186-488a-bd8c-c41937a33a33 req-19dcf083-af7f-4ece-b297-fb88ac88d525 service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:30.496200 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-99e4561e-6186-488a-bd8c-c41937a33a33 req-19dcf083-af7f-4ece-b297-fb88ac88d525 service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:30.496200 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-99e4561e-6186-488a-bd8c-c41937a33a33 req-19dcf083-af7f-4ece-b297-fb88ac88d525 service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] No waiting events found dispatching network-vif-plugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:34:30.496200 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-99e4561e-6186-488a-bd8c-c41937a33a33 req-19dcf083-af7f-4ece-b297-fb88ac88d525 service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received unexpected event network-vif-plugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 for instance with vm_state active and task_state rescuing.
May 19 04:34:30.500830 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:34:30.575293 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ed259532-c326-443a-9c94-fe257117a39e tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "13ba1e00-08ad-4da8-8258-92154f5925d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.859s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:30.580434 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9c5e38dd-755a-46a4-9b3e-716f8f086c0a req-a6201537-7d77-4a16-8ea2-1b6f8d86cf6d service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Received event network-changed-6849a6ab-b169-4813-800c-3348010fa7b0 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:30.580611 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9c5e38dd-755a-46a4-9b3e-716f8f086c0a req-a6201537-7d77-4a16-8ea2-1b6f8d86cf6d service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Refreshing instance network info cache due to event network-changed-6849a6ab-b169-4813-800c-3348010fa7b0. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:34:30.580789 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9c5e38dd-755a-46a4-9b3e-716f8f086c0a req-a6201537-7d77-4a16-8ea2-1b6f8d86cf6d service nova] Acquiring lock "refresh_cache-e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:34:30.598300 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4d8c1b56-656b-4773-8412-c9eb73df1456 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.308s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:30.611240 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:30.637074 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:30.639092 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:30.669618 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Rescuing
May 19 04:34:30.669935 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "refresh_cache-5f3f7abc-978d-4a0e-8ae1-0d813ad77f35" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:34:30.669935 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquired lock "refresh_cache-5f3f7abc-978d-4a0e-8ae1-0d813ad77f35" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:34:30.670029 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:34:30.696780 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:34:30.697512 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:34:30.698102 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:30.698530 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:30.738045 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:30.748146 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:30.804011 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8208ac95cdcb4481a05d42b29f73dde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907951cd15704c2d968614f909b64ba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:34:30.984307 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:30.992349 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] During sync_power_state the instance has a pending task (rescuing). Skip.
May 19 04:34:30.992456 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165270.992172, 13ba1e00-08ad-4da8-8258-92154f5925d2 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:30.992569 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] VM Resumed (Lifecycle Event)
May 19 04:34:30.994908 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:30.996671 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:31.020143 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:31.030186 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:31.089634 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Updating instance_info_cache with network_info: [{"id": "6849a6ab-b169-4813-800c-3348010fa7b0", "address": "fa:16:3e:a0:92:d3", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6849a6ab-b1", "ovs_interfaceid": "6849a6ab-b169-4813-800c-3348010fa7b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:31.174498 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:31.198509 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:34:31.361874 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:31.362075 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:31.362320 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] No VIF found with MAC fa:16:3e:df:6f:5d, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:34:31.362791 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Using config drive
May 19 04:34:31.488180 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Successfully created port: 87877be0-a885-4589-913e-29c2dcd6900b {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:34:31.495668 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:31.499511 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:34:31.591806 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Releasing lock "refresh_cache-e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:34:31.592602 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Instance network_info: |[{"id": "6849a6ab-b169-4813-800c-3348010fa7b0", "address": "fa:16:3e:a0:92:d3", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6849a6ab-b1", "ovs_interfaceid": "6849a6ab-b169-4813-800c-3348010fa7b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:34:31.595571 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Start _get_guest_xml network_info=[{"id": "6849a6ab-b169-4813-800c-3348010fa7b0", "address": "fa:16:3e:a0:92:d3", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6849a6ab-b1", "ovs_interfaceid": "6849a6ab-b169-4813-800c-3348010fa7b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:34:31.597988 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9c5e38dd-755a-46a4-9b3e-716f8f086c0a req-a6201537-7d77-4a16-8ea2-1b6f8d86cf6d service nova] Acquired lock "refresh_cache-e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:34:31.598211 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-9c5e38dd-755a-46a4-9b3e-716f8f086c0a req-a6201537-7d77-4a16-8ea2-1b6f8d86cf6d service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Refreshing network info cache for port 6849a6ab-b169-4813-800c-3348010fa7b0 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:34:31.603007 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:34:31.604512 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-1885948312-1', uuid='e662af2e-fcc4-4739-993c-c5e7f4ddfe9c'), owner=OwnerMeta(userid='8208ac95cdcb4481a05d42b29f73dde7', username='tempest-TestMultiAttachVolumeSwap-626733199-project-member', projectid='907951cd15704c2d968614f909b64ba7', projectname='tempest-TestMultiAttachVolumeSwap-626733199'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6849a6ab-b169-4813-800c-3348010fa7b0", "address": "fa:16:3e:a0:92:d3", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6849a6ab-b1", "ovs_interfaceid": "6849a6ab-b169-4813-800c-3348010fa7b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165271.6040695) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:34:31.608126 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:34:31.608126 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:34:31.610344 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:34:31.610568 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:34:31.611672 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:34:31.612050 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:34:31.612850 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:34:31.612850 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:34:31.612850 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:34:31.612850 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:34:31.612850 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:34:31.613060 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:34:31.613060 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:34:31.613611 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:34:31.613763 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:34:31.613920 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:34:31.631761 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:34:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1885948312-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testmultiattachvolumeswap-server-1885948312-1',id=6,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBlbq6k8T9MvQtAuYFhs0QFZxUnnQjQyrWjfLxAsKArz2JlbeiPt2SLV4E6hoFHQPVljrrHfmQGLTXhTv4UPGHJX4/ywJEjnH+yns7x73S9HX7FJlJHKkQgW1cLyfqzxg==',key_name='tempest-keypair-811971859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='907951cd15704c2d968614f909b64ba7',ramdisk_id='',reservation_id='r-v021aa8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-626733199',owner_user_name='tempest-TestMultiAttachVolumeSwap-626733199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:34:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8208ac95cdcb4481a05d42b29f73dde7',uuid=e662af2e-fcc4-4739-993c-c5e7f4ddfe9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6849a6ab-b169-4813-800c-3348010fa7b0", "address": "fa:16:3e:a0:92:d3", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6849a6ab-b1", "ovs_interfaceid": "6849a6ab-b169-4813-800c-3348010fa7b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:34:31.631979 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Converting VIF {"id": "6849a6ab-b169-4813-800c-3348010fa7b0", "address": "fa:16:3e:a0:92:d3", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6849a6ab-b1", "ovs_interfaceid": "6849a6ab-b169-4813-800c-3348010fa7b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:34:31.632746 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:92:d3,bridge_name='br-int',has_traffic_filtering=True,id=6849a6ab-b169-4813-800c-3348010fa7b0,network=Network(8000cc8e-b893-4034-9989-dea929ab765c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6849a6ab-b1') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:34:31.633691 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lazy-loading 'pci_devices' on Instance uuid e662af2e-fcc4-4739-993c-c5e7f4ddfe9c {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:31.705443 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:34:31.745739 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:31.868331 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:31.879912 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95780667-2e87-4bef-ab7f-f98ab044c03e/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:31.957706 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95780667-2e87-4bef-ab7f-f98ab044c03e/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:31.958339 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95780667-2e87-4bef-ab7f-f98ab044c03e/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:32.004869 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165272.0043964, 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:32.005035 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] VM Resumed (Lifecycle Event)
May 19 04:34:32.043962 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95780667-2e87-4bef-ab7f-f98ab044c03e/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:32.048716 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:32.106234 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-9c5e38dd-755a-46a4-9b3e-716f8f086c0a req-a6201537-7d77-4a16-8ea2-1b6f8d86cf6d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:32.137727 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] End _get_guest_xml xml=<domain type="qemu">
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:   <uuid>e662af2e-fcc4-4739-993c-c5e7f4ddfe9c</uuid>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:   <name>instance-00000006</name>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-1885948312-1</nova:name>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:34:31</nova:creationTime>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:         <nova:user uuid="8208ac95cdcb4481a05d42b29f73dde7">tempest-TestMultiAttachVolumeSwap-626733199-project-member</nova:user>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:         <nova:project uuid="907951cd15704c2d968614f909b64ba7">tempest-TestMultiAttachVolumeSwap-626733199</nova:project>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:         <nova:port uuid="6849a6ab-b169-4813-800c-3348010fa7b0">
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     <system>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <entry name="serial">e662af2e-fcc4-4739-993c-c5e7f4ddfe9c</entry>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <entry name="uuid">e662af2e-fcc4-4739-993c-c5e7f4ddfe9c</entry>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     </system>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:   <os>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:   </os>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:   <features>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:   </features>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:   <devices>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/e662af2e-fcc4-4739-993c-c5e7f4ddfe9c/disk"/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     </disk>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/e662af2e-fcc4-4739-993c-c5e7f4ddfe9c/disk.config"/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     </disk>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:a0:92:d3"/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <target dev="tap6849a6ab-b1"/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     </interface>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/e662af2e-fcc4-4739-993c-c5e7f4ddfe9c/console.log" append="off"/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     </serial>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     <video>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     </video>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     </rng>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:   </devices>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]: </domain>
May 19 04:34:32.137727 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:34:32.140068 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Preparing to wait for external event network-vif-plugged-6849a6ab-b169-4813-800c-3348010fa7b0 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:34:32.140068 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:32.140068 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:32.140068 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:32.140558 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:34:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1885948312-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testmultiattachvolumeswap-server-1885948312-1',id=6,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBlbq6k8T9MvQtAuYFhs0QFZxUnnQjQyrWjfLxAsKArz2JlbeiPt2SLV4E6hoFHQPVljrrHfmQGLTXhTv4UPGHJX4/ywJEjnH+yns7x73S9HX7FJlJHKkQgW1cLyfqzxg==',key_name='tempest-keypair-811971859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='907951cd15704c2d968614f909b64ba7',ramdisk_id='',reservation_id='r-v021aa8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-626733199',owner_user_name='tempest-TestMultiAttachVolumeSwap-626733199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:34:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8208ac95cdcb4481a05d42b29f73dde7',uuid=e662af2e-fcc4-4739-993c-c5e7f4ddfe9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6849a6ab-b169-4813-800c-3348010fa7b0", "address": "fa:16:3e:a0:92:d3", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6849a6ab-b1", "ovs_interfaceid": "6849a6ab-b169-4813-800c-3348010fa7b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:34:32.140883 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Converting VIF {"id": "6849a6ab-b169-4813-800c-3348010fa7b0", "address": "fa:16:3e:a0:92:d3", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6849a6ab-b1", "ovs_interfaceid": "6849a6ab-b169-4813-800c-3348010fa7b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:34:32.141612 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:92:d3,bridge_name='br-int',has_traffic_filtering=True,id=6849a6ab-b169-4813-800c-3348010fa7b0,network=Network(8000cc8e-b893-4034-9989-dea929ab765c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6849a6ab-b1') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:34:32.142255 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:92:d3,bridge_name='br-int',has_traffic_filtering=True,id=6849a6ab-b169-4813-800c-3348010fa7b0,network=Network(8000cc8e-b893-4034-9989-dea929ab765c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6849a6ab-b1') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:34:32.142634 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:32.142922 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:32.143621 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:34:32.144440 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:32.145317 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:32.145524 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '78077701-d364-5aa7-9a55-dd5333602fb4', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:32.146645 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:32.148531 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:34:32.159484 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:32.174869 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:32.174869 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6849a6ab-b1, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:32.174869 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6849a6ab-b1, col_values=(('qos', UUID('fed81468-5172-49b0-b8e1-87220fbc9421')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:32.174869 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6849a6ab-b1, col_values=(('external_ids', {'iface-id': '6849a6ab-b169-4813-800c-3348010fa7b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:92:d3', 'vm-uuid': 'e662af2e-fcc4-4739-993c-c5e7f4ddfe9c'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:32.178459 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:34:32.185533 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:32.187001 np0000001025 nova-compute[97981]: INFO os_vif [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:92:d3,bridge_name='br-int',has_traffic_filtering=True,id=6849a6ab-b169-4813-800c-3348010fa7b0,network=Network(8000cc8e-b893-4034-9989-dea929ab765c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6849a6ab-b1')
May 19 04:34:32.240136 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:32.250431 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:32.346530 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:32.347364 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:32.417214 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/disk --force-share --output=json" returned: 0 in 0.070s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:32.418323 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Periodic task is updating the host stat, it is trying to get disk instance-00000005, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/disk.config'
May 19 04:34:32.421285 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13ba1e00-08ad-4da8-8258-92154f5925d2/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:32.517916 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:32.521611 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:34:32.528535 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13ba1e00-08ad-4da8-8258-92154f5925d2/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:32.529637 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13ba1e00-08ad-4da8-8258-92154f5925d2/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:32.593193 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Acquiring lock "13ba1e00-08ad-4da8-8258-92154f5925d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:32.596253 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "13ba1e00-08ad-4da8-8258-92154f5925d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:32.629629 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13ba1e00-08ad-4da8-8258-92154f5925d2/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:32.635988 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:32.659961 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:32.711276 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d723761c-f7ea-4cc8-aa9f-1d0dfa978a5c req-75a31a8f-7916-404f-9c7c-ad409d96b61d service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Received event network-vif-plugged-c1cf7ee2-df61-4771-ae64-c1eb09722516 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:32.717336 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d723761c-f7ea-4cc8-aa9f-1d0dfa978a5c req-75a31a8f-7916-404f-9c7c-ad409d96b61d service nova] Acquiring lock "95780667-2e87-4bef-ab7f-f98ab044c03e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:32.717336 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d723761c-f7ea-4cc8-aa9f-1d0dfa978a5c req-75a31a8f-7916-404f-9c7c-ad409d96b61d service nova] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:32.717608 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d723761c-f7ea-4cc8-aa9f-1d0dfa978a5c req-75a31a8f-7916-404f-9c7c-ad409d96b61d service nova] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:32.717882 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d723761c-f7ea-4cc8-aa9f-1d0dfa978a5c req-75a31a8f-7916-404f-9c7c-ad409d96b61d service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Processing event network-vif-plugged-c1cf7ee2-df61-4771-ae64-c1eb09722516 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:34:32.718182 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d723761c-f7ea-4cc8-aa9f-1d0dfa978a5c req-75a31a8f-7916-404f-9c7c-ad409d96b61d service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Received event network-vif-plugged-c1cf7ee2-df61-4771-ae64-c1eb09722516 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:32.718405 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d723761c-f7ea-4cc8-aa9f-1d0dfa978a5c req-75a31a8f-7916-404f-9c7c-ad409d96b61d service nova] Acquiring lock "95780667-2e87-4bef-ab7f-f98ab044c03e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:32.718579 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d723761c-f7ea-4cc8-aa9f-1d0dfa978a5c req-75a31a8f-7916-404f-9c7c-ad409d96b61d service nova] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:32.722978 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:34:32.724709 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:34:32.726128 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d723761c-f7ea-4cc8-aa9f-1d0dfa978a5c req-75a31a8f-7916-404f-9c7c-ad409d96b61d service nova] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:32.726377 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d723761c-f7ea-4cc8-aa9f-1d0dfa978a5c req-75a31a8f-7916-404f-9c7c-ad409d96b61d service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] No waiting events found dispatching network-vif-plugged-c1cf7ee2-df61-4771-ae64-c1eb09722516 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:34:32.726694 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-d723761c-f7ea-4cc8-aa9f-1d0dfa978a5c req-75a31a8f-7916-404f-9c7c-ad409d96b61d service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Received unexpected event network-vif-plugged-c1cf7ee2-df61-4771-ae64-c1eb09722516 for instance with vm_state building and task_state spawning.
May 19 04:34:32.727271 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:34:32.728577 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Creating image(s)
May 19 04:34:32.729467 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:32.730370 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:32.730873 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "/opt/stack/data/nova/instances/f71811d1-b0ad-48f9-ba04-9a6e517961b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:32.731536 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:34:32.743030 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "/opt/stack/data/nova/instances/f71811d1-b0ad-48f9-ba04-9a6e517961b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:32.751960 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "/opt/stack/data/nova/instances/f71811d1-b0ad-48f9-ba04-9a6e517961b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.020s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:32.754540 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:32.758775 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:32.759662 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Instance spawned successfully.
May 19 04:34:32.760565 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:34:32.761390 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:32.786398 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:32.786889 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:32.788568 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:32.789208 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:32.851910 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:32.855750 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:34:32.856643 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:32.868276 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:32.881639 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.120s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:32.882606 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:32.883916 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:32.885207 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:32.891191 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:32.891798 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.035s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:32.892787 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=14711MB free_disk=74.80347442626953GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:34:32.893456 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:32.893695 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:32.894157 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:32.966952 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Successfully updated port: 87877be0-a885-4589-913e-29c2dcd6900b {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:34:32.982725 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.089s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:32.983129 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/f71811d1-b0ad-48f9-ba04-9a6e517961b9/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:33.031148 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165273.0305917, 95780667-2e87-4bef-ab7f-f98ab044c03e => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:33.031337 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] VM Started (Lifecycle Event)
May 19 04:34:33.034660 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/f71811d1-b0ad-48f9-ba04-9a6e517961b9/disk 1073741824" returned: 0 in 0.051s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:33.036291 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.152s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:33.036742 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:33.062051 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-44bc4f35-b50b-4052-be78-df4a07e2a274 req-69ace7b0-2d7e-4dd1-90e5-c5ce8af30f25 service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Received event network-changed-87877be0-a885-4589-913e-29c2dcd6900b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:33.063328 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-44bc4f35-b50b-4052-be78-df4a07e2a274 req-69ace7b0-2d7e-4dd1-90e5-c5ce8af30f25 service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Refreshing instance network info cache due to event network-changed-87877be0-a885-4589-913e-29c2dcd6900b. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:34:33.063636 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-44bc4f35-b50b-4052-be78-df4a07e2a274 req-69ace7b0-2d7e-4dd1-90e5-c5ce8af30f25 service nova] Acquiring lock "refresh_cache-f71811d1-b0ad-48f9-ba04-9a6e517961b9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:34:33.063944 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-44bc4f35-b50b-4052-be78-df4a07e2a274 req-69ace7b0-2d7e-4dd1-90e5-c5ce8af30f25 service nova] Acquired lock "refresh_cache-f71811d1-b0ad-48f9-ba04-9a6e517961b9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:34:33.065964 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-44bc4f35-b50b-4052-be78-df4a07e2a274 req-69ace7b0-2d7e-4dd1-90e5-c5ce8af30f25 service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Refreshing network info cache for port 87877be0-a885-4589-913e-29c2dcd6900b {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:34:33.103265 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lazy-loading 'flavor' on Instance uuid 13ba1e00-08ad-4da8-8258-92154f5925d2 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:33.164968 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.128s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:33.167419 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f71811d1-b0ad-48f9-ba04-9a6e517961b9/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:34:33.167419 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71811d1-b0ad-48f9-ba04-9a6e517961b9/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:33.241935 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71811d1-b0ad-48f9-ba04-9a6e517961b9/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:33.243021 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Cannot resize image /opt/stack/data/nova/instances/f71811d1-b0ad-48f9-ba04-9a6e517961b9/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:34:33.243356 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:34:33.243513 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Ensure instance console log exists: /opt/stack/data/nova/instances/f71811d1-b0ad-48f9-ba04-9a6e517961b9/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:34:33.243788 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:33.244005 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:33.244153 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:33.299073 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Took 9.11 seconds to spawn the instance on the hypervisor.
May 19 04:34:33.300634 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:33.317194 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Creating config drive at /opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/disk.config
May 19 04:34:33.325186 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdnpf90kd {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:33.365225 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdnpf90kd" returned: 0 in 0.040s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:33.472930 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "refresh_cache-f71811d1-b0ad-48f9-ba04-9a6e517961b9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:34:33.534536 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:33.541144 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:34:33.574210 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-44bc4f35-b50b-4052-be78-df4a07e2a274 req-69ace7b0-2d7e-4dd1-90e5-c5ce8af30f25 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:33.722782 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:33.723648 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:33.723648 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] No VIF found with MAC fa:16:3e:a0:92:d3, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:34:33.723648 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Using config drive
May 19 04:34:33.815568 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Took 14.61 seconds to build instance.
May 19 04:34:33.978219 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:33.994207 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:34:33.994581 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 13ba1e00-08ad-4da8-8258-92154f5925d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:34:33.994581 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:34:33.994581 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 95780667-2e87-4bef-ab7f-f98ab044c03e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:34:33.995304 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 8926c69b-c0ce-47e5-a3b6-ddbdeff44963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:34:33.995304 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance e662af2e-fcc4-4739-993c-c5e7f4ddfe9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:34:33.995304 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance f71811d1-b0ad-48f9-ba04-9a6e517961b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:34:33.995304 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:34:33.995451 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=1856MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:34:32 up 25 min,  2 users,  load average: 4.54, 2.25, 1.14\n', 'num_instances': '7', 'num_vm_active': '3', 'num_task_None': '2', 'num_os_type_None': '7', 'num_proj_334b83c8d3714844830f961673658b20': '2', 'io_workload': '5', 'num_proj_45d20e935bfe484890e9cc58ce28186e': '1', 'num_task_rescuing': '1', 'num_vm_building': '4', 'num_task_spawning': '4', 'num_proj_6417ad7b082a41bc9af43c57fb87ee89': '1', 'num_proj_3244e0bf71164922b7a0e4cbbf0d01db': '1', 'num_proj_907951cd15704c2d968614f909b64ba7': '2'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:34:34.010335 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:34.045055 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165274.0447636, 95780667-2e87-4bef-ab7f-f98ab044c03e => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:34.045236 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] VM Paused (Lifecycle Event)
May 19 04:34:34.072471 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:34.117161 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "13ba1e00-08ad-4da8-8258-92154f5925d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.523s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:34.219302 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:34.230571 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:34.248620 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:34.321897 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-227c2736-6ed0-4f3a-af28-3725fe11f59b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.121s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:34.325819 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-44bc4f35-b50b-4052-be78-df4a07e2a274 req-69ace7b0-2d7e-4dd1-90e5-c5ce8af30f25 service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:34:34.429566 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:34.438425 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:34.445373 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:34.462552 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:34.470901 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:34.560346 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:34.563695 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165274.5634124, 95780667-2e87-4bef-ab7f-f98ab044c03e => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:34.564629 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] VM Resumed (Lifecycle Event)
May 19 04:34:34.598309 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:34:34.598309 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:34:34.766478 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Creating config drive at /opt/stack/data/nova/instances/e662af2e-fcc4-4739-993c-c5e7f4ddfe9c/disk.config
May 19 04:34:34.778945 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e662af2e-fcc4-4739-993c-c5e7f4ddfe9c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe7psnoys {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:34.837868 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e662af2e-fcc4-4739-993c-c5e7f4ddfe9c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe7psnoys" returned: 0 in 0.060s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:34.873203 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Updating instance_info_cache with network_info: [{"id": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "address": "fa:16:3e:8a:28:ef", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91a50f4f-e3", "ovs_interfaceid": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:34.912143 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-9c5e38dd-755a-46a4-9b3e-716f8f086c0a req-a6201537-7d77-4a16-8ea2-1b6f8d86cf6d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:35.029337 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-44bc4f35-b50b-4052-be78-df4a07e2a274 req-69ace7b0-2d7e-4dd1-90e5-c5ce8af30f25 service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:35.072680 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:35.077054 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:34:35.109854 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:34:35.210910 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-652e879f-b650-4242-b93a-dc3a6d6b66d6 req-287fbdf6-07fb-4c83-afa7-0e22e5d34a29 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Received event network-vif-plugged-f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:35.210910 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-652e879f-b650-4242-b93a-dc3a6d6b66d6 req-287fbdf6-07fb-4c83-afa7-0e22e5d34a29 service nova] Acquiring lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:35.210910 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-652e879f-b650-4242-b93a-dc3a6d6b66d6 req-287fbdf6-07fb-4c83-afa7-0e22e5d34a29 service nova] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:35.210910 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-652e879f-b650-4242-b93a-dc3a6d6b66d6 req-287fbdf6-07fb-4c83-afa7-0e22e5d34a29 service nova] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:35.210910 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-652e879f-b650-4242-b93a-dc3a6d6b66d6 req-287fbdf6-07fb-4c83-afa7-0e22e5d34a29 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Processing event network-vif-plugged-f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:34:35.258372 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:34:35.265827 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:34:35.277554 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Instance spawned successfully.
May 19 04:34:35.278019 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:34:35.377952 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Releasing lock "refresh_cache-5f3f7abc-978d-4a0e-8ae1-0d813ad77f35" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:34:35.466463 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:35.496163 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:35.499777 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:35.535752 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-44bc4f35-b50b-4052-be78-df4a07e2a274 req-69ace7b0-2d7e-4dd1-90e5-c5ce8af30f25 service nova] Releasing lock "refresh_cache-f71811d1-b0ad-48f9-ba04-9a6e517961b9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:34:35.540592 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquired lock "refresh_cache-f71811d1-b0ad-48f9-ba04-9a6e517961b9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:34:35.540917 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:34:35.588437 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165275.5842528, 8926c69b-c0ce-47e5-a3b6-ddbdeff44963 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:35.588437 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] VM Started (Lifecycle Event)
May 19 04:34:35.631803 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:34:35.631803 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.737s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:35.633226 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 56.71 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:34:35.710310 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:35.800002 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:35.800002 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:35.800002 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:35.800002 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:35.800389 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:35.800723 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:35.839256 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-9c5e38dd-755a-46a4-9b3e-716f8f086c0a req-a6201537-7d77-4a16-8ea2-1b6f8d86cf6d service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Updated VIF entry in instance network info cache for port 6849a6ab-b169-4813-800c-3348010fa7b0. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:34:35.842495 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-9c5e38dd-755a-46a4-9b3e-716f8f086c0a req-a6201537-7d77-4a16-8ea2-1b6f8d86cf6d service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Updating instance_info_cache with network_info: [{"id": "6849a6ab-b169-4813-800c-3348010fa7b0", "address": "fa:16:3e:a0:92:d3", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6849a6ab-b1", "ovs_interfaceid": "6849a6ab-b169-4813-800c-3348010fa7b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:35.893897 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Acquiring lock "13ba1e00-08ad-4da8-8258-92154f5925d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:35.894387 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "13ba1e00-08ad-4da8-8258-92154f5925d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:35.894387 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Attaching volume e6477f41-82fa-4ab4-951b-147262445739 to /dev/vdb
May 19 04:34:35.994093 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:36.003697 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:34:36.003903 np0000001025 nova-compute[97981]: INFO oslo.privsep.daemon [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp0qtb3ckv/privsep.sock']
May 19 04:34:36.017952 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:36.019567 np0000001025 sudo[110366]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp0qtb3ckv/privsep.sock
May 19 04:34:36.020793 np0000001025 sudo[110366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 19 04:34:36.090400 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:36.094021 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:34:36.306724 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Took 9.68 seconds to spawn the instance on the hypervisor.
May 19 04:34:36.306959 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:36.344199 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9c5e38dd-755a-46a4-9b3e-716f8f086c0a req-a6201537-7d77-4a16-8ea2-1b6f8d86cf6d service nova] Releasing lock "refresh_cache-e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:34:36.353555 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:34:36.369464 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 19 04:34:36.369643 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 19 04:34:36.369643 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 19 04:34:36.369643 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: 
May 19 04:34:36.370142 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 19 04:34:36.372245 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 19 04:34:36.372422 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 19 04:34:36.372507 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: 
May 19 04:34:36.372553 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 19 04:34:36.596853 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:34:36.597318 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165276.596925, 8926c69b-c0ce-47e5-a3b6-ddbdeff44963 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:36.597363 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] VM Paused (Lifecycle Event)
May 19 04:34:36.750139 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 19 04:34:36.750139 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 19 04:34:36.750139 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 19 04:34:36.750139 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: 
May 19 04:34:36.750139 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 19 04:34:36.750139 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 19 04:34:36.750139 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 19 04:34:36.750139 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log: 
May 19 04:34:36.750139 np0000001025 nova-compute[97981]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 19 04:34:36.833015 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Took 17.00 seconds to build instance.
May 19 04:34:37.027905 np0000001025 sudo[110366]: pam_unix(sudo:session): session closed for user root
May 19 04:34:37.030085 np0000001025 nova-compute[97981]: INFO oslo.privsep.daemon [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Spawned new privsep daemon via rootwrap
May 19 04:34:37.111493 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:37.123572 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-63173223-978e-4165-82aa-cb46328ee408 req-cdcefa98-645d-47c3-84f8-0b7763ead8ba service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Received event network-vif-plugged-6849a6ab-b169-4813-800c-3348010fa7b0 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:37.123572 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-63173223-978e-4165-82aa-cb46328ee408 req-cdcefa98-645d-47c3-84f8-0b7763ead8ba service nova] Acquiring lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:37.123572 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-63173223-978e-4165-82aa-cb46328ee408 req-cdcefa98-645d-47c3-84f8-0b7763ead8ba service nova] Lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:37.123572 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-63173223-978e-4165-82aa-cb46328ee408 req-cdcefa98-645d-47c3-84f8-0b7763ead8ba service nova] Lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:37.123572 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-63173223-978e-4165-82aa-cb46328ee408 req-cdcefa98-645d-47c3-84f8-0b7763ead8ba service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Processing event network-vif-plugged-6849a6ab-b169-4813-800c-3348010fa7b0 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:34:37.127154 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:37.131268 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:34:37.134195 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165277.1332312, 8926c69b-c0ce-47e5-a3b6-ddbdeff44963 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:37.134195 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] VM Resumed (Lifecycle Event)
May 19 04:34:37.140739 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:34:37.146027 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Instance spawned successfully.
May 19 04:34:37.146343 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:34:37.151248 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:37.175509 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:37.209540 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:34:37.209997 np0000001025 nova-compute[97981]: WARNING os_brick.initiator.connectors.nvmeof [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
May 19 04:34:37.245570 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:37.278154 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:34:37.281350 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:34:37.298004 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:34:37.305294 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fec3:abf5', 'fe80::fc16:3eff:fe81:2190', 'fe80::e86a:f3ff:fee3:83a1', 'fe80::fc44:afff:fef1:f9f8', 'fe80::fc16:3eff:fe94:e53c', 'fe80::986d:f6ff:feb5:7cbc', 'fe80::fc16:3eff:fedf:6f5d', 'fe80::2c03:76ff:fe4b:5798', 'fe80::fc16:3eff:fea0:92d3', 'fe80::98fd:dbff:fefe:cdf5'] 
May 19 04:34:37.305645 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:34:37.305781 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:34:37.306164 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] <== get_connector_properties: return (1302ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:34:37.306502 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Updating existing volume attachment record: 9c9a68c6-76ca-4a4b-a8aa-bc3cdd09a63b {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:34:37.316687 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:37.329966 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-25032b58-af18-4558-9966-2c84f4e990f2 req-81c9e8c6-e1ef-491f-84ab-fed50707d169 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Received event network-vif-plugged-f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:37.332900 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-25032b58-af18-4558-9966-2c84f4e990f2 req-81c9e8c6-e1ef-491f-84ab-fed50707d169 service nova] Acquiring lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:37.334184 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-25032b58-af18-4558-9966-2c84f4e990f2 req-81c9e8c6-e1ef-491f-84ab-fed50707d169 service nova] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:37.334979 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-25032b58-af18-4558-9966-2c84f4e990f2 req-81c9e8c6-e1ef-491f-84ab-fed50707d169 service nova] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:37.335241 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-25032b58-af18-4558-9966-2c84f4e990f2 req-81c9e8c6-e1ef-491f-84ab-fed50707d169 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] No waiting events found dispatching network-vif-plugged-f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:34:37.335994 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-25032b58-af18-4558-9966-2c84f4e990f2 req-81c9e8c6-e1ef-491f-84ab-fed50707d169 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Received unexpected event network-vif-plugged-f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01 for instance with vm_state active and task_state None.
May 19 04:34:37.340147 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a79ff13-8800-4ab3-9ae2-2887e37ea002 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.518s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:37.415961 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:37.439307 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:37.456622 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:37.457420 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:37.474332 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Instance destroyed successfully.
May 19 04:34:37.475008 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'numa_topology' on Instance uuid 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:37.479702 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:37.614146 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:37.621271 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:37.642377 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:37.647920 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:34:37.669977 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:37.669977 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:37.669977 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:37.673063 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:37.673063 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:37.673063 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:37.801397 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:37.811389 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:37.866756 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:37.969095 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:37.969095 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:37.969095 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connector [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Factory for ISCSI on None {{(pid=97981) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}}
May 19 04:34:37.969625 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:37.969909 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:34:37.970680 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739', 'iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6477f41-82fa-4ab4-951b-147262445739', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:34:37.970680 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:34:37.971094 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:34:37.971638 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739', 'iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6477f41-82fa-4ab4-951b-147262445739', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:34:37.977215 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-bbc202ee-9283-400e-bb3a-f9a5e7e29fef req-93b772aa-00a6-4ad1-81d3-6088e032955f service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Received event network-changed-c1cf7ee2-df61-4771-ae64-c1eb09722516 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:37.980589 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-bbc202ee-9283-400e-bb3a-f9a5e7e29fef req-93b772aa-00a6-4ad1-81d3-6088e032955f service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Refreshing instance network info cache due to event network-changed-c1cf7ee2-df61-4771-ae64-c1eb09722516. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:34:37.980692 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bbc202ee-9283-400e-bb3a-f9a5e7e29fef req-93b772aa-00a6-4ad1-81d3-6088e032955f service nova] Acquiring lock "refresh_cache-95780667-2e87-4bef-ab7f-f98ab044c03e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:34:37.981159 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bbc202ee-9283-400e-bb3a-f9a5e7e29fef req-93b772aa-00a6-4ad1-81d3-6088e032955f service nova] Acquired lock "refresh_cache-95780667-2e87-4bef-ab7f-f98ab044c03e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:34:37.981159 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-bbc202ee-9283-400e-bb3a-f9a5e7e29fef req-93b772aa-00a6-4ad1-81d3-6088e032955f service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Refreshing network info cache for port c1cf7ee2-df61-4771-ae64-c1eb09722516 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:34:37.994208 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Attempting rescue
May 19 04:34:37.994208 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=97981) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 19 04:34:38.000306 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:34:38.000306 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:34:38.000306 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:34:38.002813 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:34:38.003601 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:34:38.004237 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:34:38.007740 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Instance directory exists: not creating {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 19 04:34:38.007740 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Creating image(s)
May 19 04:34:38.008758 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:38.009035 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "/opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:38.010481 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "/opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:38.011923 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:38.022953 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:34:38.022953 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:34:38.024200 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:34:38.024200 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:34:38.029169 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Updating instance_info_cache with network_info: [{"id": "87877be0-a885-4589-913e-29c2dcd6900b", "address": "fa:16:3e:ca:fa:0b", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877be0-a8", "ovs_interfaceid": "87877be0-a885-4589-913e-29c2dcd6900b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:38.039411 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739] added
May 19 04:34:38.039411 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:34:38.039411 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:34:38.039411 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:34:38.039411 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:34:38.039411 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:34:38.039411 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:34:38.039785 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:34:38.039958 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0397(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:34:38.040122 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:34:38.050851 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739] added
May 19 04:34:38.050851 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:34:38.050851 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:34:38.050851 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:34:38.050851 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:34:38.050851 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:34:38.050851 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:34:38.051907 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:34:38.052390 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0481(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:34:38.052390 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:34:38.151167 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165278.1508482, e662af2e-fcc4-4739-993c-c5e7f4ddfe9c => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:38.151384 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] VM Started (Lifecycle Event)
May 19 04:34:38.181155 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Took 8.18 seconds to spawn the instance on the hypervisor.
May 19 04:34:38.181297 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:38.354854 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:38.488461 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-bbc202ee-9283-400e-bb3a-f9a5e7e29fef req-93b772aa-00a6-4ad1-81d3-6088e032955f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:38.513155 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Object Instance<5f3f7abc-978d-4a0e-8ae1-0d813ad77f35> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:34:38.514971 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:38.520931 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:38.525975 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:38.525975 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:38.525975 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:38.530786 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:38.532130 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:38.558259 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Releasing lock "refresh_cache-f71811d1-b0ad-48f9-ba04-9a6e517961b9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:34:38.559089 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Instance network_info: |[{"id": "87877be0-a885-4589-913e-29c2dcd6900b", "address": "fa:16:3e:ca:fa:0b", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877be0-a8", "ovs_interfaceid": "87877be0-a885-4589-913e-29c2dcd6900b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:34:38.566651 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Start _get_guest_xml network_info=[{"id": "87877be0-a885-4589-913e-29c2dcd6900b", "address": "fa:16:3e:ca:fa:0b", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877be0-a8", "ovs_interfaceid": "87877be0-a885-4589-913e-29c2dcd6900b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:34:38.580286 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:34:38.582700 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-1885948312-2', uuid='f71811d1-b0ad-48f9-ba04-9a6e517961b9'), owner=OwnerMeta(userid='8208ac95cdcb4481a05d42b29f73dde7', username='tempest-TestMultiAttachVolumeSwap-626733199-project-member', projectid='907951cd15704c2d968614f909b64ba7', projectname='tempest-TestMultiAttachVolumeSwap-626733199'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "87877be0-a885-4589-913e-29c2dcd6900b", "address": "fa:16:3e:ca:fa:0b", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877be0-a8", "ovs_interfaceid": "87877be0-a885-4589-913e-29c2dcd6900b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165278.5805788) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:34:38.584990 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:34:38.585540 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:34:38.590400 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:34:38.590891 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:34:38.592048 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:34:38.592048 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:34:38.592048 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:34:38.592618 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:34:38.592618 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:34:38.592618 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:34:38.592618 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:34:38.592742 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:34:38.592891 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:34:38.593008 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:34:38.597464 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:34:38.597736 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:34:38.637773 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.105s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:38.640903 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.rescue {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:38.665145 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:38.678083 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:34:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1885948312-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testmultiattachvolumeswap-server-1885948312-2',id=7,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBlbq6k8T9MvQtAuYFhs0QFZxUnnQjQyrWjfLxAsKArz2JlbeiPt2SLV4E6hoFHQPVljrrHfmQGLTXhTv4UPGHJX4/ywJEjnH+yns7x73S9HX7FJlJHKkQgW1cLyfqzxg==',key_name='tempest-keypair-811971859',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='907951cd15704c2d968614f909b64ba7',ramdisk_id='',reservation_id='r-v021aa8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-626733199',owner_user_name='tempest-TestMultiAttachVolumeSwap-626733199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:34:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8208ac95cdcb4481a05d42b29f73dde7',uuid=f71811d1-b0ad-48f9-ba04-9a6e517961b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87877be0-a885-4589-913e-29c2dcd6900b", "address": "fa:16:3e:ca:fa:0b", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877be0-a8", "ovs_interfaceid": "87877be0-a885-4589-913e-29c2dcd6900b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:34:38.679142 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Converting VIF {"id": "87877be0-a885-4589-913e-29c2dcd6900b", "address": "fa:16:3e:ca:fa:0b", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877be0-a8", "ovs_interfaceid": "87877be0-a885-4589-913e-29c2dcd6900b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:34:38.679923 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:fa:0b,bridge_name='br-int',has_traffic_filtering=True,id=87877be0-a885-4589-913e-29c2dcd6900b,network=Network(8000cc8e-b893-4034-9989-dea929ab765c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87877be0-a8') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:34:38.680832 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lazy-loading 'pci_devices' on Instance uuid f71811d1-b0ad-48f9-ba04-9a6e517961b9 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:38.683120 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:34:38.710490 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Took 13.88 seconds to build instance.
May 19 04:34:38.714898 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.rescue" returned: 0 in 0.072s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:38.716356 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:38.716641 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'migration_context' on Instance uuid 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:39.044059 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:34:39.052949 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:34:39.065684 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:34:39.065684 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:34:39.075219 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:34:39.075219 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:34:39.089685 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:34:39.098856 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:34:39.110068 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 19 04:34:39.110068 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:34:39.110068 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 19 04:34:39.110068 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:34:39.110068 np0000001025 nova-compute[97981]: WARNING os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 19 04:34:39.110068 np0000001025 nova-compute[97981]: 
May 19 04:34:39.118578 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 19 04:34:39.118578 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:34:39.118743 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 19 04:34:39.118743 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:34:39.119464 np0000001025 nova-compute[97981]: WARNING os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 19 04:34:39.119464 np0000001025 nova-compute[97981]: 
May 19 04:34:39.135310 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-bbc202ee-9283-400e-bb3a-f9a5e7e29fef req-93b772aa-00a6-4ad1-81d3-6088e032955f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:39.187135 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] End _get_guest_xml xml=<domain type="qemu">
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:   <uuid>f71811d1-b0ad-48f9-ba04-9a6e517961b9</uuid>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:   <name>instance-00000007</name>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-1885948312-2</nova:name>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:34:38</nova:creationTime>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:         <nova:user uuid="8208ac95cdcb4481a05d42b29f73dde7">tempest-TestMultiAttachVolumeSwap-626733199-project-member</nova:user>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:         <nova:project uuid="907951cd15704c2d968614f909b64ba7">tempest-TestMultiAttachVolumeSwap-626733199</nova:project>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:         <nova:port uuid="87877be0-a885-4589-913e-29c2dcd6900b">
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     <system>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <entry name="serial">f71811d1-b0ad-48f9-ba04-9a6e517961b9</entry>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <entry name="uuid">f71811d1-b0ad-48f9-ba04-9a6e517961b9</entry>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     </system>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:   <os>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:   </os>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:   <features>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:   </features>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:   <devices>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/f71811d1-b0ad-48f9-ba04-9a6e517961b9/disk"/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     </disk>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/f71811d1-b0ad-48f9-ba04-9a6e517961b9/disk.config"/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     </disk>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:ca:fa:0b"/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <target dev="tap87877be0-a8"/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     </interface>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/f71811d1-b0ad-48f9-ba04-9a6e517961b9/console.log" append="off"/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     </serial>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     <video>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     </video>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     </rng>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:   </devices>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]: </domain>
May 19 04:34:39.187135 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:34:39.187135 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Preparing to wait for external event network-vif-plugged-87877be0-a885-4589-913e-29c2dcd6900b {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:34:39.190314 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:39.190314 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:39.190314 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:39.196004 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:34:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1885948312-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testmultiattachvolumeswap-server-1885948312-2',id=7,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBlbq6k8T9MvQtAuYFhs0QFZxUnnQjQyrWjfLxAsKArz2JlbeiPt2SLV4E6hoFHQPVljrrHfmQGLTXhTv4UPGHJX4/ywJEjnH+yns7x73S9HX7FJlJHKkQgW1cLyfqzxg==',key_name='tempest-keypair-811971859',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='907951cd15704c2d968614f909b64ba7',ramdisk_id='',reservation_id='r-v021aa8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-626733199',owner_user_name='tempest-TestMultiAttachVolumeSwap-626733199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:34:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8208ac95cdcb4481a05d42b29f73dde7',uuid=f71811d1-b0ad-48f9-ba04-9a6e517961b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87877be0-a885-4589-913e-29c2dcd6900b", "address": "fa:16:3e:ca:fa:0b", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877be0-a8", "ovs_interfaceid": "87877be0-a885-4589-913e-29c2dcd6900b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:34:39.196185 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Converting VIF {"id": "87877be0-a885-4589-913e-29c2dcd6900b", "address": "fa:16:3e:ca:fa:0b", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877be0-a8", "ovs_interfaceid": "87877be0-a885-4589-913e-29c2dcd6900b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:34:39.196857 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:fa:0b,bridge_name='br-int',has_traffic_filtering=True,id=87877be0-a885-4589-913e-29c2dcd6900b,network=Network(8000cc8e-b893-4034-9989-dea929ab765c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87877be0-a8') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:34:39.197231 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:fa:0b,bridge_name='br-int',has_traffic_filtering=True,id=87877be0-a885-4589-913e-29c2dcd6900b,network=Network(8000cc8e-b893-4034-9989-dea929ab765c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87877be0-a8') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:34:39.198012 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:39.199868 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165279.1955893, e662af2e-fcc4-4739-993c-c5e7f4ddfe9c => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:39.200695 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:39.200695 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:34:39.202004 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:39.202417 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] VM Paused (Lifecycle Event)
May 19 04:34:39.204016 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31b656dc-85f2-5595-ae90-6a6e09fcec59', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:39.205916 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:39.209868 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:34:39.212430 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:39.216128 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.394s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:39.219504 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:39.219784 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87877be0-a8, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:39.220402 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87877be0-a8, col_values=(('qos', UUID('c8b0d373-df6c-410a-9de3-f28bcaf7234a')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:39.220497 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87877be0-a8, col_values=(('external_ids', {'iface-id': '87877be0-a885-4589-913e-29c2dcd6900b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:fa:0b', 'vm-uuid': 'f71811d1-b0ad-48f9-ba04-9a6e517961b9'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:39.221754 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:39.224037 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:34:39.224361 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Object Instance<5f3f7abc-978d-4a0e-8ae1-0d813ad77f35> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:34:39.224718 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:34:39.225355 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Start _get_guest_xml network_info=[{"id": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "address": "fa:16:3e:8a:28:ef", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "vif_mac": "fa:16:3e:8a:28:ef"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91a50f4f-e3", "ovs_interfaceid": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:34:39.225589 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'resources' on Instance uuid 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:39.239200 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:39.239441 np0000001025 nova-compute[97981]: INFO os_vif [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:fa:0b,bridge_name='br-int',has_traffic_filtering=True,id=87877be0-a885-4589-913e-29c2dcd6900b,network=Network(8000cc8e-b893-4034-9989-dea929ab765c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87877be0-a8')
May 19 04:34:39.385168 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a2569f69-6581-446c-b351-317dc4e89c04 req-9004ec3b-e95d-41df-b46c-be4ac8937252 service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Received event network-vif-plugged-6849a6ab-b169-4813-800c-3348010fa7b0 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:39.385357 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a2569f69-6581-446c-b351-317dc4e89c04 req-9004ec3b-e95d-41df-b46c-be4ac8937252 service nova] Acquiring lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:39.385412 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a2569f69-6581-446c-b351-317dc4e89c04 req-9004ec3b-e95d-41df-b46c-be4ac8937252 service nova] Lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:39.385618 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a2569f69-6581-446c-b351-317dc4e89c04 req-9004ec3b-e95d-41df-b46c-be4ac8937252 service nova] Lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:39.389459 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a2569f69-6581-446c-b351-317dc4e89c04 req-9004ec3b-e95d-41df-b46c-be4ac8937252 service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] No waiting events found dispatching network-vif-plugged-6849a6ab-b169-4813-800c-3348010fa7b0 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:34:39.389660 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-a2569f69-6581-446c-b351-317dc4e89c04 req-9004ec3b-e95d-41df-b46c-be4ac8937252 service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Received unexpected event network-vif-plugged-6849a6ab-b169-4813-800c-3348010fa7b0 for instance with vm_state active and task_state None.
May 19 04:34:39.393255 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-bbc202ee-9283-400e-bb3a-f9a5e7e29fef req-93b772aa-00a6-4ad1-81d3-6088e032955f service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Updated VIF entry in instance network info cache for port c1cf7ee2-df61-4771-ae64-c1eb09722516. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:34:39.395194 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-bbc202ee-9283-400e-bb3a-f9a5e7e29fef req-93b772aa-00a6-4ad1-81d3-6088e032955f service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Updating instance_info_cache with network_info: [{"id": "c1cf7ee2-df61-4771-ae64-c1eb09722516", "address": "fa:16:3e:94:e5:3c", "network": {"id": "5f3c92cb-a2be-4e71-9708-047a0a006bec", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1354251025-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6417ad7b082a41bc9af43c57fb87ee89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1cf7ee2-df", "ovs_interfaceid": "c1cf7ee2-df61-4771-ae64-c1eb09722516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:39.711432 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:39.713044 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165279.7126706, e662af2e-fcc4-4739-993c-c5e7f4ddfe9c => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:39.713144 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] VM Resumed (Lifecycle Event)
May 19 04:34:39.733588 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Object Instance<5f3f7abc-978d-4a0e-8ae1-0d813ad77f35> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:34:39.735924 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:34:39.737743 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-843635983', uuid='5f3f7abc-978d-4a0e-8ae1-0d813ad77f35'), owner=OwnerMeta(userid='7cdf106961084f0e941b5b65911c9b76', username='tempest-ServerRescueNegativeTestJSON-1305117099-project-member', projectid='334b83c8d3714844830f961673658b20', projectname='tempest-ServerRescueNegativeTestJSON-1305117099'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "address": "fa:16:3e:8a:28:ef", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "vif_mac": "fa:16:3e:8a:28:ef"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91a50f4f-e3", "ovs_interfaceid": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165279.7372482) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:34:39.738754 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:34:39.739073 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:34:39.739863 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:34:39.739863 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:34:39.740860 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:34:39.741063 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:34:39.741244 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:34:39.741362 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:34:39.741488 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:34:39.741568 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:34:39.741652 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:34:39.741787 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:34:39.741903 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:34:39.742013 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:34:39.742102 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:34:39.742491 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:34:39.742781 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:39.897227 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bbc202ee-9283-400e-bb3a-f9a5e7e29fef req-93b772aa-00a6-4ad1-81d3-6088e032955f service nova] Releasing lock "refresh_cache-95780667-2e87-4bef-ab7f-f98ab044c03e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:34:40.080246 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b41be57f-7b36-40ef-b2e9-039f23c0766a req-cb93804e-b4e9-46a6-89f6-ff7154df60d2 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Received event network-changed-f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:40.080246 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b41be57f-7b36-40ef-b2e9-039f23c0766a req-cb93804e-b4e9-46a6-89f6-ff7154df60d2 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Refreshing instance network info cache due to event network-changed-f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:34:40.080246 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b41be57f-7b36-40ef-b2e9-039f23c0766a req-cb93804e-b4e9-46a6-89f6-ff7154df60d2 service nova] Acquiring lock "refresh_cache-8926c69b-c0ce-47e5-a3b6-ddbdeff44963" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:34:40.080246 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b41be57f-7b36-40ef-b2e9-039f23c0766a req-cb93804e-b4e9-46a6-89f6-ff7154df60d2 service nova] Acquired lock "refresh_cache-8926c69b-c0ce-47e5-a3b6-ddbdeff44963" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:34:40.080246 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-b41be57f-7b36-40ef-b2e9-039f23c0766a req-cb93804e-b4e9-46a6-89f6-ff7154df60d2 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Refreshing network info cache for port f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:34:40.174515 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739, portal: 192.168.40.100,3260]
May 19 04:34:40.174515 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739, portal: 192.168.40.100,3260] successful.
May 19 04:34:40.174515 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:34:40.183465 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739, portal: 192.168.50.100,3260]
May 19 04:34:40.183465 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739, portal: 192.168.50.100,3260] successful.
May 19 04:34:40.183465 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:34:40.191209 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:34:40.198668 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:34:40.206079 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739 (non-flash)
May 19 04:34:40.206079 np0000001025 nova-compute[97981]: tcp: [2] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739 (non-flash)
May 19 04:34:40.206079 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:34:40.206079 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsi session list stdout=tcp: [1] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739 (non-flash)
May 19 04:34:40.206079 np0000001025 nova-compute[97981]: tcp: [2] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739 (non-flash)
May 19 04:34:40.206079 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:34:40.206079 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.206s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:34:40.206763 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:34:40.207557 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] HCTL ('7', '-', '-', 0) found on session 1 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:34:40.207557 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:34:40.215498 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739 (non-flash)
May 19 04:34:40.215498 np0000001025 nova-compute[97981]: tcp: [2] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739 (non-flash)
May 19 04:34:40.215498 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:34:40.215498 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsi session list stdout=tcp: [1] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739 (non-flash)
May 19 04:34:40.215498 np0000001025 nova-compute[97981]: tcp: [2] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739 (non-flash)
May 19 04:34:40.215498 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:34:40.215498 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.211s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:34:40.215498 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:34:40.215498 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] HCTL ('8', '-', '-', 0) found on session 2 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:34:40.215498 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:34:40.216496 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:40.228397 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:34:40.244239 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Searching for a device in session 2 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:34:40.244239 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e6477f41-82fa-4ab4-951b-147262445739', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:34:40.244933 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Searching for a device in session 1 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:34:40.245051 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6477f41-82fa-4ab4-951b-147262445739', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:34:40.245991 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Object Instance<5f3f7abc-978d-4a0e-8ae1-0d813ad77f35> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:34:40.263675 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-843635983',display_name='tempest-ServerRescueNegativeTestJSON-server-843635983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverrescuenegativetestjson-server-843635983',id=3,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:34:29Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='334b83c8d3714844830f961673658b20',ramdisk_id='',reservation_id='r-gxkwrxjh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1305117099',owner_user_name='tempest-ServerRescueNegativeTestJSON-1305117099-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:34:29Z,user_data=None,user_id='7cdf106961084f0e941b5b65911c9b76',uuid=5f3f7abc-978d-4a0e-8ae1-0d813ad77f35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "address": "fa:16:3e:8a:28:ef", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "vif_mac": "fa:16:3e:8a:28:ef"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91a50f4f-e3", "ovs_interfaceid": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:34:40.265765 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converting VIF {"id": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "address": "fa:16:3e:8a:28:ef", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "vif_mac": "fa:16:3e:8a:28:ef"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91a50f4f-e3", "ovs_interfaceid": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:34:40.267515 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:28:ef,bridge_name='br-int',has_traffic_filtering=True,id=91a50f4f-e3ff-4e6f-80f9-472e706603f0,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91a50f4f-e3') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:34:40.268662 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:40.585223 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-b41be57f-7b36-40ef-b2e9-039f23c0766a req-cb93804e-b4e9-46a6-89f6-ff7154df60d2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:40.738542 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999229782999919 future=<Future at 0x7218506f88c0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:34:40.738925 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.998834572000078 future=<Future at 0x7218506f88c0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:34:40.739078 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.998651041999892 future=<Future at 0x7218506f88c0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:34:40.770316 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Object Instance<5f3f7abc-978d-4a0e-8ae1-0d813ad77f35> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:34:40.772272 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] End _get_guest_xml xml=<domain type="qemu">
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:   <uuid>5f3f7abc-978d-4a0e-8ae1-0d813ad77f35</uuid>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:   <name>instance-00000003</name>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-843635983</nova:name>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:34:39</nova:creationTime>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:           <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:           <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:         <nova:user uuid="7cdf106961084f0e941b5b65911c9b76">tempest-ServerRescueNegativeTestJSON-1305117099-project-member</nova:user>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:         <nova:project uuid="334b83c8d3714844830f961673658b20">tempest-ServerRescueNegativeTestJSON-1305117099</nova:project>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:         <nova:port uuid="91a50f4f-e3ff-4e6f-80f9-472e706603f0">
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     <system>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <entry name="serial">5f3f7abc-978d-4a0e-8ae1-0d813ad77f35</entry>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <entry name="uuid">5f3f7abc-978d-4a0e-8ae1-0d813ad77f35</entry>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     </system>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:   <os>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:   </os>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:   <features>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:   </features>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:   <devices>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.rescue"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     </disk>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <target dev="vdb" bus="virtio"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     </disk>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.config.rescue"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     </disk>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:8a:28:ef"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <target dev="tap91a50f4f-e3"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     </interface>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/console.log" append="off"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     </serial>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     <video>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     </video>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     </rng>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:   </devices>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]: </domain>
May 19 04:34:40.772272 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:34:40.774502 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:40.774502 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:40.774502 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] No VIF found with MAC fa:16:3e:ca:fa:0b, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:34:40.777153 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Using config drive
May 19 04:34:40.779359 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Instance destroyed successfully.
May 19 04:34:41.004470 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:34:41.052034 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-b41be57f-7b36-40ef-b2e9-039f23c0766a req-cb93804e-b4e9-46a6-89f6-ff7154df60d2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:41.237535 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-b41be57f-7b36-40ef-b2e9-039f23c0766a req-cb93804e-b4e9-46a6-89f6-ff7154df60d2 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Updated VIF entry in instance network info cache for port f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:34:41.237864 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-b41be57f-7b36-40ef-b2e9-039f23c0766a req-cb93804e-b4e9-46a6-89f6-ff7154df60d2 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Updating instance_info_cache with network_info: [{"id": "f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01", "address": "fa:16:3e:df:6f:5d", "network": {"id": "73aac25c-954c-49db-a0fe-58650bbb516f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-765910815-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3244e0bf71164922b7a0e4cbbf0d01db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dbf2cc-42", "ovs_interfaceid": "f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:41.283893 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:41.503357 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Creating config drive at /opt/stack/data/nova/instances/f71811d1-b0ad-48f9-ba04-9a6e517961b9/disk.config
May 19 04:34:41.510791 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f71811d1-b0ad-48f9-ba04-9a6e517961b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpib5tg4ur {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:41.532302 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "6ea060d2-e149-4189-b93b-66ce319b9157" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:41.533328 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "6ea060d2-e149-4189-b93b-66ce319b9157" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:41.553761 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f71811d1-b0ad-48f9-ba04-9a6e517961b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpib5tg4ur" returned: 0 in 0.043s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:41.744279 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b41be57f-7b36-40ef-b2e9-039f23c0766a req-cb93804e-b4e9-46a6-89f6-ff7154df60d2 service nova] Releasing lock "refresh_cache-8926c69b-c0ce-47e5-a3b6-ddbdeff44963" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:34:42.026801 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Found WWN 33000000068b82e18 for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:34:42.027459 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.056s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:34:42.027675 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] <== connect_volume: return (4056ms) {'type': 'block', 'scsi_wwn': '33000000068b82e18', 'path': '/dev/dm-0', 'multipath_id': '33000000068b82e18'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:34:42.027856 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000068b82e18', 'path': '/dev/dm-0', 'multipath_id': '33000000068b82e18'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:34:42.035613 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lazy-loading 'flavor' on Instance uuid 13ba1e00-08ad-4da8-8258-92154f5925d2 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:42.046657 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:34:42.095918 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:42.130005 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:42.137169 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:42.253385 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:42.299855 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:42.304786 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:42.305057 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:42.305192 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:42.305390 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No VIF found with MAC fa:16:3e:8a:28:ef, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:34:42.306316 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Using config drive
May 19 04:34:42.310280 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:42.539400 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Attempting to attach volume e6477f41-82fa-4ab4-951b-147262445739 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:34:42.540304 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:34:42.540304 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:34:42.540304 np0000001025 nova-compute[97981]:   <alias name="ua-e6477f41-82fa-4ab4-951b-147262445739"/>
May 19 04:34:42.540304 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:34:42.540304 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:34:42.540304 np0000001025 nova-compute[97981]:   <serial>e6477f41-82fa-4ab4-951b-147262445739</serial>
May 19 04:34:42.540304 np0000001025 nova-compute[97981]: </disk>
May 19 04:34:42.540304 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:34:42.618668 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:42.619158 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:42.624690 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:34:42.624819 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Claim successful on node np0000001025
May 19 04:34:42.809750 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'ec2_ids' on Instance uuid 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:42.877607 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:43.070964 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165283.0703633, f71811d1-b0ad-48f9-ba04-9a6e517961b9 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:43.074663 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] VM Started (Lifecycle Event)
May 19 04:34:43.315127 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Object Instance<5f3f7abc-978d-4a0e-8ae1-0d813ad77f35> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:34:43.315127 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'keypairs' on Instance uuid 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:43.569240 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:43.580189 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:43.584024 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165283.583029, f71811d1-b0ad-48f9-ba04-9a6e517961b9 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:43.584024 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] VM Paused (Lifecycle Event)
May 19 04:34:43.790544 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:43.818174 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Object Instance<5f3f7abc-978d-4a0e-8ae1-0d813ad77f35> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:34:43.822886 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:44.053381 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Creating config drive at /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.config.rescue
May 19 04:34:44.062741 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp965vupq {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:44.089802 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:44.093814 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:34:44.100711 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp965vupq" returned: 0 in 0.037s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:44.221681 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:44.241080 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:44.241783 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:44.241993 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:44.242148 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] No VIF found with MAC fa:16:3e:c3:ab:f5, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:34:44.246255 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:34:44.246526 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:34:44.599643 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:34:44.725660 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:44.752994 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:34:44.777744 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:44.906532 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:44.916508 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:44.916508 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:45.156500 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2012f7d0-9c5f-410c-ade5-9fb0c5e44d30 req-0b4d4551-8b88-40cc-a1f7-9780f330ea6e service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received event network-vif-unplugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:45.156500 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2012f7d0-9c5f-410c-ade5-9fb0c5e44d30 req-0b4d4551-8b88-40cc-a1f7-9780f330ea6e service nova] Acquiring lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:45.156500 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2012f7d0-9c5f-410c-ade5-9fb0c5e44d30 req-0b4d4551-8b88-40cc-a1f7-9780f330ea6e service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:45.156500 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2012f7d0-9c5f-410c-ade5-9fb0c5e44d30 req-0b4d4551-8b88-40cc-a1f7-9780f330ea6e service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:45.161361 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2012f7d0-9c5f-410c-ade5-9fb0c5e44d30 req-0b4d4551-8b88-40cc-a1f7-9780f330ea6e service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] No waiting events found dispatching network-vif-unplugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:34:45.163287 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-2012f7d0-9c5f-410c-ade5-9fb0c5e44d30 req-0b4d4551-8b88-40cc-a1f7-9780f330ea6e service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received unexpected event network-vif-unplugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 for instance with vm_state active and task_state rescuing.
May 19 04:34:45.304969 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.684s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:45.304969 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:34:45.379379 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f0411b9a-4ba4-4ad0-baef-23637802f7c6 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "13ba1e00-08ad-4da8-8258-92154f5925d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.485s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:45.819875 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:34:45.821057 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:34:45.821057 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:45.821057 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:45.934409 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Removed pending STOPPED event for 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35 due to new event <LifecycleEvent: 1779165285.9339359, 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35 => Resumed> {{(pid=97981) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 19 04:34:45.934978 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165285.9339359, 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:45.934978 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] VM Resumed (Lifecycle Event)
May 19 04:34:45.949631 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3172afdb-3dbf-49eb-a963-cd694dea3345 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:45.961973 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Acquiring lock "13ba1e00-08ad-4da8-8258-92154f5925d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:45.962220 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "13ba1e00-08ad-4da8-8258-92154f5925d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:45.962463 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Acquiring lock "13ba1e00-08ad-4da8-8258-92154f5925d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:45.964654 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "13ba1e00-08ad-4da8-8258-92154f5925d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:45.964821 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "13ba1e00-08ad-4da8-8258-92154f5925d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:45.975850 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cde403fc60ce4630af81e6bdfa2b4603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34124f30156425cbda16473ccedeff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:34:45.980665 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Terminating instance
May 19 04:34:46.324862 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:34:46.348998 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:46.437328 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:46.441763 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:34:46.486543 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:34:46.509429 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:46.511975 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:46.535389 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:46.540374 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:46.566386 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:46.696169 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1625085d-668a-47d7-84f9-baa01b480b86 req-872809e3-ffb8-4f5f-aff3-1b8b2adb10e1 service nova] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Received event network-vif-unplugged-4709f63b-e1e2-40a4-b2eb-e246f257e437 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:46.696363 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1625085d-668a-47d7-84f9-baa01b480b86 req-872809e3-ffb8-4f5f-aff3-1b8b2adb10e1 service nova] Acquiring lock "13ba1e00-08ad-4da8-8258-92154f5925d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:46.696483 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1625085d-668a-47d7-84f9-baa01b480b86 req-872809e3-ffb8-4f5f-aff3-1b8b2adb10e1 service nova] Lock "13ba1e00-08ad-4da8-8258-92154f5925d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:46.696579 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1625085d-668a-47d7-84f9-baa01b480b86 req-872809e3-ffb8-4f5f-aff3-1b8b2adb10e1 service nova] Lock "13ba1e00-08ad-4da8-8258-92154f5925d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:46.696710 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1625085d-668a-47d7-84f9-baa01b480b86 req-872809e3-ffb8-4f5f-aff3-1b8b2adb10e1 service nova] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] No waiting events found dispatching network-vif-unplugged-4709f63b-e1e2-40a4-b2eb-e246f257e437 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:34:46.696793 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1625085d-668a-47d7-84f9-baa01b480b86 req-872809e3-ffb8-4f5f-aff3-1b8b2adb10e1 service nova] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Received event network-vif-unplugged-4709f63b-e1e2-40a4-b2eb-e246f257e437 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:34:46.832051 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:34:46.850551 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Instance destroyed successfully.
May 19 04:34:46.850978 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lazy-loading 'resources' on Instance uuid 13ba1e00-08ad-4da8-8258-92154f5925d2 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:46.944299 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165286.9437468, 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:46.944299 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] VM Started (Lifecycle Event)
May 19 04:34:47.068507 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Successfully created port: 7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:34:47.293383 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received event network-vif-unplugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:47.294614 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Acquiring lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:47.294769 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:47.294876 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:47.294994 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] No waiting events found dispatching network-vif-unplugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:34:47.295133 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received unexpected event network-vif-unplugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 for instance with vm_state rescued and task_state None.
May 19 04:34:47.295283 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received event network-vif-plugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:47.295461 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Acquiring lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:47.295679 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:47.295868 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:47.296012 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] No waiting events found dispatching network-vif-plugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:34:47.296159 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received unexpected event network-vif-plugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 for instance with vm_state rescued and task_state None.
May 19 04:34:47.296259 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received event network-vif-plugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:47.296408 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Acquiring lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:47.296545 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:47.296671 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:47.296800 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] No waiting events found dispatching network-vif-plugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:34:47.296900 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received unexpected event network-vif-plugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 for instance with vm_state rescued and task_state None.
May 19 04:34:47.297004 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received event network-vif-unplugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:47.297165 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Acquiring lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:47.297291 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:47.297404 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:47.297498 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] No waiting events found dispatching network-vif-unplugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:34:47.297611 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received unexpected event network-vif-unplugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 for instance with vm_state rescued and task_state None.
May 19 04:34:47.297701 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received event network-vif-unplugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:47.297834 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Acquiring lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:47.300007 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:47.300007 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:47.300007 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] No waiting events found dispatching network-vif-unplugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:34:47.300007 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received unexpected event network-vif-unplugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 for instance with vm_state rescued and task_state None.
May 19 04:34:47.300007 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Received event network-vif-plugged-87877be0-a885-4589-913e-29c2dcd6900b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:47.300201 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Acquiring lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:47.300818 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:47.300932 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:47.301116 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Processing event network-vif-plugged-87877be0-a885-4589-913e-29c2dcd6900b {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:34:47.301365 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Received event network-vif-plugged-87877be0-a885-4589-913e-29c2dcd6900b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:47.301494 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Acquiring lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:47.301675 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:47.301886 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:47.301886 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] No waiting events found dispatching network-vif-plugged-87877be0-a885-4589-913e-29c2dcd6900b {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:34:47.302042 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Received unexpected event network-vif-plugged-87877be0-a885-4589-913e-29c2dcd6900b for instance with vm_state building and task_state spawning.
May 19 04:34:47.303932 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:34:47.304393 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received event network-vif-plugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:47.305287 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Acquiring lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:47.305287 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:47.305409 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:47.305474 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] No waiting events found dispatching network-vif-plugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:34:47.305670 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-72aac6d6-7f4d-47c6-b977-e8ed59d1f99b req-3031d368-e353-42ba-81a9-f8cd80730adc service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received unexpected event network-vif-plugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 for instance with vm_state rescued and task_state None.
May 19 04:34:47.308895 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:34:47.313758 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Instance spawned successfully.
May 19 04:34:47.314251 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:34:47.354925 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1277794978',display_name='tempest-DeleteServersTestJSON-server-1277794978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-deleteserverstestjson-server-1277794978',id=2,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:34:29Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45d20e935bfe484890e9cc58ce28186e',ramdisk_id='',reservation_id='r-filcpli6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1086734078',owner_user_name='tempest-DeleteServersTestJSON-1086734078-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:34:30Z,user_data=None,user_id='4760ff7f5fb748adb8f905519b7d139d',uuid=13ba1e00-08ad-4da8-8258-92154f5925d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4709f63b-e1e2-40a4-b2eb-e246f257e437", "address": "fa:16:3e:c3:ab:f5", "network": {"id": "5dba6c16-14eb-438d-a91c-e4f4c65a6894", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1814314607-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45d20e935bfe484890e9cc58ce28186e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4709f63b-e1", "ovs_interfaceid": "4709f63b-e1e2-40a4-b2eb-e246f257e437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:34:47.357694 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Converting VIF {"id": "4709f63b-e1e2-40a4-b2eb-e246f257e437", "address": "fa:16:3e:c3:ab:f5", "network": {"id": "5dba6c16-14eb-438d-a91c-e4f4c65a6894", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1814314607-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45d20e935bfe484890e9cc58ce28186e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4709f63b-e1", "ovs_interfaceid": "4709f63b-e1e2-40a4-b2eb-e246f257e437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:34:47.358607 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ab:f5,bridge_name='br-int',has_traffic_filtering=True,id=4709f63b-e1e2-40a4-b2eb-e246f257e437,network=Network(5dba6c16-14eb-438d-a91c-e4f4c65a6894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4709f63b-e1') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:34:47.358945 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ab:f5,bridge_name='br-int',has_traffic_filtering=True,id=4709f63b-e1e2-40a4-b2eb-e246f257e437,network=Network(5dba6c16-14eb-438d-a91c-e4f4c65a6894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4709f63b-e1') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:34:47.361067 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:47.363149 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4709f63b-e1, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:47.364130 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:47.366826 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:34:47.372317 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:47.372794 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49b19b4d-77a0-4185-8a6e-c49f3deb60b3) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:47.376879 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:47.378468 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:34:47.384171 np0000001025 nova-compute[97981]: INFO os_vif [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ab:f5,bridge_name='br-int',has_traffic_filtering=True,id=4709f63b-e1e2-40a4-b2eb-e246f257e437,network=Network(5dba6c16-14eb-438d-a91c-e4f4c65a6894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4709f63b-e1')
May 19 04:34:47.386342 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:34:47.386765 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739', 'iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6477f41-82fa-4ab4-951b-147262445739', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:34:47.386965 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:34:47.387399 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:34:47.387722 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739', 'iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6477f41-82fa-4ab4-951b-147262445739', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:34:47.387860 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:34:47.418196 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739 (non-flash)
May 19 04:34:47.418196 np0000001025 nova-compute[97981]: tcp: [2] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739 (non-flash)
May 19 04:34:47.418196 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:34:47.418759 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsi session list stdout=tcp: [1] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739 (non-flash)
May 19 04:34:47.418759 np0000001025 nova-compute[97981]: tcp: [2] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739 (non-flash)
May 19 04:34:47.418759 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:34:47.418759 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739', '1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739', '2')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:34:47.418759 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739', '1')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:34:47.421011 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739', '2')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:34:47.421618 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218503f7a60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739'): ({'sdb'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:34:47.421826 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Removing multipathed devices sdc, sdb {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:34:47.422053 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Flush multipath device 33000000068b82e18 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:34:47.447911 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:47.456667 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:34:47.457906 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:34:47.506032 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:34:47.556504 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:34:47.556645 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:34:47.558316 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:34:47.583594 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:34:47.583813 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:34:47.605053 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:34:47.645995 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 1, target: iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739, portal: 192.168.40.100,3260]
May 19 04:34:47.645995 np0000001025 nova-compute[97981]: Logout of [sid: 1, target: iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739, portal: 192.168.40.100,3260] successful.
May 19 04:34:47.645995 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:34:47.663760 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:34:47.676627 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:34:47.713449 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739, portal: 192.168.50.100,3260]
May 19 04:34:47.713449 np0000001025 nova-compute[97981]: Logout of [sid: 2, target: iqn.2023-03.storpool.com:os--volume-e6477f41-82fa-4ab4-951b-147262445739, portal: 192.168.50.100,3260] successful.
May 19 04:34:47.713449 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:34:47.730620 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:34:47.735473 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:34:47.735739 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] <== disconnect_volume: return (348ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:34:47.735846 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:34:47.736169 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Deleting instance files /opt/stack/data/nova/instances/13ba1e00-08ad-4da8-8258-92154f5925d2_del
May 19 04:34:47.736934 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Deletion of /opt/stack/data/nova/instances/13ba1e00-08ad-4da8-8258-92154f5925d2_del complete
May 19 04:34:47.823202 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:47.823202 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:47.823202 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:47.823202 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:47.823202 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:47.823202 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:47.850876 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:34:47.852889 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:34:47.855386 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Creating image(s)
May 19 04:34:47.855386 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:47.855386 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "/opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:47.855885 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "/opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:47.856823 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:47.862769 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:47.869187 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:47.882490 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:47.961781 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999602865000043 future=<Future at 0x72185011ed20 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:34:47.961781 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165287.9613812, f71811d1-b0ad-48f9-ba04-9a6e517961b9 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:47.961781 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] VM Resumed (Lifecycle Event)
May 19 04:34:47.970049 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.101s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:47.970538 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:47.970945 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:47.971471 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:47.975625 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:47.976477 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:48.032135 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Successfully updated port: 7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:34:48.049885 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.074s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:48.050362 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:48.085504 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk 1073741824" returned: 0 in 0.035s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:48.085926 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.115s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:48.086514 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:48.176193 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.089s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:48.176469 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:34:48.176712 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:48.250542 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Took 1.76 seconds to destroy the instance on the hypervisor.
May 19 04:34:48.252518 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:34:48.252916 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:34:48.253007 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:34:48.253575 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:48.257432 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:48.258039 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Cannot resize image /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:34:48.258540 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:34:48.258781 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Ensure instance console log exists: /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:34:48.259133 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:48.259323 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:48.259451 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:48.331682 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Took 15.61 seconds to spawn the instance on the hypervisor.
May 19 04:34:48.331682 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:48.343972 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:48.467551 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:48.468406 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:34:48.535266 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "refresh_cache-6ea060d2-e149-4189-b93b-66ce319b9157" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:34:48.535464 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquired lock "refresh_cache-6ea060d2-e149-4189-b93b-66ce319b9157" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:34:48.535686 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:34:48.663712 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-55abb45d-d73e-491d-b121-f961ad8f24ea req-947d82d6-6d21-43f2-88a8-8f9614d5dd2b service nova] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Received event network-vif-deleted-4709f63b-e1e2-40a4-b2eb-e246f257e437 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:48.663856 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-55abb45d-d73e-491d-b121-f961ad8f24ea req-947d82d6-6d21-43f2-88a8-8f9614d5dd2b service nova] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Neutron deleted interface 4709f63b-e1e2-40a4-b2eb-e246f257e437; detaching it from the instance and deleting it from the info cache
May 19 04:34:48.664001 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-55abb45d-d73e-491d-b121-f961ad8f24ea req-947d82d6-6d21-43f2-88a8-8f9614d5dd2b service nova] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:48.793015 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9b1bef80-9d26-4010-851a-741a98627b91 req-3a73bbad-7ce2-4dca-859b-5b5d57155f17 service nova] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Received event network-vif-unplugged-4709f63b-e1e2-40a4-b2eb-e246f257e437 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:48.793212 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9b1bef80-9d26-4010-851a-741a98627b91 req-3a73bbad-7ce2-4dca-859b-5b5d57155f17 service nova] Acquiring lock "13ba1e00-08ad-4da8-8258-92154f5925d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:48.793363 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9b1bef80-9d26-4010-851a-741a98627b91 req-3a73bbad-7ce2-4dca-859b-5b5d57155f17 service nova] Lock "13ba1e00-08ad-4da8-8258-92154f5925d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:48.796419 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9b1bef80-9d26-4010-851a-741a98627b91 req-3a73bbad-7ce2-4dca-859b-5b5d57155f17 service nova] Lock "13ba1e00-08ad-4da8-8258-92154f5925d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:48.796569 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9b1bef80-9d26-4010-851a-741a98627b91 req-3a73bbad-7ce2-4dca-859b-5b5d57155f17 service nova] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] No waiting events found dispatching network-vif-unplugged-4709f63b-e1e2-40a4-b2eb-e246f257e437 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:34:48.796695 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9b1bef80-9d26-4010-851a-741a98627b91 req-3a73bbad-7ce2-4dca-859b-5b5d57155f17 service nova] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Received event network-vif-unplugged-4709f63b-e1e2-40a4-b2eb-e246f257e437 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:34:48.846039 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Took 23.96 seconds to build instance.
May 19 04:34:49.087311 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:49.125023 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:34:49.167924 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-55abb45d-d73e-491d-b121-f961ad8f24ea req-947d82d6-6d21-43f2-88a8-8f9614d5dd2b service nova] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Detach interface failed, port_id=4709f63b-e1e2-40a4-b2eb-e246f257e437, reason: Instance 13ba1e00-08ad-4da8-8258-92154f5925d2 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:34:49.347735 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.477s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:49.351228 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:49.398494 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b95e3823-25a2-4c12-a7d8-524310ebb25a req-44037cfa-c500-4ed9-9e7c-26ebf38dcd59 service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received event network-vif-plugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:49.398689 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b95e3823-25a2-4c12-a7d8-524310ebb25a req-44037cfa-c500-4ed9-9e7c-26ebf38dcd59 service nova] Acquiring lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:49.398906 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b95e3823-25a2-4c12-a7d8-524310ebb25a req-44037cfa-c500-4ed9-9e7c-26ebf38dcd59 service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:49.400284 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b95e3823-25a2-4c12-a7d8-524310ebb25a req-44037cfa-c500-4ed9-9e7c-26ebf38dcd59 service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:49.400489 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b95e3823-25a2-4c12-a7d8-524310ebb25a req-44037cfa-c500-4ed9-9e7c-26ebf38dcd59 service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] No waiting events found dispatching network-vif-plugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:34:49.400685 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-b95e3823-25a2-4c12-a7d8-524310ebb25a req-44037cfa-c500-4ed9-9e7c-26ebf38dcd59 service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received unexpected event network-vif-plugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 for instance with vm_state rescued and task_state None.
May 19 04:34:49.400879 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b95e3823-25a2-4c12-a7d8-524310ebb25a req-44037cfa-c500-4ed9-9e7c-26ebf38dcd59 service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received event network-changed-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:49.401037 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b95e3823-25a2-4c12-a7d8-524310ebb25a req-44037cfa-c500-4ed9-9e7c-26ebf38dcd59 service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Refreshing instance network info cache due to event network-changed-7cdc75ea-9f5f-4944-92ae-1788cf00aea2. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:34:49.401226 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b95e3823-25a2-4c12-a7d8-524310ebb25a req-44037cfa-c500-4ed9-9e7c-26ebf38dcd59 service nova] Acquiring lock "refresh_cache-6ea060d2-e149-4189-b93b-66ce319b9157" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:34:49.542058 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Updating instance_info_cache with network_info: [{"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:49.588772 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Took 1.34 seconds to deallocate network for instance.
May 19 04:34:49.927540 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Rescuing
May 19 04:34:49.927711 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "refresh_cache-4866cabb-0595-4fe5-8be5-ebf4ed9c8f94" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:34:49.927968 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquired lock "refresh_cache-4866cabb-0595-4fe5-8be5-ebf4ed9c8f94" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:34:49.928022 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:34:50.045021 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Releasing lock "refresh_cache-6ea060d2-e149-4189-b93b-66ce319b9157" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:34:50.045359 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Instance network_info: |[{"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:34:50.045803 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b95e3823-25a2-4c12-a7d8-524310ebb25a req-44037cfa-c500-4ed9-9e7c-26ebf38dcd59 service nova] Acquired lock "refresh_cache-6ea060d2-e149-4189-b93b-66ce319b9157" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:34:50.047588 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Start _get_guest_xml network_info=[{"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:34:50.048759 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-b95e3823-25a2-4c12-a7d8-524310ebb25a req-44037cfa-c500-4ed9-9e7c-26ebf38dcd59 service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Refreshing network info cache for port 7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:34:50.050362 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:34:50.051683 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1325996205', uuid='6ea060d2-e149-4189-b93b-66ce319b9157'), owner=OwnerMeta(userid='cde403fc60ce4630af81e6bdfa2b4603', username='tempest-ServerActionsTestOtherB-1000009728-project-member', projectid='b34124f30156425cbda16473ccedeff4', projectname='tempest-ServerActionsTestOtherB-1000009728'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165290.0512896) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:34:50.052679 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:34:50.053079 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:34:50.054042 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:34:50.054488 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:34:50.055680 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:34:50.056818 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:34:50.057736 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:34:50.058030 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:34:50.058424 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:34:50.058662 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:34:50.059055 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:34:50.059161 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:34:50.059519 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:34:50.059519 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:34:50.059608 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:34:50.059770 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:34:50.074216 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1325996205',display_name='tempest-ServerActionsTestOtherB-server-1325996205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serveractionstestotherb-server-1325996205',id=8,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3jK8eIICR3l/4SHxst/8yPlILpDesN4+H3trAm2UFhRABDmHluvxgOWTGKox1jLYWeyqvab+bX/g483yAyobp3jhS/ZI5/84mWYZjjvl9ViemWFe558Ts8/0C9LeWLvw==',key_name='tempest-keypair-958107194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b34124f30156425cbda16473ccedeff4',ramdisk_id='',reservation_id='r-k74jcc1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1000009728',owner_user_name='tempest-ServerActionsTestOtherB-1000009728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:34:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cde403fc60ce4630af81e6bdfa2b4603',uuid=6ea060d2-e149-4189-b93b-66ce319b9157,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:34:50.074698 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Converting VIF {"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:34:50.075629 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:b1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7cdc75ea-9f5f-4944-92ae-1788cf00aea2,network=Network(8114a6bf-054f-469f-a788-9fd489f4ee76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cdc75ea-9f') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:34:50.076663 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ea060d2-e149-4189-b93b-66ce319b9157 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:50.209837 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Took 0.62 seconds to detach 1 volumes for instance.
May 19 04:34:50.430903 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:50.553575 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-b95e3823-25a2-4c12-a7d8-524310ebb25a req-44037cfa-c500-4ed9-9e7c-26ebf38dcd59 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:50.582265 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] End _get_guest_xml xml=<domain type="qemu">
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:   <uuid>6ea060d2-e149-4189-b93b-66ce319b9157</uuid>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:   <name>instance-00000008</name>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServerActionsTestOtherB-server-1325996205</nova:name>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:34:50</nova:creationTime>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:         <nova:user uuid="cde403fc60ce4630af81e6bdfa2b4603">tempest-ServerActionsTestOtherB-1000009728-project-member</nova:user>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:         <nova:project uuid="b34124f30156425cbda16473ccedeff4">tempest-ServerActionsTestOtherB-1000009728</nova:project>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:         <nova:port uuid="7cdc75ea-9f5f-4944-92ae-1788cf00aea2">
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     <system>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <entry name="serial">6ea060d2-e149-4189-b93b-66ce319b9157</entry>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <entry name="uuid">6ea060d2-e149-4189-b93b-66ce319b9157</entry>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     </system>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:   <os>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:   </os>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:   <features>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:   </features>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:   <devices>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk"/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     </disk>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk.config"/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     </disk>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:40:b1:c7"/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <target dev="tap7cdc75ea-9f"/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     </interface>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/console.log" append="off"/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     </serial>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     <video>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     </video>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     </rng>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:   </devices>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]: </domain>
May 19 04:34:50.582265 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:34:50.582265 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Preparing to wait for external event network-vif-plugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:34:50.584941 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:50.584941 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:50.584941 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:50.584941 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1325996205',display_name='tempest-ServerActionsTestOtherB-server-1325996205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serveractionstestotherb-server-1325996205',id=8,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3jK8eIICR3l/4SHxst/8yPlILpDesN4+H3trAm2UFhRABDmHluvxgOWTGKox1jLYWeyqvab+bX/g483yAyobp3jhS/ZI5/84mWYZjjvl9ViemWFe558Ts8/0C9LeWLvw==',key_name='tempest-keypair-958107194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b34124f30156425cbda16473ccedeff4',ramdisk_id='',reservation_id='r-k74jcc1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1000009728',owner_user_name='tempest-ServerActionsTestOtherB-1000009728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:34:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cde403fc60ce4630af81e6bdfa2b4603',uuid=6ea060d2-e149-4189-b93b-66ce319b9157,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:34:50.585232 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Converting VIF {"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:34:50.585232 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:b1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7cdc75ea-9f5f-4944-92ae-1788cf00aea2,network=Network(8114a6bf-054f-469f-a788-9fd489f4ee76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cdc75ea-9f') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:34:50.585232 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:b1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7cdc75ea-9f5f-4944-92ae-1788cf00aea2,network=Network(8114a6bf-054f-469f-a788-9fd489f4ee76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cdc75ea-9f') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:34:50.586555 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:50.586555 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:50.586555 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:34:50.589371 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:50.590930 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0c494f0-3a9f-5aa8-8f24-c9a8e8e7579a', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:50.593195 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:34:50.604874 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:50.604874 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cdc75ea-9f, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:50.604874 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cdc75ea-9f, col_values=(('qos', UUID('5b7f01bc-6d36-40f0-ba0d-1caa02683e15')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:50.604874 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cdc75ea-9f, col_values=(('external_ids', {'iface-id': '7cdc75ea-9f5f-4944-92ae-1788cf00aea2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:b1:c7', 'vm-uuid': '6ea060d2-e149-4189-b93b-66ce319b9157'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:34:50.604874 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:50.607182 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:34:50.611004 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:50.612293 np0000001025 nova-compute[97981]: INFO os_vif [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:b1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7cdc75ea-9f5f-4944-92ae-1788cf00aea2,network=Network(8114a6bf-054f-469f-a788-9fd489f4ee76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cdc75ea-9f')
May 19 04:34:50.716630 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:50.717974 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:50.904229 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6529760c-eca6-4192-8e6c-2a466ecf6caa req-7dd20e70-b8b4-4c16-a2f1-46b6b7da4a80 service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Received event network-changed-87877be0-a885-4589-913e-29c2dcd6900b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:50.904436 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6529760c-eca6-4192-8e6c-2a466ecf6caa req-7dd20e70-b8b4-4c16-a2f1-46b6b7da4a80 service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Refreshing instance network info cache due to event network-changed-87877be0-a885-4589-913e-29c2dcd6900b. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:34:50.904670 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6529760c-eca6-4192-8e6c-2a466ecf6caa req-7dd20e70-b8b4-4c16-a2f1-46b6b7da4a80 service nova] Acquiring lock "refresh_cache-f71811d1-b0ad-48f9-ba04-9a6e517961b9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:34:50.905175 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6529760c-eca6-4192-8e6c-2a466ecf6caa req-7dd20e70-b8b4-4c16-a2f1-46b6b7da4a80 service nova] Acquired lock "refresh_cache-f71811d1-b0ad-48f9-ba04-9a6e517961b9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:34:50.905468 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-6529760c-eca6-4192-8e6c-2a466ecf6caa req-7dd20e70-b8b4-4c16-a2f1-46b6b7da4a80 service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Refreshing network info cache for port 87877be0-a885-4589-913e-29c2dcd6900b {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:34:51.030587 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:51.074202 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-b95e3823-25a2-4c12-a7d8-524310ebb25a req-44037cfa-c500-4ed9-9e7c-26ebf38dcd59 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:51.284570 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Updating instance_info_cache with network_info: [{"id": "13c0c2a4-ed11-438d-a852-17bc610c6269", "address": "fa:16:3e:81:21:90", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c0c2a4-ed", "ovs_interfaceid": "13c0c2a4-ed11-438d-a852-17bc610c6269", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:51.290411 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-b95e3823-25a2-4c12-a7d8-524310ebb25a req-44037cfa-c500-4ed9-9e7c-26ebf38dcd59 service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Updated VIF entry in instance network info cache for port 7cdc75ea-9f5f-4944-92ae-1788cf00aea2. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:34:51.290592 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-b95e3823-25a2-4c12-a7d8-524310ebb25a req-44037cfa-c500-4ed9-9e7c-26ebf38dcd59 service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Updating instance_info_cache with network_info: [{"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:51.359123 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:34:51.359123 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:34:51.408285 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-6529760c-eca6-4192-8e6c-2a466ecf6caa req-7dd20e70-b8b4-4c16-a2f1-46b6b7da4a80 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:51.528162 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-bece77ab-1e3b-465e-82ca-0a48c7e141de req-1e58affa-eb1a-419c-9616-a1a78c79d25a service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received event network-vif-unplugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:51.532605 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bece77ab-1e3b-465e-82ca-0a48c7e141de req-1e58affa-eb1a-419c-9616-a1a78c79d25a service nova] Acquiring lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:51.534026 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bece77ab-1e3b-465e-82ca-0a48c7e141de req-1e58affa-eb1a-419c-9616-a1a78c79d25a service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:51.534026 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bece77ab-1e3b-465e-82ca-0a48c7e141de req-1e58affa-eb1a-419c-9616-a1a78c79d25a service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:51.534026 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-bece77ab-1e3b-465e-82ca-0a48c7e141de req-1e58affa-eb1a-419c-9616-a1a78c79d25a service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] No event matching network-vif-unplugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 in dict_keys([('network-vif-plugged', '7cdc75ea-9f5f-4944-92ae-1788cf00aea2')]) {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 19 04:34:51.534026 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-bece77ab-1e3b-465e-82ca-0a48c7e141de req-1e58affa-eb1a-419c-9616-a1a78c79d25a service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received unexpected event network-vif-unplugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 for instance with vm_state building and task_state spawning.
May 19 04:34:51.793174 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Releasing lock "refresh_cache-4866cabb-0595-4fe5-8be5-ebf4ed9c8f94" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:34:51.794717 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b95e3823-25a2-4c12-a7d8-524310ebb25a req-44037cfa-c500-4ed9-9e7c-26ebf38dcd59 service nova] Releasing lock "refresh_cache-6ea060d2-e149-4189-b93b-66ce319b9157" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:34:51.808295 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-6529760c-eca6-4192-8e6c-2a466ecf6caa req-7dd20e70-b8b4-4c16-a2f1-46b6b7da4a80 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:51.861361 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:34:51.992140 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-6529760c-eca6-4192-8e6c-2a466ecf6caa req-7dd20e70-b8b4-4c16-a2f1-46b6b7da4a80 service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Updated VIF entry in instance network info cache for port 87877be0-a885-4589-913e-29c2dcd6900b. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:34:51.992348 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-6529760c-eca6-4192-8e6c-2a466ecf6caa req-7dd20e70-b8b4-4c16-a2f1-46b6b7da4a80 service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Updating instance_info_cache with network_info: [{"id": "87877be0-a885-4589-913e-29c2dcd6900b", "address": "fa:16:3e:ca:fa:0b", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877be0-a8", "ovs_interfaceid": "87877be0-a885-4589-913e-29c2dcd6900b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:52.159229 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:52.159391 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:52.159514 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] No VIF found with MAC fa:16:3e:40:b1:c7, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:34:52.159950 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Using config drive
May 19 04:34:52.372314 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.655s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:52.433535 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Deleted allocations for instance 13ba1e00-08ad-4da8-8258-92154f5925d2
May 19 04:34:52.496129 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6529760c-eca6-4192-8e6c-2a466ecf6caa req-7dd20e70-b8b4-4c16-a2f1-46b6b7da4a80 service nova] Releasing lock "refresh_cache-f71811d1-b0ad-48f9-ba04-9a6e517961b9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:34:52.668138 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:52.795042 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Creating config drive at /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk.config
May 19 04:34:52.797865 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp163yx8ae {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:52.841668 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp163yx8ae" returned: 0 in 0.043s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:52.883962 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:52.909771 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquiring lock "1081cdc6-540d-4cb8-9e0d-d7584411e539" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:52.911378 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:53.372393 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:53.393837 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:53.418955 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:34:53.451465 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:53.455808 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-0fd3022a-77e5-4b29-a87e-253afe3306f1 tempest-DeleteServersTestJSON-1086734078 tempest-DeleteServersTestJSON-1086734078-project-member] Lock "13ba1e00-08ad-4da8-8258-92154f5925d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.494s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:53.460295 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:53.477224 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:53.525121 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:53.721084 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-aeb43be0-1753-4ab5-a5b9-b3255cdf2a7b req-084efa0e-0b5e-4848-87cb-d640ada4050c service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received event network-vif-plugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:53.721369 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-aeb43be0-1753-4ab5-a5b9-b3255cdf2a7b req-084efa0e-0b5e-4848-87cb-d640ada4050c service nova] Acquiring lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:53.721631 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-aeb43be0-1753-4ab5-a5b9-b3255cdf2a7b req-084efa0e-0b5e-4848-87cb-d640ada4050c service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:53.723363 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-aeb43be0-1753-4ab5-a5b9-b3255cdf2a7b req-084efa0e-0b5e-4848-87cb-d640ada4050c service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:53.723363 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-aeb43be0-1753-4ab5-a5b9-b3255cdf2a7b req-084efa0e-0b5e-4848-87cb-d640ada4050c service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Processing event network-vif-plugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:34:53.766692 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e1eb460c-4144-48e2-a4fa-81510b0595b5 req-6ba62732-561b-499f-af3a-64ae5c1f390d service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received event network-vif-unplugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:53.766692 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e1eb460c-4144-48e2-a4fa-81510b0595b5 req-6ba62732-561b-499f-af3a-64ae5c1f390d service nova] Acquiring lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:53.766692 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e1eb460c-4144-48e2-a4fa-81510b0595b5 req-6ba62732-561b-499f-af3a-64ae5c1f390d service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:53.766692 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e1eb460c-4144-48e2-a4fa-81510b0595b5 req-6ba62732-561b-499f-af3a-64ae5c1f390d service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:53.766692 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e1eb460c-4144-48e2-a4fa-81510b0595b5 req-6ba62732-561b-499f-af3a-64ae5c1f390d service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] No waiting events found dispatching network-vif-unplugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:34:53.766692 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-e1eb460c-4144-48e2-a4fa-81510b0595b5 req-6ba62732-561b-499f-af3a-64ae5c1f390d service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received unexpected event network-vif-unplugged-13c0c2a4-ed11-438d-a852-17bc610c6269 for instance with vm_state active and task_state rescuing.
May 19 04:34:53.819785 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.998569885000052 future=<Future at 0x721850164a40 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:34:53.826268 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Instance destroyed successfully.
May 19 04:34:53.826611 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'numa_topology' on Instance uuid 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:53.877334 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:53.888054 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:53.897131 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:53.925735 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:53.933326 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:53.982904 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:53.983212 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:53.988421 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:34:53.988609 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Claim successful on node np0000001025
May 19 04:34:54.182233 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:54.189275 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:54.334029 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Attempting rescue
May 19 04:34:54.335579 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=97981) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 19 04:34:54.339164 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Instance directory exists: not creating {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 19 04:34:54.339164 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Creating image(s)
May 19 04:34:54.339559 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "/opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:54.339724 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "/opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:54.340162 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "/opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:54.340331 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:54.430916 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:34:54.432181 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165294.4315965, 6ea060d2-e149-4189-b93b-66ce319b9157 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:54.432264 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] VM Started (Lifecycle Event)
May 19 04:34:54.439456 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:34:54.444203 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Instance spawned successfully.
May 19 04:34:54.444633 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:34:54.842422 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Object Instance<4866cabb-0595-4fe5-8be5-ebf4ed9c8f94> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:34:54.843100 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:54.850792 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:54.852457 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:54.853337 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:54.854392 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:54.859473 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:54.861391 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:54.941502 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:54.948762 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:34:54.959376 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:54.960121 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:54.960594 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:54.960875 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:54.961162 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:54.961547 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:34:54.967064 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.106s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:54.967857 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk.rescue {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:55.016235 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk.rescue" returned: 0 in 0.048s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:55.017314 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.164s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:55.017314 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'migration_context' on Instance uuid 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:55.452977 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:34:55.453371 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165295.453016, 6ea060d2-e149-4189-b93b-66ce319b9157 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:55.454222 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] VM Paused (Lifecycle Event)
May 19 04:34:55.472213 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Took 7.62 seconds to spawn the instance on the hypervisor.
May 19 04:34:55.472440 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:55.521814 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Object Instance<4866cabb-0595-4fe5-8be5-ebf4ed9c8f94> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:34:55.522165 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:34:55.523012 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Start _get_guest_xml network_info=[{"id": "13c0c2a4-ed11-438d-a852-17bc610c6269", "address": "fa:16:3e:81:21:90", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "vif_mac": "fa:16:3e:81:21:90"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c0c2a4-ed", "ovs_interfaceid": "13c0c2a4-ed11-438d-a852-17bc610c6269", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:34:55.523831 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'resources' on Instance uuid 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:55.605898 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:55.639786 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:34:55.639786 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:34:55.738465 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0006863500000235945 future=<Future at 0x7218506f88c0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:34:55.738586 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:34:55.738719 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=7.222158212000068 future=<Future at 0x72185011ed20 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:34:55.738800 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=7.222058712000035 future=<Future at 0x72185011ed20 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:34:55.833361 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-41b7762f-ed8b-4d38-9374-9d3913afdfd7 req-e341a519-b400-464d-a28d-8865e31f299a service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received event network-vif-plugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:55.834034 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-41b7762f-ed8b-4d38-9374-9d3913afdfd7 req-e341a519-b400-464d-a28d-8865e31f299a service nova] Acquiring lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:55.834503 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-41b7762f-ed8b-4d38-9374-9d3913afdfd7 req-e341a519-b400-464d-a28d-8865e31f299a service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:55.834639 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-41b7762f-ed8b-4d38-9374-9d3913afdfd7 req-e341a519-b400-464d-a28d-8865e31f299a service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:55.834839 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-41b7762f-ed8b-4d38-9374-9d3913afdfd7 req-e341a519-b400-464d-a28d-8865e31f299a service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] No waiting events found dispatching network-vif-plugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:34:55.834910 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-41b7762f-ed8b-4d38-9374-9d3913afdfd7 req-e341a519-b400-464d-a28d-8865e31f299a service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received unexpected event network-vif-plugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 for instance with vm_state active and task_state None.
May 19 04:34:55.868972 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a8c62187-36f4-465a-becb-f7d79cc66bb5 req-ee2cfac3-3c1c-4db7-9425-81385a505e89 service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received event network-vif-unplugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:55.869437 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a8c62187-36f4-465a-becb-f7d79cc66bb5 req-ee2cfac3-3c1c-4db7-9425-81385a505e89 service nova] Acquiring lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:55.869804 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a8c62187-36f4-465a-becb-f7d79cc66bb5 req-ee2cfac3-3c1c-4db7-9425-81385a505e89 service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:55.871128 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a8c62187-36f4-465a-becb-f7d79cc66bb5 req-ee2cfac3-3c1c-4db7-9425-81385a505e89 service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:55.871128 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a8c62187-36f4-465a-becb-f7d79cc66bb5 req-ee2cfac3-3c1c-4db7-9425-81385a505e89 service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] No waiting events found dispatching network-vif-unplugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:34:55.871358 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-a8c62187-36f4-465a-becb-f7d79cc66bb5 req-ee2cfac3-3c1c-4db7-9425-81385a505e89 service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received unexpected event network-vif-unplugged-13c0c2a4-ed11-438d-a852-17bc610c6269 for instance with vm_state active and task_state rescuing.
May 19 04:34:55.956854 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:55.958688 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165295.9582496, 6ea060d2-e149-4189-b93b-66ce319b9157 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:34:55.958909 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] VM Resumed (Lifecycle Event)
May 19 04:34:55.986700 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Took 13.44 seconds to build instance.
May 19 04:34:56.030316 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Object Instance<4866cabb-0595-4fe5-8be5-ebf4ed9c8f94> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:34:56.034563 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:34:56.036217 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-21819966', uuid='4866cabb-0595-4fe5-8be5-ebf4ed9c8f94'), owner=OwnerMeta(userid='7cdf106961084f0e941b5b65911c9b76', username='tempest-ServerRescueNegativeTestJSON-1305117099-project-member', projectid='334b83c8d3714844830f961673658b20', projectname='tempest-ServerRescueNegativeTestJSON-1305117099'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "13c0c2a4-ed11-438d-a852-17bc610c6269", "address": "fa:16:3e:81:21:90", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "vif_mac": "fa:16:3e:81:21:90"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c0c2a4-ed", "ovs_interfaceid": "13c0c2a4-ed11-438d-a852-17bc610c6269", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165296.0352986) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:34:56.038889 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:34:56.039380 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:34:56.040122 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:34:56.040360 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:34:56.041723 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:34:56.042173 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:34:56.042531 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:34:56.042531 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:34:56.042713 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:34:56.042937 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:34:56.042937 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:34:56.043394 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:34:56.043560 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:34:56.043674 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:34:56.043850 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:34:56.043987 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:34:56.044421 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:56.141829 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:34:56.376778 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:56.461792 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:34:56.468361 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:34:56.488692 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "6ea060d2-e149-4189-b93b-66ce319b9157" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.955s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:56.547274 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Object Instance<4866cabb-0595-4fe5-8be5-ebf4ed9c8f94> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:34:56.577758 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-21819966',display_name='tempest-ServerRescueNegativeTestJSON-server-21819966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverrescuenegativetestjson-server-21819966',id=1,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:34:29Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='334b83c8d3714844830f961673658b20',ramdisk_id='',reservation_id='r-zwug52jp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1305117099',owner_user_name='tempest-ServerRescueNegativeTestJSON-1305117099-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:34:30Z,user_data=None,user_id='7cdf106961084f0e941b5b65911c9b76',uuid=4866cabb-0595-4fe5-8be5-ebf4ed9c8f94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13c0c2a4-ed11-438d-a852-17bc610c6269", "address": "fa:16:3e:81:21:90", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "vif_mac": "fa:16:3e:81:21:90"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c0c2a4-ed", "ovs_interfaceid": "13c0c2a4-ed11-438d-a852-17bc610c6269", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:34:56.578357 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converting VIF {"id": "13c0c2a4-ed11-438d-a852-17bc610c6269", "address": "fa:16:3e:81:21:90", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "vif_mac": "fa:16:3e:81:21:90"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c0c2a4-ed", "ovs_interfaceid": "13c0c2a4-ed11-438d-a852-17bc610c6269", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:34:56.578934 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:21:90,bridge_name='br-int',has_traffic_filtering=True,id=13c0c2a4-ed11-438d-a852-17bc610c6269,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c0c2a4-ed') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:34:56.579174 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'pci_devices' on Instance uuid 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:56.653610 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.670s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:56.654059 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:34:57.082214 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Object Instance<4866cabb-0595-4fe5-8be5-ebf4ed9c8f94> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:34:57.082744 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] End _get_guest_xml xml=<domain type="qemu">
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:   <uuid>4866cabb-0595-4fe5-8be5-ebf4ed9c8f94</uuid>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:   <name>instance-00000001</name>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-21819966</nova:name>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:34:56</nova:creationTime>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:           <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:           <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:         <nova:user uuid="7cdf106961084f0e941b5b65911c9b76">tempest-ServerRescueNegativeTestJSON-1305117099-project-member</nova:user>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:         <nova:project uuid="334b83c8d3714844830f961673658b20">tempest-ServerRescueNegativeTestJSON-1305117099</nova:project>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:         <nova:port uuid="13c0c2a4-ed11-438d-a852-17bc610c6269">
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     <system>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <entry name="serial">4866cabb-0595-4fe5-8be5-ebf4ed9c8f94</entry>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <entry name="uuid">4866cabb-0595-4fe5-8be5-ebf4ed9c8f94</entry>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     </system>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:   <os>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:   </os>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:   <features>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:   </features>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:   <devices>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk.rescue"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     </disk>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <target dev="vdb" bus="virtio"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     </disk>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk.config.rescue"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     </disk>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:81:21:90"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <target dev="tap13c0c2a4-ed"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     </interface>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/console.log" append="off"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     </serial>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     <video>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     </video>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     </rng>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:   </devices>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]: </domain>
May 19 04:34:57.082744 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:34:57.087940 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Instance destroyed successfully.
May 19 04:34:57.162656 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:34:57.162656 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:34:57.162903 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:57.163189 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:57.252624 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97454d937cea4489b1c5e2b7dbbde8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbef1a3853c14e3daa34b934269bb404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:34:57.665424 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:34:57.888756 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:34:57.955936 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ec3950c1-02a7-42d9-a02f-afb44be59b4b req-fa6663ba-c9d1-41a3-a625-3d9b9a6afd2e service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received event network-changed-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:34:57.957944 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ec3950c1-02a7-42d9-a02f-afb44be59b4b req-fa6663ba-c9d1-41a3-a625-3d9b9a6afd2e service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Refreshing instance network info cache due to event network-changed-7cdc75ea-9f5f-4944-92ae-1788cf00aea2. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:34:57.958248 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ec3950c1-02a7-42d9-a02f-afb44be59b4b req-fa6663ba-c9d1-41a3-a625-3d9b9a6afd2e service nova] Acquiring lock "refresh_cache-6ea060d2-e149-4189-b93b-66ce319b9157" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:34:57.958605 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ec3950c1-02a7-42d9-a02f-afb44be59b4b req-fa6663ba-c9d1-41a3-a625-3d9b9a6afd2e service nova] Acquired lock "refresh_cache-6ea060d2-e149-4189-b93b-66ce319b9157" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:34:57.959300 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-ec3950c1-02a7-42d9-a02f-afb44be59b4b req-fa6663ba-c9d1-41a3-a625-3d9b9a6afd2e service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Refreshing network info cache for port 7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:34:58.005161 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Successfully created port: e0f5a2e8-4380-464f-99dd-c33eaa062d63 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:34:58.169057 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:34:58.464209 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-ec3950c1-02a7-42d9-a02f-afb44be59b4b req-fa6663ba-c9d1-41a3-a625-3d9b9a6afd2e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:58.611856 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:58.611965 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:58.612055 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:34:58.612177 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No VIF found with MAC fa:16:3e:81:21:90, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:34:58.612597 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Using config drive
May 19 04:34:58.627700 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Successfully updated port: e0f5a2e8-4380-464f-99dd-c33eaa062d63 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:34:58.833479 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-ec3950c1-02a7-42d9-a02f-afb44be59b4b req-fa6663ba-c9d1-41a3-a625-3d9b9a6afd2e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:34:58.973010 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-ec3950c1-02a7-42d9-a02f-afb44be59b4b req-fa6663ba-c9d1-41a3-a625-3d9b9a6afd2e service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Updated VIF entry in instance network info cache for port 7cdc75ea-9f5f-4944-92ae-1788cf00aea2. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:34:58.973312 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-ec3950c1-02a7-42d9-a02f-afb44be59b4b req-fa6663ba-c9d1-41a3-a625-3d9b9a6afd2e service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Updating instance_info_cache with network_info: [{"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:34:59.115872 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'ec2_ids' on Instance uuid 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:59.136928 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquiring lock "refresh_cache-1081cdc6-540d-4cb8-9e0d-d7584411e539" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:34:59.137095 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquired lock "refresh_cache-1081cdc6-540d-4cb8-9e0d-d7584411e539" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:34:59.137263 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:34:59.181629 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:34:59.182551 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:34:59.182785 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Creating image(s)
May 19 04:34:59.183233 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquiring lock "/opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:59.183395 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "/opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:59.183868 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "/opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:59.184926 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:59.187539 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:59.191563 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:59.281278 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.089s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:59.281692 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:59.282173 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:59.285738 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:59.288669 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:34:59.288914 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:59.370720 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.081s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:59.371345 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:59.415223 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk 1073741824" returned: 0 in 0.044s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:59.415677 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.133s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:59.415997 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:59.477075 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ec3950c1-02a7-42d9-a02f-afb44be59b4b req-fa6663ba-c9d1-41a3-a625-3d9b9a6afd2e service nova] Releasing lock "refresh_cache-6ea060d2-e149-4189-b93b-66ce319b9157" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:34:59.512135 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.096s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:59.512593 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:34:59.512842 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:34:59.612994 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:34:59.614020 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Cannot resize image /opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:34:59.614135 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:34:59.614619 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Ensure instance console log exists: /opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:34:59.615697 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:34:59.615697 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:34:59.615697 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:34:59.620367 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Object Instance<4866cabb-0595-4fe5-8be5-ebf4ed9c8f94> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:34:59.620611 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'keypairs' on Instance uuid 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:34:59.718748 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:34:59.923767 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:00.071591 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50165811-d489-403b-aa30-c736d697ca2c req-721c73be-c279-4673-a23c-87657ca5fce7 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Received event network-changed-e0f5a2e8-4380-464f-99dd-c33eaa062d63 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:00.071793 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50165811-d489-403b-aa30-c736d697ca2c req-721c73be-c279-4673-a23c-87657ca5fce7 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Refreshing instance network info cache due to event network-changed-e0f5a2e8-4380-464f-99dd-c33eaa062d63. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:35:00.072018 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50165811-d489-403b-aa30-c736d697ca2c req-721c73be-c279-4673-a23c-87657ca5fce7 service nova] Acquiring lock "refresh_cache-1081cdc6-540d-4cb8-9e0d-d7584411e539" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:35:00.124656 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Object Instance<4866cabb-0595-4fe5-8be5-ebf4ed9c8f94> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:35:00.127827 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:00.136961 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Updating instance_info_cache with network_info: [{"id": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "address": "fa:16:3e:e5:ed:dc", "network": {"id": "637c588b-9807-4474-9ce4-42f9d9631794", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-90879599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f5a2e8-43", "ovs_interfaceid": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:00.281996 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Creating config drive at /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk.config.rescue
May 19 04:35:00.285904 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmgipu0xi {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:00.322251 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmgipu0xi" returned: 0 in 0.036s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:00.607749 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:00.639909 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Releasing lock "refresh_cache-1081cdc6-540d-4cb8-9e0d-d7584411e539" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:35:00.642895 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Instance network_info: |[{"id": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "address": "fa:16:3e:e5:ed:dc", "network": {"id": "637c588b-9807-4474-9ce4-42f9d9631794", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-90879599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f5a2e8-43", "ovs_interfaceid": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:35:00.643553 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50165811-d489-403b-aa30-c736d697ca2c req-721c73be-c279-4673-a23c-87657ca5fce7 service nova] Acquired lock "refresh_cache-1081cdc6-540d-4cb8-9e0d-d7584411e539" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:35:00.643757 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-50165811-d489-403b-aa30-c736d697ca2c req-721c73be-c279-4673-a23c-87657ca5fce7 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Refreshing network info cache for port e0f5a2e8-4380-464f-99dd-c33eaa062d63 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:35:00.645811 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Start _get_guest_xml network_info=[{"id": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "address": "fa:16:3e:e5:ed:dc", "network": {"id": "637c588b-9807-4474-9ce4-42f9d9631794", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-90879599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f5a2e8-43", "ovs_interfaceid": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:35:00.654374 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:35:00.655965 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1629521735', uuid='1081cdc6-540d-4cb8-9e0d-d7584411e539'), owner=OwnerMeta(userid='97454d937cea4489b1c5e2b7dbbde8d5', username='tempest-TaggedAttachmentsTest-268161223-project-member', projectid='dbef1a3853c14e3daa34b934269bb404', projectname='tempest-TaggedAttachmentsTest-268161223'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "address": "fa:16:3e:e5:ed:dc", "network": {"id": "637c588b-9807-4474-9ce4-42f9d9631794", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-90879599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f5a2e8-43", "ovs_interfaceid": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165300.655524) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:35:00.659027 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:35:00.660201 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:35:00.675348 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:35:00.675348 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:35:00.675348 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:35:00.675348 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:35:00.675348 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:35:00.675348 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:35:00.675348 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:35:00.675348 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:35:00.675708 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:35:00.675708 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:35:00.675859 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:35:00.676047 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:35:00.676231 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:35:00.676697 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:35:00.700790 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1629521735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1629521735',id=9,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEYnYF79S8BYxQZJ+dMTZjjdbQN3rcn72CWM+baGIlro7OTlpW3xu/PoWXZ+BC9Xw4nxCPqKjMoVyw2hgomsW56DUe6HIHrGodPsGgr/T3ioiXjmvIEBQenW8502hvJuQ==',key_name='tempest-keypair-1597632254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbef1a3853c14e3daa34b934269bb404',ramdisk_id='',reservation_id='r-xqcyykie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-268161223',owner_user_name='tempest-TaggedAttachmentsTest-268161223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:34:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97454d937cea4489b1c5e2b7dbbde8d5',uuid=1081cdc6-540d-4cb8-9e0d-d7584411e539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "address": "fa:16:3e:e5:ed:dc", "network": {"id": "637c588b-9807-4474-9ce4-42f9d9631794", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-90879599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f5a2e8-43", "ovs_interfaceid": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:35:00.701321 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Converting VIF {"id": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "address": "fa:16:3e:e5:ed:dc", "network": {"id": "637c588b-9807-4474-9ce4-42f9d9631794", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-90879599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f5a2e8-43", "ovs_interfaceid": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:35:00.701992 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ed:dc,bridge_name='br-int',has_traffic_filtering=True,id=e0f5a2e8-4380-464f-99dd-c33eaa062d63,network=Network(637c588b-9807-4474-9ce4-42f9d9631794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f5a2e8-43') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:35:00.702665 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lazy-loading 'pci_devices' on Instance uuid 1081cdc6-540d-4cb8-9e0d-d7584411e539 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:00.804248 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:00.835442 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:00.835635 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:00.958904 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:00.966739 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:01.148542 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-50165811-d489-403b-aa30-c736d697ca2c req-721c73be-c279-4673-a23c-87657ca5fce7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:01.206314 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] End _get_guest_xml xml=<domain type="qemu">
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:   <uuid>1081cdc6-540d-4cb8-9e0d-d7584411e539</uuid>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:   <name>instance-00000009</name>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <nova:name>tempest-device-tagging-server-1629521735</nova:name>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:35:00</nova:creationTime>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:         <nova:user uuid="97454d937cea4489b1c5e2b7dbbde8d5">tempest-TaggedAttachmentsTest-268161223-project-member</nova:user>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:         <nova:project uuid="dbef1a3853c14e3daa34b934269bb404">tempest-TaggedAttachmentsTest-268161223</nova:project>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:         <nova:port uuid="e0f5a2e8-4380-464f-99dd-c33eaa062d63">
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     <system>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <entry name="serial">1081cdc6-540d-4cb8-9e0d-d7584411e539</entry>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <entry name="uuid">1081cdc6-540d-4cb8-9e0d-d7584411e539</entry>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     </system>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:   <os>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:   </os>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:   <features>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:   </features>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:   <devices>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk"/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     </disk>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk.config"/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     </disk>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:e5:ed:dc"/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <target dev="tape0f5a2e8-43"/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     </interface>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/console.log" append="off"/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     </serial>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     <video>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     </video>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     </rng>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:   </devices>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]: </domain>
May 19 04:35:01.206314 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:35:01.209380 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Preparing to wait for external event network-vif-plugged-e0f5a2e8-4380-464f-99dd-c33eaa062d63 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:35:01.209380 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquiring lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:01.209380 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:01.209380 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:01.209380 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1629521735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1629521735',id=9,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEYnYF79S8BYxQZJ+dMTZjjdbQN3rcn72CWM+baGIlro7OTlpW3xu/PoWXZ+BC9Xw4nxCPqKjMoVyw2hgomsW56DUe6HIHrGodPsGgr/T3ioiXjmvIEBQenW8502hvJuQ==',key_name='tempest-keypair-1597632254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbef1a3853c14e3daa34b934269bb404',ramdisk_id='',reservation_id='r-xqcyykie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-268161223',owner_user_name='tempest-TaggedAttachmentsTest-268161223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:34:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97454d937cea4489b1c5e2b7dbbde8d5',uuid=1081cdc6-540d-4cb8-9e0d-d7584411e539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "address": "fa:16:3e:e5:ed:dc", "network": {"id": "637c588b-9807-4474-9ce4-42f9d9631794", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-90879599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f5a2e8-43", "ovs_interfaceid": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:35:01.209643 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Converting VIF {"id": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "address": "fa:16:3e:e5:ed:dc", "network": {"id": "637c588b-9807-4474-9ce4-42f9d9631794", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-90879599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f5a2e8-43", "ovs_interfaceid": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:35:01.209643 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ed:dc,bridge_name='br-int',has_traffic_filtering=True,id=e0f5a2e8-4380-464f-99dd-c33eaa062d63,network=Network(637c588b-9807-4474-9ce4-42f9d9631794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f5a2e8-43') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:35:01.209643 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ed:dc,bridge_name='br-int',has_traffic_filtering=True,id=e0f5a2e8-4380-464f-99dd-c33eaa062d63,network=Network(637c588b-9807-4474-9ce4-42f9d9631794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f5a2e8-43') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:35:01.209954 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:01.211275 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:01.211592 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:35:01.212857 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:01.213571 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad3c8c4c-f225-5747-bc3c-d5101141e0dd', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:01.214341 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:01.214917 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:35:01.216318 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:01.219416 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:01.219692 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0f5a2e8-43, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:01.221878 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape0f5a2e8-43, col_values=(('qos', UUID('8f08cddc-7f47-40da-b1a3-b0c30a013c8c')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:01.221878 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape0f5a2e8-43, col_values=(('external_ids', {'iface-id': 'e0f5a2e8-4380-464f-99dd-c33eaa062d63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:ed:dc', 'vm-uuid': '1081cdc6-540d-4cb8-9e0d-d7584411e539'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:01.221878 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:01.225026 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:35:01.231588 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:01.232872 np0000001025 nova-compute[97981]: INFO os_vif [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ed:dc,bridge_name='br-int',has_traffic_filtering=True,id=e0f5a2e8-4380-464f-99dd-c33eaa062d63,network=Network(637c588b-9807-4474-9ce4-42f9d9631794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f5a2e8-43')
May 19 04:35:01.584906 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-50165811-d489-403b-aa30-c736d697ca2c req-721c73be-c279-4673-a23c-87657ca5fce7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:01.730564 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-50165811-d489-403b-aa30-c736d697ca2c req-721c73be-c279-4673-a23c-87657ca5fce7 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Updated VIF entry in instance network info cache for port e0f5a2e8-4380-464f-99dd-c33eaa062d63. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:35:01.730800 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-50165811-d489-403b-aa30-c736d697ca2c req-721c73be-c279-4673-a23c-87657ca5fce7 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Updating instance_info_cache with network_info: [{"id": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "address": "fa:16:3e:e5:ed:dc", "network": {"id": "637c588b-9807-4474-9ce4-42f9d9631794", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-90879599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f5a2e8-43", "ovs_interfaceid": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:01.827405 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Removed pending STOPPED event for 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 due to new event <LifecycleEvent: 1779165301.8269691, 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 => Resumed> {{(pid=97981) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 19 04:35:01.827504 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165301.8269691, 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:35:01.827607 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] VM Resumed (Lifecycle Event)
May 19 04:35:01.833368 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-915655a6-d9ca-4717-ae77-6cee3e80c98f tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:35:02.238131 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f23d5d6a-543f-4572-bd85-0280cfc2afe7 req-f2b7ff9b-1428-4ab2-ada5-aeb84fd40cec service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received event network-vif-plugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:02.238131 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f23d5d6a-543f-4572-bd85-0280cfc2afe7 req-f2b7ff9b-1428-4ab2-ada5-aeb84fd40cec service nova] Acquiring lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:02.238131 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f23d5d6a-543f-4572-bd85-0280cfc2afe7 req-f2b7ff9b-1428-4ab2-ada5-aeb84fd40cec service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:02.238131 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f23d5d6a-543f-4572-bd85-0280cfc2afe7 req-f2b7ff9b-1428-4ab2-ada5-aeb84fd40cec service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:02.245734 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f23d5d6a-543f-4572-bd85-0280cfc2afe7 req-f2b7ff9b-1428-4ab2-ada5-aeb84fd40cec service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] No waiting events found dispatching network-vif-plugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:35:02.246866 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-f23d5d6a-543f-4572-bd85-0280cfc2afe7 req-f2b7ff9b-1428-4ab2-ada5-aeb84fd40cec service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received unexpected event network-vif-plugged-13c0c2a4-ed11-438d-a852-17bc610c6269 for instance with vm_state rescued and task_state None.
May 19 04:35:02.247015 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f23d5d6a-543f-4572-bd85-0280cfc2afe7 req-f2b7ff9b-1428-4ab2-ada5-aeb84fd40cec service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received event network-vif-plugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:02.247200 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f23d5d6a-543f-4572-bd85-0280cfc2afe7 req-f2b7ff9b-1428-4ab2-ada5-aeb84fd40cec service nova] Acquiring lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:02.247340 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f23d5d6a-543f-4572-bd85-0280cfc2afe7 req-f2b7ff9b-1428-4ab2-ada5-aeb84fd40cec service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:02.247437 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f23d5d6a-543f-4572-bd85-0280cfc2afe7 req-f2b7ff9b-1428-4ab2-ada5-aeb84fd40cec service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:02.247551 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f23d5d6a-543f-4572-bd85-0280cfc2afe7 req-f2b7ff9b-1428-4ab2-ada5-aeb84fd40cec service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] No waiting events found dispatching network-vif-plugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:35:02.247655 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-f23d5d6a-543f-4572-bd85-0280cfc2afe7 req-f2b7ff9b-1428-4ab2-ada5-aeb84fd40cec service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received unexpected event network-vif-plugged-13c0c2a4-ed11-438d-a852-17bc610c6269 for instance with vm_state rescued and task_state None.
May 19 04:35:02.248457 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50165811-d489-403b-aa30-c736d697ca2c req-721c73be-c279-4673-a23c-87657ca5fce7 service nova] Releasing lock "refresh_cache-1081cdc6-540d-4cb8-9e0d-d7584411e539" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:35:02.269210 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:02.332714 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:35:02.335478 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:35:02.766384 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:35:02.766521 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:35:02.766643 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] No VIF found with MAC fa:16:3e:e5:ed:dc, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:35:02.767095 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Using config drive
May 19 04:35:02.837621 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165302.8372977, 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:35:02.837815 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] VM Started (Lifecycle Event)
May 19 04:35:02.892156 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:02.962399 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0014772050001283787 future=<Future at 0x72185011ed20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:35:02.963381 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:35:02.963630 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=5.854623098000047 future=<Future at 0x721850164a40 state=cancelled>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:35:02.963758 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=5.8544751619999715 future=<Future at 0x721850164a40 state=cancelled>) was cancelled while queued, skipping {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:35:02.963873 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:35:02.966023 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Emitting event <LifecycleEvent: 1779165287.9607947, 13ba1e00-08ad-4da8-8258-92154f5925d2 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:35:02.966249 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] VM Stopped (Lifecycle Event)
May 19 04:35:03.272944 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:03.343536 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:35:03.345100 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:35:03.437462 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Creating config drive at /opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk.config
May 19 04:35:03.441678 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnh4w8vx0 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:03.461759 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-9b5d67a4-615a-4601-b6fc-445f6ec1cbba tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Unrescuing
May 19 04:35:03.462200 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9b5d67a4-615a-4601-b6fc-445f6ec1cbba tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "refresh_cache-4866cabb-0595-4fe5-8be5-ebf4ed9c8f94" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:35:03.462370 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9b5d67a4-615a-4601-b6fc-445f6ec1cbba tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquired lock "refresh_cache-4866cabb-0595-4fe5-8be5-ebf4ed9c8f94" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:35:03.462559 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9b5d67a4-615a-4601-b6fc-445f6ec1cbba tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:35:03.472427 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 13ba1e00-08ad-4da8-8258-92154f5925d2] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:35:03.490855 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnh4w8vx0" returned: 0 in 0.049s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:03.849531 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 19 04:35:03.969360 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-9b5d67a4-615a-4601-b6fc-445f6ec1cbba tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:03.999834 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:04.020742 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:04.024820 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:04.145398 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:04.290531 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ca8c2206-0e96-473f-bfeb-70d5cabb20ac req-0deb8692-7088-4ab4-ba10-53d65ab830c4 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Received event network-vif-plugged-e0f5a2e8-4380-464f-99dd-c33eaa062d63 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:04.292219 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ca8c2206-0e96-473f-bfeb-70d5cabb20ac req-0deb8692-7088-4ab4-ba10-53d65ab830c4 service nova] Acquiring lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:04.292219 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ca8c2206-0e96-473f-bfeb-70d5cabb20ac req-0deb8692-7088-4ab4-ba10-53d65ab830c4 service nova] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:04.292219 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ca8c2206-0e96-473f-bfeb-70d5cabb20ac req-0deb8692-7088-4ab4-ba10-53d65ab830c4 service nova] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:04.292644 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ca8c2206-0e96-473f-bfeb-70d5cabb20ac req-0deb8692-7088-4ab4-ba10-53d65ab830c4 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Processing event network-vif-plugged-e0f5a2e8-4380-464f-99dd-c33eaa062d63 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:35:04.423260 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:04.423403 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:04.429063 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:04.431015 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:04.454176 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:04.525608 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-9b5d67a4-615a-4601-b6fc-445f6ec1cbba tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:04.857699 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:04.978264 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9b5d67a4-615a-4601-b6fc-445f6ec1cbba tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Updating instance_info_cache with network_info: [{"id": "13c0c2a4-ed11-438d-a852-17bc610c6269", "address": "fa:16:3e:81:21:90", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c0c2a4-ed", "ovs_interfaceid": "13c0c2a4-ed11-438d-a852-17bc610c6269", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:05.121161 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:35:05.121518 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165305.1212943, 1081cdc6-540d-4cb8-9e0d-d7584411e539 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:35:05.121641 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] VM Started (Lifecycle Event)
May 19 04:35:05.127157 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:35:05.134138 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Instance spawned successfully.
May 19 04:35:05.134138 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:35:05.481138 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9b5d67a4-615a-4601-b6fc-445f6ec1cbba tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Releasing lock "refresh_cache-4866cabb-0595-4fe5-8be5-ebf4ed9c8f94" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:35:05.481794 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-9b5d67a4-615a-4601-b6fc-445f6ec1cbba tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'flavor' on Instance uuid 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:05.625519 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:35:05.629766 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:35:05.641693 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:35:05.641834 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:35:05.642217 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:35:05.642487 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:35:05.642791 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:35:05.643125 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:35:06.056541 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:06.082876 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:06.135685 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:35:06.135959 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165306.1357358, 1081cdc6-540d-4cb8-9e0d-d7584411e539 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:35:06.136094 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] VM Paused (Lifecycle Event)
May 19 04:35:06.151063 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Took 6.97 seconds to spawn the instance on the hypervisor.
May 19 04:35:06.151063 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:35:06.230455 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:06.285363 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:06.291952 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:06.380620 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-121c76c9-264d-4acf-b9c0-152581643a16 req-731d5409-87cc-4f65-806c-109690445ae0 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Received event network-vif-plugged-e0f5a2e8-4380-464f-99dd-c33eaa062d63 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:06.380871 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-121c76c9-264d-4acf-b9c0-152581643a16 req-731d5409-87cc-4f65-806c-109690445ae0 service nova] Acquiring lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:06.381076 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-121c76c9-264d-4acf-b9c0-152581643a16 req-731d5409-87cc-4f65-806c-109690445ae0 service nova] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:06.381259 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-121c76c9-264d-4acf-b9c0-152581643a16 req-731d5409-87cc-4f65-806c-109690445ae0 service nova] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:06.381429 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-121c76c9-264d-4acf-b9c0-152581643a16 req-731d5409-87cc-4f65-806c-109690445ae0 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] No waiting events found dispatching network-vif-plugged-e0f5a2e8-4380-464f-99dd-c33eaa062d63 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:35:06.381588 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-121c76c9-264d-4acf-b9c0-152581643a16 req-731d5409-87cc-4f65-806c-109690445ae0 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Received unexpected event network-vif-plugged-e0f5a2e8-4380-464f-99dd-c33eaa062d63 for instance with vm_state active and task_state None.
May 19 04:35:06.410958 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Instance destroyed successfully.
May 19 04:35:06.411323 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-9b5d67a4-615a-4601-b6fc-445f6ec1cbba tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'numa_topology' on Instance uuid 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:06.641313 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:35:06.643353 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165306.643104, 1081cdc6-540d-4cb8-9e0d-d7584411e539 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:35:06.643501 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] VM Resumed (Lifecycle Event)
May 19 04:35:06.666688 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Took 12.74 seconds to build instance.
May 19 04:35:06.913218 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-9b5d67a4-615a-4601-b6fc-445f6ec1cbba tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Object Instance<4866cabb-0595-4fe5-8be5-ebf4ed9c8f94> lazy-loaded attributes: flavor,numa_topology {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:35:07.147382 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:35:07.150677 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:35:07.170282 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.260s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:07.440302 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:07.480750 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:07.576177 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:07.622010 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:07.624530 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:07.655835 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999512251999931 future=<Future at 0x72185030a8d0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:35:07.657450 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.996202474000029 future=<Future at 0x72185030a8d0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:35:07.657603 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.996025825999823 future=<Future at 0x72185030a8d0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:35:07.891124 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:08.439867 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f0a5e18e-2093-4c18-b402-bd4febb61b96 req-be9f62c0-020d-4bf2-80b7-9dec7aa587ca service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Received event network-changed-e0f5a2e8-4380-464f-99dd-c33eaa062d63 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:08.441727 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f0a5e18e-2093-4c18-b402-bd4febb61b96 req-be9f62c0-020d-4bf2-80b7-9dec7aa587ca service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Refreshing instance network info cache due to event network-changed-e0f5a2e8-4380-464f-99dd-c33eaa062d63. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:35:08.443463 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f0a5e18e-2093-4c18-b402-bd4febb61b96 req-be9f62c0-020d-4bf2-80b7-9dec7aa587ca service nova] Acquiring lock "refresh_cache-1081cdc6-540d-4cb8-9e0d-d7584411e539" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:35:08.443463 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f0a5e18e-2093-4c18-b402-bd4febb61b96 req-be9f62c0-020d-4bf2-80b7-9dec7aa587ca service nova] Acquired lock "refresh_cache-1081cdc6-540d-4cb8-9e0d-d7584411e539" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:35:08.443463 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-f0a5e18e-2093-4c18-b402-bd4febb61b96 req-be9f62c0-020d-4bf2-80b7-9dec7aa587ca service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Refreshing network info cache for port e0f5a2e8-4380-464f-99dd-c33eaa062d63 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:35:08.452481 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Removed pending STOPPED event for 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 due to new event <LifecycleEvent: 1779165308.4522002, 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 => Resumed> {{(pid=97981) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 19 04:35:08.452719 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165308.4522002, 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:35:08.455341 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] VM Resumed (Lifecycle Event)
May 19 04:35:08.460096 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9b5d67a4-615a-4601-b6fc-445f6ec1cbba tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:35:08.944592 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-f0a5e18e-2093-4c18-b402-bd4febb61b96 req-be9f62c0-020d-4bf2-80b7-9dec7aa587ca service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:08.962129 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:35:08.965394 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:35:09.306013 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-f0a5e18e-2093-4c18-b402-bd4febb61b96 req-be9f62c0-020d-4bf2-80b7-9dec7aa587ca service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:09.468959 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165309.4687052, 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:35:09.469073 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] VM Started (Lifecycle Event)
May 19 04:35:09.477018 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-f0a5e18e-2093-4c18-b402-bd4febb61b96 req-be9f62c0-020d-4bf2-80b7-9dec7aa587ca service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Updated VIF entry in instance network info cache for port e0f5a2e8-4380-464f-99dd-c33eaa062d63. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:35:09.477309 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-f0a5e18e-2093-4c18-b402-bd4febb61b96 req-be9f62c0-020d-4bf2-80b7-9dec7aa587ca service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Updating instance_info_cache with network_info: [{"id": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "address": "fa:16:3e:e5:ed:dc", "network": {"id": "637c588b-9807-4474-9ce4-42f9d9631794", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-90879599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f5a2e8-43", "ovs_interfaceid": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:09.583646 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:09.979282 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:35:09.981573 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f0a5e18e-2093-4c18-b402-bd4febb61b96 req-be9f62c0-020d-4bf2-80b7-9dec7aa587ca service nova] Releasing lock "refresh_cache-1081cdc6-540d-4cb8-9e0d-d7584411e539" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:35:09.985014 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:35:10.767713 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c6167c9b-e13a-4b7e-a1ab-36130f99d48c req-b7791631-db35-44da-880f-7ec941862397 service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received event network-vif-unplugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:10.771506 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c6167c9b-e13a-4b7e-a1ab-36130f99d48c req-b7791631-db35-44da-880f-7ec941862397 service nova] Acquiring lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:10.771769 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c6167c9b-e13a-4b7e-a1ab-36130f99d48c req-b7791631-db35-44da-880f-7ec941862397 service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:10.772005 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c6167c9b-e13a-4b7e-a1ab-36130f99d48c req-b7791631-db35-44da-880f-7ec941862397 service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:10.772165 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c6167c9b-e13a-4b7e-a1ab-36130f99d48c req-b7791631-db35-44da-880f-7ec941862397 service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] No waiting events found dispatching network-vif-unplugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:35:10.772336 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-c6167c9b-e13a-4b7e-a1ab-36130f99d48c req-b7791631-db35-44da-880f-7ec941862397 service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received unexpected event network-vif-unplugged-13c0c2a4-ed11-438d-a852-17bc610c6269 for instance with vm_state active and task_state None.
May 19 04:35:11.231757 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:11.715338 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:12.895418 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-502fc011-f12f-43cc-bbef-0d8971516ddb req-2143c221-a99f-4678-8c35-188f6846de5c service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received event network-vif-unplugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:12.895903 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-502fc011-f12f-43cc-bbef-0d8971516ddb req-2143c221-a99f-4678-8c35-188f6846de5c service nova] Acquiring lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:12.898659 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-502fc011-f12f-43cc-bbef-0d8971516ddb req-2143c221-a99f-4678-8c35-188f6846de5c service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:12.899533 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:12.901704 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-502fc011-f12f-43cc-bbef-0d8971516ddb req-2143c221-a99f-4678-8c35-188f6846de5c service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:12.901978 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-502fc011-f12f-43cc-bbef-0d8971516ddb req-2143c221-a99f-4678-8c35-188f6846de5c service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] No waiting events found dispatching network-vif-unplugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:35:12.903388 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-502fc011-f12f-43cc-bbef-0d8971516ddb req-2143c221-a99f-4678-8c35-188f6846de5c service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received unexpected event network-vif-unplugged-13c0c2a4-ed11-438d-a852-17bc610c6269 for instance with vm_state active and task_state None.
May 19 04:35:12.903619 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-502fc011-f12f-43cc-bbef-0d8971516ddb req-2143c221-a99f-4678-8c35-188f6846de5c service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received event network-vif-plugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:12.904164 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-502fc011-f12f-43cc-bbef-0d8971516ddb req-2143c221-a99f-4678-8c35-188f6846de5c service nova] Acquiring lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:12.905340 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-502fc011-f12f-43cc-bbef-0d8971516ddb req-2143c221-a99f-4678-8c35-188f6846de5c service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:12.905340 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-502fc011-f12f-43cc-bbef-0d8971516ddb req-2143c221-a99f-4678-8c35-188f6846de5c service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:12.905340 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-502fc011-f12f-43cc-bbef-0d8971516ddb req-2143c221-a99f-4678-8c35-188f6846de5c service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] No waiting events found dispatching network-vif-plugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:35:12.905340 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-502fc011-f12f-43cc-bbef-0d8971516ddb req-2143c221-a99f-4678-8c35-188f6846de5c service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received unexpected event network-vif-plugged-13c0c2a4-ed11-438d-a852-17bc610c6269 for instance with vm_state active and task_state None.
May 19 04:35:12.905340 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-502fc011-f12f-43cc-bbef-0d8971516ddb req-2143c221-a99f-4678-8c35-188f6846de5c service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received event network-vif-plugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:12.905340 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-502fc011-f12f-43cc-bbef-0d8971516ddb req-2143c221-a99f-4678-8c35-188f6846de5c service nova] Acquiring lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:12.905340 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-502fc011-f12f-43cc-bbef-0d8971516ddb req-2143c221-a99f-4678-8c35-188f6846de5c service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:12.905660 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-502fc011-f12f-43cc-bbef-0d8971516ddb req-2143c221-a99f-4678-8c35-188f6846de5c service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:12.905660 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-502fc011-f12f-43cc-bbef-0d8971516ddb req-2143c221-a99f-4678-8c35-188f6846de5c service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] No waiting events found dispatching network-vif-plugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:35:12.905784 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-502fc011-f12f-43cc-bbef-0d8971516ddb req-2143c221-a99f-4678-8c35-188f6846de5c service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received unexpected event network-vif-plugged-13c0c2a4-ed11-438d-a852-17bc610c6269 for instance with vm_state active and task_state None.
May 19 04:35:14.947910 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:14.948443 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:15.276375 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Acquiring lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:15.276585 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:15.450941 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:35:15.471630 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Acquiring lock "95780667-2e87-4bef-ab7f-f98ab044c03e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:15.471769 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:15.780310 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Lazy-loading 'flavor' on Instance uuid 8926c69b-c0ce-47e5-a3b6-ddbdeff44963 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:16.077941 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lazy-loading 'flavor' on Instance uuid 95780667-2e87-4bef-ab7f-f98ab044c03e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:16.139905 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:16.140090 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:16.142736 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:35:16.142893 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Claim successful on node np0000001025
May 19 04:35:16.232852 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:16.786314 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:17.091692 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.620s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:17.620275 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:35:17.620497 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:35:17.898986 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:18.123226 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:35:18.334845 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Acquiring lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:18.335100 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:18.335346 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Attaching volume dceec4dc-5452-4668-ab02-6ca89873c0ee to /dev/vdb
May 19 04:35:18.387962 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:35:18.398157 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:35:18.420027 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:18.456101 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:35:18.458568 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:35:18.470487 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:35:18.472602 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::e86a:f3ff:fee3:83a1', 'fe80::fc16:3eff:fe94:e53c', 'fe80::986d:f6ff:feb5:7cbc', 'fe80::fc16:3eff:fedf:6f5d', 'fe80::2c03:76ff:fe4b:5798', 'fe80::fc16:3eff:fea0:92d3', 'fe80::98fd:dbff:fefe:cdf5', 'fe80::fc16:3eff:feca:fa0b', 'fe80::fc16:3eff:fe8a:28ef', 'fe80::fc16:3eff:fe40:b1c7', 'fe80::74d3:60ff:fec2:dcbf', 'fe80::fc16:3eff:fee5:eddc', 'fe80::cc29:a6ff:fef5:800e', 'fe80::fc16:3eff:fe81:2190'] 
May 19 04:35:18.472789 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:35:18.472907 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:35:18.473283 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:35:18.473852 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Updating existing volume attachment record: d1b45a01-bde9-4e51-a45f-fd00957310c8 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:35:18.500385 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Acquiring lock "95780667-2e87-4bef-ab7f-f98ab044c03e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:18.500627 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:18.500957 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Attaching volume 86e048ad-58c7-4c9f-9863-c889c14a93f6 to /dev/sdc
May 19 04:35:18.553654 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:35:18.575508 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:35:18.596346 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:18.623826 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:35:18.624095 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:35:18.632138 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.492s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:18.634282 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:35:18.639490 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:35:18.645293 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::e86a:f3ff:fee3:83a1', 'fe80::fc16:3eff:fe94:e53c', 'fe80::986d:f6ff:feb5:7cbc', 'fe80::fc16:3eff:fedf:6f5d', 'fe80::2c03:76ff:fe4b:5798', 'fe80::fc16:3eff:fea0:92d3', 'fe80::98fd:dbff:fefe:cdf5', 'fe80::fc16:3eff:feca:fa0b', 'fe80::fc16:3eff:fe8a:28ef', 'fe80::fc16:3eff:fe40:b1c7', 'fe80::74d3:60ff:fec2:dcbf', 'fe80::fc16:3eff:fee5:eddc', 'fe80::cc29:a6ff:fef5:800e', 'fe80::fc16:3eff:fe81:2190'] 
May 19 04:35:18.645758 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:35:18.645951 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:35:18.646296 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:35:18.646551 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Updating existing volume attachment record: 73bb7ab2-c729-4edd-b579-b956f0099c56 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:35:19.035456 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:35:19.035834 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee', 'iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dceec4dc-5452-4668-ab02-6ca89873c0ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:35:19.036315 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:35:19.036506 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:35:19.036743 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee', 'iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dceec4dc-5452-4668-ab02-6ca89873c0ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:35:19.051004 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:35:19.051853 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:35:19.052318 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:35:19.052731 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:35:19.052935 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:35:19.053140 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:35:19.066356 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:35:19.066356 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:19.073776 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:35:19.073776 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:19.083679 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee] added
May 19 04:35:19.083679 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:35:19.083679 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:35:19.083679 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:35:19.083679 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:35:19.083679 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:35:19.083679 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:19.083975 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:35:19.083975 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0314(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:35:19.084156 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:35:19.087995 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee] added
May 19 04:35:19.087995 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:35:19.087995 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:35:19.087995 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:35:19.087995 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:35:19.087995 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:35:19.087995 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:19.088325 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:35:19.088325 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0352(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:35:19.088437 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:35:19.157761 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:35:19.159733 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:35:19.159733 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:19.159733 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:19.216376 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:35:19.216702 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6', 'iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86e048ad-58c7-4c9f-9863-c889c14a93f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:35:19.216876 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:35:19.239501 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cdf106961084f0e941b5b65911c9b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b83c8d3714844830f961673658b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:35:19.660658 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:35:19.867337 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Successfully created port: fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:35:20.084682 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:35:20.088862 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:35:20.098774 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:35:20.098774 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:35:20.105258 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:35:20.105258 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:20.112158 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:20.119524 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:20.128375 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:20.128375 np0000001025 nova-compute[97981]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:20.128375 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:35:20.129561 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:20.129561 np0000001025 nova-compute[97981]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:20.129561 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:35:20.136131 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:20.136131 np0000001025 nova-compute[97981]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:20.136131 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:35:20.136131 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:20.136131 np0000001025 nova-compute[97981]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:20.136131 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:35:20.164894 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee, portal: 192.168.40.100,3260]
May 19 04:35:20.164894 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee, portal: 192.168.40.100,3260] successful.
May 19 04:35:20.164894 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:20.168503 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:35:20.181547 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:20.187265 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee, portal: 192.168.50.100,3260]
May 19 04:35:20.187265 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee, portal: 192.168.50.100,3260] successful.
May 19 04:35:20.187265 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:20.197184 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:20.197184 np0000001025 nova-compute[97981]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:20.197184 np0000001025 nova-compute[97981]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:20.197184 np0000001025 nova-compute[97981]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:20.197184 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:35:20.197184 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:20.197184 np0000001025 nova-compute[97981]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:20.197184 np0000001025 nova-compute[97981]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:20.197184 np0000001025 nova-compute[97981]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:20.197184 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:35:20.197546 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:35:20.197546 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:35:20.200206 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:20.200206 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] HCTL ('9', '-', '-', 0) found on session 7 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:35:20.200206 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Scanning host 9 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:35:20.215395 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:20.215395 np0000001025 nova-compute[97981]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:20.215395 np0000001025 nova-compute[97981]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:20.215395 np0000001025 nova-compute[97981]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:20.215395 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:35:20.215619 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:20.215619 np0000001025 nova-compute[97981]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:20.215619 np0000001025 nova-compute[97981]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:20.215619 np0000001025 nova-compute[97981]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:20.215619 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:35:20.215841 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:35:20.215841 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:35:20.217298 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] HCTL ('10', '-', '-', 0) found on session 8 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:35:20.217298 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Scanning host 10 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:35:20.233377 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Searching for a device in session 7 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:35:20.233377 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dceec4dc-5452-4668-ab02-6ca89873c0ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:35:20.249284 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Searching for a device in session 8 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:35:20.249284 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dceec4dc-5452-4668-ab02-6ca89873c0ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:35:20.521339 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Successfully updated port: fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:35:20.584009 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-034f880f-c640-450d-bfb7-82cf8e79024b req-52962e6a-811b-4532-a978-b735868218cc service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received event network-changed-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:20.584191 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-034f880f-c640-450d-bfb7-82cf8e79024b req-52962e6a-811b-4532-a978-b735868218cc service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Refreshing instance network info cache due to event network-changed-fe8167e8-425b-4446-a2e8-84711a2be7dd. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:35:20.584456 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-034f880f-c640-450d-bfb7-82cf8e79024b req-52962e6a-811b-4532-a978-b735868218cc service nova] Acquiring lock "refresh_cache-b5f34a29-15f7-4f5e-a8bf-574abebd5c84" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:35:20.584512 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-034f880f-c640-450d-bfb7-82cf8e79024b req-52962e6a-811b-4532-a978-b735868218cc service nova] Acquired lock "refresh_cache-b5f34a29-15f7-4f5e-a8bf-574abebd5c84" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:35:20.584632 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-034f880f-c640-450d-bfb7-82cf8e79024b req-52962e6a-811b-4532-a978-b735868218cc service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Refreshing network info cache for port fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:35:21.024263 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "refresh_cache-b5f34a29-15f7-4f5e-a8bf-574abebd5c84" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:35:21.052605 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:35:21.087486 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-034f880f-c640-450d-bfb7-82cf8e79024b req-52962e6a-811b-4532-a978-b735868218cc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:21.172796 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-034f880f-c640-450d-bfb7-82cf8e79024b req-52962e6a-811b-4532-a978-b735868218cc service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:35:21.177161 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:35:21.178077 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:35:21.178358 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Creating image(s)
May 19 04:35:21.178919 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:21.179963 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "/opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:21.179963 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "/opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:21.181122 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:35:21.184033 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:35:21.185418 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:21.241580 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:21.264577 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.079s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:21.265217 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:21.265615 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:21.266013 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:35:21.269378 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:35:21.269695 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:21.360831 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.091s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:21.362198 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:21.392424 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-034f880f-c640-450d-bfb7-82cf8e79024b req-52962e6a-811b-4532-a978-b735868218cc service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:21.412745 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk 1073741824" returned: 0 in 0.050s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:21.413304 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.148s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:21.413716 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:21.520344 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.106s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:21.524133 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:35:21.524133 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:21.608119 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:21.608693 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Cannot resize image /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:35:21.609431 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:35:21.609832 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Ensure instance console log exists: /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:35:21.610261 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:21.610613 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:21.610826 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:21.896915 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-034f880f-c640-450d-bfb7-82cf8e79024b req-52962e6a-811b-4532-a978-b735868218cc service nova] Releasing lock "refresh_cache-b5f34a29-15f7-4f5e-a8bf-574abebd5c84" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:35:21.897374 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquired lock "refresh_cache-b5f34a29-15f7-4f5e-a8bf-574abebd5c84" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:35:21.897546 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:35:22.071927 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Found WWN 3300000007137e607 for multipath device dm-3 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:35:22.072357 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:35:22.072591 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000007137e607', 'path': '/dev/dm-3', 'multipath_id': '3300000007137e607'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:35:22.072799 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007137e607', 'path': '/dev/dm-3', 'multipath_id': '3300000007137e607'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:35:22.073670 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.857s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:35:22.074052 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6', 'iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86e048ad-58c7-4c9f-9863-c889c14a93f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:35:22.077980 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Lazy-loading 'flavor' on Instance uuid 8926c69b-c0ce-47e5-a3b6-ddbdeff44963 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:22.087951 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:35:22.088358 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:35:22.088560 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:35:22.089920 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:35:22.089920 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:35:22.089920 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:35:22.102384 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:35:22.102384 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:22.104760 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:35:22.104760 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:22.115770 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6] added
May 19 04:35:22.115770 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:35:22.115770 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:35:22.115770 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:35:22.115770 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:35:22.115770 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:35:22.115770 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:22.116079 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:35:22.116240 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0276(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:35:22.116407 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:35:22.122382 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6] added
May 19 04:35:22.122382 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:35:22.122382 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:35:22.122382 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:35:22.122382 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:35:22.122382 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:35:22.122382 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:22.122382 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:35:22.122382 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0324(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:35:22.122382 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:35:22.460201 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:35:22.583650 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Attempting to attach volume dceec4dc-5452-4668-ab02-6ca89873c0ee with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:35:22.585093 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] attach device xml: <disk type="block" device="disk">
May 19 04:35:22.585093 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:35:22.585093 np0000001025 nova-compute[97981]:   <alias name="ua-dceec4dc-5452-4668-ab02-6ca89873c0ee"/>
May 19 04:35:22.585093 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-3"/>
May 19 04:35:22.585093 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:35:22.585093 np0000001025 nova-compute[97981]:   <serial>dceec4dc-5452-4668-ab02-6ca89873c0ee</serial>
May 19 04:35:22.585093 np0000001025 nova-compute[97981]: </disk>
May 19 04:35:22.585093 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:35:22.634477 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:22.654052 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00034854700015785056 future=<Future at 0x72185030a8d0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:35:22.654206 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:35:22.809931 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Updating instance_info_cache with network_info: [{"id": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "address": "fa:16:3e:7d:73:e6", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe8167e8-42", "ovs_interfaceid": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:22.898392 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:23.117166 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:35:23.127944 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:35:23.136404 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:35:23.136404 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:35:23.147695 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:35:23.147695 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:23.155546 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:23.166796 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:23.172126 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:23.172126 np0000001025 nova-compute[97981]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:23.172126 np0000001025 nova-compute[97981]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:23.172126 np0000001025 nova-compute[97981]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:23.172126 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:35:23.172469 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:23.172469 np0000001025 nova-compute[97981]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:23.172469 np0000001025 nova-compute[97981]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:23.172469 np0000001025 nova-compute[97981]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:23.172469 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:35:23.179952 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:23.179952 np0000001025 nova-compute[97981]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:23.179952 np0000001025 nova-compute[97981]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:23.179952 np0000001025 nova-compute[97981]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:23.179952 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:35:23.180232 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:23.180232 np0000001025 nova-compute[97981]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:23.180232 np0000001025 nova-compute[97981]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:23.180232 np0000001025 nova-compute[97981]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:23.180232 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:35:23.217001 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6, portal: 192.168.50.100,3260]
May 19 04:35:23.217001 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6, portal: 192.168.50.100,3260] successful.
May 19 04:35:23.217001 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:23.229941 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:23.230587 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6, portal: 192.168.40.100,3260]
May 19 04:35:23.230587 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6, portal: 192.168.40.100,3260] successful.
May 19 04:35:23.230587 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:23.242589 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:23.252164 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6 (non-flash)
May 19 04:35:23.252164 np0000001025 nova-compute[97981]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:23.252164 np0000001025 nova-compute[97981]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:23.252164 np0000001025 nova-compute[97981]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:23.252164 np0000001025 nova-compute[97981]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:23.252164 np0000001025 nova-compute[97981]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6 (non-flash)
May 19 04:35:23.252164 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:35:23.252164 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6 (non-flash)
May 19 04:35:23.252164 np0000001025 nova-compute[97981]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:23.252164 np0000001025 nova-compute[97981]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:23.252164 np0000001025 nova-compute[97981]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:23.252164 np0000001025 nova-compute[97981]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:23.252164 np0000001025 nova-compute[97981]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6 (non-flash)
May 19 04:35:23.252164 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:35:23.252164 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.162s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:35:23.252164 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:35:23.254447 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] HCTL ('11', '-', '-', 0) found on session 9 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:35:23.254447 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:35:23.260934 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6 (non-flash)
May 19 04:35:23.260934 np0000001025 nova-compute[97981]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:23.260934 np0000001025 nova-compute[97981]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:23.260934 np0000001025 nova-compute[97981]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:23.260934 np0000001025 nova-compute[97981]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:23.260934 np0000001025 nova-compute[97981]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6 (non-flash)
May 19 04:35:23.260934 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:35:23.261311 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6 (non-flash)
May 19 04:35:23.261311 np0000001025 nova-compute[97981]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:23.261311 np0000001025 nova-compute[97981]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:35:23.261311 np0000001025 nova-compute[97981]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:23.261311 np0000001025 nova-compute[97981]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:23.261311 np0000001025 nova-compute[97981]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6 (non-flash)
May 19 04:35:23.261311 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:35:23.261533 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:35:23.261759 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:35:23.263313 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] HCTL ('12', '-', '-', 0) found on session 10 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:35:23.263517 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:35:23.277061 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Searching for a device in session 9 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:35:23.277061 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '86e048ad-58c7-4c9f-9863-c889c14a93f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:35:23.286779 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Searching for a device in session 10 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:35:23.287079 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86e048ad-58c7-4c9f-9863-c889c14a93f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:35:23.311926 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Releasing lock "refresh_cache-b5f34a29-15f7-4f5e-a8bf-574abebd5c84" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:35:23.312380 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Instance network_info: |[{"id": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "address": "fa:16:3e:7d:73:e6", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe8167e8-42", "ovs_interfaceid": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:35:23.314568 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Start _get_guest_xml network_info=[{"id": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "address": "fa:16:3e:7d:73:e6", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe8167e8-42", "ovs_interfaceid": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:35:23.324132 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:35:23.324536 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-610177958', uuid='b5f34a29-15f7-4f5e-a8bf-574abebd5c84'), owner=OwnerMeta(userid='7cdf106961084f0e941b5b65911c9b76', username='tempest-ServerRescueNegativeTestJSON-1305117099-project-member', projectid='334b83c8d3714844830f961673658b20', projectname='tempest-ServerRescueNegativeTestJSON-1305117099'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "address": "fa:16:3e:7d:73:e6", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe8167e8-42", "ovs_interfaceid": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165323.3226292) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:35:23.326255 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:35:23.326848 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:35:23.332609 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:35:23.333238 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:35:23.334986 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:35:23.335604 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:35:23.336201 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:35:23.336361 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:35:23.338119 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:35:23.338119 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:35:23.338119 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:35:23.338119 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:35:23.338119 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:35:23.338119 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:35:23.338119 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:35:23.338481 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:35:23.353893 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-610177958',display_name='tempest-ServerRescueNegativeTestJSON-server-610177958',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverrescuenegativetestjson-server-610177958',id=10,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEof4N14+Ak1LVBtAkPut88JFqrfziujXkwzhlzzGWikBF+XeYH2EhInUSGhj5W54Gw3WfzaAmJeE58MxA5o/wrrspO3oas8tLUUdfN0O59dnL6RW93aVKiG3Fu6+namUQ==',key_name='tempest-keypair-541496426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='334b83c8d3714844830f961673658b20',ramdisk_id='',reservation_id='r-rbufrcjf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1305117099',owner_user_name='tempest-ServerRescueNegativeTestJSON-1305117099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:35:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cdf106961084f0e941b5b65911c9b76',uuid=b5f34a29-15f7-4f5e-a8bf-574abebd5c84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "address": "fa:16:3e:7d:73:e6", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe8167e8-42", "ovs_interfaceid": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:35:23.354453 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converting VIF {"id": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "address": "fa:16:3e:7d:73:e6", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe8167e8-42", "ovs_interfaceid": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:35:23.355528 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:73:e6,bridge_name='br-int',has_traffic_filtering=True,id=fe8167e8-425b-4446-a2e8-84711a2be7dd,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe8167e8-42') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:35:23.356517 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'pci_devices' on Instance uuid b5f34a29-15f7-4f5e-a8bf-574abebd5c84 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:23.859776 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] End _get_guest_xml xml=<domain type="qemu">
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:   <uuid>b5f34a29-15f7-4f5e-a8bf-574abebd5c84</uuid>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:   <name>instance-0000000a</name>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-610177958</nova:name>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:35:23</nova:creationTime>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:         <nova:user uuid="7cdf106961084f0e941b5b65911c9b76">tempest-ServerRescueNegativeTestJSON-1305117099-project-member</nova:user>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:         <nova:project uuid="334b83c8d3714844830f961673658b20">tempest-ServerRescueNegativeTestJSON-1305117099</nova:project>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:         <nova:port uuid="fe8167e8-425b-4446-a2e8-84711a2be7dd">
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     <system>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <entry name="serial">b5f34a29-15f7-4f5e-a8bf-574abebd5c84</entry>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <entry name="uuid">b5f34a29-15f7-4f5e-a8bf-574abebd5c84</entry>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     </system>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:   <os>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:   </os>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:   <features>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:   </features>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:   <devices>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk"/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     </disk>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk.config"/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     </disk>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:7d:73:e6"/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <target dev="tapfe8167e8-42"/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     </interface>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/console.log" append="off"/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     </serial>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     <video>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     </video>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     </rng>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:   </devices>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]: </domain>
May 19 04:35:23.859776 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:35:23.862161 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Preparing to wait for external event network-vif-plugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:35:23.862161 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:23.862161 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:23.862161 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:23.862161 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-610177958',display_name='tempest-ServerRescueNegativeTestJSON-server-610177958',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverrescuenegativetestjson-server-610177958',id=10,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEof4N14+Ak1LVBtAkPut88JFqrfziujXkwzhlzzGWikBF+XeYH2EhInUSGhj5W54Gw3WfzaAmJeE58MxA5o/wrrspO3oas8tLUUdfN0O59dnL6RW93aVKiG3Fu6+namUQ==',key_name='tempest-keypair-541496426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='334b83c8d3714844830f961673658b20',ramdisk_id='',reservation_id='r-rbufrcjf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1305117099',owner_user_name='tempest-ServerRescueNegativeTestJSON-1305117099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:35:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cdf106961084f0e941b5b65911c9b76',uuid=b5f34a29-15f7-4f5e-a8bf-574abebd5c84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "address": "fa:16:3e:7d:73:e6", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe8167e8-42", "ovs_interfaceid": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:35:23.862528 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converting VIF {"id": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "address": "fa:16:3e:7d:73:e6", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe8167e8-42", "ovs_interfaceid": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:35:23.862528 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:73:e6,bridge_name='br-int',has_traffic_filtering=True,id=fe8167e8-425b-4446-a2e8-84711a2be7dd,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe8167e8-42') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:35:23.862659 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:73:e6,bridge_name='br-int',has_traffic_filtering=True,id=fe8167e8-425b-4446-a2e8-84711a2be7dd,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe8167e8-42') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:35:23.862994 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:23.863271 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:23.863556 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:35:23.864444 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:23.864617 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b70399a-46f1-5f85-a586-f0574a5bdd53', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:23.865395 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:23.866035 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:35:23.866614 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:23.868297 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:23.868551 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe8167e8-42, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:23.868916 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe8167e8-42, col_values=(('qos', UUID('c088ddc2-a5f1-42eb-9d3a-5d942694b2c0')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:23.869140 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe8167e8-42, col_values=(('external_ids', {'iface-id': 'fe8167e8-425b-4446-a2e8-84711a2be7dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:73:e6', 'vm-uuid': 'b5f34a29-15f7-4f5e-a8bf-574abebd5c84'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:23.869942 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:23.871235 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:35:23.876057 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:23.876900 np0000001025 nova-compute[97981]: INFO os_vif [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:73:e6,bridge_name='br-int',has_traffic_filtering=True,id=fe8167e8-425b-4446-a2e8-84711a2be7dd,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe8167e8-42')
May 19 04:35:24.089934 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:35:24.269398 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:35:24.269398 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:35:24.269398 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:35:24.269635 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] No VIF found with MAC fa:16:3e:df:6f:5d, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:35:25.110910 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Found WWN 33000000017c5a284 for multipath device dm-4 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:35:25.111555 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:35:25.111555 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] <== connect_volume: return (5894ms) {'type': 'block', 'scsi_wwn': '33000000017c5a284', 'path': '/dev/dm-4', 'multipath_id': '33000000017c5a284'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:35:25.111699 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000017c5a284', 'path': '/dev/dm-4', 'multipath_id': '33000000017c5a284'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:35:25.114962 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lazy-loading 'flavor' on Instance uuid 95780667-2e87-4bef-ab7f-f98ab044c03e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:25.394809 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:35:25.394916 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:35:25.395038 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No VIF found with MAC fa:16:3e:7d:73:e6, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:35:25.395490 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Using config drive
May 19 04:35:25.621698 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:35:25.621698 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:35:25.621698 np0000001025 nova-compute[97981]:   <alias name="ua-86e048ad-58c7-4c9f-9863-c889c14a93f6"/>
May 19 04:35:25.621698 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-4"/>
May 19 04:35:25.621698 np0000001025 nova-compute[97981]:   <target dev="sdc" bus="scsi"/>
May 19 04:35:25.621698 np0000001025 nova-compute[97981]:   <serial>86e048ad-58c7-4c9f-9863-c889c14a93f6</serial>
May 19 04:35:25.621698 np0000001025 nova-compute[97981]:   <address type="drive" controller="0" unit="2"/>
May 19 04:35:25.621698 np0000001025 nova-compute[97981]: </disk>
May 19 04:35:25.621698 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:35:25.833499 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3323360f-5bb9-4c8f-b79d-f40cdba9f67c tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.498s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:25.901884 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:26.055238 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Creating config drive at /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk.config
May 19 04:35:26.060416 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdg11ztoy {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:26.080429 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-0b8504b0-eb3d-4514-a82c-a7e50b692149 tempest-VolumesAssistedSnapshotsTest-695634513 tempest-VolumesAssistedSnapshotsTest-695634513-project] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] volume_snapshot_create: create_info: {'snapshot_id': '75fe095a-8f4b-4e7d-b5df-6ac7ddd851e8', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=97981) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3769}}
May 19 04:35:26.083855 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-0b8504b0-eb3d-4514-a82c-a7e50b692149 tempest-VolumesAssistedSnapshotsTest-695634513 tempest-VolumesAssistedSnapshotsTest-695634513-project] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] snap xml: <domainsnapshot>
May 19 04:35:26.083855 np0000001025 nova-compute[97981]:   <disks>
May 19 04:35:26.083855 np0000001025 nova-compute[97981]:     <disk name="/dev/dm-3" snapshot="external" type="file">
May 19 04:35:26.083855 np0000001025 nova-compute[97981]:       <source file="/dev/new_file"/>
May 19 04:35:26.083855 np0000001025 nova-compute[97981]:     </disk>
May 19 04:35:26.083855 np0000001025 nova-compute[97981]:     <disk name="vda" snapshot="no"/>
May 19 04:35:26.083855 np0000001025 nova-compute[97981]:     <disk name="hda" snapshot="no"/>
May 19 04:35:26.083855 np0000001025 nova-compute[97981]:   </disks>
May 19 04:35:26.083855 np0000001025 nova-compute[97981]: </domainsnapshot>
May 19 04:35:26.083855 np0000001025 nova-compute[97981]:  {{(pid=97981) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3710}}
May 19 04:35:26.084201 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-0b8504b0-eb3d-4514-a82c-a7e50b692149 tempest-VolumesAssistedSnapshotsTest-695634513 tempest-VolumesAssistedSnapshotsTest-695634513-project] Lazy-loading 'system_metadata' on Instance uuid 8926c69b-c0ce-47e5-a3b6-ddbdeff44963 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:26.097331 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdg11ztoy" returned: 0 in 0.037s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:26.145129 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-df7cbb29-ac24-49de-9283-2924c1ddbc8b tempest-VolumesAssistedSnapshotsTest-695634513 tempest-VolumesAssistedSnapshotsTest-695634513-project] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] volume_snapshot_delete: delete_info: {'volume_id': 'dceec4dc-5452-4668-ab02-6ca89873c0ee'} {{(pid=97981) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3877}}
May 19 04:35:26.149619 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [None req-df7cbb29-ac24-49de-9283-2924c1ddbc8b tempest-VolumesAssistedSnapshotsTest-695634513 tempest-VolumesAssistedSnapshotsTest-695634513-project] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
May 19 04:35:26.149619 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Traceback (most recent call last):
May 19 04:35:26.149619 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 19 04:35:26.149619 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963]     self._volume_snapshot_delete(context, instance, volume_id,
May 19 04:35:26.149619 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 19 04:35:26.149619 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963]     if delete_info['type'] != 'qcow2':
May 19 04:35:26.149619 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963]        ~~~~~~~~~~~^^^^^^^^
May 19 04:35:26.149619 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] KeyError: 'type'
May 19 04:35:26.149619 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] 
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [None req-df7cbb29-ac24-49de-9283-2924c1ddbc8b tempest-VolumesAssistedSnapshotsTest-695634513 tempest-VolumesAssistedSnapshotsTest-695634513-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver        ~~~~~~~~~~~^^^^^^^^
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver KeyError: 'type'
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver 
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver 
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-fa554a74-6339-4b24-ae12-44bbde9111eb)
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver 
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver 
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 19 04:35:26.196673 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.197680 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 19 04:35:26.197680 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 19 04:35:26.197680 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.197680 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 19 04:35:26.197680 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 19 04:35:26.197680 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.197680 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 19 04:35:26.197680 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 19 04:35:26.197680 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 19 04:35:26.197680 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver 
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server [None req-df7cbb29-ac24-49de-9283-2924c1ddbc8b tempest-VolumesAssistedSnapshotsTest-695634513 tempest-VolumesAssistedSnapshotsTest-695634513-project] Exception during message handling: KeyError: 'type'
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     raise self.value
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4829, in volume_snapshot_delete
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4053, in volume_snapshot_delete
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     raise self.value
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server        ~~~~~~~~~~~^^^^^^^^
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server KeyError: 'type'
May 19 04:35:26.214794 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server 
May 19 04:35:26.574769 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:26.589133 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-0b8504b0-eb3d-4514-a82c-a7e50b692149 tempest-VolumesAssistedSnapshotsTest-695634513 tempest-VolumesAssistedSnapshotsTest-695634513-project] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Skipping quiescing instance: QEMU guest agent is not enabled.
May 19 04:35:26.598923 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [None req-0b8504b0-eb3d-4514-a82c-a7e50b692149 tempest-VolumesAssistedSnapshotsTest-695634513 tempest-VolumesAssistedSnapshotsTest-695634513-project] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 19 04:35:26.598923 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Traceback (most recent call last):
May 19 04:35:26.598923 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 19 04:35:26.598923 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 19 04:35:26.598923 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 19 04:35:26.598923 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 19 04:35:26.598923 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 19 04:35:26.598923 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 19 04:35:26.598923 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 19 04:35:26.598923 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] 
May 19 04:35:26.599551 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [None req-0b8504b0-eb3d-4514-a82c-a7e50b692149 tempest-VolumesAssistedSnapshotsTest-695634513 tempest-VolumesAssistedSnapshotsTest-695634513-project] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 19 04:35:26.599551 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Traceback (most recent call last):
May 19 04:35:26.599551 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 19 04:35:26.599551 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963]     self._volume_snapshot_create(context, instance, guest,
May 19 04:35:26.599551 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 19 04:35:26.599551 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 19 04:35:26.599551 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 19 04:35:26.599551 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 19 04:35:26.599551 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 19 04:35:26.599551 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 19 04:35:26.599551 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 19 04:35:26.599551 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] 
May 19 04:35:26.607417 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:26.612062 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver [None req-0b8504b0-eb3d-4514-a82c-a7e50b692149 tempest-VolumesAssistedSnapshotsTest-695634513 tempest-VolumesAssistedSnapshotsTest-695634513-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 75fe095a-8f4b-4e7d-b5df-6ac7ddd851e8 could not be found.
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver 
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver 
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 75fe095a-8f4b-4e7d-b5df-6ac7ddd851e8 could not be found. (HTTP 404) (Request-ID: req-5cdf48db-c0a0-4676-8a3b-432493a4710e)
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver 
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver 
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 19 04:35:26.650586 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 19 04:35:26.651676 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 19 04:35:26.651676 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.651676 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 19 04:35:26.651676 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 19 04:35:26.651676 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.651676 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 19 04:35:26.651676 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 19 04:35:26.651676 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.651676 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 19 04:35:26.651676 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 19 04:35:26.651676 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.651676 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 19 04:35:26.651676 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 19 04:35:26.651676 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 75fe095a-8f4b-4e7d-b5df-6ac7ddd851e8 could not be found.
May 19 04:35:26.651676 np0000001025 nova-compute[97981]: ERROR nova.virt.libvirt.driver 
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server [None req-0b8504b0-eb3d-4514-a82c-a7e50b692149 tempest-VolumesAssistedSnapshotsTest-695634513 tempest-VolumesAssistedSnapshotsTest-695634513-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     raise self.value
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4817, in volume_snapshot_create
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3790, in volume_snapshot_create
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     raise self.value
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 19 04:35:26.657203 np0000001025 nova-compute[97981]: ERROR oslo_messaging.rpc.server 
May 19 04:35:26.696061 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:26.722765 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:26.723816 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:26.891921 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-65a22809-6029-41f0-a472-5d2798f0d345 req-42266016-7c98-4eb1-b27a-a3d68b1af6b3 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received event network-vif-plugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:26.891921 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-65a22809-6029-41f0-a472-5d2798f0d345 req-42266016-7c98-4eb1-b27a-a3d68b1af6b3 service nova] Acquiring lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:26.891921 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-65a22809-6029-41f0-a472-5d2798f0d345 req-42266016-7c98-4eb1-b27a-a3d68b1af6b3 service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:26.891921 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-65a22809-6029-41f0-a472-5d2798f0d345 req-42266016-7c98-4eb1-b27a-a3d68b1af6b3 service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:26.891921 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-65a22809-6029-41f0-a472-5d2798f0d345 req-42266016-7c98-4eb1-b27a-a3d68b1af6b3 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Processing event network-vif-plugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:35:26.942199 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Acquiring lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:26.942461 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:27.345187 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] No BDM found with device name sda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:35:27.345187 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] No BDM found with device name sdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:35:27.345187 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] No BDM found with device name sdc, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:35:27.345654 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] No VIF found with MAC fa:16:3e:94:e5:3c, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:35:27.446027 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Detaching volume dceec4dc-5452-4668-ab02-6ca89873c0ee
May 19 04:35:27.498306 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Attempting to driver detach volume dceec4dc-5452-4668-ab02-6ca89873c0ee from mountpoint /dev/vdb
May 19 04:35:27.504812 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Found disk vdb by alias ua-dceec4dc-5452-4668-ab02-6ca89873c0ee {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:35:27.505813 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Found disk vdb by alias ua-dceec4dc-5452-4668-ab02-6ca89873c0ee {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:35:27.505948 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Attempting to detach device vdb from instance 8926c69b-c0ce-47e5-a3b6-ddbdeff44963 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:35:27.506232 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] detach device xml: <disk type="block" device="disk">
May 19 04:35:27.506232 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:35:27.506232 np0000001025 nova-compute[97981]:   <alias name="ua-dceec4dc-5452-4668-ab02-6ca89873c0ee"/>
May 19 04:35:27.506232 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-3"/>
May 19 04:35:27.506232 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:35:27.506232 np0000001025 nova-compute[97981]:   <serial>dceec4dc-5452-4668-ab02-6ca89873c0ee</serial>
May 19 04:35:27.506232 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:35:27.506232 np0000001025 nova-compute[97981]: </disk>
May 19 04:35:27.506232 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:35:27.512170 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Successfully detached device vdb from instance 8926c69b-c0ce-47e5-a3b6-ddbdeff44963 from the persistent domain config.
May 19 04:35:27.512493 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] (1/8): Attempting to detach device vdb with device alias ua-dceec4dc-5452-4668-ab02-6ca89873c0ee from instance 8926c69b-c0ce-47e5-a3b6-ddbdeff44963 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:35:27.513525 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] detach device xml: <disk type="block" device="disk">
May 19 04:35:27.513525 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:35:27.513525 np0000001025 nova-compute[97981]:   <alias name="ua-dceec4dc-5452-4668-ab02-6ca89873c0ee"/>
May 19 04:35:27.513525 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-3"/>
May 19 04:35:27.513525 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:35:27.513525 np0000001025 nova-compute[97981]:   <serial>dceec4dc-5452-4668-ab02-6ca89873c0ee</serial>
May 19 04:35:27.513525 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:35:27.513525 np0000001025 nova-compute[97981]: </disk>
May 19 04:35:27.513525 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:35:27.536135 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165327.5356486, b5f34a29-15f7-4f5e-a8bf-574abebd5c84 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:35:27.536335 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] VM Started (Lifecycle Event)
May 19 04:35:27.537681 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:35:27.546780 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:35:27.549468 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Instance spawned successfully.
May 19 04:35:27.550144 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:35:27.901682 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:28.042177 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:35:28.046576 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:35:28.059041 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:35:28.059154 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:35:28.059564 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:35:28.060317 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:35:28.060317 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:35:28.060530 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:35:28.155294 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:28.155944 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:28.235054 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-dceec4dc-5452-4668-ab02-6ca89873c0ee for instance 8926c69b-c0ce-47e5-a3b6-ddbdeff44963 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:35:28.549718 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:35:28.550234 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165328.5498734, b5f34a29-15f7-4f5e-a8bf-574abebd5c84 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:35:28.550576 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] VM Paused (Lifecycle Event)
May 19 04:35:28.565621 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Took 7.39 seconds to spawn the instance on the hypervisor.
May 19 04:35:28.566127 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:35:28.661942 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lazy-loading 'flavor' on Instance uuid e662af2e-fcc4-4739-993c-c5e7f4ddfe9c {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:28.870983 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:28.912756 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-15a9cd4c-51fb-4056-ac54-91d59e03fd69 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.412s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:28.986337 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received event network-vif-plugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:28.989300 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] Acquiring lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:28.989300 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:28.989300 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:28.989300 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] No waiting events found dispatching network-vif-plugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:35:28.989300 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received unexpected event network-vif-plugged-fe8167e8-425b-4446-a2e8-84711a2be7dd for instance with vm_state active and task_state None.
May 19 04:35:28.989300 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Received event network-changed-87877be0-a885-4589-913e-29c2dcd6900b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:28.989300 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Refreshing instance network info cache due to event network-changed-87877be0-a885-4589-913e-29c2dcd6900b. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:35:28.989300 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] Acquiring lock "refresh_cache-f71811d1-b0ad-48f9-ba04-9a6e517961b9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:35:28.989300 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] Acquired lock "refresh_cache-f71811d1-b0ad-48f9-ba04-9a6e517961b9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:35:28.989300 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Refreshing network info cache for port 87877be0-a885-4589-913e-29c2dcd6900b {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:35:29.052719 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:35:29.053917 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165329.0537212, b5f34a29-15f7-4f5e-a8bf-574abebd5c84 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:35:29.054027 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] VM Resumed (Lifecycle Event)
May 19 04:35:29.085711 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Took 13.01 seconds to build instance.
May 19 04:35:29.493212 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:29.556926 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:35:29.559752 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:35:29.596285 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.648s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:29.668248 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:29.829717 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Acquiring lock "95780667-2e87-4bef-ab7f-f98ab044c03e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:29.829943 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:29.908543 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:29.912570 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1323aa2e-74be-4db3-9301-925e16c4c90a req-dc68842e-24d1-4c8c-b11f-6f1ad21950c2 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received event network-changed-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:29.913062 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1323aa2e-74be-4db3-9301-925e16c4c90a req-dc68842e-24d1-4c8c-b11f-6f1ad21950c2 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Refreshing instance network info cache due to event network-changed-fe8167e8-425b-4446-a2e8-84711a2be7dd. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:35:29.913339 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1323aa2e-74be-4db3-9301-925e16c4c90a req-dc68842e-24d1-4c8c-b11f-6f1ad21950c2 service nova] Acquiring lock "refresh_cache-b5f34a29-15f7-4f5e-a8bf-574abebd5c84" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:35:29.913498 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1323aa2e-74be-4db3-9301-925e16c4c90a req-dc68842e-24d1-4c8c-b11f-6f1ad21950c2 service nova] Acquired lock "refresh_cache-b5f34a29-15f7-4f5e-a8bf-574abebd5c84" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:35:29.913686 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1323aa2e-74be-4db3-9301-925e16c4c90a req-dc68842e-24d1-4c8c-b11f-6f1ad21950c2 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Refreshing network info cache for port fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:35:30.061182 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Updated VIF entry in instance network info cache for port 87877be0-a885-4589-913e-29c2dcd6900b. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:35:30.061324 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Updating instance_info_cache with network_info: [{"id": "87877be0-a885-4589-913e-29c2dcd6900b", "address": "fa:16:3e:ca:fa:0b", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877be0-a8", "ovs_interfaceid": "87877be0-a885-4589-913e-29c2dcd6900b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:30.066226 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165330.0650613, 8926c69b-c0ce-47e5-a3b6-ddbdeff44963 => ua-dceec4dc-5452-4668-ab02-6ca89873c0ee> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:35:30.070009 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Successfully detached device vdb from instance 8926c69b-c0ce-47e5-a3b6-ddbdeff44963 from the live domain config.
May 19 04:35:30.072819 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:35:30.072819 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee', 'iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dceec4dc-5452-4668-ab02-6ca89873c0ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:35:30.072819 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:35:30.072819 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:35:30.072819 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee', 'iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dceec4dc-5452-4668-ab02-6ca89873c0ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:35:30.072819 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:35:30.096960 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6 (non-flash)
May 19 04:35:30.096960 np0000001025 nova-compute[97981]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:30.096960 np0000001025 nova-compute[97981]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:30.096960 np0000001025 nova-compute[97981]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6 (non-flash)
May 19 04:35:30.096960 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:35:30.096960 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6 (non-flash)
May 19 04:35:30.096960 np0000001025 nova-compute[97981]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:30.096960 np0000001025 nova-compute[97981]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee (non-flash)
May 19 04:35:30.096960 np0000001025 nova-compute[97981]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6 (non-flash)
May 19 04:35:30.096960 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:35:30.096960 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6', '9')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:35:30.096960 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee', '7')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:35:30.098673 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee', '8')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:35:30.100201 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721850760040>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee'): ({'sde'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:35:30.100201 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Removing multipathed devices sde, sdd {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:35:30.100201 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Flush multipath device 3300000007137e607 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:35:30.135039 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:35:30.188890 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:35:30.237575 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:35:30.237912 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] SCSI volumes sde, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:35:30.238954 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:35:30.250882 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:35:30.251355 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:35:30.261591 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:30.287306 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee, portal: 192.168.40.100,3260]
May 19 04:35:30.287306 np0000001025 nova-compute[97981]: Logout of [sid: 7, target: iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee, portal: 192.168.40.100,3260] successful.
May 19 04:35:30.287306 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:30.300036 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:30.310551 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:30.333600 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Detaching volume 86e048ad-58c7-4c9f-9863-c889c14a93f6
May 19 04:35:30.335141 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee, portal: 192.168.50.100,3260]
May 19 04:35:30.335141 np0000001025 nova-compute[97981]: Logout of [sid: 8, target: iqn.2023-03.storpool.com:os--volume-dceec4dc-5452-4668-ab02-6ca89873c0ee, portal: 192.168.50.100,3260] successful.
May 19 04:35:30.335141 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:30.349459 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:30.349459 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:35:30.349459 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] <== disconnect_volume: return (277ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:35:30.349459 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:35:30.381601 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Attempting to driver detach volume 86e048ad-58c7-4c9f-9863-c889c14a93f6 from mountpoint /dev/sdc
May 19 04:35:30.385181 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Found disk sdc by alias ua-86e048ad-58c7-4c9f-9863-c889c14a93f6 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:35:30.387297 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Found disk sdc by alias ua-86e048ad-58c7-4c9f-9863-c889c14a93f6 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:35:30.387297 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Attempting to detach device sdc from instance 95780667-2e87-4bef-ab7f-f98ab044c03e from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:35:30.387297 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:35:30.387297 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:35:30.387297 np0000001025 nova-compute[97981]:   <alias name="ua-86e048ad-58c7-4c9f-9863-c889c14a93f6"/>
May 19 04:35:30.387297 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-4"/>
May 19 04:35:30.387297 np0000001025 nova-compute[97981]:   <target dev="sdc" bus="scsi"/>
May 19 04:35:30.387297 np0000001025 nova-compute[97981]:   <serial>86e048ad-58c7-4c9f-9863-c889c14a93f6</serial>
May 19 04:35:30.387297 np0000001025 nova-compute[97981]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 19 04:35:30.387297 np0000001025 nova-compute[97981]: </disk>
May 19 04:35:30.387297 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:35:30.397570 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Successfully detached device sdc from instance 95780667-2e87-4bef-ab7f-f98ab044c03e from the persistent domain config.
May 19 04:35:30.397570 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] (1/8): Attempting to detach device sdc with device alias ua-86e048ad-58c7-4c9f-9863-c889c14a93f6 from instance 95780667-2e87-4bef-ab7f-f98ab044c03e from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:35:30.397570 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:35:30.397570 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:35:30.397570 np0000001025 nova-compute[97981]:   <alias name="ua-86e048ad-58c7-4c9f-9863-c889c14a93f6"/>
May 19 04:35:30.397570 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-4"/>
May 19 04:35:30.397570 np0000001025 nova-compute[97981]:   <target dev="sdc" bus="scsi"/>
May 19 04:35:30.397570 np0000001025 nova-compute[97981]:   <serial>86e048ad-58c7-4c9f-9863-c889c14a93f6</serial>
May 19 04:35:30.397570 np0000001025 nova-compute[97981]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 19 04:35:30.397570 np0000001025 nova-compute[97981]: </disk>
May 19 04:35:30.397570 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:35:30.416509 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-1323aa2e-74be-4db3-9301-925e16c4c90a req-dc68842e-24d1-4c8c-b11f-6f1ad21950c2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:30.563221 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] Releasing lock "refresh_cache-f71811d1-b0ad-48f9-ba04-9a6e517961b9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:35:30.563771 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Received event network-changed-6849a6ab-b169-4813-800c-3348010fa7b0 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:30.563771 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Refreshing instance network info cache due to event network-changed-6849a6ab-b169-4813-800c-3348010fa7b0. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:35:30.564040 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] Acquiring lock "refresh_cache-e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:35:30.564390 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] Acquired lock "refresh_cache-e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:35:30.564608 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Refreshing network info cache for port 6849a6ab-b169-4813-800c-3348010fa7b0 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:35:30.572738 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165330.5724635, 95780667-2e87-4bef-ab7f-f98ab044c03e => ua-86e048ad-58c7-4c9f-9863-c889c14a93f6> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:35:30.573835 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-86e048ad-58c7-4c9f-9863-c889c14a93f6 for instance 95780667-2e87-4bef-ab7f-f98ab044c03e {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:35:30.576126 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Successfully detached device sdc from instance 95780667-2e87-4bef-ab7f-f98ab044c03e from the live domain config.
May 19 04:35:30.578785 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:35:30.578785 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6', 'iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86e048ad-58c7-4c9f-9863-c889c14a93f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:35:30.578785 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:35:30.578785 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:35:30.578785 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6', 'iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86e048ad-58c7-4c9f-9863-c889c14a93f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:35:30.578785 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:35:30.604832 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6 (non-flash)
May 19 04:35:30.604832 np0000001025 nova-compute[97981]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6 (non-flash)
May 19 04:35:30.604832 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:35:30.604832 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6 (non-flash)
May 19 04:35:30.604832 np0000001025 nova-compute[97981]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6 (non-flash)
May 19 04:35:30.604832 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:35:30.604832 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6', '9')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:35:30.604832 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6', '10')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:35:30.604832 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6', '9')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:35:30.604832 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185012d120>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6'): ({'sdf'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:35:30.604832 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Removing multipathed devices sdg, sdf {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:35:30.604832 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Flush multipath device 33000000017c5a284 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:35:30.648320 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:35:30.696450 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:35:30.737967 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:35:30.737967 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:35:30.737967 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:35:30.738659 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:30.738873 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:30.739083 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Attaching volume ec3c9c30-a760-430d-93c4-6a04d0c9a413 to /dev/vdb
May 19 04:35:30.746840 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-1323aa2e-74be-4db3-9301-925e16c4c90a req-dc68842e-24d1-4c8c-b11f-6f1ad21950c2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:30.752176 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:35:30.752504 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:35:30.765890 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:30.792213 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:35:30.792213 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6, portal: 192.168.40.100,3260]
May 19 04:35:30.792213 np0000001025 nova-compute[97981]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6, portal: 192.168.40.100,3260] successful.
May 19 04:35:30.792213 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:30.802357 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:35:30.807493 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:30.820656 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:30.829676 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:30.851292 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6, portal: 192.168.50.100,3260]
May 19 04:35:30.851292 np0000001025 nova-compute[97981]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-86e048ad-58c7-4c9f-9863-c889c14a93f6, portal: 192.168.50.100,3260] successful.
May 19 04:35:30.851292 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:30.860258 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:35:30.860918 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:35:30.862487 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:30.862824 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:35:30.862949 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] <== disconnect_volume: return (285ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:35:30.863090 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:35:30.868837 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:35:30.872163 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::e86a:f3ff:fee3:83a1', 'fe80::fc16:3eff:fe94:e53c', 'fe80::986d:f6ff:feb5:7cbc', 'fe80::fc16:3eff:fedf:6f5d', 'fe80::2c03:76ff:fe4b:5798', 'fe80::fc16:3eff:fea0:92d3', 'fe80::98fd:dbff:fefe:cdf5', 'fe80::fc16:3eff:feca:fa0b', 'fe80::fc16:3eff:fe8a:28ef', 'fe80::fc16:3eff:fe40:b1c7', 'fe80::74d3:60ff:fec2:dcbf', 'fe80::fc16:3eff:fee5:eddc', 'fe80::cc29:a6ff:fef5:800e', 'fe80::fc16:3eff:fe81:2190', 'fe80::fc16:3eff:fe7d:73e6'] 
May 19 04:35:30.872163 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:35:30.872163 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:35:30.872163 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:35:30.872163 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Updating existing volume attachment record: 55be0b62-a598-422b-8a0e-2ec3afd5b3c3 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:35:30.915621 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Lazy-loading 'flavor' on Instance uuid 8926c69b-c0ce-47e5-a3b6-ddbdeff44963 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:30.927594 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1323aa2e-74be-4db3-9301-925e16c4c90a req-dc68842e-24d1-4c8c-b11f-6f1ad21950c2 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Updated VIF entry in instance network info cache for port fe8167e8-425b-4446-a2e8-84711a2be7dd. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:35:30.928045 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1323aa2e-74be-4db3-9301-925e16c4c90a req-dc68842e-24d1-4c8c-b11f-6f1ad21950c2 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Updating instance_info_cache with network_info: [{"id": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "address": "fa:16:3e:7d:73:e6", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe8167e8-42", "ovs_interfaceid": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:31.066865 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:31.430179 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1323aa2e-74be-4db3-9301-925e16c4c90a req-dc68842e-24d1-4c8c-b11f-6f1ad21950c2 service nova] Releasing lock "refresh_cache-b5f34a29-15f7-4f5e-a8bf-574abebd5c84" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:35:31.446608 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:35:31.447228 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:35:31.447348 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:35:31.448090 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:35:31.448090 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:35:31.462226 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lazy-loading 'flavor' on Instance uuid 95780667-2e87-4bef-ab7f-f98ab044c03e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:31.466223 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:35:31.466223 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:35:31.467410 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:35:31.468404 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:35:31.471730 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:31.474747 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.009s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:35:31.474747 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:35:31.481352 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:35:31.481352 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:31.485832 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:35:31.485832 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:31.493908 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413] added
May 19 04:35:31.493908 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:35:31.493908 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:35:31.493908 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:35:31.493908 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:35:31.493908 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:35:31.493908 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:31.493908 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:35:31.494977 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0265(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:35:31.495135 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:35:31.498396 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413] added
May 19 04:35:31.498396 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:35:31.498396 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:35:31.498396 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:35:31.498396 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:35:31.498396 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:35:31.498396 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:31.498588 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:35:31.498742 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0255(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:35:31.498929 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:35:31.665279 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Updated VIF entry in instance network info cache for port 6849a6ab-b169-4813-800c-3348010fa7b0. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:35:31.665741 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Updating instance_info_cache with network_info: [{"id": "6849a6ab-b169-4813-800c-3348010fa7b0", "address": "fa:16:3e:a0:92:d3", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6849a6ab-b1", "ovs_interfaceid": "6849a6ab-b169-4813-800c-3348010fa7b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:31.933563 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c617dd79-e05c-4d35-9b4b-ea51108028e3 tempest-VolumesAssistedSnapshotsTest-1767952540 tempest-VolumesAssistedSnapshotsTest-1767952540-project-admin] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.991s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:32.168039 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-82774074-8118-4f2a-a173-08d6cf8606e4 req-eb1be32c-3ee5-47fa-91a9-1d48f81c7e30 service nova] Releasing lock "refresh_cache-e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:35:32.345557 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:35:32.345836 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:35:32.346090 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:35:32.346381 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:35:32.346777 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:35:32.347535 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:35:32.347757 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:35:32.347968 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:35:32.348146 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:35:32.348372 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:35:32.470305 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-be164bdd-52cb-4586-a5b5-0032fe6b2d7b tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.640s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:32.496552 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:35:32.499461 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:35:32.507884 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:35:32.507884 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:35:32.513829 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:35:32.513829 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:32.523441 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:32.528641 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:32.535003 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 19 04:35:32.535003 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:35:32.535003 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 19 04:35:32.535003 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:35:32.535314 np0000001025 nova-compute[97981]: WARNING os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 19 04:35:32.535314 np0000001025 nova-compute[97981]: 
May 19 04:35:32.541100 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 19 04:35:32.541100 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:35:32.541316 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 19 04:35:32.541316 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:35:32.542943 np0000001025 nova-compute[97981]: WARNING os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 19 04:35:32.542943 np0000001025 nova-compute[97981]: 
May 19 04:35:32.560614 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413, portal: 192.168.50.100,3260]
May 19 04:35:32.560614 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413, portal: 192.168.50.100,3260] successful.
May 19 04:35:32.560614 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:32.575705 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:32.586560 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413, portal: 192.168.40.100,3260]
May 19 04:35:32.586560 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413, portal: 192.168.40.100,3260] successful.
May 19 04:35:32.586560 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:32.593553 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:32.593553 np0000001025 nova-compute[97981]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:32.593553 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:35:32.593707 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:32.593707 np0000001025 nova-compute[97981]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:32.593707 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:35:32.593905 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.127s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:35:32.594053 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:35:32.594696 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] HCTL ('7', '-', '-', 0) found on session 11 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:35:32.594832 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:35:32.603862 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:32.610635 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Searching for a device in session 11 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:35:32.610865 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:35:32.618275 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:32.618275 np0000001025 nova-compute[97981]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:32.618275 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:35:32.618275 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:32.618275 np0000001025 nova-compute[97981]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:32.618275 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:35:32.618509 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:35:32.618587 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:35:32.619060 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] HCTL ('8', '-', '-', 0) found on session 12 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:35:32.619253 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:35:32.636784 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Searching for a device in session 12 and hctl ['8', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:35:32.852609 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:32.853078 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:32.853078 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:32.853078 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:35:32.905521 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:33.323773 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Acquiring lock "95780667-2e87-4bef-ab7f-f98ab044c03e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:33.324503 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:33.324503 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Acquiring lock "95780667-2e87-4bef-ab7f-f98ab044c03e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:33.324503 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:33.324503 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:33.326814 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Terminating instance
May 19 04:35:33.524225 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Acquiring lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:33.524225 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:33.524225 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Acquiring lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:33.524225 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:33.524225 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:33.525395 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Terminating instance
May 19 04:35:33.635175 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Searching for a device in session 12 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:35:33.635175 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:35:33.834792 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:35:33.853536 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:33.860192 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:33.871792 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:33.885982 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:33.895409 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:33.904399 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:33.926378 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:34.000171 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:34.001612 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:34.031850 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:35:34.039962 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-440836b1-99f6-4c89-ae3f-1354132c76fd req-cbaa368c-3a4e-4efc-b950-738194e06cba service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Received event network-vif-unplugged-c1cf7ee2-df61-4771-ae64-c1eb09722516 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:34.041080 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-440836b1-99f6-4c89-ae3f-1354132c76fd req-cbaa368c-3a4e-4efc-b950-738194e06cba service nova] Acquiring lock "95780667-2e87-4bef-ab7f-f98ab044c03e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:34.041336 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-440836b1-99f6-4c89-ae3f-1354132c76fd req-cbaa368c-3a4e-4efc-b950-738194e06cba service nova] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:34.041710 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-440836b1-99f6-4c89-ae3f-1354132c76fd req-cbaa368c-3a4e-4efc-b950-738194e06cba service nova] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:34.041710 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-440836b1-99f6-4c89-ae3f-1354132c76fd req-cbaa368c-3a4e-4efc-b950-738194e06cba service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] No waiting events found dispatching network-vif-unplugged-c1cf7ee2-df61-4771-ae64-c1eb09722516 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:35:34.041836 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-440836b1-99f6-4c89-ae3f-1354132c76fd req-cbaa368c-3a4e-4efc-b950-738194e06cba service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Received event network-vif-unplugged-c1cf7ee2-df61-4771-ae64-c1eb09722516 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:35:34.060750 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:34.067895 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:34.086877 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:34.089654 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:34.117441 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:34.120909 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:34.127886 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e662af2e-fcc4-4739-993c-c5e7f4ddfe9c/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:34.159222 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:34.175571 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:34.181705 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999562301999958 future=<Future at 0x7218502ca720 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:35:34.182700 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.998538639000117 future=<Future at 0x7218502ca720 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:35:34.182859 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.998367830999996 future=<Future at 0x7218502ca720 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:35:34.186716 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Instance destroyed successfully.
May 19 04:35:34.187487 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lazy-loading 'resources' on Instance uuid 95780667-2e87-4bef-ab7f-f98ab044c03e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:34.232215 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e662af2e-fcc4-4739-993c-c5e7f4ddfe9c/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:34.232830 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e662af2e-fcc4-4739-993c-c5e7f4ddfe9c/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:34.330388 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e662af2e-fcc4-4739-993c-c5e7f4ddfe9c/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:34.336683 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:34.402456 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999379852999937 future=<Future at 0x721850603050 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:35:34.405822 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Instance destroyed successfully.
May 19 04:35:34.406517 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Lazy-loading 'resources' on Instance uuid 8926c69b-c0ce-47e5-a3b6-ddbdeff44963 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:34.444460 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:34.444885 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:34.490303 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Found WWN 330000000a96716bb for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:35:34.490303 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:35:34.490303 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '330000000a96716bb', 'path': '/dev/dm-0', 'multipath_id': '330000000a96716bb'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:35:34.490303 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a96716bb', 'path': '/dev/dm-0', 'multipath_id': '330000000a96716bb'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:35:34.494436 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lazy-loading 'flavor' on Instance uuid e662af2e-fcc4-4739-993c-c5e7f4ddfe9c {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:34.524959 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:34.528320 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:34.628125 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:34.628698 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:34.695126 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-951112015',display_name='tempest-AttachSCSIVolumeTestJSON-server-951112015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachscsivolumetestjson-server-951112015',id=4,image_ref='17c062fc-ea68-4cab-bf7e-28ea6cbcf35b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIU4hDVFhSAwvg2aPifvVly5RLzAbIhBSBlJoObNIrbmgxj8zF+Okm5LC3IvLoCc9eBLEbIwmOD8cNXKmIj4FWs/zKPKAIYVIJyrmhK2YhWq5ifWZSrQHW8ZQVRLuK1Bg==',key_name='tempest-keypair-954448069',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:34:33Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6417ad7b082a41bc9af43c57fb87ee89',ramdisk_id='',reservation_id='r-sx7tulh5',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='17c062fc-ea68-4cab-bf7e-28ea6cbcf35b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1273604612',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1273604612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:34:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66e33e6af79d44e4a3f18926a525acc5',uuid=95780667-2e87-4bef-ab7f-f98ab044c03e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1cf7ee2-df61-4771-ae64-c1eb09722516", "address": "fa:16:3e:94:e5:3c", "network": {"id": "5f3c92cb-a2be-4e71-9708-047a0a006bec", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1354251025-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6417ad7b082a41bc9af43c57fb87ee89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1cf7ee2-df", "ovs_interfaceid": "c1cf7ee2-df61-4771-ae64-c1eb09722516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:35:34.695415 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Converting VIF {"id": "c1cf7ee2-df61-4771-ae64-c1eb09722516", "address": "fa:16:3e:94:e5:3c", "network": {"id": "5f3c92cb-a2be-4e71-9708-047a0a006bec", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1354251025-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6417ad7b082a41bc9af43c57fb87ee89", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1cf7ee2-df", "ovs_interfaceid": "c1cf7ee2-df61-4771-ae64-c1eb09722516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:35:34.696528 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:e5:3c,bridge_name='br-int',has_traffic_filtering=True,id=c1cf7ee2-df61-4771-ae64-c1eb09722516,network=Network(5f3c92cb-a2be-4e71-9708-047a0a006bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1cf7ee2-df') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:35:34.696868 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:e5:3c,bridge_name='br-int',has_traffic_filtering=True,id=c1cf7ee2-df61-4771-ae64-c1eb09722516,network=Network(5f3c92cb-a2be-4e71-9708-047a0a006bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1cf7ee2-df') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:35:34.698970 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:34.699489 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1cf7ee2-df, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:34.700990 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:34.702276 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:35:34.708121 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:34.708804 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:34.709021 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb6f62ca-c48b-459d-a6f3-66a62d5f6223) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:34.709585 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:34.710228 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:35:34.715490 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:34.717568 np0000001025 nova-compute[97981]: INFO os_vif [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:e5:3c,bridge_name='br-int',has_traffic_filtering=True,id=c1cf7ee2-df61-4771-ae64-c1eb09722516,network=Network(5f3c92cb-a2be-4e71-9708-047a0a006bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1cf7ee2-df')
May 19 04:35:34.717966 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Deleting instance files /opt/stack/data/nova/instances/95780667-2e87-4bef-ab7f-f98ab044c03e_del
May 19 04:35:34.718829 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Deletion of /opt/stack/data/nova/instances/95780667-2e87-4bef-ab7f-f98ab044c03e_del complete
May 19 04:35:34.732487 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:34.735142 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:34.811274 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:34.814404 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:34.890758 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:34.896390 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.rescue --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:34.914879 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1915748245',display_name='tempest-VolumesAssistedSnapshotsTest-server-1915748245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesassistedsnapshotstest-server-1915748245',id=5,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfzymJ4MBS2XIGF74GX7KL8frgRs+juanN45/xEsGuMoCh+QNCsGyy93h6CaHxiJ0Bnrk7SuZ9+VbkXx7zMKw8lN3lx0+s3AP4lSZvDm9OzfkomoU+i+nzjCqfxVOxc7w==',key_name='tempest-keypair-2100770679',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:34:36Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3244e0bf71164922b7a0e4cbbf0d01db',ramdisk_id='',reservation_id='r-pzak64ur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1721889722',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1721889722-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:34:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38a001b8a8954c318a641c5482213944',uuid=8926c69b-c0ce-47e5-a3b6-ddbdeff44963,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01", "address": "fa:16:3e:df:6f:5d", "network": {"id": "73aac25c-954c-49db-a0fe-58650bbb516f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-765910815-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3244e0bf71164922b7a0e4cbbf0d01db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dbf2cc-42", "ovs_interfaceid": "f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:35:34.915301 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Converting VIF {"id": "f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01", "address": "fa:16:3e:df:6f:5d", "network": {"id": "73aac25c-954c-49db-a0fe-58650bbb516f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-765910815-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3244e0bf71164922b7a0e4cbbf0d01db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dbf2cc-42", "ovs_interfaceid": "f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:35:34.916734 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:6f:5d,bridge_name='br-int',has_traffic_filtering=True,id=f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01,network=Network(73aac25c-954c-49db-a0fe-58650bbb516f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7dbf2cc-42') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:35:34.917291 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:6f:5d,bridge_name='br-int',has_traffic_filtering=True,id=f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01,network=Network(73aac25c-954c-49db-a0fe-58650bbb516f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7dbf2cc-42') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:35:34.923649 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:34.923973 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7dbf2cc-42, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:34.925827 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:34.926878 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:35:34.927152 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:34.928175 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:34.928346 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37830ec7-72c1-4f0b-b312-98ec247f8ed1) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:34.928956 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:34.929460 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:35:34.930020 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:34.932360 np0000001025 nova-compute[97981]: INFO os_vif [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:6f:5d,bridge_name='br-int',has_traffic_filtering=True,id=f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01,network=Network(73aac25c-954c-49db-a0fe-58650bbb516f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7dbf2cc-42')
May 19 04:35:34.932648 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Deleting instance files /opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963_del
May 19 04:35:34.933422 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Deletion of /opt/stack/data/nova/instances/8926c69b-c0ce-47e5-a3b6-ddbdeff44963_del complete
May 19 04:35:34.976503 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.rescue --force-share --output=json" returned: 0 in 0.080s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:34.977023 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.rescue --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:35.000604 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Attempting to attach volume ec3c9c30-a760-430d-93c4-6a04d0c9a413 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:35:35.002847 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:35:35.002847 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:35:35.002847 np0000001025 nova-compute[97981]:   <alias name="ua-ec3c9c30-a760-430d-93c4-6a04d0c9a413"/>
May 19 04:35:35.002847 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:35:35.002847 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:35:35.002847 np0000001025 nova-compute[97981]:   <serial>ec3c9c30-a760-430d-93c4-6a04d0c9a413</serial>
May 19 04:35:35.002847 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:35:35.002847 np0000001025 nova-compute[97981]: </disk>
May 19 04:35:35.002847 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:35:35.048408 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.rescue --force-share --output=json" returned: 0 in 0.071s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:35.048990 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:35.132480 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:35.132946 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:35.209971 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:35.212604 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71811d1-b0ad-48f9-ba04-9a6e517961b9/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:35.240206 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Took 1.40 seconds to destroy the instance on the hypervisor.
May 19 04:35:35.241514 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:35:35.242200 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:35:35.242394 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:35:35.243203 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:35.310985 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71811d1-b0ad-48f9-ba04-9a6e517961b9/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:35.311582 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71811d1-b0ad-48f9-ba04-9a6e517961b9/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:35.347520 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:35.409651 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71811d1-b0ad-48f9-ba04-9a6e517961b9/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:35.414004 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:35.451344 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Took 1.42 seconds to destroy the instance on the hypervisor.
May 19 04:35:35.455397 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:35:35.455765 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:35:35.455888 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:35:35.456371 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:35.467047 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "6ea060d2-e149-4189-b93b-66ce319b9157" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:35.467344 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "6ea060d2-e149-4189-b93b-66ce319b9157" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:35.529955 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:35.530994 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:35.620352 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:35.632370 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:35.633826 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Error from libvirt while getting description of instance-00000004: [Error Code 42] Domain not found: no domain with matching uuid '95780667-2e87-4bef-ab7f-f98ab044c03e' (instance-00000004): libvirt.libvirtError: Domain not found: no domain with matching uuid '95780667-2e87-4bef-ab7f-f98ab044c03e' (instance-00000004)
May 19 04:35:35.636367 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:35:35.639158 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:35.677144 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.039s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:35.679295 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=11983MB free_disk=74.52317810058594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:35:35.679295 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:35.679589 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:35.975775 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lazy-loading 'flavor' on Instance uuid 6ea060d2-e149-4189-b93b-66ce319b9157 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:35.995295 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a0af2264-da4a-423b-a008-75cc1d6a6786 req-c35855ff-1ae4-43a3-83cc-1d0cf7063e4a service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Received event network-vif-deleted-c1cf7ee2-df61-4771-ae64-c1eb09722516 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:35.996469 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-a0af2264-da4a-423b-a008-75cc1d6a6786 req-c35855ff-1ae4-43a3-83cc-1d0cf7063e4a service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Neutron deleted interface c1cf7ee2-df61-4771-ae64-c1eb09722516; detaching it from the instance and deleting it from the info cache
May 19 04:35:35.996802 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a0af2264-da4a-423b-a008-75cc1d6a6786 req-c35855ff-1ae4-43a3-83cc-1d0cf7063e4a service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:36.115269 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fe0c0600-f560-4eee-b54c-9db5f853da08 req-86b4df64-a80b-41fe-a641-4c4ffe9b82b7 service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Received event network-vif-unplugged-c1cf7ee2-df61-4771-ae64-c1eb09722516 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:36.118136 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fe0c0600-f560-4eee-b54c-9db5f853da08 req-86b4df64-a80b-41fe-a641-4c4ffe9b82b7 service nova] Acquiring lock "95780667-2e87-4bef-ab7f-f98ab044c03e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:36.118136 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fe0c0600-f560-4eee-b54c-9db5f853da08 req-86b4df64-a80b-41fe-a641-4c4ffe9b82b7 service nova] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:36.118136 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fe0c0600-f560-4eee-b54c-9db5f853da08 req-86b4df64-a80b-41fe-a641-4c4ffe9b82b7 service nova] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:36.118136 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fe0c0600-f560-4eee-b54c-9db5f853da08 req-86b4df64-a80b-41fe-a641-4c4ffe9b82b7 service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] No waiting events found dispatching network-vif-unplugged-c1cf7ee2-df61-4771-ae64-c1eb09722516 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:35:36.118136 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fe0c0600-f560-4eee-b54c-9db5f853da08 req-86b4df64-a80b-41fe-a641-4c4ffe9b82b7 service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Received event network-vif-unplugged-c1cf7ee2-df61-4771-ae64-c1eb09722516 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:35:36.118136 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fe0c0600-f560-4eee-b54c-9db5f853da08 req-86b4df64-a80b-41fe-a641-4c4ffe9b82b7 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Received event network-vif-unplugged-f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:36.118136 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fe0c0600-f560-4eee-b54c-9db5f853da08 req-86b4df64-a80b-41fe-a641-4c4ffe9b82b7 service nova] Acquiring lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:36.119156 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fe0c0600-f560-4eee-b54c-9db5f853da08 req-86b4df64-a80b-41fe-a641-4c4ffe9b82b7 service nova] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:36.119156 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fe0c0600-f560-4eee-b54c-9db5f853da08 req-86b4df64-a80b-41fe-a641-4c4ffe9b82b7 service nova] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:36.119156 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fe0c0600-f560-4eee-b54c-9db5f853da08 req-86b4df64-a80b-41fe-a641-4c4ffe9b82b7 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] No waiting events found dispatching network-vif-unplugged-f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:35:36.119156 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fe0c0600-f560-4eee-b54c-9db5f853da08 req-86b4df64-a80b-41fe-a641-4c4ffe9b82b7 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Received event network-vif-unplugged-f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:35:36.119257 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fe0c0600-f560-4eee-b54c-9db5f853da08 req-86b4df64-a80b-41fe-a641-4c4ffe9b82b7 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Received event network-vif-unplugged-f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:36.119544 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fe0c0600-f560-4eee-b54c-9db5f853da08 req-86b4df64-a80b-41fe-a641-4c4ffe9b82b7 service nova] Acquiring lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:36.119544 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fe0c0600-f560-4eee-b54c-9db5f853da08 req-86b4df64-a80b-41fe-a641-4c4ffe9b82b7 service nova] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:36.120006 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fe0c0600-f560-4eee-b54c-9db5f853da08 req-86b4df64-a80b-41fe-a641-4c4ffe9b82b7 service nova] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:36.120137 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fe0c0600-f560-4eee-b54c-9db5f853da08 req-86b4df64-a80b-41fe-a641-4c4ffe9b82b7 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] No waiting events found dispatching network-vif-unplugged-f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:35:36.120250 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fe0c0600-f560-4eee-b54c-9db5f853da08 req-86b4df64-a80b-41fe-a641-4c4ffe9b82b7 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Received event network-vif-unplugged-f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:35:36.420053 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e44810a1-181c-4b8d-8c47-5c8787d94f1b req-4a6e7fdb-75ce-4929-9468-81ee89698710 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Received event network-vif-deleted-f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:36.421414 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-e44810a1-181c-4b8d-8c47-5c8787d94f1b req-4a6e7fdb-75ce-4929-9468-81ee89698710 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Neutron deleted interface f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01; detaching it from the instance and deleting it from the info cache
May 19 04:35:36.421414 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e44810a1-181c-4b8d-8c47-5c8787d94f1b req-4a6e7fdb-75ce-4929-9468-81ee89698710 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:36.430451 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:36.502827 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a0af2264-da4a-423b-a008-75cc1d6a6786 req-c35855ff-1ae4-43a3-83cc-1d0cf7063e4a service nova] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Detach interface failed, port_id=c1cf7ee2-df61-4771-ae64-c1eb09722516, reason: Instance 95780667-2e87-4bef-ab7f-f98ab044c03e could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:35:36.685290 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:35:36.685871 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:35:36.688551 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:35:36.688551 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] No VIF found with MAC fa:16:3e:a0:92:d3, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:35:36.745818 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:35:36.746043 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:35:36.746222 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 95780667-2e87-4bef-ab7f-f98ab044c03e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:35:36.746352 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 8926c69b-c0ce-47e5-a3b6-ddbdeff44963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:35:36.746490 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance e662af2e-fcc4-4739-993c-c5e7f4ddfe9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:35:36.746617 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance f71811d1-b0ad-48f9-ba04-9a6e517961b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:35:36.746740 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 6ea060d2-e149-4189-b93b-66ce319b9157 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:35:36.746865 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 1081cdc6-540d-4cb8-9e0d-d7584411e539 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:35:36.747001 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance b5f34a29-15f7-4f5e-a8bf-574abebd5c84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:35:36.747245 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:35:36.747482 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=2240MB phys_disk=95GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:35:35 up 26 min,  2 users,  load average: 7.85, 3.78, 1.75\n', 'num_instances': '9', 'num_vm_active': '8', 'num_task_None': '7', 'num_os_type_None': '9', 'num_proj_334b83c8d3714844830f961673658b20': '3', 'io_workload': '0', 'num_vm_rescued': '1', 'num_task_deleting': '2', 'num_proj_6417ad7b082a41bc9af43c57fb87ee89': '1', 'num_proj_3244e0bf71164922b7a0e4cbbf0d01db': '1', 'num_proj_907951cd15704c2d968614f909b64ba7': '2', 'num_proj_b34124f30156425cbda16473ccedeff4': '1', 'num_proj_dbef1a3853c14e3daa34b934269bb404': '1'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:35:36.855572 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:36.926838 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e44810a1-181c-4b8d-8c47-5c8787d94f1b req-4a6e7fdb-75ce-4929-9468-81ee89698710 service nova] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Detach interface failed, port_id=f7dbf2cc-4215-482f-ae5e-a7dc9ad3ad01, reason: Instance 8926c69b-c0ce-47e5-a3b6-ddbdeff44963 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:35:36.933022 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Took 1.69 seconds to deallocate network for instance.
May 19 04:35:36.983078 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "6ea060d2-e149-4189-b93b-66ce319b9157" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:37.357683 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Took 1.90 seconds to deallocate network for instance.
May 19 04:35:37.372392 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:35:37.372683 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:35:37.444989 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:37.552057 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:37.552317 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:37.676707 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Acquiring lock "23196294-f311-4315-a76c-1b9509bfa082" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:37.676892 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Lock "23196294-f311-4315-a76c-1b9509bfa082" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:37.863532 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:37.876024 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:35:37.905315 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:38.055354 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:35:38.069543 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "6ea060d2-e149-4189-b93b-66ce319b9157" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:38.069767 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "6ea060d2-e149-4189-b93b-66ce319b9157" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:38.070002 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Attaching volume 4b25ba87-624c-4d65-b535-95d5d14da486 to /dev/vdb
May 19 04:35:38.106479 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:38.106657 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:38.115613 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:35:38.128936 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:35:38.152411 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:38.179893 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:35:38.187247 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:35:38.187497 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:35:38.204794 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:35:38.206017 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::e86a:f3ff:fee3:83a1', 'fe80::fc16:3eff:fea0:92d3', 'fe80::98fd:dbff:fefe:cdf5', 'fe80::fc16:3eff:feca:fa0b', 'fe80::fc16:3eff:fe8a:28ef', 'fe80::fc16:3eff:fe40:b1c7', 'fe80::74d3:60ff:fec2:dcbf', 'fe80::fc16:3eff:fee5:eddc', 'fe80::cc29:a6ff:fef5:800e', 'fe80::fc16:3eff:fe81:2190', 'fe80::fc16:3eff:fe7d:73e6'] 
May 19 04:35:38.206162 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:35:38.206272 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:35:38.206494 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:35:38.206697 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Updating existing volume attachment record: 39f8249f-d7e4-446e-984c-274cbdfa8e5c {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:35:38.258457 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-159184a4-8d11-4afd-981e-9acd2a92f82b tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.519s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:38.387129 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:35:38.387361 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.709s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:38.387767 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.23 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:35:38.388372 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.943s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:38.610295 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lazy-loading 'flavor' on Instance uuid f71811d1-b0ad-48f9-ba04-9a6e517961b9 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:38.618796 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:38.740566 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:38.759391 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:35:38.759391 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b25ba87-624c-4d65-b535-95d5d14da486', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:35:38.759391 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:35:38.759391 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:35:38.759391 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b25ba87-624c-4d65-b535-95d5d14da486', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:35:38.770604 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:35:38.771141 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:35:38.771655 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:35:38.771877 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:35:38.772352 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:35:38.772553 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:35:38.783331 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:35:38.783331 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:38.786263 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:35:38.786263 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:38.800870 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486] added
May 19 04:35:38.800870 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:35:38.800870 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:35:38.800870 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:35:38.800870 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:35:38.800870 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:35:38.800870 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:38.801216 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:35:38.801326 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:35:38.801457 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:35:38.801918 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486] added
May 19 04:35:38.801918 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:35:38.801918 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:35:38.801918 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:35:38.801918 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:35:38.801918 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:35:38.801918 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:38.802143 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:35:38.802335 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0304(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:35:38.802534 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:35:38.923299 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:35:38.923588 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:35:39.426425 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:35:39.616225 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:39.802078 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:35:39.802966 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:35:39.813594 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:35:39.813594 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:35:39.818727 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:35:39.818727 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:39.824658 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:39.829174 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:39.838703 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:39.838703 np0000001025 nova-compute[97981]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:39.838703 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:35:39.838962 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:39.838962 np0000001025 nova-compute[97981]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:39.838962 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:35:39.841063 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:39.841063 np0000001025 nova-compute[97981]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:39.841063 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:35:39.841280 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:39.841280 np0000001025 nova-compute[97981]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:39.841280 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:35:39.875477 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.50.100,3260]
May 19 04:35:39.875477 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.50.100,3260] successful.
May 19 04:35:39.875477 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:39.881016 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.40.100,3260]
May 19 04:35:39.881016 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.40.100,3260] successful.
May 19 04:35:39.881016 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:39.887606 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:39.894323 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:39.903606 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:39.903606 np0000001025 nova-compute[97981]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:39.903606 np0000001025 nova-compute[97981]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:35:39.903606 np0000001025 nova-compute[97981]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:35:39.903606 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:35:39.903943 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:39.903943 np0000001025 nova-compute[97981]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:39.903943 np0000001025 nova-compute[97981]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:35:39.903943 np0000001025 nova-compute[97981]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:35:39.903943 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:35:39.904103 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.132s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:35:39.904329 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:35:39.905560 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] HCTL ('9', '-', '-', 0) found on session 13 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:35:39.905560 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:35:39.910595 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:39.910595 np0000001025 nova-compute[97981]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:39.910595 np0000001025 nova-compute[97981]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:35:39.910595 np0000001025 nova-compute[97981]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:35:39.910595 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:35:39.910868 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:39.910868 np0000001025 nova-compute[97981]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:39.910868 np0000001025 nova-compute[97981]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:35:39.910868 np0000001025 nova-compute[97981]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:35:39.910868 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:35:39.911081 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:35:39.911231 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:35:39.911936 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] HCTL ('10', '-', '-', 0) found on session 14 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:35:39.912091 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:35:39.918985 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Searching for a device in session 13 and hctl ['9', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:35:39.927950 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Searching for a device in session 14 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:35:39.927950 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b25ba87-624c-4d65-b535-95d5d14da486', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:35:39.942645 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.554s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:39.944613 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.079s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:39.944911 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:40.026818 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Deleted allocations for instance 95780667-2e87-4bef-ab7f-f98ab044c03e
May 19 04:35:40.564846 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:35:40.565239 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:35:40.733238 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:40.733425 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:40.733608 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Attaching volume ec3c9c30-a760-430d-93c4-6a04d0c9a413 to /dev/vdb
May 19 04:35:40.771511 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:35:40.781086 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:35:40.802267 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:40.828020 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:35:40.828419 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:35:40.837086 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:35:40.838414 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::e86a:f3ff:fee3:83a1', 'fe80::fc16:3eff:fea0:92d3', 'fe80::98fd:dbff:fefe:cdf5', 'fe80::fc16:3eff:feca:fa0b', 'fe80::fc16:3eff:fe8a:28ef', 'fe80::fc16:3eff:fe40:b1c7', 'fe80::74d3:60ff:fec2:dcbf', 'fe80::fc16:3eff:fee5:eddc', 'fe80::cc29:a6ff:fef5:800e', 'fe80::fc16:3eff:fe81:2190', 'fe80::fc16:3eff:fe7d:73e6'] 
May 19 04:35:40.838568 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:35:40.838748 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:35:40.838994 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] <== get_connector_properties: return (67ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:35:40.839295 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Updating existing volume attachment record: 0b746dfc-40d1-4236-b447-4615b7fbdb96 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:35:40.919814 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Searching for a device in session 13 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:35:40.922248 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4b25ba87-624c-4d65-b535-95d5d14da486', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:35:41.036609 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-67340496-0919-4806-ab3c-6d8144616c09 tempest-AttachSCSIVolumeTestJSON-1273604612 tempest-AttachSCSIVolumeTestJSON-1273604612-project-member] Lock "95780667-2e87-4bef-ab7f-f98ab044c03e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.712s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:41.068319 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:35:41.389718 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:35:41.390026 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:35:41.390255 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:35:41.578529 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.635s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:41.580190 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.961s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:41.584121 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:35:41.584308 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Claim successful on node np0000001025
May 19 04:35:41.649422 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Deleted allocations for instance 8926c69b-c0ce-47e5-a3b6-ddbdeff44963
May 19 04:35:41.793693 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Found WWN 330000000b045a358 for multipath device dm-1 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:35:41.794219 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:35:41.794406 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000b045a358', 'path': '/dev/dm-1', 'multipath_id': '330000000b045a358'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:35:41.794582 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b045a358', 'path': '/dev/dm-1', 'multipath_id': '330000000b045a358'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:35:41.795227 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.405s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:35:41.795522 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:35:41.803599 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lazy-loading 'flavor' on Instance uuid 6ea060d2-e149-4189-b93b-66ce319b9157 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:41.807375 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:35:41.807903 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:35:41.808207 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:35:41.808607 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:35:41.808950 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:35:41.809032 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.startup = automatic
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.scan = manual
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:35:41.823873 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:35:41.823873 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.startup = automatic
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.scan = manual
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:35:41.829922 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:35:41.829922 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:41.838225 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:41.844869 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:41.851026 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:41.851026 np0000001025 nova-compute[97981]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:41.851026 np0000001025 nova-compute[97981]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:35:41.851026 np0000001025 nova-compute[97981]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:35:41.851026 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:35:41.851277 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:41.851277 np0000001025 nova-compute[97981]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:41.851277 np0000001025 nova-compute[97981]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:35:41.851277 np0000001025 nova-compute[97981]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:35:41.851277 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:35:41.851510 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.043s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:35:41.851695 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:35:41.852268 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] HCTL ('7', '0', '0', 0) found on session 11 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:35:41.852420 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:35:41.857741 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:41.857741 np0000001025 nova-compute[97981]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:41.857741 np0000001025 nova-compute[97981]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:35:41.857741 np0000001025 nova-compute[97981]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:35:41.857741 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:35:41.857741 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:41.857741 np0000001025 nova-compute[97981]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:41.857741 np0000001025 nova-compute[97981]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:35:41.857741 np0000001025 nova-compute[97981]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:35:41.857741 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:35:41.857741 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.049s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:35:41.857741 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:35:41.857741 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] HCTL ('8', '0', '0', 0) found on session 12 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:35:41.857741 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:35:41.861961 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Searching for a device in session 11 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:35:41.862146 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:35:41.866913 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Searching for a device in session 12 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:35:41.866913 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:35:42.310753 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Attempting to attach volume 4b25ba87-624c-4d65-b535-95d5d14da486 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:35:42.312071 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:35:42.312071 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:35:42.312071 np0000001025 nova-compute[97981]:   <alias name="ua-4b25ba87-624c-4d65-b535-95d5d14da486"/>
May 19 04:35:42.312071 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-1"/>
May 19 04:35:42.312071 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:35:42.312071 np0000001025 nova-compute[97981]:   <serial>4b25ba87-624c-4d65-b535-95d5d14da486</serial>
May 19 04:35:42.312071 np0000001025 nova-compute[97981]: </disk>
May 19 04:35:42.312071 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:35:42.657405 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-aa493376-e5a4-429e-81e9-489a0871c3e8 tempest-VolumesAssistedSnapshotsTest-1721889722 tempest-VolumesAssistedSnapshotsTest-1721889722-project-member] Lock "8926c69b-c0ce-47e5-a3b6-ddbdeff44963" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.135s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:42.811823 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:35:42.907325 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:43.063916 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:35:43.064191 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:35:43.566672 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:35:43.825839 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Found WWN 330000000a96716bb for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:35:43.825839 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.030s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:35:43.825839 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] <== connect_volume: return (2434ms) {'type': 'block', 'scsi_wwn': '330000000a96716bb', 'path': '/dev/dm-0', 'multipath_id': '330000000a96716bb'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:35:43.825839 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a96716bb', 'path': '/dev/dm-0', 'multipath_id': '330000000a96716bb'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:35:43.828682 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lazy-loading 'flavor' on Instance uuid f71811d1-b0ad-48f9-ba04-9a6e517961b9 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:43.955195 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:35:43.955317 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:35:43.955446 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:35:43.955596 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] No VIF found with MAC fa:16:3e:40:b1:c7, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:35:44.074267 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.495s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:44.075196 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 5.334s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:44.075196 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:35:44.079722 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:35:44.082000 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Claim successful on node np0000001025
May 19 04:35:44.331798 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Attempting to attach volume ec3c9c30-a760-430d-93c4-6a04d0c9a413 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:35:44.333206 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:35:44.333206 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:35:44.333206 np0000001025 nova-compute[97981]:   <alias name="ua-ec3c9c30-a760-430d-93c4-6a04d0c9a413"/>
May 19 04:35:44.333206 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:35:44.333206 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:35:44.333206 np0000001025 nova-compute[97981]:   <serial>ec3c9c30-a760-430d-93c4-6a04d0c9a413</serial>
May 19 04:35:44.333206 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:35:44.333206 np0000001025 nova-compute[97981]: </disk>
May 19 04:35:44.333206 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:35:44.582214 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:35:44.586487 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:35:44.588329 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:44.588329 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:44.732311 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:44.842965 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:44.865043 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a349efc3ddaf48ed966109438d3f0625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc088ff80284506af708277495c5882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:35:44.950254 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:45.090204 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:35:45.498491 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Successfully created port: ad71ba07-449a-4565-bd5e-17c050975bd3 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:35:45.536527 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-29520377-a8ea-4b57-b89f-1f1ab85e1aed tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "6ea060d2-e149-4189-b93b-66ce319b9157" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.467s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:45.633098 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquiring lock "interface-1081cdc6-540d-4cb8-9e0d-d7584411e539-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:45.633302 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "interface-1081cdc6-540d-4cb8-9e0d-d7584411e539-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:45.633586 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lazy-loading 'flavor' on Instance uuid 1081cdc6-540d-4cb8-9e0d-d7584411e539 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:45.771395 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:35:45.771665 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:35:45.956125 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Successfully created port: 55210bd9-f231-4f7e-89be-c5779add4e83 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:35:46.036132 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:35:46.036294 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:35:46.036497 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:35:46.036642 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] No VIF found with MAC fa:16:3e:ca:fa:0b, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:35:46.136570 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:46.274481 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:35:46.451011 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Successfully created port: c0ec0e22-8097-46a0-93bb-077e4e38a07c {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:35:46.487941 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lazy-loading 'pci_requests' on Instance uuid 1081cdc6-540d-4cb8-9e0d-d7584411e539 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:46.607796 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:35:46.781503 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.707s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:46.781903 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:35:46.990228 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Object Instance<1081cdc6-540d-4cb8-9e0d-d7584411e539> lazy-loaded attributes: flavor,pci_requests {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:35:46.990671 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:35:46.990751 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:46.991062 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:47.015958 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Successfully created port: 42811c2a-5e1a-48c2-ae48-869cd5e416e6 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:35:47.074142 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97454d937cea4489b1c5e2b7dbbde8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbef1a3853c14e3daa34b934269bb404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:35:47.112931 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:47.114852 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Booting with volume 1d04e1a5-6059-4dec-9127-3ffa039dd625 at /dev/vda
May 19 04:35:47.163198 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:47.176681 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:35:47.190355 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:35:47.215476 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:47.244775 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:35:47.246002 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:35:47.253216 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:35:47.258833 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::e86a:f3ff:fee3:83a1', 'fe80::fc16:3eff:fea0:92d3', 'fe80::98fd:dbff:fefe:cdf5', 'fe80::fc16:3eff:feca:fa0b', 'fe80::fc16:3eff:fe8a:28ef', 'fe80::fc16:3eff:fe40:b1c7', 'fe80::74d3:60ff:fec2:dcbf', 'fe80::fc16:3eff:fee5:eddc', 'fe80::cc29:a6ff:fef5:800e', 'fe80::fc16:3eff:fe81:2190', 'fe80::fc16:3eff:fe7d:73e6'] 
May 19 04:35:47.258833 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:35:47.258833 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:35:47.258833 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] <== get_connector_properties: return (79ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:35:47.258833 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Updating existing volume attachment record: 6319109d-cadd-4b50-be76-a009e927f481 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:35:47.290120 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:35:47.290702 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:35:47.291095 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:47.291444 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:47.440549 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Successfully created port: d7648d4e-3e92-4c77-9347-91670c3b9113 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:35:47.604603 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Successfully created port: 312ea861-c69c-4976-ba37-408f1e7fe0dd {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:35:47.612042 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b5e77594-d0a5-4a52-9795-7f5dd07cb02d tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.878s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:47.794131 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:35:47.909703 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:48.154141 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Successfully updated port: 312ea861-c69c-4976-ba37-408f1e7fe0dd {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:35:48.161021 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Successfully updated port: ad71ba07-449a-4565-bd5e-17c050975bd3 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:35:48.210670 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8eb8a55765f4945b13225a7bc9909eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363a8652da134f1bab65bef424c60cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:35:48.298210 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:35:48.382353 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-20f2fb92-c035-47e2-8cee-91759ea2b5cf req-9dea3e82-b743-4193-9b61-af68001e544b service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-changed-ad71ba07-449a-4565-bd5e-17c050975bd3 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:48.384052 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-20f2fb92-c035-47e2-8cee-91759ea2b5cf req-9dea3e82-b743-4193-9b61-af68001e544b service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Refreshing instance network info cache due to event network-changed-ad71ba07-449a-4565-bd5e-17c050975bd3. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:35:48.384052 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-20f2fb92-c035-47e2-8cee-91759ea2b5cf req-9dea3e82-b743-4193-9b61-af68001e544b service nova] Acquiring lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:35:48.386046 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-20f2fb92-c035-47e2-8cee-91759ea2b5cf req-9dea3e82-b743-4193-9b61-af68001e544b service nova] Acquired lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:35:48.386046 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-20f2fb92-c035-47e2-8cee-91759ea2b5cf req-9dea3e82-b743-4193-9b61-af68001e544b service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Refreshing network info cache for port ad71ba07-449a-4565-bd5e-17c050975bd3 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:35:48.411324 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-22020513-63c4-4a34-b03d-8458dcc6d630 req-261a38b9-723d-47f7-ab1c-2f5547ba1cb3 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Received event network-changed-312ea861-c69c-4976-ba37-408f1e7fe0dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:48.411823 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-22020513-63c4-4a34-b03d-8458dcc6d630 req-261a38b9-723d-47f7-ab1c-2f5547ba1cb3 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Refreshing instance network info cache due to event network-changed-312ea861-c69c-4976-ba37-408f1e7fe0dd. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:35:48.412170 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-22020513-63c4-4a34-b03d-8458dcc6d630 req-261a38b9-723d-47f7-ab1c-2f5547ba1cb3 service nova] Acquiring lock "refresh_cache-1081cdc6-540d-4cb8-9e0d-d7584411e539" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:35:48.412333 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-22020513-63c4-4a34-b03d-8458dcc6d630 req-261a38b9-723d-47f7-ab1c-2f5547ba1cb3 service nova] Acquired lock "refresh_cache-1081cdc6-540d-4cb8-9e0d-d7584411e539" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:35:48.412480 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-22020513-63c4-4a34-b03d-8458dcc6d630 req-261a38b9-723d-47f7-ab1c-2f5547ba1cb3 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Refreshing network info cache for port 312ea861-c69c-4976-ba37-408f1e7fe0dd {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:35:48.520802 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Stashing vm_state: active {{(pid=97981) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 19 04:35:48.656429 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquiring lock "refresh_cache-1081cdc6-540d-4cb8-9e0d-d7584411e539" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:35:48.863063 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Booting with volume df86bd40-0f7a-447e-86d5-0494d1928695 at /dev/vdb
May 19 04:35:48.890242 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-20f2fb92-c035-47e2-8cee-91759ea2b5cf req-9dea3e82-b743-4193-9b61-af68001e544b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:48.894859 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Successfully created port: a6477693-efb0-41aa-8a1f-7af1881965c5 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:35:48.914785 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-22020513-63c4-4a34-b03d-8458dcc6d630 req-261a38b9-723d-47f7-ab1c-2f5547ba1cb3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:48.926419 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:35:48.944747 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:35:48.968542 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:48.997921 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:35:48.998280 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:35:49.008326 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:35:49.009543 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::e86a:f3ff:fee3:83a1', 'fe80::fc16:3eff:fea0:92d3', 'fe80::98fd:dbff:fefe:cdf5', 'fe80::fc16:3eff:feca:fa0b', 'fe80::fc16:3eff:fe8a:28ef', 'fe80::fc16:3eff:fe40:b1c7', 'fe80::74d3:60ff:fec2:dcbf', 'fe80::fc16:3eff:fee5:eddc', 'fe80::cc29:a6ff:fef5:800e', 'fe80::fc16:3eff:fe81:2190', 'fe80::fc16:3eff:fe7d:73e6'] 
May 19 04:35:49.009543 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:35:49.009675 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:35:49.010195 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:35:49.010717 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Updating existing volume attachment record: 94795eba-c09c-474e-b032-974c6d04cb85 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:35:49.079279 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:49.080256 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-20f2fb92-c035-47e2-8cee-91759ea2b5cf req-9dea3e82-b743-4193-9b61-af68001e544b service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:35:49.081758 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:49.157455 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:49.181749 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0004572569998799736 future=<Future at 0x7218502ca720 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:35:49.181879 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:35:49.182770 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Emitting event <LifecycleEvent: 1779165334.1811428, 95780667-2e87-4bef-ab7f-f98ab044c03e => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:35:49.183044 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=0.21874506300014218 future=<Future at 0x721850603050 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:35:49.183370 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] VM Stopped (Lifecycle Event)
May 19 04:35:49.184042 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=0.2177417370000967 future=<Future at 0x721850603050 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:35:49.287639 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Successfully updated port: 60124aa0-3747-4d4f-bac3-3c90e62b801c {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:35:49.310886 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:35:49.316132 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:35:49.316997 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Creating image(s)
May 19 04:35:49.317832 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Acquiring lock "/opt/stack/data/nova/instances/23196294-f311-4315-a76c-1b9509bfa082/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:49.318322 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Lock "/opt/stack/data/nova/instances/23196294-f311-4315-a76c-1b9509bfa082/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:49.318791 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Lock "/opt/stack/data/nova/instances/23196294-f311-4315-a76c-1b9509bfa082/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:49.319322 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:35:49.322154 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:35:49.323692 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:49.387905 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-46205d4e-481c-4353-a678-41b952e586d4 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:49.388240 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-46205d4e-481c-4353-a678-41b952e586d4 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:49.402511 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0006718439999531256 future=<Future at 0x721850603050 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:35:49.402661 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:35:49.406291 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Emitting event <LifecycleEvent: 1779165334.4016757, 8926c69b-c0ce-47e5-a3b6-ddbdeff44963 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:35:49.406291 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] VM Stopped (Lifecycle Event)
May 19 04:35:49.414985 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-20f2fb92-c035-47e2-8cee-91759ea2b5cf req-9dea3e82-b743-4193-9b61-af68001e544b service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:49.416507 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.093s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:49.419716 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:49.421638 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:49.422190 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:35:49.430574 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:35:49.435985 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:49.466129 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Successfully updated port: a6477693-efb0-41aa-8a1f-7af1881965c5 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:35:49.516553 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.080s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:49.521285 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/23196294-f311-4315-a76c-1b9509bfa082/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:49.568985 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/23196294-f311-4315-a76c-1b9509bfa082/disk 1073741824" returned: 0 in 0.051s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:49.570333 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.148s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:49.570333 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:49.597757 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:35:49.598217 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Claim successful on node np0000001025
May 19 04:35:49.630366 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-22020513-63c4-4a34-b03d-8458dcc6d630 req-261a38b9-723d-47f7-ab1c-2f5547ba1cb3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:49.651833 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.082s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:49.652515 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23196294-f311-4315-a76c-1b9509bfa082/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:35:49.652752 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23196294-f311-4315-a76c-1b9509bfa082/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:49.687619 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-6e99adf8-f9e0-4832-bee1-4de81cf4cd7b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 95780667-2e87-4bef-ab7f-f98ab044c03e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:35:49.730633 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23196294-f311-4315-a76c-1b9509bfa082/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:49.731007 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Cannot resize image /opt/stack/data/nova/instances/23196294-f311-4315-a76c-1b9509bfa082/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:35:49.731391 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:35:49.731635 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Ensure instance console log exists: /opt/stack/data/nova/instances/23196294-f311-4315-a76c-1b9509bfa082/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:35:49.732012 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:49.732286 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:49.732365 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:49.803693 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-22020513-63c4-4a34-b03d-8458dcc6d630 req-261a38b9-723d-47f7-ab1c-2f5547ba1cb3 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Added VIF to instance network info cache for port 312ea861-c69c-4976-ba37-408f1e7fe0dd. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3531}}
May 19 04:35:49.804195 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-22020513-63c4-4a34-b03d-8458dcc6d630 req-261a38b9-723d-47f7-ab1c-2f5547ba1cb3 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Updating instance_info_cache with network_info: [{"id": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "address": "fa:16:3e:e5:ed:dc", "network": {"id": "637c588b-9807-4474-9ce4-42f9d9631794", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-90879599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f5a2e8-43", "ovs_interfaceid": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "address": "fa:16:3e:63:a6:69", "network": {"id": "dcc776c0-b6b9-42ac-a64c-4ee5021d2646", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2010051909", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap312ea861-c6", "ovs_interfaceid": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:49.892408 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-46205d4e-481c-4353-a678-41b952e586d4 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Detaching volume ec3c9c30-a760-430d-93c4-6a04d0c9a413
May 19 04:35:49.908193 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 8926c69b-c0ce-47e5-a3b6-ddbdeff44963] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:35:49.917476 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-20f2fb92-c035-47e2-8cee-91759ea2b5cf req-9dea3e82-b743-4193-9b61-af68001e544b service nova] Releasing lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:35:49.930682 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-46205d4e-481c-4353-a678-41b952e586d4 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Attempting to driver detach volume ec3c9c30-a760-430d-93c4-6a04d0c9a413 from mountpoint /dev/vdb
May 19 04:35:49.934413 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-46205d4e-481c-4353-a678-41b952e586d4 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Found disk vdb by alias ua-ec3c9c30-a760-430d-93c4-6a04d0c9a413 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:35:49.935576 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-46205d4e-481c-4353-a678-41b952e586d4 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Found disk vdb by alias ua-ec3c9c30-a760-430d-93c4-6a04d0c9a413 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:35:49.935753 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-46205d4e-481c-4353-a678-41b952e586d4 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Attempting to detach device vdb from instance f71811d1-b0ad-48f9-ba04-9a6e517961b9 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:35:49.936076 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-46205d4e-481c-4353-a678-41b952e586d4 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:35:49.936076 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:35:49.936076 np0000001025 nova-compute[97981]:   <alias name="ua-ec3c9c30-a760-430d-93c4-6a04d0c9a413"/>
May 19 04:35:49.936076 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:35:49.936076 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:35:49.936076 np0000001025 nova-compute[97981]:   <serial>ec3c9c30-a760-430d-93c4-6a04d0c9a413</serial>
May 19 04:35:49.936076 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:35:49.936076 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:35:49.936076 np0000001025 nova-compute[97981]: </disk>
May 19 04:35:49.936076 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:35:49.942356 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-46205d4e-481c-4353-a678-41b952e586d4 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Successfully detached device vdb from instance f71811d1-b0ad-48f9-ba04-9a6e517961b9 from the persistent domain config.
May 19 04:35:49.942840 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-46205d4e-481c-4353-a678-41b952e586d4 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] (1/8): Attempting to detach device vdb with device alias ua-ec3c9c30-a760-430d-93c4-6a04d0c9a413 from instance f71811d1-b0ad-48f9-ba04-9a6e517961b9 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:35:49.943232 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-46205d4e-481c-4353-a678-41b952e586d4 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:35:49.943232 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:35:49.943232 np0000001025 nova-compute[97981]:   <alias name="ua-ec3c9c30-a760-430d-93c4-6a04d0c9a413"/>
May 19 04:35:49.943232 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:35:49.943232 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:35:49.943232 np0000001025 nova-compute[97981]:   <serial>ec3c9c30-a760-430d-93c4-6a04d0c9a413</serial>
May 19 04:35:49.943232 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:35:49.943232 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:35:49.943232 np0000001025 nova-compute[97981]: </disk>
May 19 04:35:49.943232 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:35:49.953333 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:49.973930 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Acquiring lock "refresh_cache-23196294-f311-4315-a76c-1b9509bfa082" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:35:49.973930 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Acquired lock "refresh_cache-23196294-f311-4315-a76c-1b9509bfa082" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:35:49.973930 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:35:50.109289 np0000001025 nova-compute[97981]: INFO nova.compute.resource_tracker [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Updating resource usage from migration 43bd7291-90c6-4d03-8188-14763bc4ce41
May 19 04:35:50.307197 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-22020513-63c4-4a34-b03d-8458dcc6d630 req-261a38b9-723d-47f7-ab1c-2f5547ba1cb3 service nova] Releasing lock "refresh_cache-1081cdc6-540d-4cb8-9e0d-d7584411e539" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:35:50.307686 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquired lock "refresh_cache-1081cdc6-540d-4cb8-9e0d-d7584411e539" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:35:50.307686 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:35:50.318961 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Successfully updated port: 137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:35:50.385568 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-170f6238-2fb1-4198-9022-2c3704b752e3 req-9eab0b4b-dd1a-4bee-a52f-3e3c1dfb9917 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-changed-137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:50.385690 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-170f6238-2fb1-4198-9022-2c3704b752e3 req-9eab0b4b-dd1a-4bee-a52f-3e3c1dfb9917 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Refreshing instance network info cache due to event network-changed-137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:35:50.385854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-170f6238-2fb1-4198-9022-2c3704b752e3 req-9eab0b4b-dd1a-4bee-a52f-3e3c1dfb9917 service nova] Acquiring lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:35:50.385976 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-170f6238-2fb1-4198-9022-2c3704b752e3 req-9eab0b4b-dd1a-4bee-a52f-3e3c1dfb9917 service nova] Acquired lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:35:50.386167 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-170f6238-2fb1-4198-9022-2c3704b752e3 req-9eab0b4b-dd1a-4bee-a52f-3e3c1dfb9917 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Refreshing network info cache for port 137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:35:50.459286 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165350.4588616, f71811d1-b0ad-48f9-ba04-9a6e517961b9 => ua-ec3c9c30-a760-430d-93c4-6a04d0c9a413> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:35:50.461576 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-46205d4e-481c-4353-a678-41b952e586d4 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ec3c9c30-a760-430d-93c4-6a04d0c9a413 for instance f71811d1-b0ad-48f9-ba04-9a6e517961b9 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:35:50.465058 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-828d29d2-9ae3-402f-a4d1-cff87e14de96 req-6fb82a80-855a-4ec0-a16a-fbac61913b34 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-changed-60124aa0-3747-4d4f-bac3-3c90e62b801c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:50.465366 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-828d29d2-9ae3-402f-a4d1-cff87e14de96 req-6fb82a80-855a-4ec0-a16a-fbac61913b34 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Refreshing instance network info cache due to event network-changed-60124aa0-3747-4d4f-bac3-3c90e62b801c. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:35:50.466222 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-46205d4e-481c-4353-a678-41b952e586d4 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Successfully detached device vdb from instance f71811d1-b0ad-48f9-ba04-9a6e517961b9 from the live domain config.
May 19 04:35:50.466456 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-828d29d2-9ae3-402f-a4d1-cff87e14de96 req-6fb82a80-855a-4ec0-a16a-fbac61913b34 service nova] Acquiring lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:35:50.469185 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2b47df70-6aeb-4160-8d17-b7da61d5cc5a req-104633e7-6410-49f2-91e2-9e368f723fdc service nova] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Received event network-changed-a6477693-efb0-41aa-8a1f-7af1881965c5 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:50.469273 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2b47df70-6aeb-4160-8d17-b7da61d5cc5a req-104633e7-6410-49f2-91e2-9e368f723fdc service nova] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Refreshing instance network info cache due to event network-changed-a6477693-efb0-41aa-8a1f-7af1881965c5. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:35:50.469414 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2b47df70-6aeb-4160-8d17-b7da61d5cc5a req-104633e7-6410-49f2-91e2-9e368f723fdc service nova] Acquiring lock "refresh_cache-23196294-f311-4315-a76c-1b9509bfa082" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:35:50.570146 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:35:50.655381 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Booting with volume 1fe9afac-3374-4e79-bff5-27405bd5fd0f at /dev/vdc
May 19 04:35:50.713291 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:35:50.714169 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:35:50.715448 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:35:50.727767 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:35:50.751358 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:50.782135 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:35:50.782482 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:35:50.789801 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:35:50.791343 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::e86a:f3ff:fee3:83a1', 'fe80::fc16:3eff:fea0:92d3', 'fe80::98fd:dbff:fefe:cdf5', 'fe80::fc16:3eff:feca:fa0b', 'fe80::fc16:3eff:fe8a:28ef', 'fe80::fc16:3eff:fe40:b1c7', 'fe80::74d3:60ff:fec2:dcbf', 'fe80::fc16:3eff:fee5:eddc', 'fe80::cc29:a6ff:fef5:800e', 'fe80::fc16:3eff:fe81:2190', 'fe80::fc16:3eff:fe7d:73e6'] 
May 19 04:35:50.791500 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:35:50.791759 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:35:50.792053 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] <== get_connector_properties: return (76ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:35:50.792365 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Updating existing volume attachment record: c6262bc8-a454-4b07-9cc7-cccb0e981880 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:35:50.798961 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:50.861684 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:35:50.889238 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-170f6238-2fb1-4198-9022-2c3704b752e3 req-9eab0b4b-dd1a-4bee-a52f-3e3c1dfb9917 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:50.925678 np0000001025 nova-compute[97981]: WARNING nova.network.neutron [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] dcc776c0-b6b9-42ac-a64c-4ee5021d2646 already exists in list: networks containing: ['dcc776c0-b6b9-42ac-a64c-4ee5021d2646']. ignoring it
May 19 04:35:50.925858 np0000001025 nova-compute[97981]: WARNING nova.network.neutron [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] 312ea861-c69c-4976-ba37-408f1e7fe0dd already exists in list: port_ids containing: ['312ea861-c69c-4976-ba37-408f1e7fe0dd']. ignoring it
May 19 04:35:50.970497 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Updating instance_info_cache with network_info: [{"id": "a6477693-efb0-41aa-8a1f-7af1881965c5", "address": "fa:16:3e:53:4c:8e", "network": {"id": "65e495fa-ccc2-48b7-9b32-ef75280bef22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "579b33395d4a41479b805cf02294060a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6477693-ef", "ovs_interfaceid": "a6477693-efb0-41aa-8a1f-7af1881965c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:51.013894 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-170f6238-2fb1-4198-9022-2c3704b752e3 req-9eab0b4b-dd1a-4bee-a52f-3e3c1dfb9917 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:35:51.016284 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-46205d4e-481c-4353-a678-41b952e586d4 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Detected multiple connections on this host for volume: ec3c9c30-a760-430d-93c4-6a04d0c9a413, skipping target disconnect.
May 19 04:35:51.202476 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:51.213623 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-170f6238-2fb1-4198-9022-2c3704b752e3 req-9eab0b4b-dd1a-4bee-a52f-3e3c1dfb9917 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:51.217762 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:35:51.331392 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Successfully updated port: 55210bd9-f231-4f7e-89be-c5779add4e83 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:35:51.474615 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Releasing lock "refresh_cache-23196294-f311-4315-a76c-1b9509bfa082" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:35:51.474615 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Instance network_info: |[{"id": "a6477693-efb0-41aa-8a1f-7af1881965c5", "address": "fa:16:3e:53:4c:8e", "network": {"id": "65e495fa-ccc2-48b7-9b32-ef75280bef22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "579b33395d4a41479b805cf02294060a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6477693-ef", "ovs_interfaceid": "a6477693-efb0-41aa-8a1f-7af1881965c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:35:51.475095 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2b47df70-6aeb-4160-8d17-b7da61d5cc5a req-104633e7-6410-49f2-91e2-9e368f723fdc service nova] Acquired lock "refresh_cache-23196294-f311-4315-a76c-1b9509bfa082" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:35:51.475337 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2b47df70-6aeb-4160-8d17-b7da61d5cc5a req-104633e7-6410-49f2-91e2-9e368f723fdc service nova] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Refreshing network info cache for port a6477693-efb0-41aa-8a1f-7af1881965c5 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:35:51.478263 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Start _get_guest_xml network_info=[{"id": "a6477693-efb0-41aa-8a1f-7af1881965c5", "address": "fa:16:3e:53:4c:8e", "network": {"id": "65e495fa-ccc2-48b7-9b32-ef75280bef22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "579b33395d4a41479b805cf02294060a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6477693-ef", "ovs_interfaceid": "a6477693-efb0-41aa-8a1f-7af1881965c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:35:51.481497 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:35:51.483333 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-VolumesNegativeTest-instance-582430480', uuid='23196294-f311-4315-a76c-1b9509bfa082'), owner=OwnerMeta(userid='e8eb8a55765f4945b13225a7bc9909eb', username='tempest-VolumesNegativeTest-204685150-project-member', projectid='363a8652da134f1bab65bef424c60cbe', projectname='tempest-VolumesNegativeTest-204685150'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a6477693-efb0-41aa-8a1f-7af1881965c5", "address": "fa:16:3e:53:4c:8e", "network": {"id": "65e495fa-ccc2-48b7-9b32-ef75280bef22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "579b33395d4a41479b805cf02294060a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6477693-ef", "ovs_interfaceid": "a6477693-efb0-41aa-8a1f-7af1881965c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165351.4827697) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:35:51.485216 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:35:51.486141 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:35:51.487235 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:35:51.487493 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:35:51.489130 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:35:51.489582 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:35:51.489798 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:35:51.489965 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:35:51.490178 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:35:51.490315 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:35:51.490472 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:35:51.490665 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:35:51.490913 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:35:51.491101 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:35:51.491340 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:35:51.491522 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:35:51.510537 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-582430480',display_name='tempest-VolumesNegativeTest-instance-582430480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesnegativetest-instance-582430480',id=12,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='363a8652da134f1bab65bef424c60cbe',ramdisk_id='',reservation_id='r-1lzkjjg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-204685150',owner_user_name='tempest-VolumesNegativeTest-204685150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:35:48Z,user_data=None,user_id='e8eb8a55765f4945b13225a7bc9909eb',uuid=23196294-f311-4315-a76c-1b9509bfa082,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6477693-efb0-41aa-8a1f-7af1881965c5", "address": "fa:16:3e:53:4c:8e", "network": {"id": "65e495fa-ccc2-48b7-9b32-ef75280bef22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "579b33395d4a41479b805cf02294060a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6477693-ef", "ovs_interfaceid": "a6477693-efb0-41aa-8a1f-7af1881965c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:35:51.510774 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Converting VIF {"id": "a6477693-efb0-41aa-8a1f-7af1881965c5", "address": "fa:16:3e:53:4c:8e", "network": {"id": "65e495fa-ccc2-48b7-9b32-ef75280bef22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "579b33395d4a41479b805cf02294060a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6477693-ef", "ovs_interfaceid": "a6477693-efb0-41aa-8a1f-7af1881965c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:35:51.511947 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:4c:8e,bridge_name='br-int',has_traffic_filtering=True,id=a6477693-efb0-41aa-8a1f-7af1881965c5,network=Network(65e495fa-ccc2-48b7-9b32-ef75280bef22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6477693-ef') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:35:51.512559 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Lazy-loading 'pci_devices' on Instance uuid 23196294-f311-4315-a76c-1b9509bfa082 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:51.539593 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:51.610015 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-46205d4e-481c-4353-a678-41b952e586d4 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lazy-loading 'flavor' on Instance uuid f71811d1-b0ad-48f9-ba04-9a6e517961b9 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:51.691061 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Updating instance_info_cache with network_info: [{"id": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "address": "fa:16:3e:e5:ed:dc", "network": {"id": "637c588b-9807-4474-9ce4-42f9d9631794", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-90879599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f5a2e8-43", "ovs_interfaceid": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "address": "fa:16:3e:63:a6:69", "network": {"id": "dcc776c0-b6b9-42ac-a64c-4ee5021d2646", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2010051909", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap312ea861-c6", "ovs_interfaceid": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:51.715683 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-170f6238-2fb1-4198-9022-2c3704b752e3 req-9eab0b4b-dd1a-4bee-a52f-3e3c1dfb9917 service nova] Releasing lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:35:51.716064 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-828d29d2-9ae3-402f-a4d1-cff87e14de96 req-6fb82a80-855a-4ec0-a16a-fbac61913b34 service nova] Acquired lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:35:51.716236 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-828d29d2-9ae3-402f-a4d1-cff87e14de96 req-6fb82a80-855a-4ec0-a16a-fbac61913b34 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Refreshing network info cache for port 60124aa0-3747-4d4f-bac3-3c90e62b801c {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:35:51.725228 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.645s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:51.725426 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Migrating
May 19 04:35:51.725891 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:35:51.725891 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquired lock "compute-rpcapi-router" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:35:51.979584 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-2b47df70-6aeb-4160-8d17-b7da61d5cc5a req-104633e7-6410-49f2-91e2-9e368f723fdc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:52.015870 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] End _get_guest_xml xml=<domain type="qemu">
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:   <uuid>23196294-f311-4315-a76c-1b9509bfa082</uuid>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:   <name>instance-0000000c</name>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <nova:name>tempest-VolumesNegativeTest-instance-582430480</nova:name>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:35:51</nova:creationTime>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:         <nova:user uuid="e8eb8a55765f4945b13225a7bc9909eb">tempest-VolumesNegativeTest-204685150-project-member</nova:user>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:         <nova:project uuid="363a8652da134f1bab65bef424c60cbe">tempest-VolumesNegativeTest-204685150</nova:project>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:         <nova:port uuid="a6477693-efb0-41aa-8a1f-7af1881965c5">
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="192.168.233.148" ipVersion="4"/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     <system>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <entry name="serial">23196294-f311-4315-a76c-1b9509bfa082</entry>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <entry name="uuid">23196294-f311-4315-a76c-1b9509bfa082</entry>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     </system>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:   <os>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:   </os>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:   <features>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:   </features>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:   <devices>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/23196294-f311-4315-a76c-1b9509bfa082/disk"/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     </disk>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/23196294-f311-4315-a76c-1b9509bfa082/disk.config"/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     </disk>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:53:4c:8e"/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <target dev="tapa6477693-ef"/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     </interface>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/23196294-f311-4315-a76c-1b9509bfa082/console.log" append="off"/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     </serial>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     <video>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     </video>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     </rng>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:   </devices>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]: </domain>
May 19 04:35:52.015870 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:35:52.019583 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Preparing to wait for external event network-vif-plugged-a6477693-efb0-41aa-8a1f-7af1881965c5 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:35:52.019583 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Acquiring lock "23196294-f311-4315-a76c-1b9509bfa082-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:52.019583 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Lock "23196294-f311-4315-a76c-1b9509bfa082-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:52.019583 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Lock "23196294-f311-4315-a76c-1b9509bfa082-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:52.019583 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-582430480',display_name='tempest-VolumesNegativeTest-instance-582430480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesnegativetest-instance-582430480',id=12,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='363a8652da134f1bab65bef424c60cbe',ramdisk_id='',reservation_id='r-1lzkjjg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-204685150',owner_user_name='tempest-VolumesNegativeTest-204685150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:35:48Z,user_data=None,user_id='e8eb8a55765f4945b13225a7bc9909eb',uuid=23196294-f311-4315-a76c-1b9509bfa082,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6477693-efb0-41aa-8a1f-7af1881965c5", "address": "fa:16:3e:53:4c:8e", "network": {"id": "65e495fa-ccc2-48b7-9b32-ef75280bef22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "579b33395d4a41479b805cf02294060a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6477693-ef", "ovs_interfaceid": "a6477693-efb0-41aa-8a1f-7af1881965c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:35:52.019914 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Converting VIF {"id": "a6477693-efb0-41aa-8a1f-7af1881965c5", "address": "fa:16:3e:53:4c:8e", "network": {"id": "65e495fa-ccc2-48b7-9b32-ef75280bef22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "579b33395d4a41479b805cf02294060a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6477693-ef", "ovs_interfaceid": "a6477693-efb0-41aa-8a1f-7af1881965c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:35:52.019914 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:4c:8e,bridge_name='br-int',has_traffic_filtering=True,id=a6477693-efb0-41aa-8a1f-7af1881965c5,network=Network(65e495fa-ccc2-48b7-9b32-ef75280bef22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6477693-ef') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:35:52.020893 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:4c:8e,bridge_name='br-int',has_traffic_filtering=True,id=a6477693-efb0-41aa-8a1f-7af1881965c5,network=Network(65e495fa-ccc2-48b7-9b32-ef75280bef22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6477693-ef') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:35:52.021301 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.021581 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:52.021859 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:35:52.024281 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.024538 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03e1af48-f038-5f5c-808f-8d667c893362', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:52.025458 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.026317 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:35:52.027084 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.030279 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.030425 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6477693-ef, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:52.030730 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6477693-ef, col_values=(('qos', UUID('47ce846e-1edc-4fd3-a1a5-8f2858e07ab8')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:52.030912 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6477693-ef, col_values=(('external_ids', {'iface-id': 'a6477693-efb0-41aa-8a1f-7af1881965c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:4c:8e', 'vm-uuid': '23196294-f311-4315-a76c-1b9509bfa082'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:52.031839 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.034701 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:35:52.038884 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.039735 np0000001025 nova-compute[97981]: INFO os_vif [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:4c:8e,bridge_name='br-int',has_traffic_filtering=True,id=a6477693-efb0-41aa-8a1f-7af1881965c5,network=Network(65e495fa-ccc2-48b7-9b32-ef75280bef22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6477693-ef')
May 19 04:35:52.193341 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Releasing lock "refresh_cache-1081cdc6-540d-4cb8-9e0d-d7584411e539" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:35:52.196840 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1629521735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1629521735',id=9,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEYnYF79S8BYxQZJ+dMTZjjdbQN3rcn72CWM+baGIlro7OTlpW3xu/PoWXZ+BC9Xw4nxCPqKjMoVyw2hgomsW56DUe6HIHrGodPsGgr/T3ioiXjmvIEBQenW8502hvJuQ==',key_name='tempest-keypair-1597632254',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:35:06Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dbef1a3853c14e3daa34b934269bb404',ramdisk_id='',reservation_id='r-xqcyykie',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-268161223',owner_user_name='tempest-TaggedAttachmentsTest-268161223-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:35:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97454d937cea4489b1c5e2b7dbbde8d5',uuid=1081cdc6-540d-4cb8-9e0d-d7584411e539,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "address": "fa:16:3e:63:a6:69", "network": {"id": "dcc776c0-b6b9-42ac-a64c-4ee5021d2646", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2010051909", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap312ea861-c6", "ovs_interfaceid": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:35:52.197183 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Converting VIF {"id": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "address": "fa:16:3e:63:a6:69", "network": {"id": "dcc776c0-b6b9-42ac-a64c-4ee5021d2646", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2010051909", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap312ea861-c6", "ovs_interfaceid": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:35:52.198218 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=312ea861-c69c-4976-ba37-408f1e7fe0dd,network=Network(dcc776c0-b6b9-42ac-a64c-4ee5021d2646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312ea861-c6') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:35:52.198218 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=312ea861-c69c-4976-ba37-408f1e7fe0dd,network=Network(dcc776c0-b6b9-42ac-a64c-4ee5021d2646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312ea861-c6') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:35:52.198628 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.198866 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:52.199902 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:35:52.200935 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.201163 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dbcc086b-4c26-5fb0-8d8d-c64f54476e6c', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:52.204034 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.204962 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:35:52.213001 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.215315 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.215490 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap312ea861-c6, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:52.215838 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap312ea861-c6, col_values=(('qos', UUID('bb0884a3-a1b6-4ca2-929c-02fb4a055d48')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:52.216020 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap312ea861-c6, col_values=(('external_ids', {'iface-id': '312ea861-c69c-4976-ba37-408f1e7fe0dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:a6:69', 'vm-uuid': '1081cdc6-540d-4cb8-9e0d-d7584411e539'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:52.218604 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.219846 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:35:52.220715 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-828d29d2-9ae3-402f-a4d1-cff87e14de96 req-6fb82a80-855a-4ec0-a16a-fbac61913b34 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:52.229134 np0000001025 nova-compute[97981]: INFO nova.compute.rpcapi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72
May 19 04:35:52.229783 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Releasing lock "compute-rpcapi-router" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:35:52.230056 np0000001025 nova-compute[97981]: DEBUG nova.compute.rpcapi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97981) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 19 04:35:52.249912 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.251119 np0000001025 nova-compute[97981]: INFO os_vif [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=312ea861-c69c-4976-ba37-408f1e7fe0dd,network=Network(dcc776c0-b6b9-42ac-a64c-4ee5021d2646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312ea861-c6')
May 19 04:35:52.251746 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1629521735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1629521735',id=9,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEYnYF79S8BYxQZJ+dMTZjjdbQN3rcn72CWM+baGIlro7OTlpW3xu/PoWXZ+BC9Xw4nxCPqKjMoVyw2hgomsW56DUe6HIHrGodPsGgr/T3ioiXjmvIEBQenW8502hvJuQ==',key_name='tempest-keypair-1597632254',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:35:06Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dbef1a3853c14e3daa34b934269bb404',ramdisk_id='',reservation_id='r-xqcyykie',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-268161223',owner_user_name='tempest-TaggedAttachmentsTest-268161223-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:35:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97454d937cea4489b1c5e2b7dbbde8d5',uuid=1081cdc6-540d-4cb8-9e0d-d7584411e539,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "address": "fa:16:3e:63:a6:69", "network": {"id": "dcc776c0-b6b9-42ac-a64c-4ee5021d2646", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2010051909", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap312ea861-c6", "ovs_interfaceid": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:35:52.251898 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Converting VIF {"id": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "address": "fa:16:3e:63:a6:69", "network": {"id": "dcc776c0-b6b9-42ac-a64c-4ee5021d2646", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2010051909", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap312ea861-c6", "ovs_interfaceid": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:35:52.252349 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=312ea861-c69c-4976-ba37-408f1e7fe0dd,network=Network(dcc776c0-b6b9-42ac-a64c-4ee5021d2646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312ea861-c6') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:35:52.255561 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] attach device xml: <interface type="ethernet">
May 19 04:35:52.255561 np0000001025 nova-compute[97981]:   <mac address="fa:16:3e:63:a6:69"/>
May 19 04:35:52.255561 np0000001025 nova-compute[97981]:   <model type="virtio"/>
May 19 04:35:52.255561 np0000001025 nova-compute[97981]:   <driver name="qemu"/>
May 19 04:35:52.255561 np0000001025 nova-compute[97981]:   <mtu size="1372"/>
May 19 04:35:52.255561 np0000001025 nova-compute[97981]:   <target dev="tap312ea861-c6"/>
May 19 04:35:52.255561 np0000001025 nova-compute[97981]: </interface>
May 19 04:35:52.255561 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:35:52.274074 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.336465 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-828d29d2-9ae3-402f-a4d1-cff87e14de96 req-6fb82a80-855a-4ec0-a16a-fbac61913b34 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:35:52.356048 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.358840 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.368247 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.439675 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Successfully updated port: c0ec0e22-8097-46a0-93bb-077e4e38a07c {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:35:52.472796 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-2b47df70-6aeb-4160-8d17-b7da61d5cc5a req-104633e7-6410-49f2-91e2-9e368f723fdc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:52.478829 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-eb36d7dc-48e2-47a7-b8ce-05aeaad8ccfc req-f8793fc2-caa6-47a5-98c9-61488b6292fb service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-changed-55210bd9-f231-4f7e-89be-c5779add4e83 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:52.478869 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-eb36d7dc-48e2-47a7-b8ce-05aeaad8ccfc req-f8793fc2-caa6-47a5-98c9-61488b6292fb service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Refreshing instance network info cache due to event network-changed-55210bd9-f231-4f7e-89be-c5779add4e83. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:35:52.479135 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-eb36d7dc-48e2-47a7-b8ce-05aeaad8ccfc req-f8793fc2-caa6-47a5-98c9-61488b6292fb service nova] Acquiring lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:35:52.603506 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-48c7867b-0e45-4a6a-bc8b-43074bce3425 req-3673bbea-508d-4bd5-a233-937c32c022c5 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Received event network-vif-plugged-312ea861-c69c-4976-ba37-408f1e7fe0dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:52.603546 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-48c7867b-0e45-4a6a-bc8b-43074bce3425 req-3673bbea-508d-4bd5-a233-937c32c022c5 service nova] Acquiring lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:52.605195 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-48c7867b-0e45-4a6a-bc8b-43074bce3425 req-3673bbea-508d-4bd5-a233-937c32c022c5 service nova] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:52.606148 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-48c7867b-0e45-4a6a-bc8b-43074bce3425 req-3673bbea-508d-4bd5-a233-937c32c022c5 service nova] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:52.606592 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-48c7867b-0e45-4a6a-bc8b-43074bce3425 req-3673bbea-508d-4bd5-a233-937c32c022c5 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] No waiting events found dispatching network-vif-plugged-312ea861-c69c-4976-ba37-408f1e7fe0dd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:35:52.606592 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-48c7867b-0e45-4a6a-bc8b-43074bce3425 req-3673bbea-508d-4bd5-a233-937c32c022c5 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Received unexpected event network-vif-plugged-312ea861-c69c-4976-ba37-408f1e7fe0dd for instance with vm_state active and task_state None.
May 19 04:35:52.616655 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-46205d4e-481c-4353-a678-41b952e586d4 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.228s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:52.642445 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-828d29d2-9ae3-402f-a4d1-cff87e14de96 req-6fb82a80-855a-4ec0-a16a-fbac61913b34 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:52.668711 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2b47df70-6aeb-4160-8d17-b7da61d5cc5a req-104633e7-6410-49f2-91e2-9e368f723fdc service nova] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Updated VIF entry in instance network info cache for port a6477693-efb0-41aa-8a1f-7af1881965c5. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:35:52.669379 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2b47df70-6aeb-4160-8d17-b7da61d5cc5a req-104633e7-6410-49f2-91e2-9e368f723fdc service nova] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Updating instance_info_cache with network_info: [{"id": "a6477693-efb0-41aa-8a1f-7af1881965c5", "address": "fa:16:3e:53:4c:8e", "network": {"id": "65e495fa-ccc2-48b7-9b32-ef75280bef22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "579b33395d4a41479b805cf02294060a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6477693-ef", "ovs_interfaceid": "a6477693-efb0-41aa-8a1f-7af1881965c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:52.679566 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.688869 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.695886 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.726578 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.734581 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.768600 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "refresh_cache-6ea060d2-e149-4189-b93b-66ce319b9157" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:35:52.770374 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquired lock "refresh_cache-6ea060d2-e149-4189-b93b-66ce319b9157" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:35:52.770374 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:35:52.912551 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:52.915460 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:35:52.917277 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:35:52.917518 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Creating image(s)
May 19 04:35:52.917886 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:35:52.918101 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Ensure instance console log exists: /opt/stack/data/nova/instances/63247a98-0dc4-4a87-9141-5ae713a462b5/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:35:52.918388 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:52.918563 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:52.918682 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:53.145656 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-828d29d2-9ae3-402f-a4d1-cff87e14de96 req-6fb82a80-855a-4ec0-a16a-fbac61913b34 service nova] Releasing lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:35:53.146222 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-eb36d7dc-48e2-47a7-b8ce-05aeaad8ccfc req-f8793fc2-caa6-47a5-98c9-61488b6292fb service nova] Acquired lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:35:53.146457 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-eb36d7dc-48e2-47a7-b8ce-05aeaad8ccfc req-f8793fc2-caa6-47a5-98c9-61488b6292fb service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Refreshing network info cache for port 55210bd9-f231-4f7e-89be-c5779add4e83 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:35:53.171421 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2b47df70-6aeb-4160-8d17-b7da61d5cc5a req-104633e7-6410-49f2-91e2-9e368f723fdc service nova] Releasing lock "refresh_cache-23196294-f311-4315-a76c-1b9509bfa082" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:35:53.276864 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:53.567134 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:35:53.567134 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:35:53.567134 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] No VIF found with MAC fa:16:3e:53:4c:8e, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:35:53.567134 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Using config drive
May 19 04:35:53.633802 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Successfully updated port: 42811c2a-5e1a-48c2-ae48-869cd5e416e6 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:35:53.649894 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-eb36d7dc-48e2-47a7-b8ce-05aeaad8ccfc req-f8793fc2-caa6-47a5-98c9-61488b6292fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:53.688240 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:53.693391 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-60ccd1a3-ad57-4791-a31d-4df11fddfa55 req-479600be-34e4-4380-99bc-ec7e1c4c9482 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-changed-42811c2a-5e1a-48c2-ae48-869cd5e416e6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:53.693391 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-60ccd1a3-ad57-4791-a31d-4df11fddfa55 req-479600be-34e4-4380-99bc-ec7e1c4c9482 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Refreshing instance network info cache due to event network-changed-42811c2a-5e1a-48c2-ae48-869cd5e416e6. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:35:53.693391 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-60ccd1a3-ad57-4791-a31d-4df11fddfa55 req-479600be-34e4-4380-99bc-ec7e1c4c9482 service nova] Acquiring lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:35:53.757417 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-eb36d7dc-48e2-47a7-b8ce-05aeaad8ccfc req-f8793fc2-caa6-47a5-98c9-61488b6292fb service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:35:53.869604 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Updating instance_info_cache with network_info: [{"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:53.895594 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:53.895825 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:53.910234 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:35:53.910399 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:35:53.910508 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] No VIF found with MAC fa:16:3e:e5:ed:dc, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:35:53.962477 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-eb36d7dc-48e2-47a7-b8ce-05aeaad8ccfc req-f8793fc2-caa6-47a5-98c9-61488b6292fb service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:54.075141 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:54.240223 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Creating config drive at /opt/stack/data/nova/instances/23196294-f311-4315-a76c-1b9509bfa082/disk.config
May 19 04:35:54.244066 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/23196294-f311-4315-a76c-1b9509bfa082/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp45iuz8na {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:54.282125 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/23196294-f311-4315-a76c-1b9509bfa082/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp45iuz8na" returned: 0 in 0.037s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:54.372265 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Releasing lock "refresh_cache-6ea060d2-e149-4189-b93b-66ce319b9157" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:35:54.400534 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Detaching volume ec3c9c30-a760-430d-93c4-6a04d0c9a413
May 19 04:35:54.421680 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1629521735', uuid='1081cdc6-540d-4cb8-9e0d-d7584411e539'), owner=OwnerMeta(userid='97454d937cea4489b1c5e2b7dbbde8d5', username='tempest-TaggedAttachmentsTest-268161223-project-member', projectid='dbef1a3853c14e3daa34b934269bb404', projectname='tempest-TaggedAttachmentsTest-268161223'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "address": "fa:16:3e:e5:ed:dc", "network": {"id": "637c588b-9807-4474-9ce4-42f9d9631794", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-90879599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f5a2e8-43", "ovs_interfaceid": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "address": "fa:16:3e:63:a6:69", "network": {"id": "dcc776c0-b6b9-42ac-a64c-4ee5021d2646", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2010051909", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap312ea861-c6", "ovs_interfaceid": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165354.4211757) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:35:54.422438 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:   <nova:package version="33.1.0"/>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:   <nova:name>tempest-device-tagging-server-1629521735</nova:name>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:   <nova:creationTime>2026-05-19 04:35:54</nova:creationTime>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:   <nova:flavor name="m1.nano" id="42">
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:     <nova:memory>192</nova:memory>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:     <nova:disk>1</nova:disk>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:     <nova:swap>0</nova:swap>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:     <nova:ephemeral>0</nova:ephemeral>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:     <nova:vcpus>1</nova:vcpus>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:     <nova:extraSpecs>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:     </nova:extraSpecs>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:   </nova:flavor>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:   <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:     <nova:containerFormat>bare</nova:containerFormat>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:     <nova:minDisk>1</nova:minDisk>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:     <nova:minRam>0</nova:minRam>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:     <nova:properties>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:       <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:       <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:     </nova:properties>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:   </nova:image>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:   <nova:owner>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:     <nova:user uuid="97454d937cea4489b1c5e2b7dbbde8d5">tempest-TaggedAttachmentsTest-268161223-project-member</nova:user>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:     <nova:project uuid="dbef1a3853c14e3daa34b934269bb404">tempest-TaggedAttachmentsTest-268161223</nova:project>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:   </nova:owner>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:   <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:   <nova:ports>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:     <nova:port uuid="e0f5a2e8-4380-464f-99dd-c33eaa062d63">
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:       <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:     </nova:port>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:     <nova:port uuid="312ea861-c69c-4976-ba37-408f1e7fe0dd">
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:       <nova:ip type="fixed" address="10.10.10.76" ipVersion="4"/>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:     </nova:port>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:   </nova:ports>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]: </nova:instance>
May 19 04:35:54.422438 np0000001025 nova-compute[97981]:  {{(pid=97981) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 19 04:35:54.464842 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-eb36d7dc-48e2-47a7-b8ce-05aeaad8ccfc req-f8793fc2-caa6-47a5-98c9-61488b6292fb service nova] Releasing lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:35:54.465630 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-60ccd1a3-ad57-4791-a31d-4df11fddfa55 req-479600be-34e4-4380-99bc-ec7e1c4c9482 service nova] Acquired lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:35:54.465822 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-60ccd1a3-ad57-4791-a31d-4df11fddfa55 req-479600be-34e4-4380-99bc-ec7e1c4c9482 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Refreshing network info cache for port 42811c2a-5e1a-48c2-ae48-869cd5e416e6 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:35:54.487511 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Attempting to driver detach volume ec3c9c30-a760-430d-93c4-6a04d0c9a413 from mountpoint /dev/vdb
May 19 04:35:54.497214 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Found disk vdb by alias ua-ec3c9c30-a760-430d-93c4-6a04d0c9a413 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:35:54.498726 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Found disk vdb by alias ua-ec3c9c30-a760-430d-93c4-6a04d0c9a413 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:35:54.498866 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Attempting to detach device vdb from instance e662af2e-fcc4-4739-993c-c5e7f4ddfe9c from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:35:54.499214 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:35:54.499214 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:35:54.499214 np0000001025 nova-compute[97981]:   <alias name="ua-ec3c9c30-a760-430d-93c4-6a04d0c9a413"/>
May 19 04:35:54.499214 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:35:54.499214 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:35:54.499214 np0000001025 nova-compute[97981]:   <serial>ec3c9c30-a760-430d-93c4-6a04d0c9a413</serial>
May 19 04:35:54.499214 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:35:54.499214 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:35:54.499214 np0000001025 nova-compute[97981]: </disk>
May 19 04:35:54.499214 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:35:54.506970 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Successfully detached device vdb from instance e662af2e-fcc4-4739-993c-c5e7f4ddfe9c from the persistent domain config.
May 19 04:35:54.507293 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] (1/8): Attempting to detach device vdb with device alias ua-ec3c9c30-a760-430d-93c4-6a04d0c9a413 from instance e662af2e-fcc4-4739-993c-c5e7f4ddfe9c from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:35:54.507577 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:35:54.507577 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:35:54.507577 np0000001025 nova-compute[97981]:   <alias name="ua-ec3c9c30-a760-430d-93c4-6a04d0c9a413"/>
May 19 04:35:54.507577 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:35:54.507577 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:35:54.507577 np0000001025 nova-compute[97981]:   <serial>ec3c9c30-a760-430d-93c4-6a04d0c9a413</serial>
May 19 04:35:54.507577 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:35:54.507577 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:35:54.507577 np0000001025 nova-compute[97981]: </disk>
May 19 04:35:54.507577 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:35:54.574791 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8dd59650-eeee-4179-9a00-92862a73d8fd req-f135289c-431b-4bc4-bfc4-66da6a74e7cf service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-changed-c0ec0e22-8097-46a0-93bb-077e4e38a07c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:54.575241 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8dd59650-eeee-4179-9a00-92862a73d8fd req-f135289c-431b-4bc4-bfc4-66da6a74e7cf service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Refreshing instance network info cache due to event network-changed-c0ec0e22-8097-46a0-93bb-077e4e38a07c. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:35:54.575458 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8dd59650-eeee-4179-9a00-92862a73d8fd req-f135289c-431b-4bc4-bfc4-66da6a74e7cf service nova] Acquiring lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:35:54.709126 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Successfully updated port: d7648d4e-3e92-4c77-9347-91670c3b9113 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:35:54.714722 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ae3e5fa8-f8f3-4ede-b7dd-47cd8db04373 req-f48308d7-42ff-4b27-9b10-26fa88d3af4a service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Received event network-vif-plugged-312ea861-c69c-4976-ba37-408f1e7fe0dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:54.715020 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ae3e5fa8-f8f3-4ede-b7dd-47cd8db04373 req-f48308d7-42ff-4b27-9b10-26fa88d3af4a service nova] Acquiring lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:54.715215 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ae3e5fa8-f8f3-4ede-b7dd-47cd8db04373 req-f48308d7-42ff-4b27-9b10-26fa88d3af4a service nova] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:54.715346 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ae3e5fa8-f8f3-4ede-b7dd-47cd8db04373 req-f48308d7-42ff-4b27-9b10-26fa88d3af4a service nova] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:54.715470 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ae3e5fa8-f8f3-4ede-b7dd-47cd8db04373 req-f48308d7-42ff-4b27-9b10-26fa88d3af4a service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] No waiting events found dispatching network-vif-plugged-312ea861-c69c-4976-ba37-408f1e7fe0dd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:35:54.715581 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-ae3e5fa8-f8f3-4ede-b7dd-47cd8db04373 req-f48308d7-42ff-4b27-9b10-26fa88d3af4a service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Received unexpected event network-vif-plugged-312ea861-c69c-4976-ba37-408f1e7fe0dd for instance with vm_state active and task_state None.
May 19 04:35:54.802875 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:54.870798 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:54.872304 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:54.934989 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-237da060-c524-4fe4-8eaf-c736e8027071 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "interface-1081cdc6-540d-4cb8-9e0d-d7584411e539-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 9.301s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:54.939268 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:54.970169 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-60ccd1a3-ad57-4791-a31d-4df11fddfa55 req-479600be-34e4-4380-99bc-ec7e1c4c9482 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:55.121535 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-60ccd1a3-ad57-4791-a31d-4df11fddfa55 req-479600be-34e4-4380-99bc-ec7e1c4c9482 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:35:55.137526 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:55.140504 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:55.168909 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:55.214934 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:35:55.283362 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-60ccd1a3-ad57-4791-a31d-4df11fddfa55 req-479600be-34e4-4380-99bc-ec7e1c4c9482 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:55.567508 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:55.718611 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165355.7182388, 23196294-f311-4315-a76c-1b9509bfa082 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:35:55.719212 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 23196294-f311-4315-a76c-1b9509bfa082] VM Started (Lifecycle Event)
May 19 04:35:55.763075 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4a684aa1-074a-4df1-8a90-c9245cce9635 req-9bbaa77d-9b67-4004-aea1-99637d0d6734 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-changed-d7648d4e-3e92-4c77-9347-91670c3b9113 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:55.763075 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4a684aa1-074a-4df1-8a90-c9245cce9635 req-9bbaa77d-9b67-4004-aea1-99637d0d6734 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Refreshing instance network info cache due to event network-changed-d7648d4e-3e92-4c77-9347-91670c3b9113. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:35:55.763075 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4a684aa1-074a-4df1-8a90-c9245cce9635 req-9bbaa77d-9b67-4004-aea1-99637d0d6734 service nova] Acquiring lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:35:55.785382 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-60ccd1a3-ad57-4791-a31d-4df11fddfa55 req-479600be-34e4-4380-99bc-ec7e1c4c9482 service nova] Releasing lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:35:55.785602 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8dd59650-eeee-4179-9a00-92862a73d8fd req-f135289c-431b-4bc4-bfc4-66da6a74e7cf service nova] Acquired lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:35:55.785751 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-8dd59650-eeee-4179-9a00-92862a73d8fd req-f135289c-431b-4bc4-bfc4-66da6a74e7cf service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Refreshing network info cache for port c0ec0e22-8097-46a0-93bb-077e4e38a07c {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:35:55.888703 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Starting migrate_disk_and_power_off {{(pid=97981) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 19 04:35:55.896916 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquiring lock "1081cdc6-540d-4cb8-9e0d-d7584411e539" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:55.897316 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:55.910983 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:55.914081 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:55.936717 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:55.940887 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:55.961314 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:55.967253 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:56.221993 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:35:56.229408 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165356.2290308, 23196294-f311-4315-a76c-1b9509bfa082 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:35:56.230153 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 23196294-f311-4315-a76c-1b9509bfa082] VM Paused (Lifecycle Event)
May 19 04:35:56.288385 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-8dd59650-eeee-4179-9a00-92862a73d8fd req-f135289c-431b-4bc4-bfc4-66da6a74e7cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:56.355461 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ec3c9c30-a760-430d-93c4-6a04d0c9a413 for instance e662af2e-fcc4-4739-993c-c5e7f4ddfe9c {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:35:56.369896 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Instance destroyed successfully.
May 19 04:35:56.372467 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1325996205',display_name='tempest-ServerActionsTestOtherB-server-1325996205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serveractionstestotherb-server-1325996205',id=8,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3jK8eIICR3l/4SHxst/8yPlILpDesN4+H3trAm2UFhRABDmHluvxgOWTGKox1jLYWeyqvab+bX/g483yAyobp3jhS/ZI5/84mWYZjjvl9ViemWFe558Ts8/0C9LeWLvw==',key_name='tempest-keypair-958107194',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:34:55Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b34124f30156425cbda16473ccedeff4',ramdisk_id='',reservation_id='r-k74jcc1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1000009728',owner_user_name='tempest-ServerActionsTestOtherB-1000009728-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:35:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cde403fc60ce4630af81e6bdfa2b4603',uuid=6ea060d2-e149-4189-b93b-66ce319b9157,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1819520594-network", "vif_mac": "fa:16:3e:40:b1:c7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:35:56.372720 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Converting VIF {"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1819520594-network", "vif_mac": "fa:16:3e:40:b1:c7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:35:56.375186 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:b1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7cdc75ea-9f5f-4944-92ae-1788cf00aea2,network=Network(8114a6bf-054f-469f-a788-9fd489f4ee76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cdc75ea-9f') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:35:56.377026 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:b1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7cdc75ea-9f5f-4944-92ae-1788cf00aea2,network=Network(8114a6bf-054f-469f-a788-9fd489f4ee76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cdc75ea-9f') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:35:56.378559 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:56.378943 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cdc75ea-9f, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:56.380630 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:56.381601 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:35:56.382579 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:56.383853 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:56.384044 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b7f01bc-6d36-40f0-ba0d-1caa02683e15) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:35:56.384635 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:56.387939 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:35:56.387939 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:56.390834 np0000001025 nova-compute[97981]: INFO os_vif [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:b1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7cdc75ea-9f5f-4944-92ae-1788cf00aea2,network=Network(8114a6bf-054f-469f-a788-9fd489f4ee76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cdc75ea-9f')
May 19 04:35:56.392132 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:35:56.392585 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b25ba87-624c-4d65-b535-95d5d14da486', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:35:56.393623 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:35:56.394854 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:35:56.395190 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b25ba87-624c-4d65-b535-95d5d14da486', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:35:56.395338 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:35:56.399377 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-8dd59650-eeee-4179-9a00-92862a73d8fd req-f135289c-431b-4bc4-bfc4-66da6a74e7cf service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:35:56.405577 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lazy-loading 'flavor' on Instance uuid 1081cdc6-540d-4cb8-9e0d-d7584411e539 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:56.431538 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:56.431538 np0000001025 nova-compute[97981]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:56.431538 np0000001025 nova-compute[97981]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:35:56.431538 np0000001025 nova-compute[97981]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:35:56.431538 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:35:56.431881 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:56.431881 np0000001025 nova-compute[97981]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:56.431881 np0000001025 nova-compute[97981]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:35:56.431881 np0000001025 nova-compute[97981]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:35:56.431881 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:35:56.431881 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', '14')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:35:56.432023 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', '14')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:35:56.435293 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', '13')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:35:56.436199 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218500f7920>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486'): ({'sdd'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:35:56.436409 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Removing multipathed devices sdd, sde {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:35:56.436674 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Flush multipath device 330000000b045a358 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:35:56.473290 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:35:56.525060 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:35:56.575955 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:35:56.576187 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] SCSI volumes sdd, sde have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:35:56.576923 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:35:56.591602 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:35:56.596251 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:35:56.608920 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-8dd59650-eeee-4179-9a00-92862a73d8fd req-f135289c-431b-4bc4-bfc4-66da6a74e7cf service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:35:56.613125 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:56.652594 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.40.100,3260]
May 19 04:35:56.652594 np0000001025 nova-compute[97981]: Logout of [sid: 14, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.40.100,3260] successful.
May 19 04:35:56.652594 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:56.667488 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:56.678675 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:56.713464 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.50.100,3260]
May 19 04:35:56.713464 np0000001025 nova-compute[97981]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.50.100,3260] successful.
May 19 04:35:56.713464 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:56.729313 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:56.729741 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:35:56.729807 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] <== disconnect_volume: return (337ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:35:56.729974 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:35:56.732360 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:35:56.736860 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:56.749733 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:35:56.821989 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6265cef1-21ac-4f05-b8a0-65075dacdc02 req-c01d3f95-0ff7-4631-8da7-415802647d1f service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received event network-vif-unplugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:56.822316 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6265cef1-21ac-4f05-b8a0-65075dacdc02 req-c01d3f95-0ff7-4631-8da7-415802647d1f service nova] Acquiring lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:56.829015 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6265cef1-21ac-4f05-b8a0-65075dacdc02 req-c01d3f95-0ff7-4631-8da7-415802647d1f service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:56.829218 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6265cef1-21ac-4f05-b8a0-65075dacdc02 req-c01d3f95-0ff7-4631-8da7-415802647d1f service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:56.830380 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6265cef1-21ac-4f05-b8a0-65075dacdc02 req-c01d3f95-0ff7-4631-8da7-415802647d1f service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] No waiting events found dispatching network-vif-unplugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:35:56.830472 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-6265cef1-21ac-4f05-b8a0-65075dacdc02 req-c01d3f95-0ff7-4631-8da7-415802647d1f service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received unexpected event network-vif-unplugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 for instance with vm_state active and task_state resize_migrating.
May 19 04:35:56.830613 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6265cef1-21ac-4f05-b8a0-65075dacdc02 req-c01d3f95-0ff7-4631-8da7-415802647d1f service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received event network-vif-unplugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:35:56.830794 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6265cef1-21ac-4f05-b8a0-65075dacdc02 req-c01d3f95-0ff7-4631-8da7-415802647d1f service nova] Acquiring lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:56.831251 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6265cef1-21ac-4f05-b8a0-65075dacdc02 req-c01d3f95-0ff7-4631-8da7-415802647d1f service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:56.831404 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6265cef1-21ac-4f05-b8a0-65075dacdc02 req-c01d3f95-0ff7-4631-8da7-415802647d1f service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:56.831542 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6265cef1-21ac-4f05-b8a0-65075dacdc02 req-c01d3f95-0ff7-4631-8da7-415802647d1f service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] No waiting events found dispatching network-vif-unplugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:35:56.831677 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-6265cef1-21ac-4f05-b8a0-65075dacdc02 req-c01d3f95-0ff7-4631-8da7-415802647d1f service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received unexpected event network-vif-unplugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 for instance with vm_state active and task_state resize_migrating.
May 19 04:35:56.832268 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:56.832694 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:56.935521 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:56.935962 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:35:56.936536 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157_resize/disk /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:57.017412 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CMD "cp -r /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157_resize/disk /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk" returned: 0 in 0.081s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:57.017867 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157_resize/disk.config /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk.config {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:57.064648 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CMD "cp -r /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157_resize/disk.config /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk.config" returned: 0 in 0.046s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:57.065245 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157_resize/disk.info /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk.info {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:57.103101 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CMD "cp -r /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157_resize/disk.info /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk.info" returned: 0 in 0.037s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:35:57.114448 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8dd59650-eeee-4179-9a00-92862a73d8fd req-f135289c-431b-4bc4-bfc4-66da6a74e7cf service nova] Releasing lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:35:57.115184 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquired lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:35:57.115590 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:35:57.260379 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 23196294-f311-4315-a76c-1b9509bfa082] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:35:57.261293 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165357.2610135, e662af2e-fcc4-4739-993c-c5e7f4ddfe9c => ua-ec3c9c30-a760-430d-93c4-6a04d0c9a413> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:35:57.261597 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999814244999925 future=<Future at 0x72185017da00 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:35:57.261830 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999571246999949 future=<Future at 0x72185017da00 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:35:57.261936 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999446002000013 future=<Future at 0x72185017da00 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:35:57.267016 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Successfully detached device vdb from instance e662af2e-fcc4-4739-993c-c5e7f4ddfe9c from the live domain config.
May 19 04:35:57.302915 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:35:57.303370 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:35:57.303554 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:35:57.304033 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:35:57.304414 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec3c9c30-a760-430d-93c4-6a04d0c9a413', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:35:57.304607 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:35:57.328427 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:57.328427 np0000001025 nova-compute[97981]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:57.328427 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:35:57.328649 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:57.328649 np0000001025 nova-compute[97981]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413 (non-flash)
May 19 04:35:57.328649 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:35:57.328765 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', '12')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:35:57.328826 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', '12')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:35:57.329628 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413', '11')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:35:57.331272 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185018f6a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413'): ({'sdb'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:35:57.331272 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Removing multipathed devices sdc, sdb {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:35:57.331272 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Flush multipath device 330000000a96716bb {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:35:57.370047 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:35:57.409064 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:35:57.419645 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.522s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:57.460395 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:35:57.460641 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:35:57.461600 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:35:57.473122 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:35:57.473421 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:35:57.487539 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:57.518900 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413, portal: 192.168.40.100,3260]
May 19 04:35:57.518900 np0000001025 nova-compute[97981]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413, portal: 192.168.40.100,3260] successful.
May 19 04:35:57.518900 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:57.528944 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:57.538424 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:57.569071 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413, portal: 192.168.50.100,3260]
May 19 04:35:57.569071 np0000001025 nova-compute[97981]: Logout of [sid: 11, target: iqn.2023-03.storpool.com:os--volume-ec3c9c30-a760-430d-93c4-6a04d0c9a413, portal: 192.168.50.100,3260] successful.
May 19 04:35:57.569071 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:57.579882 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:57.580301 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:35:57.580497 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] <== disconnect_volume: return (276ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:35:57.580649 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:35:57.713662 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:35:57.896566 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:57.916489 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:35:58.145338 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lazy-loading 'flavor' on Instance uuid e662af2e-fcc4-4739-993c-c5e7f4ddfe9c {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:35:58.242359 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:58.242705 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:58.315982 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Port 7cdc75ea-9f5f-4944-92ae-1788cf00aea2 binding to destination host np0000001025 is already ACTIVE {{(pid=97981) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}}
May 19 04:35:58.502077 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquiring lock "1081cdc6-540d-4cb8-9e0d-d7584411e539" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:58.502348 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:58.502586 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Attaching volume b382aa5a-cec8-437c-ab56-ec6837f134fc to /dev/vdb
May 19 04:35:58.551269 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:35:58.562514 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:35:58.584202 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:35:58.625008 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:35:58.625008 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:35:58.632711 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:35:58.634704 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::e86a:f3ff:fee3:83a1', 'fe80::fc16:3eff:fea0:92d3', 'fe80::98fd:dbff:fefe:cdf5', 'fe80::fc16:3eff:feca:fa0b', 'fe80::fc16:3eff:fe8a:28ef', 'fe80::fc16:3eff:fee5:eddc', 'fe80::cc29:a6ff:fef5:800e', 'fe80::fc16:3eff:fe81:2190', 'fe80::fc16:3eff:fe7d:73e6', 'fe80::fc16:3eff:fe63:a669', 'fe80::18b0:b2ff:fedd:8318', 'fe80::fc16:3eff:fe53:4c8e', 'fe80::ac38:63ff:fe70:6d96'] 
May 19 04:35:58.634832 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:35:58.634883 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:35:58.635086 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:35:58.635391 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Updating existing volume attachment record: 66316251-1ced-4aa3-a274-a8544506d98b {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:35:58.751437 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:59.128878 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:59.160281 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cd1321bb-b5d1-4109-bd18-f3e95d64b5e3 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.262s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:59.200605 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:35:59.200926 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc', 'iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b382aa5a-cec8-437c-ab56-ec6837f134fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:35:59.201070 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:35:59.203133 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:35:59.203133 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc', 'iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b382aa5a-cec8-437c-ab56-ec6837f134fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:35:59.213708 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:35:59.215128 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:35:59.215128 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:35:59.215128 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:35:59.217353 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:35:59.217610 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:35:59.228040 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:35:59.228040 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:59.239162 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:35:59.239162 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:59.244154 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc] added
May 19 04:35:59.244154 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:35:59.244154 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:35:59.244154 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:35:59.244154 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:35:59.244154 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:35:59.244154 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:59.244452 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:35:59.244767 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0295(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:35:59.244922 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:35:59.251320 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc] added
May 19 04:35:59.251320 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:35:59.251320 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:35:59.251320 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:35:59.251320 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:35:59.251320 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:35:59.251320 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:35:59.251546 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:35:59.251805 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0341(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:35:59.252003 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:35:59.329173 np0000001025 nova-compute[97981]: DEBUG nova.compute.rpcapi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97981) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 19 04:35:59.346021 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:59.346434 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:59.346484 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:59.509184 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:35:59.552379 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:59.552379 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:59.552379 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:59.552379 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:59.552379 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:59.553483 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Terminating instance
May 19 04:35:59.673867 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:59.674065 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:59.674630 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:35:59.674630 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:35:59.674630 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:35:59.676799 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Terminating instance
May 19 04:35:59.819874 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:00.061695 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:36:00.086550 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:00.089978 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:00.108624 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:00.113069 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:00.179795 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:36:00.205663 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:00.209588 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:00.228542 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:00.242624 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:00.245432 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:36:00.252510 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:36:00.253254 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:36:00.264431 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:36:00.264431 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:36:00.274092 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:36:00.274092 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:00.284966 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:00.288283 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:00.297867 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:00.303823 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 19 04:36:00.303823 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:00.304008 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 19 04:36:00.304008 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:00.304230 np0000001025 nova-compute[97981]: WARNING os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 19 04:36:00.304230 np0000001025 nova-compute[97981]: 
May 19 04:36:00.312976 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 19 04:36:00.312976 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:00.313166 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 19 04:36:00.313166 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:00.313322 np0000001025 nova-compute[97981]: WARNING os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 19 04:36:00.313322 np0000001025 nova-compute[97981]: 
May 19 04:36:00.317236 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:00.336865 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc, portal: 192.168.50.100,3260]
May 19 04:36:00.336865 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc, portal: 192.168.50.100,3260] successful.
May 19 04:36:00.336865 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:00.350485 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:00.355503 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc, portal: 192.168.40.100,3260]
May 19 04:36:00.355503 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc, portal: 192.168.40.100,3260] successful.
May 19 04:36:00.355503 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:00.364210 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:00.364210 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:00.364210 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:00.364352 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsi session list stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:00.364352 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:00.364352 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:00.364652 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:00.364776 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:36:00.366755 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:00.371535 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] HCTL ('7', '-', '-', 0) found on session 15 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:36:00.371652 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:36:00.375212 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:00.388239 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Searching for a device in session 15 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:36:00.388239 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b382aa5a-cec8-437c-ab56-ec6837f134fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:36:00.393535 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e6ac718f-e5cd-4fd3-b8a6-529b2fcf1483 req-ccef0af5-08fd-4a0a-b809-4a18584d33b7 service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Received event network-vif-unplugged-6849a6ab-b169-4813-800c-3348010fa7b0 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:00.393535 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e6ac718f-e5cd-4fd3-b8a6-529b2fcf1483 req-ccef0af5-08fd-4a0a-b809-4a18584d33b7 service nova] Acquiring lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:00.393637 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e6ac718f-e5cd-4fd3-b8a6-529b2fcf1483 req-ccef0af5-08fd-4a0a-b809-4a18584d33b7 service nova] Lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:00.393712 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e6ac718f-e5cd-4fd3-b8a6-529b2fcf1483 req-ccef0af5-08fd-4a0a-b809-4a18584d33b7 service nova] Lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:00.393816 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e6ac718f-e5cd-4fd3-b8a6-529b2fcf1483 req-ccef0af5-08fd-4a0a-b809-4a18584d33b7 service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] No waiting events found dispatching network-vif-unplugged-6849a6ab-b169-4813-800c-3348010fa7b0 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:00.394210 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e6ac718f-e5cd-4fd3-b8a6-529b2fcf1483 req-ccef0af5-08fd-4a0a-b809-4a18584d33b7 service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Received event network-vif-unplugged-6849a6ab-b169-4813-800c-3348010fa7b0 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:36:00.394812 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:00.394812 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:00.394812 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:00.394941 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsi session list stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:00.394941 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:00.394941 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:00.395167 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:00.395261 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:36:00.398095 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] HCTL ('8', '-', '-', 0) found on session 16 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:36:00.398095 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:36:00.409391 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:00.428191 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Searching for a device in session 16 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:36:00.428390 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b382aa5a-cec8-437c-ab56-ec6837f134fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:36:00.455708 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:00.527571 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "refresh_cache-6ea060d2-e149-4189-b93b-66ce319b9157" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:36:00.527571 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquired lock "refresh_cache-6ea060d2-e149-4189-b93b-66ce319b9157" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:36:00.527571 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:36:00.534896 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999715177000098 future=<Future at 0x7218501b26c0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:00.556716 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:00.566734 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999764025999866 future=<Future at 0x721850309eb0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:00.566734 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Instance destroyed successfully.
May 19 04:36:00.568527 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lazy-loading 'resources' on Instance uuid e662af2e-fcc4-4739-993c-c5e7f4ddfe9c {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:00.574232 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Instance destroyed successfully.
May 19 04:36:00.575915 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lazy-loading 'resources' on Instance uuid f71811d1-b0ad-48f9-ba04-9a6e517961b9 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:00.805309 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:00.811193 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Updating instance_info_cache with network_info: [{"id": "ad71ba07-449a-4565-bd5e-17c050975bd3", "address": "fa:16:3e:3b:78:32", "network": {"id": "a3b3266f-28a3-47fc-b52c-26f42a06a1bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1135470460-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad71ba07-44", "ovs_interfaceid": "ad71ba07-449a-4565-bd5e-17c050975bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "address": "fa:16:3e:e7:64:b0", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60124aa0-37", "ovs_interfaceid": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "address": "fa:16:3e:c8:33:5b", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap137c6f2c-dd", "ovs_interfaceid": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "55210bd9-f231-4f7e-89be-c5779add4e83", "address": "fa:16:3e:d0:04:13", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55210bd9-f2", "ovs_interfaceid": "55210bd9-f231-4f7e-89be-c5779add4e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "address": "fa:16:3e:50:b6:e3", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ec0e22-80", "ovs_interfaceid": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "address": "fa:16:3e:10:97:76", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42811c2a-5e", "ovs_interfaceid": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7648d4e-3e92-4c77-9347-91670c3b9113", "address": "fa:16:3e:2c:e3:ec", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7648d4e-3e", "ovs_interfaceid": "d7648d4e-3e92-4c77-9347-91670c3b9113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:00.817922 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:00.824552 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:00.856690 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:00.869522 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:00.969946 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:01.001557 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:01.029438 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:01.071829 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1885948312-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testmultiattachvolumeswap-server-1885948312-1',id=6,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBlbq6k8T9MvQtAuYFhs0QFZxUnnQjQyrWjfLxAsKArz2JlbeiPt2SLV4E6hoFHQPVljrrHfmQGLTXhTv4UPGHJX4/ywJEjnH+yns7x73S9HX7FJlJHKkQgW1cLyfqzxg==',key_name='tempest-keypair-811971859',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:34:38Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='907951cd15704c2d968614f909b64ba7',ramdisk_id='',reservation_id='r-v021aa8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-626733199',owner_user_name='tempest-TestMultiAttachVolumeSwap-626733199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:34:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8208ac95cdcb4481a05d42b29f73dde7',uuid=e662af2e-fcc4-4739-993c-c5e7f4ddfe9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6849a6ab-b169-4813-800c-3348010fa7b0", "address": "fa:16:3e:a0:92:d3", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6849a6ab-b1", "ovs_interfaceid": "6849a6ab-b169-4813-800c-3348010fa7b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:36:01.072016 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Converting VIF {"id": "6849a6ab-b169-4813-800c-3348010fa7b0", "address": "fa:16:3e:a0:92:d3", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6849a6ab-b1", "ovs_interfaceid": "6849a6ab-b169-4813-800c-3348010fa7b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:01.072708 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:92:d3,bridge_name='br-int',has_traffic_filtering=True,id=6849a6ab-b169-4813-800c-3348010fa7b0,network=Network(8000cc8e-b893-4034-9989-dea929ab765c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6849a6ab-b1') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:01.073039 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:92:d3,bridge_name='br-int',has_traffic_filtering=True,id=6849a6ab-b169-4813-800c-3348010fa7b0,network=Network(8000cc8e-b893-4034-9989-dea929ab765c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6849a6ab-b1') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:36:01.074462 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:01.074782 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6849a6ab-b1, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:01.075888 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:01.076848 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:01.079476 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1885948312-2',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testmultiattachvolumeswap-server-1885948312-2',id=7,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBlbq6k8T9MvQtAuYFhs0QFZxUnnQjQyrWjfLxAsKArz2JlbeiPt2SLV4E6hoFHQPVljrrHfmQGLTXhTv4UPGHJX4/ywJEjnH+yns7x73S9HX7FJlJHKkQgW1cLyfqzxg==',key_name='tempest-keypair-811971859',keypairs=<?>,launch_index=1,launched_at=2026-05-19T04:34:48Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='907951cd15704c2d968614f909b64ba7',ramdisk_id='',reservation_id='r-v021aa8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-626733199',owner_user_name='tempest-TestMultiAttachVolumeSwap-626733199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:34:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8208ac95cdcb4481a05d42b29f73dde7',uuid=f71811d1-b0ad-48f9-ba04-9a6e517961b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87877be0-a885-4589-913e-29c2dcd6900b", "address": "fa:16:3e:ca:fa:0b", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877be0-a8", "ovs_interfaceid": "87877be0-a885-4589-913e-29c2dcd6900b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:36:01.079731 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Converting VIF {"id": "87877be0-a885-4589-913e-29c2dcd6900b", "address": "fa:16:3e:ca:fa:0b", "network": {"id": "8000cc8e-b893-4034-9989-dea929ab765c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1163502361-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "907951cd15704c2d968614f909b64ba7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap87877be0-a8", "ovs_interfaceid": "87877be0-a885-4589-913e-29c2dcd6900b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:01.080218 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:fa:0b,bridge_name='br-int',has_traffic_filtering=True,id=87877be0-a885-4589-913e-29c2dcd6900b,network=Network(8000cc8e-b893-4034-9989-dea929ab765c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87877be0-a8') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:01.080435 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:fa:0b,bridge_name='br-int',has_traffic_filtering=True,id=87877be0-a885-4589-913e-29c2dcd6900b,network=Network(8000cc8e-b893-4034-9989-dea929ab765c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87877be0-a8') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:36:01.082603 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:01.083397 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:01.083579 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87877be0-a8, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:01.084430 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:01.085023 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:01.085080 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:01.085378 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:01.086047 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fed81468-5172-49b0-b8e1-87220fbc9421) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:01.086669 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:01.087183 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:01.087564 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:01.087882 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:01.088006 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8b0d373-df6c-410a-9de3-f28bcaf7234a) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:01.088894 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:01.088945 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:01.089842 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:01.090801 np0000001025 nova-compute[97981]: INFO os_vif [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:92:d3,bridge_name='br-int',has_traffic_filtering=True,id=6849a6ab-b169-4813-800c-3348010fa7b0,network=Network(8000cc8e-b893-4034-9989-dea929ab765c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6849a6ab-b1')
May 19 04:36:01.091893 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Deleting instance files /opt/stack/data/nova/instances/e662af2e-fcc4-4739-993c-c5e7f4ddfe9c_del
May 19 04:36:01.092028 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Deletion of /opt/stack/data/nova/instances/e662af2e-fcc4-4739-993c-c5e7f4ddfe9c_del complete
May 19 04:36:01.093901 np0000001025 nova-compute[97981]: INFO os_vif [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:fa:0b,bridge_name='br-int',has_traffic_filtering=True,id=87877be0-a885-4589-913e-29c2dcd6900b,network=Network(8000cc8e-b893-4034-9989-dea929ab765c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87877be0-a8')
May 19 04:36:01.094275 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Deleting instance files /opt/stack/data/nova/instances/f71811d1-b0ad-48f9-ba04-9a6e517961b9_del
May 19 04:36:01.095818 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Deletion of /opt/stack/data/nova/instances/f71811d1-b0ad-48f9-ba04-9a6e517961b9_del complete
May 19 04:36:01.217969 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:36:01.313795 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Releasing lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:36:01.314446 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Instance network_info: |[{"id": "ad71ba07-449a-4565-bd5e-17c050975bd3", "address": "fa:16:3e:3b:78:32", "network": {"id": "a3b3266f-28a3-47fc-b52c-26f42a06a1bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1135470460-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad71ba07-44", "ovs_interfaceid": "ad71ba07-449a-4565-bd5e-17c050975bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "address": "fa:16:3e:e7:64:b0", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60124aa0-37", "ovs_interfaceid": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "address": "fa:16:3e:c8:33:5b", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap137c6f2c-dd", "ovs_interfaceid": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "55210bd9-f231-4f7e-89be-c5779add4e83", "address": "fa:16:3e:d0:04:13", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55210bd9-f2", "ovs_interfaceid": "55210bd9-f231-4f7e-89be-c5779add4e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "address": "fa:16:3e:50:b6:e3", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ec0e22-80", "ovs_interfaceid": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "address": "fa:16:3e:10:97:76", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42811c2a-5e", "ovs_interfaceid": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7648d4e-3e92-4c77-9347-91670c3b9113", "address": "fa:16:3e:2c:e3:ec", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7648d4e-3e", "ovs_interfaceid": "d7648d4e-3e92-4c77-9347-91670c3b9113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:36:01.315789 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4a684aa1-074a-4df1-8a90-c9245cce9635 req-9bbaa77d-9b67-4004-aea1-99637d0d6734 service nova] Acquired lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:36:01.315985 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4a684aa1-074a-4df1-8a90-c9245cce9635 req-9bbaa77d-9b67-4004-aea1-99637d0d6734 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Refreshing network info cache for port d7648d4e-3e92-4c77-9347-91670c3b9113 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:36:01.321870 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Start _get_guest_xml network_info=[{"id": "ad71ba07-449a-4565-bd5e-17c050975bd3", "address": "fa:16:3e:3b:78:32", "network": {"id": "a3b3266f-28a3-47fc-b52c-26f42a06a1bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1135470460-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad71ba07-44", "ovs_interfaceid": "ad71ba07-449a-4565-bd5e-17c050975bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "address": "fa:16:3e:e7:64:b0", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60124aa0-37", "ovs_interfaceid": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "address": "fa:16:3e:c8:33:5b", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap137c6f2c-dd", "ovs_interfaceid": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "55210bd9-f231-4f7e-89be-c5779add4e83", "address": "fa:16:3e:d0:04:13", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55210bd9-f2", "ovs_interfaceid": "55210bd9-f231-4f7e-89be-c5779add4e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "address": "fa:16:3e:50:b6:e3", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ec0e22-80", "ovs_interfaceid": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "address": "fa:16:3e:10:97:76", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42811c2a-5e", "ovs_interfaceid": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7648d4e-3e92-4c77-9347-91670c3b9113", "address": "fa:16:3e:2c:e3:ec", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7648d4e-3e", "ovs_interfaceid": "d7648d4e-3e92-4c77-9347-91670c3b9113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '6319109d-cadd-4b50-be76-a009e927f481', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1d04e1a5-6059-4dec-9127-3ffa039dd625', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '63247a98-0dc4-4a87-9141-5ae713a462b5', 'attached_at': '', 'detached_at': '', 'volume_id': '1d04e1a5-6059-4dec-9127-3ffa039dd625', 'serial': '1d04e1a5-6059-4dec-9127-3ffa039dd625'}, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': 1, 'attachment_id': '94795eba-c09c-474e-b032-974c6d04cb85', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df86bd40-0f7a-447e-86d5-0494d1928695', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '63247a98-0dc4-4a87-9141-5ae713a462b5', 'attached_at': '', 'detached_at': '', 'volume_id': 'df86bd40-0f7a-447e-86d5-0494d1928695', 'serial': 'df86bd40-0f7a-447e-86d5-0494d1928695'}, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': 2, 'attachment_id': 'c6262bc8-a454-4b07-9cc7-cccb0e981880', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1fe9afac-3374-4e79-bff5-27405bd5fd0f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '63247a98-0dc4-4a87-9141-5ae713a462b5', 'attached_at': '', 'detached_at': '', 'volume_id': '1fe9afac-3374-4e79-bff5-27405bd5fd0f', 'serial': '1fe9afac-3374-4e79-bff5-27405bd5fd0f'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:36:01.328444 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:36:01.330480 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-828285451', uuid='63247a98-0dc4-4a87-9141-5ae713a462b5'), owner=OwnerMeta(userid='a349efc3ddaf48ed966109438d3f0625', username='tempest-TaggedBootDevicesTest_v242-1449301970-project-member', projectid='7fc088ff80284506af708277495c5882', projectname='tempest-TaggedBootDevicesTest_v242-1449301970'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ad71ba07-449a-4565-bd5e-17c050975bd3", "address": "fa:16:3e:3b:78:32", "network": {"id": "a3b3266f-28a3-47fc-b52c-26f42a06a1bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1135470460-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad71ba07-44", "ovs_interfaceid": "ad71ba07-449a-4565-bd5e-17c050975bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "address": "fa:16:3e:e7:64:b0", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60124aa0-37", "ovs_interfaceid": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "address": "fa:16:3e:c8:33:5b", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap137c6f2c-dd", "ovs_interfaceid": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "55210bd9-f231-4f7e-89be-c5779add4e83", "address": "fa:16:3e:d0:04:13", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55210bd9-f2", "ovs_interfaceid": "55210bd9-f231-4f7e-89be-c5779add4e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "address": "fa:16:3e:50:b6:e3", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ec0e22-80", "ovs_interfaceid": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "address": "fa:16:3e:10:97:76", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42811c2a-5e", "ovs_interfaceid": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7648d4e-3e92-4c77-9347-91670c3b9113", "address": "fa:16:3e:2c:e3:ec", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7648d4e-3e", "ovs_interfaceid": "d7648d4e-3e92-4c77-9347-91670c3b9113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165361.3297567) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:36:01.336788 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:36:01.337274 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:36:01.338187 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:36:01.338435 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:36:01.339896 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:36:01.340364 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:36:01.340589 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:36:01.340736 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:36:01.340922 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:36:01.341061 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:36:01.346678 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:36:01.347033 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:36:01.347280 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:36:01.347506 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:36:01.347697 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:36:01.347868 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:36:01.365059 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:36:01.365634 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1d04e1a5-6059-4dec-9127-3ffa039dd625', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:36:01.365903 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:01.403631 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:01.541668 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Updating instance_info_cache with network_info: [{"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:01.604679 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Took 1.54 seconds to destroy the instance on the hypervisor.
May 19 04:36:01.606014 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Took 1.43 seconds to destroy the instance on the hypervisor.
May 19 04:36:01.606736 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:36:01.607535 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:36:01.607618 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:36:01.607806 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:36:01.607989 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:36:01.608264 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:36:01.608568 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:01.609287 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:01.686296 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:01.716964 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:01.823228 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-4a684aa1-074a-4df1-8a90-c9245cce9635 req-9bbaa77d-9b67-4004-aea1-99637d0d6734 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:02.043971 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Releasing lock "refresh_cache-6ea060d2-e149-4189-b93b-66ce319b9157" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:36:02.138303 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cce78ead-0421-4f7d-a032-9b6f4fee8117 req-373efe55-607f-4412-9325-148c0b14900e service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Received event network-vif-deleted-87877be0-a885-4589-913e-29c2dcd6900b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:02.138478 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-cce78ead-0421-4f7d-a032-9b6f4fee8117 req-373efe55-607f-4412-9325-148c0b14900e service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Neutron deleted interface 87877be0-a885-4589-913e-29c2dcd6900b; detaching it from the instance and deleting it from the info cache
May 19 04:36:02.138614 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-cce78ead-0421-4f7d-a032-9b6f4fee8117 req-373efe55-607f-4412-9325-148c0b14900e service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:02.157369 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-54349d16-1eb8-4eb4-b013-28dfd49fea1d req-fd39b263-1e99-49a1-9f65-0bd27fbf368d service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Received event network-vif-deleted-6849a6ab-b169-4813-800c-3348010fa7b0 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:02.159009 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-54349d16-1eb8-4eb4-b013-28dfd49fea1d req-fd39b263-1e99-49a1-9f65-0bd27fbf368d service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Neutron deleted interface 6849a6ab-b169-4813-800c-3348010fa7b0; detaching it from the instance and deleting it from the info cache
May 19 04:36:02.159317 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-54349d16-1eb8-4eb4-b013-28dfd49fea1d req-fd39b263-1e99-49a1-9f65-0bd27fbf368d service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:02.234935 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Found WWN 330000000baf93a5b for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:36:02.235342 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:02.235489 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000baf93a5b', 'path': '/dev/dm-0', 'multipath_id': '330000000baf93a5b'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:36:02.235612 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000baf93a5b', 'path': '/dev/dm-0', 'multipath_id': '330000000baf93a5b'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:36:02.236500 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.870s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:02.236753 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1d04e1a5-6059-4dec-9127-3ffa039dd625', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:36:02.241941 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:02.243087 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lazy-loading 'flavor' on Instance uuid 1081cdc6-540d-4cb8-9e0d-d7584411e539 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:02.252855 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:02.253473 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:02.253961 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:02.254210 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:36:02.254676 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:02.254949 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:36:02.266621 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:36:02.266621 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:02.279018 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625] added
May 19 04:36:02.279018 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:36:02.279018 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:02.279018 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:02.279018 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:02.279018 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:02.279018 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:02.279710 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:36:02.279710 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0253(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:36:02.279710 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:36:02.280141 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:36:02.280141 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:02.294785 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625] added
May 19 04:36:02.294785 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:36:02.294785 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:02.294785 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:02.294785 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:02.294785 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:02.294785 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:02.294958 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:36:02.295050 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0402(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:36:02.295198 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:36:02.410233 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-4a684aa1-074a-4df1-8a90-c9245cce9635 req-9bbaa77d-9b67-4004-aea1-99637d0d6734 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:02.468594 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:02.496694 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6b7c7f6e-0650-41be-ae1d-43004415312d req-91effc7d-2c8f-4e5a-ba22-367d74786aa6 service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Received event network-vif-unplugged-6849a6ab-b169-4813-800c-3348010fa7b0 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:02.496895 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6b7c7f6e-0650-41be-ae1d-43004415312d req-91effc7d-2c8f-4e5a-ba22-367d74786aa6 service nova] Acquiring lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:02.502955 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6b7c7f6e-0650-41be-ae1d-43004415312d req-91effc7d-2c8f-4e5a-ba22-367d74786aa6 service nova] Lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:02.503790 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6b7c7f6e-0650-41be-ae1d-43004415312d req-91effc7d-2c8f-4e5a-ba22-367d74786aa6 service nova] Lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:02.504521 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6b7c7f6e-0650-41be-ae1d-43004415312d req-91effc7d-2c8f-4e5a-ba22-367d74786aa6 service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] No waiting events found dispatching network-vif-unplugged-6849a6ab-b169-4813-800c-3348010fa7b0 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:02.504637 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6b7c7f6e-0650-41be-ae1d-43004415312d req-91effc7d-2c8f-4e5a-ba22-367d74786aa6 service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Received event network-vif-unplugged-6849a6ab-b169-4813-800c-3348010fa7b0 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:36:02.504787 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6b7c7f6e-0650-41be-ae1d-43004415312d req-91effc7d-2c8f-4e5a-ba22-367d74786aa6 service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Received event network-vif-unplugged-87877be0-a885-4589-913e-29c2dcd6900b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:02.508094 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6b7c7f6e-0650-41be-ae1d-43004415312d req-91effc7d-2c8f-4e5a-ba22-367d74786aa6 service nova] Acquiring lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:02.508906 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6b7c7f6e-0650-41be-ae1d-43004415312d req-91effc7d-2c8f-4e5a-ba22-367d74786aa6 service nova] Lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:02.509024 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6b7c7f6e-0650-41be-ae1d-43004415312d req-91effc7d-2c8f-4e5a-ba22-367d74786aa6 service nova] Lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:02.509203 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6b7c7f6e-0650-41be-ae1d-43004415312d req-91effc7d-2c8f-4e5a-ba22-367d74786aa6 service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] No waiting events found dispatching network-vif-unplugged-87877be0-a885-4589-913e-29c2dcd6900b {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:02.509407 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6b7c7f6e-0650-41be-ae1d-43004415312d req-91effc7d-2c8f-4e5a-ba22-367d74786aa6 service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Received event network-vif-unplugged-87877be0-a885-4589-913e-29c2dcd6900b for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:36:02.509524 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6b7c7f6e-0650-41be-ae1d-43004415312d req-91effc7d-2c8f-4e5a-ba22-367d74786aa6 service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Received event network-vif-unplugged-87877be0-a885-4589-913e-29c2dcd6900b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:02.509643 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6b7c7f6e-0650-41be-ae1d-43004415312d req-91effc7d-2c8f-4e5a-ba22-367d74786aa6 service nova] Acquiring lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:02.509755 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6b7c7f6e-0650-41be-ae1d-43004415312d req-91effc7d-2c8f-4e5a-ba22-367d74786aa6 service nova] Lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:02.509851 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6b7c7f6e-0650-41be-ae1d-43004415312d req-91effc7d-2c8f-4e5a-ba22-367d74786aa6 service nova] Lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:02.509952 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6b7c7f6e-0650-41be-ae1d-43004415312d req-91effc7d-2c8f-4e5a-ba22-367d74786aa6 service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] No waiting events found dispatching network-vif-unplugged-87877be0-a885-4589-913e-29c2dcd6900b {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:02.510045 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6b7c7f6e-0650-41be-ae1d-43004415312d req-91effc7d-2c8f-4e5a-ba22-367d74786aa6 service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Received event network-vif-unplugged-87877be0-a885-4589-913e-29c2dcd6900b for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:36:02.555372 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:36:02.567061 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:36:02.588236 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:02.599225 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:02.608129 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4a684aa1-074a-4df1-8a90-c9245cce9635 req-9bbaa77d-9b67-4004-aea1-99637d0d6734 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Updated VIF entry in instance network info cache for port d7648d4e-3e92-4c77-9347-91670c3b9113. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:36:02.609126 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4a684aa1-074a-4df1-8a90-c9245cce9635 req-9bbaa77d-9b67-4004-aea1-99637d0d6734 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Updating instance_info_cache with network_info: [{"id": "ad71ba07-449a-4565-bd5e-17c050975bd3", "address": "fa:16:3e:3b:78:32", "network": {"id": "a3b3266f-28a3-47fc-b52c-26f42a06a1bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1135470460-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad71ba07-44", "ovs_interfaceid": "ad71ba07-449a-4565-bd5e-17c050975bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "address": "fa:16:3e:e7:64:b0", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60124aa0-37", "ovs_interfaceid": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "address": "fa:16:3e:c8:33:5b", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap137c6f2c-dd", "ovs_interfaceid": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "55210bd9-f231-4f7e-89be-c5779add4e83", "address": "fa:16:3e:d0:04:13", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55210bd9-f2", "ovs_interfaceid": "55210bd9-f231-4f7e-89be-c5779add4e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "address": "fa:16:3e:50:b6:e3", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ec0e22-80", "ovs_interfaceid": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "address": "fa:16:3e:10:97:76", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42811c2a-5e", "ovs_interfaceid": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7648d4e-3e92-4c77-9347-91670c3b9113", "address": "fa:16:3e:2c:e3:ec", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7648d4e-3e", "ovs_interfaceid": "d7648d4e-3e92-4c77-9347-91670c3b9113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:02.626826 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:36:02.627571 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:36:02.641308 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:36:02.642772 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::e86a:f3ff:fee3:83a1', 'fe80::fc16:3eff:fe8a:28ef', 'fe80::fc16:3eff:fee5:eddc', 'fe80::cc29:a6ff:fef5:800e', 'fe80::fc16:3eff:fe81:2190', 'fe80::fc16:3eff:fe7d:73e6', 'fe80::fc16:3eff:fe63:a669', 'fe80::18b0:b2ff:fedd:8318', 'fe80::fc16:3eff:fe53:4c8e', 'fe80::ac38:63ff:fe70:6d96'] 
May 19 04:36:02.642904 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:36:02.643016 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:36:02.643359 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:36:02.647904 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cce78ead-0421-4f7d-a032-9b6f4fee8117 req-373efe55-607f-4412-9325-148c0b14900e service nova] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Detach interface failed, port_id=87877be0-a885-4589-913e-29c2dcd6900b, reason: Instance f71811d1-b0ad-48f9-ba04-9a6e517961b9 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:36:02.664824 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-54349d16-1eb8-4eb4-b013-28dfd49fea1d req-fd39b263-1e99-49a1-9f65-0bd27fbf368d service nova] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Detach interface failed, port_id=6849a6ab-b169-4813-800c-3348010fa7b0, reason: Instance e662af2e-fcc4-4739-993c-c5e7f4ddfe9c could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:36:02.747460 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Attempting to attach volume b382aa5a-cec8-437c-ab56-ec6837f134fc with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:36:02.748761 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:36:02.748761 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:36:02.748761 np0000001025 nova-compute[97981]:   <alias name="ua-b382aa5a-cec8-437c-ab56-ec6837f134fc"/>
May 19 04:36:02.748761 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:36:02.748761 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:36:02.748761 np0000001025 nova-compute[97981]:   <serial>b382aa5a-cec8-437c-ab56-ec6837f134fc</serial>
May 19 04:36:02.748761 np0000001025 nova-compute[97981]: </disk>
May 19 04:36:02.748761 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:36:02.917533 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:02.970857 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Took 1.36 seconds to deallocate network for instance.
May 19 04:36:03.110274 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Took 1.50 seconds to deallocate network for instance.
May 19 04:36:03.115382 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4a684aa1-074a-4df1-8a90-c9245cce9635 req-9bbaa77d-9b67-4004-aea1-99637d0d6734 service nova] Releasing lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:36:03.115657 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4a684aa1-074a-4df1-8a90-c9245cce9635 req-9bbaa77d-9b67-4004-aea1-99637d0d6734 service nova] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Received event network-vif-plugged-a6477693-efb0-41aa-8a1f-7af1881965c5 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:03.115911 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4a684aa1-074a-4df1-8a90-c9245cce9635 req-9bbaa77d-9b67-4004-aea1-99637d0d6734 service nova] Acquiring lock "23196294-f311-4315-a76c-1b9509bfa082-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:03.116305 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4a684aa1-074a-4df1-8a90-c9245cce9635 req-9bbaa77d-9b67-4004-aea1-99637d0d6734 service nova] Lock "23196294-f311-4315-a76c-1b9509bfa082-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:03.116468 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4a684aa1-074a-4df1-8a90-c9245cce9635 req-9bbaa77d-9b67-4004-aea1-99637d0d6734 service nova] Lock "23196294-f311-4315-a76c-1b9509bfa082-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:03.116614 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4a684aa1-074a-4df1-8a90-c9245cce9635 req-9bbaa77d-9b67-4004-aea1-99637d0d6734 service nova] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Processing event network-vif-plugged-a6477693-efb0-41aa-8a1f-7af1881965c5 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:36:03.116794 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4a684aa1-074a-4df1-8a90-c9245cce9635 req-9bbaa77d-9b67-4004-aea1-99637d0d6734 service nova] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Received event network-vif-plugged-a6477693-efb0-41aa-8a1f-7af1881965c5 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:03.116941 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4a684aa1-074a-4df1-8a90-c9245cce9635 req-9bbaa77d-9b67-4004-aea1-99637d0d6734 service nova] Acquiring lock "23196294-f311-4315-a76c-1b9509bfa082-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:03.117092 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4a684aa1-074a-4df1-8a90-c9245cce9635 req-9bbaa77d-9b67-4004-aea1-99637d0d6734 service nova] Lock "23196294-f311-4315-a76c-1b9509bfa082-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:03.117230 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4a684aa1-074a-4df1-8a90-c9245cce9635 req-9bbaa77d-9b67-4004-aea1-99637d0d6734 service nova] Lock "23196294-f311-4315-a76c-1b9509bfa082-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:03.117390 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4a684aa1-074a-4df1-8a90-c9245cce9635 req-9bbaa77d-9b67-4004-aea1-99637d0d6734 service nova] [instance: 23196294-f311-4315-a76c-1b9509bfa082] No waiting events found dispatching network-vif-plugged-a6477693-efb0-41aa-8a1f-7af1881965c5 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:03.117533 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-4a684aa1-074a-4df1-8a90-c9245cce9635 req-9bbaa77d-9b67-4004-aea1-99637d0d6734 service nova] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Received unexpected event network-vif-plugged-a6477693-efb0-41aa-8a1f-7af1881965c5 for instance with vm_state building and task_state spawning.
May 19 04:36:03.119532 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Instance event wait completed in 7 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:36:03.121816 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165363.1214054, 23196294-f311-4315-a76c-1b9509bfa082 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:03.122029 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 23196294-f311-4315-a76c-1b9509bfa082] VM Resumed (Lifecycle Event)
May 19 04:36:03.123728 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:36:03.126242 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Instance spawned successfully.
May 19 04:36:03.127579 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:36:03.280161 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:36:03.292025 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:36:03.292025 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:03.295758 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:36:03.302519 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:36:03.309861 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:36:03.309861 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:03.318416 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:03.318416 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:03.318416 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:03.318643 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsi session list stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:03.318643 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:03.318643 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:03.323331 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:03.336824 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:03.336824 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:03.336824 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,0 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:03.336824 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:03.336824 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsi session list stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:03.336824 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:03.336824 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,0 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:03.336824 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:03.347719 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625, portal: 192.168.40.100,3260]
May 19 04:36:03.347719 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625, portal: 192.168.40.100,3260] successful.
May 19 04:36:03.347719 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:03.363154 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:03.374453 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625, portal: 192.168.50.100,3260]
May 19 04:36:03.374453 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625, portal: 192.168.50.100,3260] successful.
May 19 04:36:03.374453 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:03.383392 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:03.383392 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:03.383392 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:03.383392 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:03.383392 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:03.383623 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsi session list stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:03.383623 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:03.383623 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:03.383623 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:03.383623 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:03.384034 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.130s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:03.386191 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:36:03.386850 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:03.390380 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] HCTL ('9', '-', '-', 0) found on session 17 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:36:03.390536 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:36:03.403097 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:03.403097 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:03.403097 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:03.403097 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:03.403097 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:03.403681 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsi session list stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:03.403681 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:03.403681 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:03.403681 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:03.403681 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:03.404019 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:03.408977 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:36:03.408977 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Searching for a device in session 17 and hctl ['9', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:36:03.408977 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] HCTL ('10', '-', '-', 0) found on session 18 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:36:03.408977 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:36:03.432500 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Searching for a device in session 18 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:36:03.433171 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1d04e1a5-6059-4dec-9127-3ffa039dd625', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:36:03.478139 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:03.478406 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:03.618314 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:03.628531 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:03.629997 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:36:03.646023 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:03.646208 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:03.646618 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:03.646903 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:03.653960 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:03.654085 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:03.798332 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Starting finish_migration {{(pid=97981) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 19 04:36:03.802339 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Instance directory exists: not creating {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 19 04:36:03.802947 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Creating image(s)
May 19 04:36:03.804779 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:03.896400 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.092s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:03.896825 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:36:03.897033 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:03.994886 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:03.995567 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Cannot resize image /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:36:04.080663 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:36:04.080663 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:36:04.082624 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:04.138996 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 23196294-f311-4315-a76c-1b9509bfa082] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:36:04.159715 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Took 14.85 seconds to spawn the instance on the hypervisor.
May 19 04:36:04.159907 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:04.407336 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Searching for a device in session 17 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:36:04.407698 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1d04e1a5-6059-4dec-9127-3ffa039dd625', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:36:04.427003 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:36:04.427383 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:36:04.427566 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] No VIF found with MAC fa:16:3e:e5:ed:dc, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:36:04.498201 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:36:04.498375 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Ensure instance console log exists: /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:36:04.498698 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:04.498870 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:04.498984 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:04.501419 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Start _get_guest_xml network_info=[{"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1819520594-network", "vif_mac": "fa:16:3e:40:b1:c7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '8fda8915-5cfc-4bce-a3f8-52856c274ed4', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b25ba87-624c-4d65-b535-95d5d14da486', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '6ea060d2-e149-4189-b93b-66ce319b9157', 'attached_at': '2026-05-19T04:36:03.000000', 'detached_at': '', 'volume_id': '4b25ba87-624c-4d65-b535-95d5d14da486', 'serial': '4b25ba87-624c-4d65-b535-95d5d14da486'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:36:04.504803 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:36:04.505907 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1325996205', uuid='6ea060d2-e149-4189-b93b-66ce319b9157'), owner=OwnerMeta(userid='cde403fc60ce4630af81e6bdfa2b4603', username='tempest-ServerActionsTestOtherB-1000009728-project-member', projectid='b34124f30156425cbda16473ccedeff4', projectname='tempest-ServerActionsTestOtherB-1000009728'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1819520594-network", "vif_mac": "fa:16:3e:40:b1:c7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165364.5055523) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:36:04.506721 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:36:04.507010 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:36:04.507691 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:36:04.507836 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:36:04.508680 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:36:04.508947 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:36:04.509075 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:36:04.509202 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:36:04.509567 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:36:04.509651 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:36:04.509753 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:36:04.509883 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:36:04.509976 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:36:04.510073 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:36:04.510220 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:36:04.510390 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:36:04.522318 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk.config --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:04.589769 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:36:04.618425 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk.config --force-share --output=json" returned: 0 in 0.096s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:04.619075 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:04.619352 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "/opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:04.619944 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "/opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:04.620369 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:36:04.620820 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b25ba87-624c-4d65-b535-95d5d14da486', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:36:04.620989 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:04.668669 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Took 25.98 seconds to build instance.
May 19 04:36:05.061179 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:05.099011 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.621s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:05.101603 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.483s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:05.170483 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Lock "23196294-f311-4315-a76c-1b9509bfa082" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.493s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:05.181791 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Deleted allocations for instance f71811d1-b0ad-48f9-ba04-9a6e517961b9
May 19 04:36:05.276246 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Found WWN 33000000060c8f6a6 for multipath device dm-1 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:36:05.276661 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:05.279125 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] <== connect_volume: return (3911ms) {'type': 'block', 'scsi_wwn': '33000000060c8f6a6', 'path': '/dev/dm-1', 'multipath_id': '33000000060c8f6a6'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:36:05.279125 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000060c8f6a6', 'path': '/dev/dm-1', 'multipath_id': '33000000060c8f6a6'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:36:05.279125 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.657s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:05.279125 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b25ba87-624c-4d65-b535-95d5d14da486', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:36:05.289340 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:05.289776 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:05.290241 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:36:05.290772 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:05.291421 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:05.292550 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:36:05.299854 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:36:05.299854 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:05.303636 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:36:05.303636 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:05.320608 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486] added
May 19 04:36:05.320608 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:36:05.320608 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:05.320608 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:05.320608 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:05.320608 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:05.320608 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:05.320797 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:36:05.320897 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0284(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:36:05.321045 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:36:05.321954 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486] added
May 19 04:36:05.321954 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:36:05.321954 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:05.321954 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:05.321954 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:05.321954 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:05.321954 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:05.322280 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:36:05.322565 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0324(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:36:05.322771 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:36:05.637376 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:36:05.637702 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:36:05.782629 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:36:05.782894 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df86bd40-0f7a-447e-86d5-0494d1928695', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:36:05.782998 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:05.914472 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Acquiring lock "23196294-f311-4315-a76c-1b9509bfa082" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:05.914472 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Lock "23196294-f311-4315-a76c-1b9509bfa082" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:05.914472 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Acquiring lock "23196294-f311-4315-a76c-1b9509bfa082-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:05.914472 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Lock "23196294-f311-4315-a76c-1b9509bfa082-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:05.914472 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Lock "23196294-f311-4315-a76c-1b9509bfa082-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:05.917517 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Terminating instance
May 19 04:36:05.987345 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fd0c14e8-8091-4ef2-a06a-03369685c879 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.484s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:06.100271 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:06.142901 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:36:06.195398 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c1ab0aff-89c8-48ac-9d6a-a01bae41794c tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "f71811d1-b0ad-48f9-ba04-9a6e517961b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.521s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:06.196838 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:06.197294 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:06.321523 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:36:06.326702 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:36:06.338298 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:36:06.338298 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:36:06.341421 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:36:06.341421 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:06.353521 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:06.357898 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:06.368483 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:06.368483 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:06.368483 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:06.368483 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:06.368483 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:06.368704 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsi session list stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:06.368704 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:06.368704 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:06.368704 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:06.368704 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:06.373057 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:06.373057 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:06.373057 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:06.373057 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:06.373057 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:06.373330 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsi session list stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:06.373330 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:06.373330 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:06.373330 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:06.373330 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:06.405905 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.50.100,3260]
May 19 04:36:06.405905 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.50.100,3260] successful.
May 19 04:36:06.405905 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:06.411716 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.40.100,3260]
May 19 04:36:06.411716 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.40.100,3260] successful.
May 19 04:36:06.411716 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:06.417369 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:06.422746 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:36:06.429665 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:06.438767 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:06.438767 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:06.438767 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:06.438767 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:06.438767 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:06.438767 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:06.438767 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:06.439019 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsi session list stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:06.439019 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:06.439019 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:06.439019 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:06.439019 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:06.439019 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:06.439019 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:06.439311 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:06.439414 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:36:06.440104 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] HCTL ('11', '-', '-', 0) found on session 19 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:36:06.440260 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:36:06.444812 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:06.450332 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:06.457466 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:06.457466 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:06.457466 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:06.457466 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:06.457466 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:06.457466 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:06.457466 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:06.457690 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsi session list stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:06.457690 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:06.457690 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:06.457690 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:06.457690 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:06.457690 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:06.457690 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:06.458242 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:06.458242 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:36:06.458974 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] HCTL ('12', '-', '-', 0) found on session 20 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:36:06.459160 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:36:06.466894 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Searching for a device in session 19 and hctl ['11', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:36:06.475867 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Searching for a device in session 20 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:36:06.476773 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:06.477013 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b25ba87-624c-4d65-b535-95d5d14da486', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:36:06.480083 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:06.509241 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:06.651707 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.550s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:06.701745 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'flavor' on Instance uuid b5f34a29-15f7-4f5e-a8bf-574abebd5c84 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:06.719655 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Deleted allocations for instance e662af2e-fcc4-4739-993c-c5e7f4ddfe9c
May 19 04:36:06.751175 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999649768999916 future=<Future at 0x72185017c6b0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:06.752763 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Instance destroyed successfully.
May 19 04:36:06.753390 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Lazy-loading 'resources' on Instance uuid 23196294-f311-4315-a76c-1b9509bfa082 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:07.255965 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-582430480',display_name='tempest-VolumesNegativeTest-instance-582430480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesnegativetest-instance-582430480',id=12,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:36:04Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='363a8652da134f1bab65bef424c60cbe',ramdisk_id='',reservation_id='r-1lzkjjg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-204685150',owner_user_name='tempest-VolumesNegativeTest-204685150-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:36:04Z,user_data=None,user_id='e8eb8a55765f4945b13225a7bc9909eb',uuid=23196294-f311-4315-a76c-1b9509bfa082,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6477693-efb0-41aa-8a1f-7af1881965c5", "address": "fa:16:3e:53:4c:8e", "network": {"id": "65e495fa-ccc2-48b7-9b32-ef75280bef22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "579b33395d4a41479b805cf02294060a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6477693-ef", "ovs_interfaceid": "a6477693-efb0-41aa-8a1f-7af1881965c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:36:07.256256 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Converting VIF {"id": "a6477693-efb0-41aa-8a1f-7af1881965c5", "address": "fa:16:3e:53:4c:8e", "network": {"id": "65e495fa-ccc2-48b7-9b32-ef75280bef22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "579b33395d4a41479b805cf02294060a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6477693-ef", "ovs_interfaceid": "a6477693-efb0-41aa-8a1f-7af1881965c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:07.256924 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:4c:8e,bridge_name='br-int',has_traffic_filtering=True,id=a6477693-efb0-41aa-8a1f-7af1881965c5,network=Network(65e495fa-ccc2-48b7-9b32-ef75280bef22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6477693-ef') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:07.257213 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:4c:8e,bridge_name='br-int',has_traffic_filtering=True,id=a6477693-efb0-41aa-8a1f-7af1881965c5,network=Network(65e495fa-ccc2-48b7-9b32-ef75280bef22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6477693-ef') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:36:07.258669 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:07.258960 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6477693-ef, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:07.274924 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:07.275645 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:07.275829 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:07.276763 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:07.276913 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47ce846e-1edc-4fd3-a1a5-8f2858e07ab8) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:07.277389 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:07.277962 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:07.279949 np0000001025 nova-compute[97981]: INFO os_vif [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:4c:8e,bridge_name='br-int',has_traffic_filtering=True,id=a6477693-efb0-41aa-8a1f-7af1881965c5,network=Network(65e495fa-ccc2-48b7-9b32-ef75280bef22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6477693-ef')
May 19 04:36:07.280265 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Deleting instance files /opt/stack/data/nova/instances/23196294-f311-4315-a76c-1b9509bfa082_del
May 19 04:36:07.280963 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Deletion of /opt/stack/data/nova/instances/23196294-f311-4315-a76c-1b9509bfa082_del complete
May 19 04:36:07.467552 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Searching for a device in session 19 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:36:07.467726 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4b25ba87-624c-4d65-b535-95d5d14da486', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:36:07.701632 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquiring lock "1081cdc6-540d-4cb8-9e0d-d7584411e539" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:07.702057 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:07.706983 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:07.727212 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4ed5ba3-3e00-4214-8866-70fdf6ecdd92 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Lock "e662af2e-fcc4-4739-993c-c5e7f4ddfe9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.177s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:07.787258 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Took 1.36 seconds to destroy the instance on the hypervisor.
May 19 04:36:07.788135 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:36:07.788446 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:36:07.788590 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 23196294-f311-4315-a76c-1b9509bfa082] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:36:07.788736 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:07.870128 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:07.921949 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:08.135802 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:08.204442 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Detaching volume b382aa5a-cec8-437c-ab56-ec6837f134fc
May 19 04:36:08.255667 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Attempting to driver detach volume b382aa5a-cec8-437c-ab56-ec6837f134fc from mountpoint /dev/vdb
May 19 04:36:08.261218 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Found disk vdb by alias ua-b382aa5a-cec8-437c-ab56-ec6837f134fc {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:36:08.262754 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Found disk vdb by alias ua-b382aa5a-cec8-437c-ab56-ec6837f134fc {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:36:08.262947 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Attempting to detach device vdb from instance 1081cdc6-540d-4cb8-9e0d-d7584411e539 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:36:08.263326 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:36:08.263326 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:36:08.263326 np0000001025 nova-compute[97981]:   <alias name="ua-b382aa5a-cec8-437c-ab56-ec6837f134fc"/>
May 19 04:36:08.263326 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:36:08.263326 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:36:08.263326 np0000001025 nova-compute[97981]:   <serial>b382aa5a-cec8-437c-ab56-ec6837f134fc</serial>
May 19 04:36:08.263326 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 19 04:36:08.263326 np0000001025 nova-compute[97981]: </disk>
May 19 04:36:08.263326 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:36:08.266359 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6e61a22f-c691-469d-b5a0-f2d6b4fdbea1 req-58d422d3-148d-4ea2-b20e-c255ddff1f73 service nova] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Received event network-vif-deleted-a6477693-efb0-41aa-8a1f-7af1881965c5 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:08.266775 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-6e61a22f-c691-469d-b5a0-f2d6b4fdbea1 req-58d422d3-148d-4ea2-b20e-c255ddff1f73 service nova] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Neutron deleted interface a6477693-efb0-41aa-8a1f-7af1881965c5; detaching it from the instance and deleting it from the info cache
May 19 04:36:08.266775 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-6e61a22f-c691-469d-b5a0-f2d6b4fdbea1 req-58d422d3-148d-4ea2-b20e-c255ddff1f73 service nova] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:08.274625 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Successfully detached device vdb from instance 1081cdc6-540d-4cb8-9e0d-d7584411e539 from the persistent domain config.
May 19 04:36:08.274801 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] (1/8): Attempting to detach device vdb with device alias ua-b382aa5a-cec8-437c-ab56-ec6837f134fc from instance 1081cdc6-540d-4cb8-9e0d-d7584411e539 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:36:08.275079 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:36:08.275079 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:36:08.275079 np0000001025 nova-compute[97981]:   <alias name="ua-b382aa5a-cec8-437c-ab56-ec6837f134fc"/>
May 19 04:36:08.275079 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:36:08.275079 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:36:08.275079 np0000001025 nova-compute[97981]:   <serial>b382aa5a-cec8-437c-ab56-ec6837f134fc</serial>
May 19 04:36:08.275079 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 19 04:36:08.275079 np0000001025 nova-compute[97981]: </disk>
May 19 04:36:08.275079 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:36:08.313641 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Found WWN 330000000b045a358 for multipath device dm-4 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:36:08.313937 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:08.314240 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] <== connect_volume: return (3693ms) {'type': 'block', 'scsi_wwn': '330000000b045a358', 'path': '/dev/dm-4', 'multipath_id': '330000000b045a358'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:36:08.314423 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b045a358', 'path': '/dev/dm-4', 'multipath_id': '330000000b045a358'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:36:08.314814 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.532s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:08.315083 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df86bd40-0f7a-447e-86d5-0494d1928695', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:36:08.330248 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:08.332800 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:08.333388 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:08.333663 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:36:08.334473 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:08.334638 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:36:08.345321 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:36:08.345321 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:08.351216 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:36:08.351216 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:08.357167 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695] added
May 19 04:36:08.357167 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:36:08.357167 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:08.357167 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:08.357167 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:08.357167 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:08.357167 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:08.357467 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:36:08.357698 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0239(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:36:08.357821 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:36:08.367638 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695] added
May 19 04:36:08.367638 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:36:08.367638 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:08.367638 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:08.367638 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:08.367638 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:08.367638 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:08.367898 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:36:08.367898 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0333(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:36:08.368238 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:36:08.697923 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:08.769994 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6e61a22f-c691-469d-b5a0-f2d6b4fdbea1 req-58d422d3-148d-4ea2-b20e-c255ddff1f73 service nova] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Detach interface failed, port_id=a6477693-efb0-41aa-8a1f-7af1881965c5, reason: Instance 23196294-f311-4315-a76c-1b9509bfa082 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:36:08.777485 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165368.777183, 1081cdc6-540d-4cb8-9e0d-d7584411e539 => ua-b382aa5a-cec8-437c-ab56-ec6837f134fc> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:36:08.779218 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b382aa5a-cec8-437c-ab56-ec6837f134fc for instance 1081cdc6-540d-4cb8-9e0d-d7584411e539 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:36:08.781069 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Successfully detached device vdb from instance 1081cdc6-540d-4cb8-9e0d-d7584411e539 from the live domain config.
May 19 04:36:08.781775 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:36:08.782365 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc', 'iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b382aa5a-cec8-437c-ab56-ec6837f134fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:36:08.782471 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:08.807127 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:08.807307 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:08.807583 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Attaching volume 34fabdf8-c75f-4180-af5a-8be2ffaca881 to /dev/vdb
May 19 04:36:08.822221 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1325996205',display_name='tempest-ServerActionsTestOtherB-server-1325996205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001025',hostname='tempest-serveractionstestotherb-server-1325996205',id=8,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3jK8eIICR3l/4SHxst/8yPlILpDesN4+H3trAm2UFhRABDmHluvxgOWTGKox1jLYWeyqvab+bX/g483yAyobp3jhS/ZI5/84mWYZjjvl9ViemWFe558Ts8/0C9LeWLvw==',key_name='tempest-keypair-958107194',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:34:55Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001025',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b34124f30156425cbda16473ccedeff4',ramdisk_id='',reservation_id='r-k74jcc1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1000009728',owner_user_name='tempest-ServerActionsTestOtherB-1000009728-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:35:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cde403fc60ce4630af81e6bdfa2b4603',uuid=6ea060d2-e149-4189-b93b-66ce319b9157,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1819520594-network", "vif_mac": "fa:16:3e:40:b1:c7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:36:08.822586 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Converting VIF {"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1819520594-network", "vif_mac": "fa:16:3e:40:b1:c7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:08.823057 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:b1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7cdc75ea-9f5f-4944-92ae-1788cf00aea2,network=Network(8114a6bf-054f-469f-a788-9fd489f4ee76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cdc75ea-9f') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:08.824871 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] End _get_guest_xml xml=<domain type="qemu">
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:   <uuid>6ea060d2-e149-4189-b93b-66ce319b9157</uuid>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:   <name>instance-00000008</name>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:   <memory>262144</memory>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServerActionsTestOtherB-server-1325996205</nova:name>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:36:04</nova:creationTime>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.micro" id="84">
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:         <nova:memory>256</nova:memory>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:           <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:           <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:         <nova:user uuid="cde403fc60ce4630af81e6bdfa2b4603">tempest-ServerActionsTestOtherB-1000009728-project-member</nova:user>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:         <nova:project uuid="b34124f30156425cbda16473ccedeff4">tempest-ServerActionsTestOtherB-1000009728</nova:project>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:         <nova:port uuid="7cdc75ea-9f5f-4944-92ae-1788cf00aea2">
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     <system>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <entry name="serial">6ea060d2-e149-4189-b93b-66ce319b9157</entry>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <entry name="uuid">6ea060d2-e149-4189-b93b-66ce319b9157</entry>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     </system>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:   <os>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:   </os>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:   <features>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:   </features>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:   <devices>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk.config"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <alias name="ua-4b25ba87-624c-4d65-b535-95d5d14da486"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-4"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <target dev="vdb" bus="virtio"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <serial>4b25ba87-624c-4d65-b535-95d5d14da486</serial>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:40:b1:c7"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <target dev="tap7cdc75ea-9f"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     </interface>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/console.log" append="off"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     </serial>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     <video>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     </video>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     </rng>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:   </devices>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]: </domain>
May 19 04:36:08.824871 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:36:08.827693 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1325996205',display_name='tempest-ServerActionsTestOtherB-server-1325996205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001025',hostname='tempest-serveractionstestotherb-server-1325996205',id=8,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3jK8eIICR3l/4SHxst/8yPlILpDesN4+H3trAm2UFhRABDmHluvxgOWTGKox1jLYWeyqvab+bX/g483yAyobp3jhS/ZI5/84mWYZjjvl9ViemWFe558Ts8/0C9LeWLvw==',key_name='tempest-keypair-958107194',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:34:55Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001025',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b34124f30156425cbda16473ccedeff4',ramdisk_id='',reservation_id='r-k74jcc1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1000009728',owner_user_name='tempest-ServerActionsTestOtherB-1000009728-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:35:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cde403fc60ce4630af81e6bdfa2b4603',uuid=6ea060d2-e149-4189-b93b-66ce319b9157,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1819520594-network", "vif_mac": "fa:16:3e:40:b1:c7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:36:08.827693 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Converting VIF {"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1819520594-network", "vif_mac": "fa:16:3e:40:b1:c7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:08.827693 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:b1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7cdc75ea-9f5f-4944-92ae-1788cf00aea2,network=Network(8114a6bf-054f-469f-a788-9fd489f4ee76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cdc75ea-9f') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:08.827693 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:b1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7cdc75ea-9f5f-4944-92ae-1788cf00aea2,network=Network(8114a6bf-054f-469f-a788-9fd489f4ee76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cdc75ea-9f') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:36:08.827693 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:08.827693 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:08.827693 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:36:08.831087 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:08.831644 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0c494f0-3a9f-5aa8-8f24-c9a8e8e7579a', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:08.832238 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:08.833518 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:08.833518 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:08.836035 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:08.836035 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cdc75ea-9f, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:08.836344 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cdc75ea-9f, col_values=(('qos', UUID('63f51fb7-a42e-4f76-9f1c-36f7238e7f43')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:08.836344 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cdc75ea-9f, col_values=(('external_ids', {'iface-id': '7cdc75ea-9f5f-4944-92ae-1788cf00aea2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:b1:c7', 'vm-uuid': '6ea060d2-e149-4189-b93b-66ce319b9157'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:08.837167 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:08.838520 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:08.842397 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:08.843497 np0000001025 nova-compute[97981]: INFO os_vif [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:b1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7cdc75ea-9f5f-4944-92ae-1788cf00aea2,network=Network(8114a6bf-054f-469f-a788-9fd489f4ee76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cdc75ea-9f')
May 19 04:36:08.851060 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:36:08.861420 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:36:08.878650 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:08.907601 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:36:08.907990 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:36:08.914713 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:36:08.917001 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::e86a:f3ff:fee3:83a1', 'fe80::fc16:3eff:fe8a:28ef', 'fe80::fc16:3eff:fee5:eddc', 'fe80::cc29:a6ff:fef5:800e', 'fe80::fc16:3eff:fe81:2190', 'fe80::fc16:3eff:fe7d:73e6', 'fe80::fc16:3eff:fe63:a669', 'fe80::18b0:b2ff:fedd:8318'] 
May 19 04:36:08.917145 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:36:08.917249 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:36:08.917458 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] <== get_connector_properties: return (65ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:36:08.917754 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Updating existing volume attachment record: dc4fe4f7-7374-489b-a7b7-1e6fd9805609 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:36:09.200486 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Took 1.41 seconds to deallocate network for instance.
May 19 04:36:09.358341 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:36:09.368519 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:36:09.370083 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:36:09.370083 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:36:09.380638 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:36:09.380638 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:09.387450 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:09.395182 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:09.405489 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:09.405489 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:09.405489 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:09.405489 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:09.405489 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:09.405489 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:09.405489 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:09.405853 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsi session list stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:09.405853 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:09.405853 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:09.405853 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:09.405853 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:09.405853 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:09.405853 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:09.412832 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:09.412832 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:09.412832 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:09.412832 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:09.412832 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:09.412832 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:09.412832 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:09.413135 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsi session list stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:09.413135 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:09.413135 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:09.413135 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:09.413135 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:09.413135 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:09.413135 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:09.452969 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695, portal: 192.168.40.100,3260]
May 19 04:36:09.452969 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695, portal: 192.168.40.100,3260] successful.
May 19 04:36:09.452969 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:09.468043 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:36:09.468222 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '34fabdf8-c75f-4180-af5a-8be2ffaca881', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:36:09.468421 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:09.469041 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:09.473693 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695, portal: 192.168.50.100,3260]
May 19 04:36:09.473693 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695, portal: 192.168.50.100,3260] successful.
May 19 04:36:09.473693 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:09.486279 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:09.486279 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:09.486279 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:09.486279 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:09.486279 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:09.486279 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:09.486279 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:09.486279 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:09.486279 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:09.486595 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsi session list stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:09.486595 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:09.486595 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:09.486595 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:09.486595 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:09.486595 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:09.486595 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:09.486595 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:09.486595 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:09.487022 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:09.487022 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:36:09.487913 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] HCTL ('13', '-', '-', 0) found on session 21 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:36:09.488220 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:36:09.492381 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:09.513575 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:09.513575 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:09.513575 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:09.513575 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:09.513575 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:09.513575 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:09.513575 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:09.513575 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:09.513575 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:09.513838 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsi session list stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:09.513838 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:09.513838 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:09.513838 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:09.513838 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:09.513838 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:09.513838 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:09.513838 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:09.513838 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:09.514078 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:09.514187 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:36:09.515328 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Searching for a device in session 21 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:36:09.515500 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df86bd40-0f7a-447e-86d5-0494d1928695', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:36:09.516460 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] HCTL ('14', '-', '-', 0) found on session 22 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:36:09.516613 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:36:09.531448 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Searching for a device in session 22 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:36:09.531583 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'df86bd40-0f7a-447e-86d5-0494d1928695', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:36:09.707080 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:09.707345 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:10.119907 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:36:10.120294 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:36:10.333901 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:36:10.363249 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:36:10.363431 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:36:10.363590 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:36:10.363754 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] No VIF found with MAC fa:16:3e:40:b1:c7, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:36:10.364515 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Using config drive
May 19 04:36:10.384457 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:10.622887 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:36:10.804366 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:10.826889 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:10.911337 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:11.019816 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f8a79049-a080-4b84-b28a-e8e99211f372 req-123c125c-50e1-4af0-90a7-ae6b814c3b40 service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received event network-vif-plugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:11.020130 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f8a79049-a080-4b84-b28a-e8e99211f372 req-123c125c-50e1-4af0-90a7-ae6b814c3b40 service nova] Acquiring lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:11.020318 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f8a79049-a080-4b84-b28a-e8e99211f372 req-123c125c-50e1-4af0-90a7-ae6b814c3b40 service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:11.020372 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f8a79049-a080-4b84-b28a-e8e99211f372 req-123c125c-50e1-4af0-90a7-ae6b814c3b40 service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:11.020519 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f8a79049-a080-4b84-b28a-e8e99211f372 req-123c125c-50e1-4af0-90a7-ae6b814c3b40 service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] No waiting events found dispatching network-vif-plugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:11.020656 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-f8a79049-a080-4b84-b28a-e8e99211f372 req-123c125c-50e1-4af0-90a7-ae6b814c3b40 service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received unexpected event network-vif-plugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 for instance with vm_state active and task_state resize_finish.
May 19 04:36:11.103984 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:11.108938 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:11.131869 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.423s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:11.133818 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:11.136351 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:11.183505 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Deleted allocations for instance 23196294-f311-4315-a76c-1b9509bfa082
May 19 04:36:11.351789 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Found WWN 330000000dba96718 for multipath device dm-5 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:36:11.352221 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:11.352445 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] <== connect_volume: return (5569ms) {'type': 'block', 'scsi_wwn': '330000000dba96718', 'path': '/dev/dm-5', 'multipath_id': '330000000dba96718'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:36:11.352603 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000dba96718', 'path': '/dev/dm-5', 'multipath_id': '330000000dba96718'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:36:11.353519 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.570s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:11.353902 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc', 'iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b382aa5a-cec8-437c-ab56-ec6837f134fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:36:11.354062 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:36:11.382594 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:11.382594 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:11.382594 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:11.382594 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:11.382594 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:11.382594 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:11.382594 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:11.382594 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:11.382594 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:11.382942 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsi session list stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:11.382942 np0000001025 nova-compute[97981]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc (non-flash)
May 19 04:36:11.382942 np0000001025 nova-compute[97981]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:11.382942 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:11.382942 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:11.382942 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:11.382942 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:11.382942 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:11.382942 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:11.383649 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', '22')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:36:11.383649 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc', '16')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:36:11.385260 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc', '15')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:36:11.386252 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218500f7e20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc'): ({'sdb'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:36:11.386561 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Removing multipathed devices sdc, sdb {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:36:11.387224 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Flush multipath device 330000000baf93a5b {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:36:11.415102 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:36:11.462836 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:36:11.511531 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:36:11.511690 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:36:11.513039 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:36:11.524493 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:36:11.525258 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:36:11.536811 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:11.575448 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc, portal: 192.168.40.100,3260]
May 19 04:36:11.575448 np0000001025 nova-compute[97981]: Logout of [sid: 16, target: iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc, portal: 192.168.40.100,3260] successful.
May 19 04:36:11.575448 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:11.592125 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:11.602598 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:11.618552 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Removed pending STOPPED event for 6ea060d2-e149-4189-b93b-66ce319b9157 due to new event <LifecycleEvent: 1779165371.6182203, 6ea060d2-e149-4189-b93b-66ce319b9157 => Resumed> {{(pid=97981) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 19 04:36:11.619264 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Instance event wait completed in 0 seconds for  {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:36:11.619623 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165371.6182203, 6ea060d2-e149-4189-b93b-66ce319b9157 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:11.620200 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] VM Resumed (Lifecycle Event)
May 19 04:36:11.622003 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Instance running successfully.
May 19 04:36:11.623080 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Failed to set time: agent not configured {{(pid=97981) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 19 04:36:11.623080 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dc08a406-7199-40b1-9ebf-ee1e05fa0cbf tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] finish_migration finished successfully. {{(pid=97981) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 19 04:36:11.634138 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc, portal: 192.168.50.100,3260]
May 19 04:36:11.634138 np0000001025 nova-compute[97981]: Logout of [sid: 15, target: iqn.2023-03.storpool.com:os--volume-b382aa5a-cec8-437c-ab56-ec6837f134fc, portal: 192.168.50.100,3260] successful.
May 19 04:36:11.634138 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:11.648456 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:11.648718 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:11.648897 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] <== disconnect_volume: return (2866ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:36:11.649043 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:36:11.650898 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.182s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:11.651122 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '34fabdf8-c75f-4180-af5a-8be2ffaca881', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:36:11.664558 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:11.665289 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:11.665766 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:11.665876 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:36:11.666422 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:11.667298 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:36:11.676834 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:36:11.676834 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:11.681980 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:36:11.681980 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:11.689626 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881] added
May 19 04:36:11.689626 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:36:11.689626 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:11.689626 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:11.689626 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:11.689626 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:11.689626 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:11.689854 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:36:11.689979 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0241(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:36:11.690142 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:36:11.693484 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881] added
May 19 04:36:11.693484 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:36:11.693484 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:11.693484 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:11.693484 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:11.693484 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:11.693484 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:11.693775 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:36:11.693889 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0272(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:36:11.694063 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:36:11.860620 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:36:11.860985 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1fe9afac-3374-4e79-bff5-27405bd5fd0f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:36:11.861167 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:11.924730 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Acquiring lock "7c91d680-72b2-4422-a3c6-fff9714d42cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:11.924969 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:12.122532 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:12.128721 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:36:12.193844 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fb8ed756-a33b-47c7-8549-b2bd63e81ce0 tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Lock "23196294-f311-4315-a76c-1b9509bfa082" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.281s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:12.199402 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lazy-loading 'flavor' on Instance uuid 1081cdc6-540d-4cb8-9e0d-d7584411e539 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:12.235747 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:12.263306 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.001874842000006538 future=<Future at 0x72185017da00 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:12.263412 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:12.263512 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=3.271061712000119 future=<Future at 0x7218501b26c0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:12.263585 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=3.270979342999908 future=<Future at 0x7218501b26c0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:12.427053 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:36:12.630851 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 19 04:36:12.631183 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165372.6309566, 6ea060d2-e149-4189-b93b-66ce319b9157 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:12.631330 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] VM Started (Lifecycle Event)
May 19 04:36:12.690615 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:36:12.694709 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:36:12.703252 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:36:12.703252 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:36:12.708780 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:36:12.708780 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:12.716562 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:12.725333 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:12.730371 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:12.730371 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:12.730371 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:12.730371 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:12.730371 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:12.730371 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:12.730371 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:12.730636 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:12.730636 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:12.730636 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:12.730636 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:12.730636 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:12.730636 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:12.730636 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:12.740232 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:12.740232 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:12.740232 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:12.740232 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:12.740232 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:12.740232 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:12.740232 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:12.740521 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:12.740521 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:12.740521 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:12.740521 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:12.740521 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:12.740521 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:12.740521 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:12.767649 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881, portal: 192.168.50.100,3260]
May 19 04:36:12.767649 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881, portal: 192.168.50.100,3260] successful.
May 19 04:36:12.767649 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:12.781545 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:12.790862 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881, portal: 192.168.40.100,3260]
May 19 04:36:12.790862 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881, portal: 192.168.40.100,3260] successful.
May 19 04:36:12.790862 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:12.797352 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:12.797352 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:12.797352 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:12.797352 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:12.797352 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:12.797352 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:12.797352 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:12.797352 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:12.797352 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:12.797675 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:12.797675 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:12.797675 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:12.797675 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:12.797675 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:12.797675 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:12.797675 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:12.797675 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:12.797675 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:12.797921 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.132s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:12.797921 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:36:12.798807 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] HCTL ('7', '-', '-', 0) found on session 23 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:36:12.798807 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:36:12.804226 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:12.812345 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Searching for a device in session 23 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:36:12.812589 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '34fabdf8-c75f-4180-af5a-8be2ffaca881', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:36:12.823094 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:12.823094 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:12.823094 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:12.823094 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:12.823094 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:12.823094 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:12.823094 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:12.823094 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:12.823094 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:12.823319 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:12.823319 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:12.823319 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:12.823319 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:12.823319 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:12.823319 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:12.823319 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:12.823319 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:12.823319 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:12.823558 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:12.823558 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:36:12.824382 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] HCTL ('8', '-', '-', 0) found on session 24 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:36:12.824490 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:36:12.839915 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Searching for a device in session 24 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:36:12.843975 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '34fabdf8-c75f-4180-af5a-8be2ffaca881', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:36:12.921938 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:12.990171 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:12.990362 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:12.992921 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:36:12.993051 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Claim successful on node np0000001025
May 19 04:36:13.001942 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquiring lock "interface-1081cdc6-540d-4cb8-9e0d-d7584411e539-312ea861-c69c-4976-ba37-408f1e7fe0dd" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:13.002248 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "interface-1081cdc6-540d-4cb8-9e0d-d7584411e539-312ea861-c69c-4976-ba37-408f1e7fe0dd" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:13.101255 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1a793f64-c2c1-4d54-b77e-09d340052f88 req-e9151504-4be5-4ff1-ba1b-0f05cee24beb service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received event network-vif-plugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:13.102507 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1a793f64-c2c1-4d54-b77e-09d340052f88 req-e9151504-4be5-4ff1-ba1b-0f05cee24beb service nova] Acquiring lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:13.102720 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1a793f64-c2c1-4d54-b77e-09d340052f88 req-e9151504-4be5-4ff1-ba1b-0f05cee24beb service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:13.102911 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1a793f64-c2c1-4d54-b77e-09d340052f88 req-e9151504-4be5-4ff1-ba1b-0f05cee24beb service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:13.103061 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1a793f64-c2c1-4d54-b77e-09d340052f88 req-e9151504-4be5-4ff1-ba1b-0f05cee24beb service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] No waiting events found dispatching network-vif-plugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:13.103221 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-1a793f64-c2c1-4d54-b77e-09d340052f88 req-e9151504-4be5-4ff1-ba1b-0f05cee24beb service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received unexpected event network-vif-plugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 for instance with vm_state resized and task_state None.
May 19 04:36:13.134879 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:13.138745 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:36:13.509902 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lazy-loading 'flavor' on Instance uuid 1081cdc6-540d-4cb8-9e0d-d7584411e539 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:13.666031 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:36:13.713607 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e54f1a26-8e49-44b7-ab13-7a9dcf3a6f7d tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.011s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:13.837778 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:13.913459 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:14.015157 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1629521735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1629521735',id=9,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEYnYF79S8BYxQZJ+dMTZjjdbQN3rcn72CWM+baGIlro7OTlpW3xu/PoWXZ+BC9Xw4nxCPqKjMoVyw2hgomsW56DUe6HIHrGodPsGgr/T3ioiXjmvIEBQenW8502hvJuQ==',key_name='tempest-keypair-1597632254',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:35:06Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbef1a3853c14e3daa34b934269bb404',ramdisk_id='',reservation_id='r-xqcyykie',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-268161223',owner_user_name='tempest-TaggedAttachmentsTest-268161223-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:35:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97454d937cea4489b1c5e2b7dbbde8d5',uuid=1081cdc6-540d-4cb8-9e0d-d7584411e539,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "address": "fa:16:3e:63:a6:69", "network": {"id": "dcc776c0-b6b9-42ac-a64c-4ee5021d2646", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2010051909", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap312ea861-c6", "ovs_interfaceid": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:36:14.015351 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Converting VIF {"id": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "address": "fa:16:3e:63:a6:69", "network": {"id": "dcc776c0-b6b9-42ac-a64c-4ee5021d2646", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2010051909", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap312ea861-c6", "ovs_interfaceid": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:14.016042 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=312ea861-c69c-4976-ba37-408f1e7fe0dd,network=Network(dcc776c0-b6b9-42ac-a64c-4ee5021d2646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312ea861-c6') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:14.020893 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:63:a6:69"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap312ea861-c6"/></interface> {{(pid=97981) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 19 04:36:14.022873 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:63:a6:69"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap312ea861-c6"/></interface> {{(pid=97981) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 19 04:36:14.027250 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Attempting to detach device tap312ea861-c6 from instance 1081cdc6-540d-4cb8-9e0d-d7584411e539 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:36:14.027461 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] detach device xml: <interface type="ethernet">
May 19 04:36:14.027461 np0000001025 nova-compute[97981]:   <mac address="fa:16:3e:63:a6:69"/>
May 19 04:36:14.027461 np0000001025 nova-compute[97981]:   <model type="virtio"/>
May 19 04:36:14.027461 np0000001025 nova-compute[97981]:   <driver name="qemu"/>
May 19 04:36:14.027461 np0000001025 nova-compute[97981]:   <mtu size="1372"/>
May 19 04:36:14.027461 np0000001025 nova-compute[97981]:   <target dev="tap312ea861-c6"/>
May 19 04:36:14.027461 np0000001025 nova-compute[97981]: </interface>
May 19 04:36:14.027461 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:36:14.034293 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:63:a6:69"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap312ea861-c6"/></interface> {{(pid=97981) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 19 04:36:14.036026 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:63:a6:69"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap312ea861-c6"/></interface>not found in domain: <domain type='qemu' id='11'>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <name>instance-00000009</name>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <uuid>1081cdc6-540d-4cb8-9e0d-d7584411e539</uuid>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <nova:package version="33.1.0"/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <nova:name>tempest-device-tagging-server-1629521735</nova:name>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <nova:creationTime>2026-05-19 04:35:54</nova:creationTime>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <nova:flavor name="m1.nano" id="42">
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <nova:memory>192</nova:memory>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <nova:disk>1</nova:disk>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <nova:swap>0</nova:swap>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <nova:ephemeral>0</nova:ephemeral>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <nova:vcpus>1</nova:vcpus>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <nova:extraSpecs>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     </nova:extraSpecs>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   </nova:flavor>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <nova:containerFormat>bare</nova:containerFormat>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <nova:minDisk>1</nova:minDisk>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <nova:minRam>0</nova:minRam>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <nova:properties>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     </nova:properties>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   </nova:image>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <nova:owner>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <nova:user uuid="97454d937cea4489b1c5e2b7dbbde8d5">tempest-TaggedAttachmentsTest-268161223-project-member</nova:user>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <nova:project uuid="dbef1a3853c14e3daa34b934269bb404">tempest-TaggedAttachmentsTest-268161223</nova:project>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   </nova:owner>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <nova:ports>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <nova:port uuid="e0f5a2e8-4380-464f-99dd-c33eaa062d63">
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     </nova:port>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <nova:port uuid="312ea861-c69c-4976-ba37-408f1e7fe0dd">
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <nova:ip type="fixed" address="10.10.10.76" ipVersion="4"/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     </nova:port>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   </nova:ports>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]: </nova:instance>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <memory unit='KiB'>196608</memory>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <currentMemory unit='KiB'>196608</currentMemory>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <vcpu placement='static'>1</vcpu>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <resource>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <partition>/machine</partition>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   </resource>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <sysinfo type='smbios'>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <system>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <entry name='product'>OpenStack Nova</entry>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <entry name='version'>33.1.0</entry>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <entry name='serial'>1081cdc6-540d-4cb8-9e0d-d7584411e539</entry>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <entry name='uuid'>1081cdc6-540d-4cb8-9e0d-d7584411e539</entry>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <entry name='family'>Virtual Machine</entry>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     </system>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <os>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <boot dev='hd'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <smbios mode='sysinfo'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   </os>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <features>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <vmcoreinfo state='on'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <tb-cache unit='KiB'>131072</tb-cache>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   </features>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <cpu mode='custom' match='exact' check='full'>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <model fallback='forbid'>Nehalem</model>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <feature policy='require' name='hypervisor'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <clock offset='utc'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <on_poweroff>destroy</on_poweroff>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <on_reboot>restart</on_reboot>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <on_crash>destroy</on_crash>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <devices>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <disk type='file' device='disk'>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <driver name='qemu' type='qcow2' cache='none'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <source file='/opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk' index='2'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <backingStore type='file' index='3'>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:         <format type='raw'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:         <source file='/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:         <backingStore/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       </backingStore>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <target dev='vda' bus='virtio'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <alias name='virtio-disk0'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <disk type='file' device='cdrom'>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <driver name='qemu' type='raw' cache='none'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <source file='/opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk.config' index='1'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <backingStore/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <target dev='hda' bus='ide'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <readonly/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <alias name='ide0-0-0'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <controller type='usb' index='0' model='none'>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <alias name='usb'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     </controller>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <controller type='pci' index='0' model='pci-root'>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <alias name='pci.0'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     </controller>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <controller type='ide' index='0'>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <alias name='ide'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     </controller>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <interface type='ethernet'>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <mac address='fa:16:3e:e5:ed:dc'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <target dev='tape0f5a2e8-43'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <model type='virtio'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <driver name='qemu'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <mtu size='1372'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <alias name='net0'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     </interface>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <interface type='ethernet'>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <mac address='fa:16:3e:63:a6:69'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <target dev='tap312ea861-c6'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <model type='virtio'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <driver name='qemu'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <mtu size='1372'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <alias name='net1'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     </interface>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <serial type='pty'>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <source path='/dev/pts/7'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <log file='/opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/console.log' append='off'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <target type='isa-serial' port='0'>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:         <model name='isa-serial'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       </target>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <alias name='serial0'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     </serial>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <console type='pty' tty='/dev/pts/7'>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <source path='/dev/pts/7'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <log file='/opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/console.log' append='off'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <target type='serial' port='0'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <alias name='serial0'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     </console>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <input type='mouse' bus='ps2'>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <alias name='input0'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     </input>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <input type='keyboard' bus='ps2'>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <alias name='input1'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     </input>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <listen type='address' address='0.0.0.0'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <audio id='1' type='none'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <video>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <model type='virtio' heads='1' primary='yes'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <alias name='video0'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     </video>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <stats period='10'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <alias name='balloon0'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <rng model='virtio'>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <backend model='random'>/dev/urandom</backend>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <alias name='rng0'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     </rng>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   </devices>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <label>libvirt-1081cdc6-540d-4cb8-9e0d-d7584411e539</label>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <imagelabel>libvirt-1081cdc6-540d-4cb8-9e0d-d7584411e539</imagelabel>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   </seclabel>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <label>+64055:+993</label>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:     <imagelabel>+64055:+993</imagelabel>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:   </seclabel>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]: </domain>
May 19 04:36:14.036026 np0000001025 nova-compute[97981]:  {{(pid=97981) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 19 04:36:14.044712 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Successfully detached device tap312ea861-c6 from instance 1081cdc6-540d-4cb8-9e0d-d7584411e539 from the persistent domain config.
May 19 04:36:14.044712 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] (1/8): Attempting to detach device tap312ea861-c6 with device alias net1 from instance 1081cdc6-540d-4cb8-9e0d-d7584411e539 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:36:14.044712 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] detach device xml: <interface type="ethernet">
May 19 04:36:14.044712 np0000001025 nova-compute[97981]:   <mac address="fa:16:3e:63:a6:69"/>
May 19 04:36:14.044712 np0000001025 nova-compute[97981]:   <model type="virtio"/>
May 19 04:36:14.044712 np0000001025 nova-compute[97981]:   <driver name="qemu"/>
May 19 04:36:14.044712 np0000001025 nova-compute[97981]:   <mtu size="1372"/>
May 19 04:36:14.044712 np0000001025 nova-compute[97981]:   <target dev="tap312ea861-c6"/>
May 19 04:36:14.044712 np0000001025 nova-compute[97981]: </interface>
May 19 04:36:14.044712 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:36:14.077633 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:14.077854 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:14.078096 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:14.159412 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:14.176766 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Port 7cdc75ea-9f5f-4944-92ae-1788cf00aea2 binding to destination host np0000001025 is already ACTIVE {{(pid=97981) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}}
May 19 04:36:14.176891 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "refresh_cache-6ea060d2-e149-4189-b93b-66ce319b9157" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:36:14.177090 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquired lock "refresh_cache-6ea060d2-e149-4189-b93b-66ce319b9157" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:36:14.177377 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:36:14.544970 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:36:14.545366 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:36:14.680865 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:14.685533 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Found WWN 330000000d7bcc730 for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:36:14.685914 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:14.686159 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] <== connect_volume: return (5217ms) {'type': 'block', 'scsi_wwn': '330000000d7bcc730', 'path': '/dev/dm-0', 'multipath_id': '330000000d7bcc730'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:36:14.686495 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d7bcc730', 'path': '/dev/dm-0', 'multipath_id': '330000000d7bcc730'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:36:14.686964 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.826s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:14.687261 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1fe9afac-3374-4e79-bff5-27405bd5fd0f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:36:14.691736 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'flavor' on Instance uuid b5f34a29-15f7-4f5e-a8bf-574abebd5c84 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:14.700889 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:14.701783 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:14.706159 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:14.706281 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:36:14.706712 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:14.709343 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:36:14.725121 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:36:14.725121 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:14.727318 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:36:14.727318 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:14.740877 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f] added
May 19 04:36:14.740877 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:36:14.740877 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:14.740877 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:14.740877 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:14.740877 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:14.740877 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:14.741153 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:36:14.741153 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:36:14.741283 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:36:14.743027 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f] added
May 19 04:36:14.743027 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:36:14.743027 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:14.743027 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:14.743027 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:14.743027 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:14.743027 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:14.743245 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:36:14.743347 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0357(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:36:14.743476 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:36:15.050688 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:36:15.058674 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:15.065016 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165375.0641847, 1081cdc6-540d-4cb8-9e0d-d7584411e539 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:36:15.066870 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Start waiting for the detach event from libvirt for device tap312ea861-c6 with device alias net1 for instance 1081cdc6-540d-4cb8-9e0d-d7584411e539 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:36:15.067193 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:63:a6:69"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap312ea861-c6"/></interface> {{(pid=97981) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 19 04:36:15.072625 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:63:a6:69"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap312ea861-c6"/></interface>not found in domain: <domain type='qemu' id='11'>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <name>instance-00000009</name>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <uuid>1081cdc6-540d-4cb8-9e0d-d7584411e539</uuid>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <nova:package version="33.1.0"/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <nova:name>tempest-device-tagging-server-1629521735</nova:name>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <nova:creationTime>2026-05-19 04:35:54</nova:creationTime>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <nova:flavor name="m1.nano" id="42">
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <nova:memory>192</nova:memory>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <nova:disk>1</nova:disk>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <nova:swap>0</nova:swap>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <nova:ephemeral>0</nova:ephemeral>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <nova:vcpus>1</nova:vcpus>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <nova:extraSpecs>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     </nova:extraSpecs>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   </nova:flavor>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <nova:containerFormat>bare</nova:containerFormat>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <nova:minDisk>1</nova:minDisk>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <nova:minRam>0</nova:minRam>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <nova:properties>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     </nova:properties>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   </nova:image>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <nova:owner>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <nova:user uuid="97454d937cea4489b1c5e2b7dbbde8d5">tempest-TaggedAttachmentsTest-268161223-project-member</nova:user>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <nova:project uuid="dbef1a3853c14e3daa34b934269bb404">tempest-TaggedAttachmentsTest-268161223</nova:project>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   </nova:owner>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <nova:ports>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <nova:port uuid="e0f5a2e8-4380-464f-99dd-c33eaa062d63">
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     </nova:port>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <nova:port uuid="312ea861-c69c-4976-ba37-408f1e7fe0dd">
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <nova:ip type="fixed" address="10.10.10.76" ipVersion="4"/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     </nova:port>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   </nova:ports>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]: </nova:instance>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <memory unit='KiB'>196608</memory>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <currentMemory unit='KiB'>196608</currentMemory>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <vcpu placement='static'>1</vcpu>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <resource>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <partition>/machine</partition>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   </resource>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <sysinfo type='smbios'>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <system>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <entry name='product'>OpenStack Nova</entry>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <entry name='version'>33.1.0</entry>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <entry name='serial'>1081cdc6-540d-4cb8-9e0d-d7584411e539</entry>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <entry name='uuid'>1081cdc6-540d-4cb8-9e0d-d7584411e539</entry>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <entry name='family'>Virtual Machine</entry>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     </system>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <os>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <boot dev='hd'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <smbios mode='sysinfo'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   </os>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <features>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <vmcoreinfo state='on'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <tb-cache unit='KiB'>131072</tb-cache>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   </features>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <cpu mode='custom' match='exact' check='full'>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <model fallback='forbid'>Nehalem</model>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <feature policy='require' name='hypervisor'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <clock offset='utc'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <on_poweroff>destroy</on_poweroff>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <on_reboot>restart</on_reboot>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <on_crash>destroy</on_crash>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <devices>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <disk type='file' device='disk'>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <driver name='qemu' type='qcow2' cache='none'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <source file='/opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk' index='2'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <backingStore type='file' index='3'>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:         <format type='raw'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:         <source file='/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:         <backingStore/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       </backingStore>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <target dev='vda' bus='virtio'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <alias name='virtio-disk0'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <disk type='file' device='cdrom'>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <driver name='qemu' type='raw' cache='none'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <source file='/opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk.config' index='1'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <backingStore/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <target dev='hda' bus='ide'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <readonly/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <alias name='ide0-0-0'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <controller type='usb' index='0' model='none'>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <alias name='usb'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     </controller>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <controller type='pci' index='0' model='pci-root'>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <alias name='pci.0'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     </controller>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <controller type='ide' index='0'>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <alias name='ide'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     </controller>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <interface type='ethernet'>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <mac address='fa:16:3e:e5:ed:dc'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <target dev='tape0f5a2e8-43'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <model type='virtio'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <driver name='qemu'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <mtu size='1372'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <alias name='net0'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     </interface>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <serial type='pty'>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <source path='/dev/pts/7'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <log file='/opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/console.log' append='off'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <target type='isa-serial' port='0'>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:         <model name='isa-serial'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       </target>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <alias name='serial0'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     </serial>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <console type='pty' tty='/dev/pts/7'>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <source path='/dev/pts/7'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <log file='/opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/console.log' append='off'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <target type='serial' port='0'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <alias name='serial0'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     </console>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <input type='mouse' bus='ps2'>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <alias name='input0'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     </input>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <input type='keyboard' bus='ps2'>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <alias name='input1'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     </input>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <listen type='address' address='0.0.0.0'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <audio id='1' type='none'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <video>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <model type='virtio' heads='1' primary='yes'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <alias name='video0'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     </video>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <stats period='10'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <alias name='balloon0'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <rng model='virtio'>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <backend model='random'>/dev/urandom</backend>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <alias name='rng0'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     </rng>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   </devices>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <label>libvirt-1081cdc6-540d-4cb8-9e0d-d7584411e539</label>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <imagelabel>libvirt-1081cdc6-540d-4cb8-9e0d-d7584411e539</imagelabel>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   </seclabel>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <label>+64055:+993</label>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:     <imagelabel>+64055:+993</imagelabel>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:   </seclabel>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]: </domain>
May 19 04:36:15.072625 np0000001025 nova-compute[97981]:  {{(pid=97981) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 19 04:36:15.072625 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Successfully detached device tap312ea861-c6 from instance 1081cdc6-540d-4cb8-9e0d-d7584411e539 from the live domain config.
May 19 04:36:15.080396 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1629521735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1629521735',id=9,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEYnYF79S8BYxQZJ+dMTZjjdbQN3rcn72CWM+baGIlro7OTlpW3xu/PoWXZ+BC9Xw4nxCPqKjMoVyw2hgomsW56DUe6HIHrGodPsGgr/T3ioiXjmvIEBQenW8502hvJuQ==',key_name='tempest-keypair-1597632254',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:35:06Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbef1a3853c14e3daa34b934269bb404',ramdisk_id='',reservation_id='r-xqcyykie',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-268161223',owner_user_name='tempest-TaggedAttachmentsTest-268161223-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:35:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97454d937cea4489b1c5e2b7dbbde8d5',uuid=1081cdc6-540d-4cb8-9e0d-d7584411e539,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "address": "fa:16:3e:63:a6:69", "network": {"id": "dcc776c0-b6b9-42ac-a64c-4ee5021d2646", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2010051909", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap312ea861-c6", "ovs_interfaceid": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:36:15.080396 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Converting VIF {"id": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "address": "fa:16:3e:63:a6:69", "network": {"id": "dcc776c0-b6b9-42ac-a64c-4ee5021d2646", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2010051909", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap312ea861-c6", "ovs_interfaceid": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:15.080396 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=312ea861-c69c-4976-ba37-408f1e7fe0dd,network=Network(dcc776c0-b6b9-42ac-a64c-4ee5021d2646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312ea861-c6') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:15.080396 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=312ea861-c69c-4976-ba37-408f1e7fe0dd,network=Network(dcc776c0-b6b9-42ac-a64c-4ee5021d2646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312ea861-c6') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:36:15.080396 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:15.080396 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap312ea861-c6, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:15.082409 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:15.088617 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:15.089954 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:15.090159 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb0884a3-a1b6-4ca2-929c-02fb4a055d48) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:15.092169 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:15.109636 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:15.115301 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:15.121501 np0000001025 nova-compute[97981]: INFO os_vif [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=312ea861-c69c-4976-ba37-408f1e7fe0dd,network=Network(dcc776c0-b6b9-42ac-a64c-4ee5021d2646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312ea861-c6')
May 19 04:36:15.124380 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1629521735', uuid='1081cdc6-540d-4cb8-9e0d-d7584411e539'), owner=OwnerMeta(userid='97454d937cea4489b1c5e2b7dbbde8d5', username='tempest-TaggedAttachmentsTest-268161223-project-member', projectid='dbef1a3853c14e3daa34b934269bb404', projectname='tempest-TaggedAttachmentsTest-268161223'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "address": "fa:16:3e:e5:ed:dc", "network": {"id": "637c588b-9807-4474-9ce4-42f9d9631794", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-90879599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f5a2e8-43", "ovs_interfaceid": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165375.1237981) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:36:15.130766 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:   <nova:package version="33.1.0"/>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:   <nova:name>tempest-device-tagging-server-1629521735</nova:name>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:   <nova:creationTime>2026-05-19 04:36:15</nova:creationTime>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:   <nova:flavor name="m1.nano" id="42">
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:     <nova:memory>192</nova:memory>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:     <nova:disk>1</nova:disk>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:     <nova:swap>0</nova:swap>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:     <nova:ephemeral>0</nova:ephemeral>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:     <nova:vcpus>1</nova:vcpus>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:     <nova:extraSpecs>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:     </nova:extraSpecs>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:   </nova:flavor>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:   <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:     <nova:containerFormat>bare</nova:containerFormat>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:     <nova:minDisk>1</nova:minDisk>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:     <nova:minRam>0</nova:minRam>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:     <nova:properties>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:       <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:       <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:     </nova:properties>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:   </nova:image>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:   <nova:owner>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:     <nova:user uuid="97454d937cea4489b1c5e2b7dbbde8d5">tempest-TaggedAttachmentsTest-268161223-project-member</nova:user>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:     <nova:project uuid="dbef1a3853c14e3daa34b934269bb404">tempest-TaggedAttachmentsTest-268161223</nova:project>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:   </nova:owner>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:   <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:   <nova:ports>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:     <nova:port uuid="e0f5a2e8-4380-464f-99dd-c33eaa062d63">
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:       <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:     </nova:port>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:   </nova:ports>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]: </nova:instance>
May 19 04:36:15.130766 np0000001025 nova-compute[97981]:  {{(pid=97981) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 19 04:36:15.133397 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:15.133754 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:15.197145 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Attempting to attach volume 34fabdf8-c75f-4180-af5a-8be2ffaca881 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:36:15.198942 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:36:15.198942 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:36:15.198942 np0000001025 nova-compute[97981]:   <alias name="ua-34fabdf8-c75f-4180-af5a-8be2ffaca881"/>
May 19 04:36:15.198942 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:36:15.198942 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:36:15.198942 np0000001025 nova-compute[97981]:   <serial>34fabdf8-c75f-4180-af5a-8be2ffaca881</serial>
May 19 04:36:15.198942 np0000001025 nova-compute[97981]: </disk>
May 19 04:36:15.198942 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:36:15.278233 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Updating instance_info_cache with network_info: [{"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:15.441776 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-85f12152-29dd-474e-a592-08a8d741ce52 req-e0a0099c-b84f-4278-8714-712b9438e942 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Received event network-vif-unplugged-312ea861-c69c-4976-ba37-408f1e7fe0dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:15.441776 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-85f12152-29dd-474e-a592-08a8d741ce52 req-e0a0099c-b84f-4278-8714-712b9438e942 service nova] Acquiring lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:15.441776 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-85f12152-29dd-474e-a592-08a8d741ce52 req-e0a0099c-b84f-4278-8714-712b9438e942 service nova] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:15.442350 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-85f12152-29dd-474e-a592-08a8d741ce52 req-e0a0099c-b84f-4278-8714-712b9438e942 service nova] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:15.442350 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-85f12152-29dd-474e-a592-08a8d741ce52 req-e0a0099c-b84f-4278-8714-712b9438e942 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] No waiting events found dispatching network-vif-unplugged-312ea861-c69c-4976-ba37-408f1e7fe0dd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:15.442350 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-85f12152-29dd-474e-a592-08a8d741ce52 req-e0a0099c-b84f-4278-8714-712b9438e942 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Received unexpected event network-vif-unplugged-312ea861-c69c-4976-ba37-408f1e7fe0dd for instance with vm_state active and task_state None.
May 19 04:36:15.536632 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0008804910000890231 future=<Future at 0x7218501b26c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:15.536632 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Emitting event <LifecycleEvent: 1779165360.534504, e662af2e-fcc4-4739-993c-c5e7f4ddfe9c => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:15.536632 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:15.536632 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] VM Stopped (Lifecycle Event)
May 19 04:36:15.537227 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=0.02764484099998299 future=<Future at 0x721850309eb0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:15.537318 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=0.027521048999915365 future=<Future at 0x721850309eb0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:15.565771 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.575s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:15.567543 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:36:15.572583 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0076556179999442975 future=<Future at 0x721850309eb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:15.572691 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:15.572815 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=6.177958097999863 future=<Future at 0x72185017c6b0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:15.573881 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Emitting event <LifecycleEvent: 1779165360.5647702, f71811d1-b0ad-48f9-ba04-9a6e517961b9 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:15.574192 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=6.176610121000067 future=<Future at 0x72185017c6b0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:15.574360 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] VM Stopped (Lifecycle Event)
May 19 04:36:15.695453 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9611e86c-b0f6-4f87-9be7-69256a9ee141 req-85cf1e78-fd2e-4846-af6f-a1f53d0d9899 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Received event network-vif-deleted-312ea861-c69c-4976-ba37-408f1e7fe0dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:15.695453 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-9611e86c-b0f6-4f87-9be7-69256a9ee141 req-85cf1e78-fd2e-4846-af6f-a1f53d0d9899 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Neutron deleted interface 312ea861-c69c-4976-ba37-408f1e7fe0dd; detaching it from the instance and deleting it from the info cache
May 19 04:36:15.695453 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-9611e86c-b0f6-4f87-9be7-69256a9ee141 req-85cf1e78-fd2e-4846-af6f-a1f53d0d9899 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Updating instance_info_cache with network_info: [{"id": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "address": "fa:16:3e:e5:ed:dc", "network": {"id": "637c588b-9807-4474-9ce4-42f9d9631794", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-90879599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f5a2e8-43", "ovs_interfaceid": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:15.742160 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:36:15.743863 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:36:15.756355 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:36:15.756355 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:36:15.765809 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:36:15.765809 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:15.779445 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:15.781411 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:15.783538 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Releasing lock "refresh_cache-6ea060d2-e149-4189-b93b-66ce319b9157" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:36:15.799842 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:15.799842 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:15.799842 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:15.799842 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:15.799842 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:15.799842 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:15.799842 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:15.799842 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:15.799842 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:15.800203 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:15.800203 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:15.800203 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:15.800203 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:15.800203 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:15.800203 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:15.800203 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:15.800203 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:15.800203 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:15.811136 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:15.811136 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:15.811136 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:15.811136 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:15.811136 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:15.811136 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:15.811136 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:15.811136 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:15.811136 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:15.811533 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:15.811533 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:15.811533 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:15.811533 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:15.811533 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:15.811533 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:15.811533 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:15.811533 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:15.811533 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:15.866196 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f, portal: 192.168.40.100,3260]
May 19 04:36:15.866196 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f, portal: 192.168.40.100,3260] successful.
May 19 04:36:15.866196 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:15.874493 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f, portal: 192.168.50.100,3260]
May 19 04:36:15.874493 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f, portal: 192.168.50.100,3260] successful.
May 19 04:36:15.874493 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:15.886149 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:15.891051 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:15.915840 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.210s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:15.915840 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:36:15.919214 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] HCTL ('15', '-', '-', 0) found on session 25 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:36:15.919214 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:36:15.920017 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] HCTL ('16', '-', '-', 0) found on session 26 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:36:15.920206 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:36:15.948865 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Searching for a device in session 26 and hctl ['16', '*', '*', 0] yield: sdj {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:36:15.948865 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1fe9afac-3374-4e79-bff5-27405bd5fd0f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:36:15.948865 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Searching for a device in session 25 and hctl ['15', '*', '*', 0] yield: sdk {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:36:15.948865 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1fe9afac-3374-4e79-bff5-27405bd5fd0f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:36:16.040989 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cc83a621-c8a1-4751-83e1-cf3aa5fdd812 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: e662af2e-fcc4-4739-993c-c5e7f4ddfe9c] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:16.075750 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:36:16.076061 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:36:16.076449 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:16.077206 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:16.079380 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: f71811d1-b0ad-48f9-ba04-9a6e517961b9] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:16.165613 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bc4987fe170442c9ec50fd9652056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a9429eac2d4f0da28551f059b1deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:36:16.196897 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [req-9611e86c-b0f6-4f87-9be7-69256a9ee141 req-85cf1e78-fd2e-4846-af6f-a1f53d0d9899 service nova] Lazy-loading 'system_metadata' on Instance uuid 1081cdc6-540d-4cb8-9e0d-d7584411e539 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:16.292888 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Creating tmpfile /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/tmpckw7eti8 to verify with other compute node that the instance is on the same shared storage. {{(pid=97981) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10552}}
May 19 04:36:16.293307 np0000001025 nova-compute[97981]: DEBUG nova.compute.rpcapi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97981) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 19 04:36:16.577185 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:36:16.700795 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [req-9611e86c-b0f6-4f87-9be7-69256a9ee141 req-85cf1e78-fd2e-4846-af6f-a1f53d0d9899 service nova] Lazy-loading 'flavor' on Instance uuid 1081cdc6-540d-4cb8-9e0d-d7584411e539 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:16.706397 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:36:16.751150 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Successfully created port: cb90c186-f98f-4d99-8292-e9600576dee1 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:36:16.815701 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:16.820874 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:16.839501 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:16.842641 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:16.864151 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:16.896400 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:36:16.896609 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:36:16.896673 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:36:16.896873 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No VIF found with MAC fa:16:3e:7d:73:e6, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:36:17.082962 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:36:17.112633 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:17.123731 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:17.145357 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquiring lock "refresh_cache-1081cdc6-540d-4cb8-9e0d-d7584411e539" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:36:17.145541 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquired lock "refresh_cache-1081cdc6-540d-4cb8-9e0d-d7584411e539" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:36:17.145693 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:36:17.148674 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999656651999885 future=<Future at 0x721850713590 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:17.155840 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Instance destroyed successfully.
May 19 04:36:17.156306 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lazy-loading 'resources' on Instance uuid 6ea060d2-e149-4189-b93b-66ce319b9157 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:17.203313 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [req-9611e86c-b0f6-4f87-9be7-69256a9ee141 req-85cf1e78-fd2e-4846-af6f-a1f53d0d9899 service nova] Object Instance<1081cdc6-540d-4cb8-9e0d-d7584411e539> lazy-loaded attributes: system_metadata,flavor {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:36:17.204487 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [req-9611e86c-b0f6-4f87-9be7-69256a9ee141 req-85cf1e78-fd2e-4846-af6f-a1f53d0d9899 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1629521735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1629521735',id=9,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEYnYF79S8BYxQZJ+dMTZjjdbQN3rcn72CWM+baGIlro7OTlpW3xu/PoWXZ+BC9Xw4nxCPqKjMoVyw2hgomsW56DUe6HIHrGodPsGgr/T3ioiXjmvIEBQenW8502hvJuQ==',key_name='tempest-keypair-1597632254',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:35:06Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000001025',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbef1a3853c14e3daa34b934269bb404',ramdisk_id='',reservation_id='r-xqcyykie',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-268161223',owner_user_name='tempest-TaggedAttachmentsTest-268161223-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:35:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97454d937cea4489b1c5e2b7dbbde8d5',uuid=1081cdc6-540d-4cb8-9e0d-d7584411e539,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "address": "fa:16:3e:63:a6:69", "network": {"id": "dcc776c0-b6b9-42ac-a64c-4ee5021d2646", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2010051909", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap312ea861-c6", "ovs_interfaceid": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:36:17.204734 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [req-9611e86c-b0f6-4f87-9be7-69256a9ee141 req-85cf1e78-fd2e-4846-af6f-a1f53d0d9899 service nova] Converting VIF {"id": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "address": "fa:16:3e:63:a6:69", "network": {"id": "dcc776c0-b6b9-42ac-a64c-4ee5021d2646", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2010051909", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap312ea861-c6", "ovs_interfaceid": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:17.205495 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [req-9611e86c-b0f6-4f87-9be7-69256a9ee141 req-85cf1e78-fd2e-4846-af6f-a1f53d0d9899 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=312ea861-c69c-4976-ba37-408f1e7fe0dd,network=Network(dcc776c0-b6b9-42ac-a64c-4ee5021d2646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312ea861-c6') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:17.207301 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [req-9611e86c-b0f6-4f87-9be7-69256a9ee141 req-85cf1e78-fd2e-4846-af6f-a1f53d0d9899 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:63:a6:69"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap312ea861-c6"/></interface> {{(pid=97981) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 19 04:36:17.209698 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [req-9611e86c-b0f6-4f87-9be7-69256a9ee141 req-85cf1e78-fd2e-4846-af6f-a1f53d0d9899 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:63:a6:69"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap312ea861-c6"/></interface>not found in domain: <domain type='qemu' id='11'>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <name>instance-00000009</name>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <uuid>1081cdc6-540d-4cb8-9e0d-d7584411e539</uuid>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <nova:package version="33.1.0"/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <nova:name>tempest-device-tagging-server-1629521735</nova:name>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <nova:creationTime>2026-05-19 04:36:15</nova:creationTime>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <nova:flavor name="m1.nano" id="42">
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <nova:memory>192</nova:memory>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <nova:disk>1</nova:disk>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <nova:swap>0</nova:swap>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <nova:ephemeral>0</nova:ephemeral>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <nova:vcpus>1</nova:vcpus>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <nova:extraSpecs>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     </nova:extraSpecs>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   </nova:flavor>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <nova:containerFormat>bare</nova:containerFormat>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <nova:minDisk>1</nova:minDisk>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <nova:minRam>0</nova:minRam>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <nova:properties>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     </nova:properties>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   </nova:image>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <nova:owner>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <nova:user uuid="97454d937cea4489b1c5e2b7dbbde8d5">tempest-TaggedAttachmentsTest-268161223-project-member</nova:user>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <nova:project uuid="dbef1a3853c14e3daa34b934269bb404">tempest-TaggedAttachmentsTest-268161223</nova:project>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   </nova:owner>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <nova:ports>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <nova:port uuid="e0f5a2e8-4380-464f-99dd-c33eaa062d63">
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     </nova:port>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   </nova:ports>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]: </nova:instance>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <memory unit='KiB'>196608</memory>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <currentMemory unit='KiB'>196608</currentMemory>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <vcpu placement='static'>1</vcpu>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <resource>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <partition>/machine</partition>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   </resource>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <sysinfo type='smbios'>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <system>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <entry name='product'>OpenStack Nova</entry>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <entry name='version'>33.1.0</entry>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <entry name='serial'>1081cdc6-540d-4cb8-9e0d-d7584411e539</entry>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <entry name='uuid'>1081cdc6-540d-4cb8-9e0d-d7584411e539</entry>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <entry name='family'>Virtual Machine</entry>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     </system>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <os>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <boot dev='hd'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <smbios mode='sysinfo'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   </os>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <features>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <vmcoreinfo state='on'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <tb-cache unit='KiB'>131072</tb-cache>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   </features>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <cpu mode='custom' match='exact' check='full'>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <model fallback='forbid'>Nehalem</model>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <feature policy='require' name='hypervisor'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <clock offset='utc'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <on_poweroff>destroy</on_poweroff>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <on_reboot>restart</on_reboot>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <on_crash>destroy</on_crash>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <devices>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <disk type='file' device='disk'>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <driver name='qemu' type='qcow2' cache='none'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <source file='/opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk' index='2'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <backingStore type='file' index='3'>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:         <format type='raw'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:         <source file='/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:         <backingStore/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       </backingStore>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <target dev='vda' bus='virtio'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <alias name='virtio-disk0'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <disk type='file' device='cdrom'>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <driver name='qemu' type='raw' cache='none'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <source file='/opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk.config' index='1'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <backingStore/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <target dev='hda' bus='ide'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <readonly/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <alias name='ide0-0-0'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <controller type='usb' index='0' model='none'>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <alias name='usb'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     </controller>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <controller type='pci' index='0' model='pci-root'>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <alias name='pci.0'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     </controller>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <controller type='ide' index='0'>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <alias name='ide'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     </controller>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <interface type='ethernet'>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <mac address='fa:16:3e:e5:ed:dc'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <target dev='tape0f5a2e8-43'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <model type='virtio'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <driver name='qemu'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <mtu size='1372'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <alias name='net0'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     </interface>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <serial type='pty'>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <source path='/dev/pts/7'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <log file='/opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/console.log' append='off'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <target type='isa-serial' port='0'>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:         <model name='isa-serial'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       </target>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <alias name='serial0'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     </serial>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <console type='pty' tty='/dev/pts/7'>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <source path='/dev/pts/7'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <log file='/opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/console.log' append='off'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <target type='serial' port='0'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <alias name='serial0'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     </console>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <input type='mouse' bus='ps2'>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <alias name='input0'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     </input>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <input type='keyboard' bus='ps2'>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <alias name='input1'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     </input>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <listen type='address' address='0.0.0.0'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <audio id='1' type='none'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <video>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <model type='virtio' heads='1' primary='yes'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <alias name='video0'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     </video>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <stats period='10'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <alias name='balloon0'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <rng model='virtio'>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <backend model='random'>/dev/urandom</backend>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <alias name='rng0'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     </rng>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   </devices>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <label>libvirt-1081cdc6-540d-4cb8-9e0d-d7584411e539</label>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <imagelabel>libvirt-1081cdc6-540d-4cb8-9e0d-d7584411e539</imagelabel>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   </seclabel>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <label>+64055:+993</label>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:     <imagelabel>+64055:+993</imagelabel>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:   </seclabel>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]: </domain>
May 19 04:36:17.209698 np0000001025 nova-compute[97981]:  {{(pid=97981) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 19 04:36:17.213777 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [req-9611e86c-b0f6-4f87-9be7-69256a9ee141 req-85cf1e78-fd2e-4846-af6f-a1f53d0d9899 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:63:a6:69"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap312ea861-c6"/></interface> {{(pid=97981) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 19 04:36:17.213777 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [req-9611e86c-b0f6-4f87-9be7-69256a9ee141 req-85cf1e78-fd2e-4846-af6f-a1f53d0d9899 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:63:a6:69"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap312ea861-c6"/></interface>not found in domain: <domain type='qemu' id='11'>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <name>instance-00000009</name>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <uuid>1081cdc6-540d-4cb8-9e0d-d7584411e539</uuid>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <nova:package version="33.1.0"/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <nova:name>tempest-device-tagging-server-1629521735</nova:name>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <nova:creationTime>2026-05-19 04:36:15</nova:creationTime>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <nova:flavor name="m1.nano" id="42">
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <nova:memory>192</nova:memory>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <nova:disk>1</nova:disk>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <nova:swap>0</nova:swap>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <nova:ephemeral>0</nova:ephemeral>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <nova:vcpus>1</nova:vcpus>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <nova:extraSpecs>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     </nova:extraSpecs>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   </nova:flavor>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <nova:containerFormat>bare</nova:containerFormat>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <nova:minDisk>1</nova:minDisk>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <nova:minRam>0</nova:minRam>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <nova:properties>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     </nova:properties>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   </nova:image>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <nova:owner>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <nova:user uuid="97454d937cea4489b1c5e2b7dbbde8d5">tempest-TaggedAttachmentsTest-268161223-project-member</nova:user>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <nova:project uuid="dbef1a3853c14e3daa34b934269bb404">tempest-TaggedAttachmentsTest-268161223</nova:project>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   </nova:owner>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <nova:ports>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <nova:port uuid="e0f5a2e8-4380-464f-99dd-c33eaa062d63">
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     </nova:port>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   </nova:ports>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]: </nova:instance>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <memory unit='KiB'>196608</memory>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <currentMemory unit='KiB'>196608</currentMemory>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <vcpu placement='static'>1</vcpu>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <resource>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <partition>/machine</partition>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   </resource>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <sysinfo type='smbios'>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <system>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <entry name='product'>OpenStack Nova</entry>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <entry name='version'>33.1.0</entry>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <entry name='serial'>1081cdc6-540d-4cb8-9e0d-d7584411e539</entry>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <entry name='uuid'>1081cdc6-540d-4cb8-9e0d-d7584411e539</entry>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <entry name='family'>Virtual Machine</entry>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     </system>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <os>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <boot dev='hd'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <smbios mode='sysinfo'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   </os>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <features>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <vmcoreinfo state='on'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <tb-cache unit='KiB'>131072</tb-cache>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   </features>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <cpu mode='custom' match='exact' check='full'>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <model fallback='forbid'>Nehalem</model>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <feature policy='require' name='hypervisor'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <clock offset='utc'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <on_poweroff>destroy</on_poweroff>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <on_reboot>restart</on_reboot>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <on_crash>destroy</on_crash>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <devices>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <disk type='file' device='disk'>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <driver name='qemu' type='qcow2' cache='none'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <source file='/opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk' index='2'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <backingStore type='file' index='3'>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:         <format type='raw'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:         <source file='/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:         <backingStore/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       </backingStore>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <target dev='vda' bus='virtio'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <alias name='virtio-disk0'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <disk type='file' device='cdrom'>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <driver name='qemu' type='raw' cache='none'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <source file='/opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/disk.config' index='1'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <backingStore/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <target dev='hda' bus='ide'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <readonly/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <alias name='ide0-0-0'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <controller type='usb' index='0' model='none'>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <alias name='usb'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     </controller>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <controller type='pci' index='0' model='pci-root'>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <alias name='pci.0'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     </controller>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <controller type='ide' index='0'>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <alias name='ide'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     </controller>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <interface type='ethernet'>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <mac address='fa:16:3e:e5:ed:dc'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <target dev='tape0f5a2e8-43'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <model type='virtio'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <driver name='qemu'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <mtu size='1372'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <alias name='net0'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     </interface>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <serial type='pty'>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <source path='/dev/pts/7'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <log file='/opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/console.log' append='off'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <target type='isa-serial' port='0'>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:         <model name='isa-serial'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       </target>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <alias name='serial0'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     </serial>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <console type='pty' tty='/dev/pts/7'>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <source path='/dev/pts/7'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <log file='/opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539/console.log' append='off'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <target type='serial' port='0'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <alias name='serial0'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     </console>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <input type='mouse' bus='ps2'>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <alias name='input0'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     </input>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <input type='keyboard' bus='ps2'>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <alias name='input1'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     </input>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <listen type='address' address='0.0.0.0'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     </graphics>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <audio id='1' type='none'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <video>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <model type='virtio' heads='1' primary='yes'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <alias name='video0'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     </video>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <stats period='10'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <alias name='balloon0'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <rng model='virtio'>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <backend model='random'>/dev/urandom</backend>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <alias name='rng0'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     </rng>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   </devices>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <label>libvirt-1081cdc6-540d-4cb8-9e0d-d7584411e539</label>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <imagelabel>libvirt-1081cdc6-540d-4cb8-9e0d-d7584411e539</imagelabel>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   </seclabel>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <label>+64055:+993</label>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:     <imagelabel>+64055:+993</imagelabel>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:   </seclabel>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]: </domain>
May 19 04:36:17.213777 np0000001025 nova-compute[97981]:  {{(pid=97981) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 19 04:36:17.213777 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [req-9611e86c-b0f6-4f87-9be7-69256a9ee141 req-85cf1e78-fd2e-4846-af6f-a1f53d0d9899 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Detaching interface fa:16:3e:63:a6:69 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap312ea861-c6' not found.
May 19 04:36:17.213777 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [req-9611e86c-b0f6-4f87-9be7-69256a9ee141 req-85cf1e78-fd2e-4846-af6f-a1f53d0d9899 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1629521735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1629521735',id=9,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEYnYF79S8BYxQZJ+dMTZjjdbQN3rcn72CWM+baGIlro7OTlpW3xu/PoWXZ+BC9Xw4nxCPqKjMoVyw2hgomsW56DUe6HIHrGodPsGgr/T3ioiXjmvIEBQenW8502hvJuQ==',key_name='tempest-keypair-1597632254',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:35:06Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000001025',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbef1a3853c14e3daa34b934269bb404',ramdisk_id='',reservation_id='r-xqcyykie',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-268161223',owner_user_name='tempest-TaggedAttachmentsTest-268161223-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:35:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97454d937cea4489b1c5e2b7dbbde8d5',uuid=1081cdc6-540d-4cb8-9e0d-d7584411e539,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "address": "fa:16:3e:63:a6:69", "network": {"id": "dcc776c0-b6b9-42ac-a64c-4ee5021d2646", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2010051909", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap312ea861-c6", "ovs_interfaceid": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:36:17.218322 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [req-9611e86c-b0f6-4f87-9be7-69256a9ee141 req-85cf1e78-fd2e-4846-af6f-a1f53d0d9899 service nova] Converting VIF {"id": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "address": "fa:16:3e:63:a6:69", "network": {"id": "dcc776c0-b6b9-42ac-a64c-4ee5021d2646", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2010051909", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap312ea861-c6", "ovs_interfaceid": "312ea861-c69c-4976-ba37-408f1e7fe0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:17.218322 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [req-9611e86c-b0f6-4f87-9be7-69256a9ee141 req-85cf1e78-fd2e-4846-af6f-a1f53d0d9899 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=312ea861-c69c-4976-ba37-408f1e7fe0dd,network=Network(dcc776c0-b6b9-42ac-a64c-4ee5021d2646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312ea861-c6') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:17.218322 np0000001025 nova-compute[97981]: DEBUG os_vif [req-9611e86c-b0f6-4f87-9be7-69256a9ee141 req-85cf1e78-fd2e-4846-af6f-a1f53d0d9899 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=312ea861-c69c-4976-ba37-408f1e7fe0dd,network=Network(dcc776c0-b6b9-42ac-a64c-4ee5021d2646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312ea861-c6') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:36:17.218322 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:17.218322 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap312ea861-c6, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:17.218322 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:36:17.218322 np0000001025 nova-compute[97981]: INFO os_vif [req-9611e86c-b0f6-4f87-9be7-69256a9ee141 req-85cf1e78-fd2e-4846-af6f-a1f53d0d9899 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=312ea861-c69c-4976-ba37-408f1e7fe0dd,network=Network(dcc776c0-b6b9-42ac-a64c-4ee5021d2646),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312ea861-c6')
May 19 04:36:17.218634 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [req-9611e86c-b0f6-4f87-9be7-69256a9ee141 req-85cf1e78-fd2e-4846-af6f-a1f53d0d9899 service nova] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1629521735', uuid='1081cdc6-540d-4cb8-9e0d-d7584411e539'), owner=OwnerMeta(userid='97454d937cea4489b1c5e2b7dbbde8d5', username='tempest-TaggedAttachmentsTest-268161223-project-member', projectid='dbef1a3853c14e3daa34b934269bb404', projectname='tempest-TaggedAttachmentsTest-268161223'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "address": "fa:16:3e:e5:ed:dc", "network": {"id": "637c588b-9807-4474-9ce4-42f9d9631794", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-90879599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f5a2e8-43", "ovs_interfaceid": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165377.2180836) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:36:17.218997 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [req-9611e86c-b0f6-4f87-9be7-69256a9ee141 req-85cf1e78-fd2e-4846-af6f-a1f53d0d9899 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:   <nova:package version="33.1.0"/>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:   <nova:name>tempest-device-tagging-server-1629521735</nova:name>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:   <nova:creationTime>2026-05-19 04:36:17</nova:creationTime>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:   <nova:flavor name="m1.nano" id="42">
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:     <nova:memory>192</nova:memory>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:     <nova:disk>1</nova:disk>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:     <nova:swap>0</nova:swap>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:     <nova:ephemeral>0</nova:ephemeral>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:     <nova:vcpus>1</nova:vcpus>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:     <nova:extraSpecs>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:     </nova:extraSpecs>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:   </nova:flavor>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:   <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:     <nova:containerFormat>bare</nova:containerFormat>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:     <nova:minDisk>1</nova:minDisk>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:     <nova:minRam>0</nova:minRam>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:     <nova:properties>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:       <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:       <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:     </nova:properties>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:   </nova:image>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:   <nova:owner>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:     <nova:user uuid="97454d937cea4489b1c5e2b7dbbde8d5">tempest-TaggedAttachmentsTest-268161223-project-member</nova:user>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:     <nova:project uuid="dbef1a3853c14e3daa34b934269bb404">tempest-TaggedAttachmentsTest-268161223</nova:project>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:   </nova:owner>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:   <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:   <nova:ports>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:     <nova:port uuid="e0f5a2e8-4380-464f-99dd-c33eaa062d63">
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:       <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:     </nova:port>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:   </nova:ports>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]: </nova:instance>
May 19 04:36:17.218997 np0000001025 nova-compute[97981]:  {{(pid=97981) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 19 04:36:17.559742 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b6f75841-fbef-4498-96fa-a9c850d4af63 req-039ac2fc-aa63-4015-866b-5fa5f07ba213 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Received event network-vif-unplugged-312ea861-c69c-4976-ba37-408f1e7fe0dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:17.559937 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b6f75841-fbef-4498-96fa-a9c850d4af63 req-039ac2fc-aa63-4015-866b-5fa5f07ba213 service nova] Acquiring lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:17.560132 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b6f75841-fbef-4498-96fa-a9c850d4af63 req-039ac2fc-aa63-4015-866b-5fa5f07ba213 service nova] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:17.560297 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b6f75841-fbef-4498-96fa-a9c850d4af63 req-039ac2fc-aa63-4015-866b-5fa5f07ba213 service nova] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:17.560522 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b6f75841-fbef-4498-96fa-a9c850d4af63 req-039ac2fc-aa63-4015-866b-5fa5f07ba213 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] No waiting events found dispatching network-vif-unplugged-312ea861-c69c-4976-ba37-408f1e7fe0dd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:17.560629 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-b6f75841-fbef-4498-96fa-a9c850d4af63 req-039ac2fc-aa63-4015-866b-5fa5f07ba213 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Received unexpected event network-vif-unplugged-312ea861-c69c-4976-ba37-408f1e7fe0dd for instance with vm_state active and task_state None.
May 19 04:36:17.560851 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b6f75841-fbef-4498-96fa-a9c850d4af63 req-039ac2fc-aa63-4015-866b-5fa5f07ba213 service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received event network-vif-unplugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:17.561281 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b6f75841-fbef-4498-96fa-a9c850d4af63 req-039ac2fc-aa63-4015-866b-5fa5f07ba213 service nova] Acquiring lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:17.561971 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b6f75841-fbef-4498-96fa-a9c850d4af63 req-039ac2fc-aa63-4015-866b-5fa5f07ba213 service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:17.562152 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b6f75841-fbef-4498-96fa-a9c850d4af63 req-039ac2fc-aa63-4015-866b-5fa5f07ba213 service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:17.562292 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b6f75841-fbef-4498-96fa-a9c850d4af63 req-039ac2fc-aa63-4015-866b-5fa5f07ba213 service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] No waiting events found dispatching network-vif-unplugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:17.562463 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-b6f75841-fbef-4498-96fa-a9c850d4af63 req-039ac2fc-aa63-4015-866b-5fa5f07ba213 service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received unexpected event network-vif-unplugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 for instance with vm_state resized and task_state resize_reverting.
May 19 04:36:17.562595 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b6f75841-fbef-4498-96fa-a9c850d4af63 req-039ac2fc-aa63-4015-866b-5fa5f07ba213 service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received event network-vif-unplugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:17.562721 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b6f75841-fbef-4498-96fa-a9c850d4af63 req-039ac2fc-aa63-4015-866b-5fa5f07ba213 service nova] Acquiring lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:17.562853 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b6f75841-fbef-4498-96fa-a9c850d4af63 req-039ac2fc-aa63-4015-866b-5fa5f07ba213 service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:17.563000 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b6f75841-fbef-4498-96fa-a9c850d4af63 req-039ac2fc-aa63-4015-866b-5fa5f07ba213 service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:17.563000 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b6f75841-fbef-4498-96fa-a9c850d4af63 req-039ac2fc-aa63-4015-866b-5fa5f07ba213 service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] No waiting events found dispatching network-vif-unplugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:17.563086 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-b6f75841-fbef-4498-96fa-a9c850d4af63 req-039ac2fc-aa63-4015-866b-5fa5f07ba213 service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received unexpected event network-vif-unplugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 for instance with vm_state resized and task_state resize_reverting.
May 19 04:36:17.565528 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Successfully updated port: cb90c186-f98f-4d99-8292-e9600576dee1 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:36:17.653866 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:17.659775 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1325996205',display_name='tempest-ServerActionsTestOtherB-server-1325996205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001025',hostname='tempest-serveractionstestotherb-server-1325996205',id=8,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3jK8eIICR3l/4SHxst/8yPlILpDesN4+H3trAm2UFhRABDmHluvxgOWTGKox1jLYWeyqvab+bX/g483yAyobp3jhS/ZI5/84mWYZjjvl9ViemWFe558Ts8/0C9LeWLvw==',key_name='tempest-keypair-958107194',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:36:12Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=Flavor(12),node='np0000001025',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b34124f30156425cbda16473ccedeff4',ramdisk_id='',reservation_id='r-k74jcc1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1000009728',owner_user_name='tempest-ServerActionsTestOtherB-1000009728-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:36:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cde403fc60ce4630af81e6bdfa2b4603',uuid=6ea060d2-e149-4189-b93b-66ce319b9157,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:36:17.659985 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Converting VIF {"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:17.660518 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:b1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7cdc75ea-9f5f-4944-92ae-1788cf00aea2,network=Network(8114a6bf-054f-469f-a788-9fd489f4ee76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cdc75ea-9f') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:17.660741 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:b1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7cdc75ea-9f5f-4944-92ae-1788cf00aea2,network=Network(8114a6bf-054f-469f-a788-9fd489f4ee76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cdc75ea-9f') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:36:17.661576 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:17.661781 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cdc75ea-9f, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:17.662810 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:17.663575 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:17.663860 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:17.664471 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:17.664651 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63f51fb7-a42e-4f76-9f1c-36f7238e7f43) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:17.664997 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:17.665414 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:17.666143 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:17.667786 np0000001025 nova-compute[97981]: INFO os_vif [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:b1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7cdc75ea-9f5f-4944-92ae-1788cf00aea2,network=Network(8114a6bf-054f-469f-a788-9fd489f4ee76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cdc75ea-9f')
May 19 04:36:17.669143 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:36:17.669143 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b25ba87-624c-4d65-b535-95d5d14da486', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:36:17.669364 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:17.722889 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Found WWN 330000000743a0bb2 for multipath device dm-6 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:36:17.723212 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:17.723479 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] <== connect_volume: return (5862ms) {'type': 'block', 'scsi_wwn': '330000000743a0bb2', 'path': '/dev/dm-6', 'multipath_id': '330000000743a0bb2'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:36:17.723671 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000743a0bb2', 'path': '/dev/dm-6', 'multipath_id': '330000000743a0bb2'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:36:17.723939 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.055s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:17.724272 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b25ba87-624c-4d65-b535-95d5d14da486', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:36:17.724409 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:36:17.752958 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:17.752958 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:17.752958 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:17.752958 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:17.752958 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:17.752958 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:17.752958 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:17.752958 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:17.752958 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:17.752958 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:17.752958 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:17.753244 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:17.753244 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:17.753244 np0000001025 nova-compute[97981]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:17.753244 np0000001025 nova-compute[97981]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:17.753244 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:17.753244 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:17.753244 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:17.753244 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:17.753244 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:17.753244 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:17.753244 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:17.753244 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', '26')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:36:17.753601 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', '20')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:36:17.755639 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', '19')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:36:17.756468 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185018eca0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486'): ({'sdf'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:36:17.756652 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Removing multipathed devices sdg, sdf {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:36:17.756859 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Flush multipath device 330000000b045a358 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:36:17.789368 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:36:17.843160 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:36:17.889477 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:36:17.889666 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:36:17.891310 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:36:17.903525 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:36:17.903575 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:36:17.916102 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:17.923937 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:17.951578 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:17.955658 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.40.100,3260]
May 19 04:36:17.955658 np0000001025 nova-compute[97981]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.40.100,3260] successful.
May 19 04:36:17.955658 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:17.972976 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:17.983672 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:18.015989 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.50.100,3260]
May 19 04:36:18.015989 np0000001025 nova-compute[97981]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.50.100,3260] successful.
May 19 04:36:18.015989 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:18.032594 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:18.033091 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:18.033091 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] <== disconnect_volume: return (363ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:36:18.033091 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:36:18.067264 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Acquiring lock "refresh_cache-7c91d680-72b2-4422-a3c6-fff9714d42cd" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:36:18.067419 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Acquired lock "refresh_cache-7c91d680-72b2-4422-a3c6-fff9714d42cd" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:36:18.067823 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:36:18.089664 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:36:18.091931 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:36:18.092231 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Creating image(s)
May 19 04:36:18.092716 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c91d680-72b2-4422-a3c6-fff9714d42cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:18.092934 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Lock "/opt/stack/data/nova/instances/7c91d680-72b2-4422-a3c6-fff9714d42cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:18.094640 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Lock "/opt/stack/data/nova/instances/7c91d680-72b2-4422-a3c6-fff9714d42cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:18.095308 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:36:18.103097 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Updating instance_info_cache with network_info: [{"id": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "address": "fa:16:3e:e5:ed:dc", "network": {"id": "637c588b-9807-4474-9ce4-42f9d9631794", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-90879599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f5a2e8-43", "ovs_interfaceid": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:18.103097 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:36:18.105976 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:18.206879 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.101s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:18.207247 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:18.207670 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:18.208026 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:36:18.211011 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:36:18.211549 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:18.230768 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-828285451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-828285451',id=11,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHptQgQOz8uzJWvG8VBqqugtU1+E4qrvwdyPZ0Pjq28H6o1y20pA6W+pQxEeyDhIOxGx4uDHTNe4uAHExnvV1cSus1abbFyIsDdDRP/0uFpv7SeZ38WmhWAVa0dVyukP+g==',key_name='tempest-keypair-392122288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fc088ff80284506af708277495c5882',ramdisk_id='',reservation_id='r-pgu1refj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1449301970',owner_user_name='tempest-TaggedBootDevicesTest_v242-1449301970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:35:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a349efc3ddaf48ed966109438d3f0625',uuid=63247a98-0dc4-4a87-9141-5ae713a462b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad71ba07-449a-4565-bd5e-17c050975bd3", "address": "fa:16:3e:3b:78:32", "network": {"id": "a3b3266f-28a3-47fc-b52c-26f42a06a1bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1135470460-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad71ba07-44", "ovs_interfaceid": "ad71ba07-449a-4565-bd5e-17c050975bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:36:18.231045 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converting VIF {"id": "ad71ba07-449a-4565-bd5e-17c050975bd3", "address": "fa:16:3e:3b:78:32", "network": {"id": "a3b3266f-28a3-47fc-b52c-26f42a06a1bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1135470460-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad71ba07-44", "ovs_interfaceid": "ad71ba07-449a-4565-bd5e-17c050975bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:18.232093 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:78:32,bridge_name='br-int',has_traffic_filtering=True,id=ad71ba07-449a-4565-bd5e-17c050975bd3,network=Network(a3b3266f-28a3-47fc-b52c-26f42a06a1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad71ba07-44') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:18.233044 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-828285451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-828285451',id=11,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHptQgQOz8uzJWvG8VBqqugtU1+E4qrvwdyPZ0Pjq28H6o1y20pA6W+pQxEeyDhIOxGx4uDHTNe4uAHExnvV1cSus1abbFyIsDdDRP/0uFpv7SeZ38WmhWAVa0dVyukP+g==',key_name='tempest-keypair-392122288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fc088ff80284506af708277495c5882',ramdisk_id='',reservation_id='r-pgu1refj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1449301970',owner_user_name='tempest-TaggedBootDevicesTest_v242-1449301970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:35:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a349efc3ddaf48ed966109438d3f0625',uuid=63247a98-0dc4-4a87-9141-5ae713a462b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "address": "fa:16:3e:e7:64:b0", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60124aa0-37", "ovs_interfaceid": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:36:18.233231 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converting VIF {"id": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "address": "fa:16:3e:e7:64:b0", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60124aa0-37", "ovs_interfaceid": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:18.233576 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:64:b0,bridge_name='br-int',has_traffic_filtering=True,id=60124aa0-3747-4d4f-bac3-3c90e62b801c,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60124aa0-37') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:18.234246 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-828285451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-828285451',id=11,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHptQgQOz8uzJWvG8VBqqugtU1+E4qrvwdyPZ0Pjq28H6o1y20pA6W+pQxEeyDhIOxGx4uDHTNe4uAHExnvV1cSus1abbFyIsDdDRP/0uFpv7SeZ38WmhWAVa0dVyukP+g==',key_name='tempest-keypair-392122288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fc088ff80284506af708277495c5882',ramdisk_id='',reservation_id='r-pgu1refj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1449301970',owner_user_name='tempest-TaggedBootDevicesTest_v242-1449301970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:35:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a349efc3ddaf48ed966109438d3f0625',uuid=63247a98-0dc4-4a87-9141-5ae713a462b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "address": "fa:16:3e:c8:33:5b", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap137c6f2c-dd", "ovs_interfaceid": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:36:18.234415 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converting VIF {"id": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "address": "fa:16:3e:c8:33:5b", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap137c6f2c-dd", "ovs_interfaceid": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:18.234947 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:33:5b,bridge_name='br-int',has_traffic_filtering=True,id=137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap137c6f2c-dd') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:18.235264 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-828285451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-828285451',id=11,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHptQgQOz8uzJWvG8VBqqugtU1+E4qrvwdyPZ0Pjq28H6o1y20pA6W+pQxEeyDhIOxGx4uDHTNe4uAHExnvV1cSus1abbFyIsDdDRP/0uFpv7SeZ38WmhWAVa0dVyukP+g==',key_name='tempest-keypair-392122288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fc088ff80284506af708277495c5882',ramdisk_id='',reservation_id='r-pgu1refj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1449301970',owner_user_name='tempest-TaggedBootDevicesTest_v242-1449301970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:35:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a349efc3ddaf48ed966109438d3f0625',uuid=63247a98-0dc4-4a87-9141-5ae713a462b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55210bd9-f231-4f7e-89be-c5779add4e83", "address": "fa:16:3e:d0:04:13", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55210bd9-f2", "ovs_interfaceid": "55210bd9-f231-4f7e-89be-c5779add4e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:36:18.235435 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converting VIF {"id": "55210bd9-f231-4f7e-89be-c5779add4e83", "address": "fa:16:3e:d0:04:13", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55210bd9-f2", "ovs_interfaceid": "55210bd9-f231-4f7e-89be-c5779add4e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:18.235699 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:04:13,bridge_name='br-int',has_traffic_filtering=True,id=55210bd9-f231-4f7e-89be-c5779add4e83,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55210bd9-f2') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:18.236382 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-828285451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-828285451',id=11,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHptQgQOz8uzJWvG8VBqqugtU1+E4qrvwdyPZ0Pjq28H6o1y20pA6W+pQxEeyDhIOxGx4uDHTNe4uAHExnvV1cSus1abbFyIsDdDRP/0uFpv7SeZ38WmhWAVa0dVyukP+g==',key_name='tempest-keypair-392122288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fc088ff80284506af708277495c5882',ramdisk_id='',reservation_id='r-pgu1refj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1449301970',owner_user_name='tempest-TaggedBootDevicesTest_v242-1449301970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:35:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a349efc3ddaf48ed966109438d3f0625',uuid=63247a98-0dc4-4a87-9141-5ae713a462b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "address": "fa:16:3e:50:b6:e3", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ec0e22-80", "ovs_interfaceid": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:36:18.236382 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converting VIF {"id": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "address": "fa:16:3e:50:b6:e3", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ec0e22-80", "ovs_interfaceid": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:18.236749 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:b6:e3,bridge_name='br-int',has_traffic_filtering=True,id=c0ec0e22-8097-46a0-93bb-077e4e38a07c,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ec0e22-80') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:18.237696 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-828285451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-828285451',id=11,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHptQgQOz8uzJWvG8VBqqugtU1+E4qrvwdyPZ0Pjq28H6o1y20pA6W+pQxEeyDhIOxGx4uDHTNe4uAHExnvV1cSus1abbFyIsDdDRP/0uFpv7SeZ38WmhWAVa0dVyukP+g==',key_name='tempest-keypair-392122288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fc088ff80284506af708277495c5882',ramdisk_id='',reservation_id='r-pgu1refj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1449301970',owner_user_name='tempest-TaggedBootDevicesTest_v242-1449301970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:35:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a349efc3ddaf48ed966109438d3f0625',uuid=63247a98-0dc4-4a87-9141-5ae713a462b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "address": "fa:16:3e:10:97:76", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42811c2a-5e", "ovs_interfaceid": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:36:18.237696 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converting VIF {"id": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "address": "fa:16:3e:10:97:76", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42811c2a-5e", "ovs_interfaceid": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:18.238023 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:97:76,bridge_name='br-int',has_traffic_filtering=True,id=42811c2a-5e1a-48c2-ae48-869cd5e416e6,network=Network(639c2651-b468-4473-890e-e2ee134e2afc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42811c2a-5e') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:18.238572 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-828285451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-828285451',id=11,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHptQgQOz8uzJWvG8VBqqugtU1+E4qrvwdyPZ0Pjq28H6o1y20pA6W+pQxEeyDhIOxGx4uDHTNe4uAHExnvV1cSus1abbFyIsDdDRP/0uFpv7SeZ38WmhWAVa0dVyukP+g==',key_name='tempest-keypair-392122288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fc088ff80284506af708277495c5882',ramdisk_id='',reservation_id='r-pgu1refj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1449301970',owner_user_name='tempest-TaggedBootDevicesTest_v242-1449301970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:35:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a349efc3ddaf48ed966109438d3f0625',uuid=63247a98-0dc4-4a87-9141-5ae713a462b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7648d4e-3e92-4c77-9347-91670c3b9113", "address": "fa:16:3e:2c:e3:ec", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7648d4e-3e", "ovs_interfaceid": "d7648d4e-3e92-4c77-9347-91670c3b9113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:36:18.238697 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converting VIF {"id": "d7648d4e-3e92-4c77-9347-91670c3b9113", "address": "fa:16:3e:2c:e3:ec", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7648d4e-3e", "ovs_interfaceid": "d7648d4e-3e92-4c77-9347-91670c3b9113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:18.239027 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e3:ec,bridge_name='br-int',has_traffic_filtering=True,id=d7648d4e-3e92-4c77-9347-91670c3b9113,network=Network(639c2651-b468-4473-890e-e2ee134e2afc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7648d4e-3e') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:18.239666 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lazy-loading 'pci_devices' on Instance uuid 63247a98-0dc4-4a87-9141-5ae713a462b5 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:18.293244 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.081s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:18.293907 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/7c91d680-72b2-4422-a3c6-fff9714d42cd/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:18.335664 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/7c91d680-72b2-4422-a3c6-fff9714d42cd/disk 1073741824" returned: 0 in 0.042s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:18.336405 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.128s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:18.336779 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:18.419738 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.083s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:18.420121 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c91d680-72b2-4422-a3c6-fff9714d42cd/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:36:18.420370 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c91d680-72b2-4422-a3c6-fff9714d42cd/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:18.457009 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f197dc89-7ddf-414d-9a24-ab51a072cca7 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.649s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:18.499425 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c91d680-72b2-4422-a3c6-fff9714d42cd/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:18.499589 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Cannot resize image /opt/stack/data/nova/instances/7c91d680-72b2-4422-a3c6-fff9714d42cd/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:36:18.499876 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:36:18.500027 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Ensure instance console log exists: /opt/stack/data/nova/instances/7c91d680-72b2-4422-a3c6-fff9714d42cd/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:36:18.500785 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:18.500977 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:18.501099 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:18.605183 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Releasing lock "refresh_cache-1081cdc6-540d-4cb8-9e0d-d7584411e539" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:36:18.639652 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:36:18.743568 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] End _get_guest_xml xml=<domain type="qemu">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:   <uuid>63247a98-0dc4-4a87-9141-5ae713a462b5</uuid>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:   <name>instance-0000000b</name>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <nova:name>tempest-device-tagging-server-828285451</nova:name>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:36:01</nova:creationTime>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         <nova:user uuid="a349efc3ddaf48ed966109438d3f0625">tempest-TaggedBootDevicesTest_v242-1449301970-project-member</nova:user>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         <nova:project uuid="7fc088ff80284506af708277495c5882">tempest-TaggedBootDevicesTest_v242-1449301970</nova:project>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         <nova:port uuid="ad71ba07-449a-4565-bd5e-17c050975bd3">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         <nova:port uuid="60124aa0-3747-4d4f-bac3-3c90e62b801c">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.1.74" ipVersion="4"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         <nova:port uuid="137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.1.36" ipVersion="4"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         <nova:port uuid="55210bd9-f231-4f7e-89be-c5779add4e83">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.1.73" ipVersion="4"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         <nova:port uuid="c0ec0e22-8097-46a0-93bb-077e4e38a07c">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.1.31" ipVersion="4"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         <nova:port uuid="42811c2a-5e1a-48c2-ae48-869cd5e416e6">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         <nova:port uuid="d7648d4e-3e92-4c77-9347-91670c3b9113">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <system>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <entry name="serial">63247a98-0dc4-4a87-9141-5ae713a462b5</entry>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <entry name="uuid">63247a98-0dc4-4a87-9141-5ae713a462b5</entry>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     </system>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:   <os>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:   </os>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:   <features>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:   </features>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:   <devices>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/63247a98-0dc4-4a87-9141-5ae713a462b5/disk.config"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <alias name="ua-1d04e1a5-6059-4dec-9127-3ffa039dd625"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-1"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <serial>1d04e1a5-6059-4dec-9127-3ffa039dd625</serial>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <alias name="ua-df86bd40-0f7a-447e-86d5-0494d1928695"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-5"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <target dev="vdb" bus="virtio"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <serial>df86bd40-0f7a-447e-86d5-0494d1928695</serial>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <alias name="ua-1fe9afac-3374-4e79-bff5-27405bd5fd0f"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-6"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <target dev="vdc" bus="virtio"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <serial>1fe9afac-3374-4e79-bff5-27405bd5fd0f</serial>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:3b:78:32"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <target dev="tapad71ba07-44"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     </interface>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:e7:64:b0"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <target dev="tap60124aa0-37"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     </interface>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:c8:33:5b"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <target dev="tap137c6f2c-dd"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     </interface>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:d0:04:13"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <target dev="tap55210bd9-f2"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     </interface>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:50:b6:e3"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <target dev="tapc0ec0e22-80"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     </interface>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:10:97:76"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <target dev="tap42811c2a-5e"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     </interface>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:2c:e3:ec"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <target dev="tapd7648d4e-3e"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     </interface>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/63247a98-0dc4-4a87-9141-5ae713a462b5/console.log" append="off"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     </serial>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <video>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     </video>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     </rng>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:   </devices>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]: </domain>
May 19 04:36:18.743568 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Preparing to wait for external event network-vif-plugged-ad71ba07-449a-4565-bd5e-17c050975bd3 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Preparing to wait for external event network-vif-plugged-60124aa0-3747-4d4f-bac3-3c90e62b801c {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Preparing to wait for external event network-vif-plugged-137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Preparing to wait for external event network-vif-plugged-55210bd9-f231-4f7e-89be-c5779add4e83 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Preparing to wait for external event network-vif-plugged-c0ec0e22-8097-46a0-93bb-077e4e38a07c {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Preparing to wait for external event network-vif-plugged-42811c2a-5e1a-48c2-ae48-869cd5e416e6 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Preparing to wait for external event network-vif-plugged-d7648d4e-3e92-4c77-9347-91670c3b9113 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:18.749864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:18.751016 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-828285451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-828285451',id=11,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHptQgQOz8uzJWvG8VBqqugtU1+E4qrvwdyPZ0Pjq28H6o1y20pA6W+pQxEeyDhIOxGx4uDHTNe4uAHExnvV1cSus1abbFyIsDdDRP/0uFpv7SeZ38WmhWAVa0dVyukP+g==',key_name='tempest-keypair-392122288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fc088ff80284506af708277495c5882',ramdisk_id='',reservation_id='r-pgu1refj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1449301970',owner_user_name='tempest-TaggedBootDevicesTest_v242-1449301970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:35:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a349efc3ddaf48ed966109438d3f0625',uuid=63247a98-0dc4-4a87-9141-5ae713a462b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad71ba07-449a-4565-bd5e-17c050975bd3", "address": "fa:16:3e:3b:78:32", "network": {"id": "a3b3266f-28a3-47fc-b52c-26f42a06a1bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1135470460-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad71ba07-44", "ovs_interfaceid": "ad71ba07-449a-4565-bd5e-17c050975bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:36:18.751016 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converting VIF {"id": "ad71ba07-449a-4565-bd5e-17c050975bd3", "address": "fa:16:3e:3b:78:32", "network": {"id": "a3b3266f-28a3-47fc-b52c-26f42a06a1bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1135470460-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad71ba07-44", "ovs_interfaceid": "ad71ba07-449a-4565-bd5e-17c050975bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:18.751016 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:78:32,bridge_name='br-int',has_traffic_filtering=True,id=ad71ba07-449a-4565-bd5e-17c050975bd3,network=Network(a3b3266f-28a3-47fc-b52c-26f42a06a1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad71ba07-44') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:18.751016 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:78:32,bridge_name='br-int',has_traffic_filtering=True,id=ad71ba07-449a-4565-bd5e-17c050975bd3,network=Network(a3b3266f-28a3-47fc-b52c-26f42a06a1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad71ba07-44') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:36:18.751016 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.751282 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.751568 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:36:18.752516 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.752656 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af2aa895-0444-54fe-9c00-3285a28d2c89', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.760013 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.760740 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:18.760871 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.762737 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.762877 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad71ba07-44, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.763189 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad71ba07-44, col_values=(('qos', UUID('4ab8e260-b2ed-400d-8115-853c319c2e6f')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.763335 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad71ba07-44, col_values=(('external_ids', {'iface-id': 'ad71ba07-449a-4565-bd5e-17c050975bd3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:78:32', 'vm-uuid': '63247a98-0dc4-4a87-9141-5ae713a462b5'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.764022 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.764987 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:18.769983 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.771040 np0000001025 nova-compute[97981]: INFO os_vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:78:32,bridge_name='br-int',has_traffic_filtering=True,id=ad71ba07-449a-4565-bd5e-17c050975bd3,network=Network(a3b3266f-28a3-47fc-b52c-26f42a06a1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad71ba07-44')
May 19 04:36:18.771686 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-828285451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-828285451',id=11,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHptQgQOz8uzJWvG8VBqqugtU1+E4qrvwdyPZ0Pjq28H6o1y20pA6W+pQxEeyDhIOxGx4uDHTNe4uAHExnvV1cSus1abbFyIsDdDRP/0uFpv7SeZ38WmhWAVa0dVyukP+g==',key_name='tempest-keypair-392122288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fc088ff80284506af708277495c5882',ramdisk_id='',reservation_id='r-pgu1refj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1449301970',owner_user_name='tempest-TaggedBootDevicesTest_v242-1449301970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:35:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a349efc3ddaf48ed966109438d3f0625',uuid=63247a98-0dc4-4a87-9141-5ae713a462b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "address": "fa:16:3e:e7:64:b0", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60124aa0-37", "ovs_interfaceid": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:36:18.771849 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converting VIF {"id": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "address": "fa:16:3e:e7:64:b0", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60124aa0-37", "ovs_interfaceid": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:18.772263 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:64:b0,bridge_name='br-int',has_traffic_filtering=True,id=60124aa0-3747-4d4f-bac3-3c90e62b801c,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60124aa0-37') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:18.772471 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:64:b0,bridge_name='br-int',has_traffic_filtering=True,id=60124aa0-3747-4d4f-bac3-3c90e62b801c,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60124aa0-37') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:36:18.772750 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.772908 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.773068 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:36:18.774008 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.774164 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '201fc2e5-46f2-5800-8ff4-0df8c9acdfd0', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.774849 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.775555 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:18.780366 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.782447 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.782579 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60124aa0-37, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.782834 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60124aa0-37, col_values=(('qos', UUID('73a6efb1-f33b-475c-aa18-2d1a3b616150')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.782955 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60124aa0-37, col_values=(('external_ids', {'iface-id': '60124aa0-3747-4d4f-bac3-3c90e62b801c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:64:b0', 'vm-uuid': '63247a98-0dc4-4a87-9141-5ae713a462b5'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.785304 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:18.786428 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Rescuing
May 19 04:36:18.786625 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "refresh_cache-b5f34a29-15f7-4f5e-a8bf-574abebd5c84" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:36:18.786754 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquired lock "refresh_cache-b5f34a29-15f7-4f5e-a8bf-574abebd5c84" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:36:18.786929 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:36:18.790705 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:18.792904 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.794121 np0000001025 nova-compute[97981]: INFO os_vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:64:b0,bridge_name='br-int',has_traffic_filtering=True,id=60124aa0-3747-4d4f-bac3-3c90e62b801c,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60124aa0-37')
May 19 04:36:18.794763 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-828285451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-828285451',id=11,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHptQgQOz8uzJWvG8VBqqugtU1+E4qrvwdyPZ0Pjq28H6o1y20pA6W+pQxEeyDhIOxGx4uDHTNe4uAHExnvV1cSus1abbFyIsDdDRP/0uFpv7SeZ38WmhWAVa0dVyukP+g==',key_name='tempest-keypair-392122288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fc088ff80284506af708277495c5882',ramdisk_id='',reservation_id='r-pgu1refj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1449301970',owner_user_name='tempest-TaggedBootDevicesTest_v242-1449301970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:35:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a349efc3ddaf48ed966109438d3f0625',uuid=63247a98-0dc4-4a87-9141-5ae713a462b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "address": "fa:16:3e:c8:33:5b", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap137c6f2c-dd", "ovs_interfaceid": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:36:18.794907 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converting VIF {"id": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "address": "fa:16:3e:c8:33:5b", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap137c6f2c-dd", "ovs_interfaceid": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:18.795410 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:33:5b,bridge_name='br-int',has_traffic_filtering=True,id=137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap137c6f2c-dd') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:18.795618 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:33:5b,bridge_name='br-int',has_traffic_filtering=True,id=137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap137c6f2c-dd') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:36:18.795989 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.796188 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.796364 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:36:18.797162 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.797342 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9fdea97-190e-5bf5-82aa-3b6c46ebc52d', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.798281 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.798900 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:18.806998 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.808768 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.808903 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap137c6f2c-dd, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.809173 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap137c6f2c-dd, col_values=(('qos', UUID('fc52e336-35f2-4d49-abc2-782d661816fe')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.809289 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap137c6f2c-dd, col_values=(('external_ids', {'iface-id': '137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:33:5b', 'vm-uuid': '63247a98-0dc4-4a87-9141-5ae713a462b5'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.810002 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.811435 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:18.823650 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.824698 np0000001025 nova-compute[97981]: INFO os_vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:33:5b,bridge_name='br-int',has_traffic_filtering=True,id=137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap137c6f2c-dd')
May 19 04:36:18.826239 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-828285451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-828285451',id=11,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHptQgQOz8uzJWvG8VBqqugtU1+E4qrvwdyPZ0Pjq28H6o1y20pA6W+pQxEeyDhIOxGx4uDHTNe4uAHExnvV1cSus1abbFyIsDdDRP/0uFpv7SeZ38WmhWAVa0dVyukP+g==',key_name='tempest-keypair-392122288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fc088ff80284506af708277495c5882',ramdisk_id='',reservation_id='r-pgu1refj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1449301970',owner_user_name='tempest-TaggedBootDevicesTest_v242-1449301970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:35:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a349efc3ddaf48ed966109438d3f0625',uuid=63247a98-0dc4-4a87-9141-5ae713a462b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55210bd9-f231-4f7e-89be-c5779add4e83", "address": "fa:16:3e:d0:04:13", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55210bd9-f2", "ovs_interfaceid": "55210bd9-f231-4f7e-89be-c5779add4e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:36:18.826239 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converting VIF {"id": "55210bd9-f231-4f7e-89be-c5779add4e83", "address": "fa:16:3e:d0:04:13", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55210bd9-f2", "ovs_interfaceid": "55210bd9-f231-4f7e-89be-c5779add4e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:18.826239 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:04:13,bridge_name='br-int',has_traffic_filtering=True,id=55210bd9-f231-4f7e-89be-c5779add4e83,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55210bd9-f2') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:18.826239 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:04:13,bridge_name='br-int',has_traffic_filtering=True,id=55210bd9-f231-4f7e-89be-c5779add4e83,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55210bd9-f2') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:36:18.826505 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.826505 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.826623 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:36:18.827121 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.827240 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a661010-a393-53e5-88b5-6927cd1d12b6', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.827745 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.828266 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:18.842479 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.844294 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.844452 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55210bd9-f2, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.844836 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap55210bd9-f2, col_values=(('qos', UUID('ea8fc0f9-0e8f-4f6e-b44c-ab27e058d68e')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.844959 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap55210bd9-f2, col_values=(('external_ids', {'iface-id': '55210bd9-f231-4f7e-89be-c5779add4e83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:04:13', 'vm-uuid': '63247a98-0dc4-4a87-9141-5ae713a462b5'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.845841 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.846966 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:18.866874 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.867761 np0000001025 nova-compute[97981]: INFO os_vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:04:13,bridge_name='br-int',has_traffic_filtering=True,id=55210bd9-f231-4f7e-89be-c5779add4e83,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55210bd9-f2')
May 19 04:36:18.868390 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-828285451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-828285451',id=11,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHptQgQOz8uzJWvG8VBqqugtU1+E4qrvwdyPZ0Pjq28H6o1y20pA6W+pQxEeyDhIOxGx4uDHTNe4uAHExnvV1cSus1abbFyIsDdDRP/0uFpv7SeZ38WmhWAVa0dVyukP+g==',key_name='tempest-keypair-392122288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fc088ff80284506af708277495c5882',ramdisk_id='',reservation_id='r-pgu1refj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1449301970',owner_user_name='tempest-TaggedBootDevicesTest_v242-1449301970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:35:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a349efc3ddaf48ed966109438d3f0625',uuid=63247a98-0dc4-4a87-9141-5ae713a462b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "address": "fa:16:3e:50:b6:e3", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ec0e22-80", "ovs_interfaceid": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:36:18.868537 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converting VIF {"id": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "address": "fa:16:3e:50:b6:e3", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ec0e22-80", "ovs_interfaceid": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:18.868937 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:b6:e3,bridge_name='br-int',has_traffic_filtering=True,id=c0ec0e22-8097-46a0-93bb-077e4e38a07c,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ec0e22-80') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:18.869165 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:b6:e3,bridge_name='br-int',has_traffic_filtering=True,id=c0ec0e22-8097-46a0-93bb-077e4e38a07c,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ec0e22-80') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:36:18.869358 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.869530 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.869744 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:36:18.870519 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.870718 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28d884b7-c53d-5d80-bf07-961a5bec0c00', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.871343 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.872020 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:18.889495 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.891313 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.891788 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0ec0e22-80, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.892099 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc0ec0e22-80, col_values=(('qos', UUID('02a65cdc-011f-43b5-9923-bd16708a2675')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.892280 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc0ec0e22-80, col_values=(('external_ids', {'iface-id': 'c0ec0e22-8097-46a0-93bb-077e4e38a07c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:b6:e3', 'vm-uuid': '63247a98-0dc4-4a87-9141-5ae713a462b5'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.893145 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.894290 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:18.912970 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.914127 np0000001025 nova-compute[97981]: INFO os_vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:b6:e3,bridge_name='br-int',has_traffic_filtering=True,id=c0ec0e22-8097-46a0-93bb-077e4e38a07c,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ec0e22-80')
May 19 04:36:18.914726 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-828285451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-828285451',id=11,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHptQgQOz8uzJWvG8VBqqugtU1+E4qrvwdyPZ0Pjq28H6o1y20pA6W+pQxEeyDhIOxGx4uDHTNe4uAHExnvV1cSus1abbFyIsDdDRP/0uFpv7SeZ38WmhWAVa0dVyukP+g==',key_name='tempest-keypair-392122288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fc088ff80284506af708277495c5882',ramdisk_id='',reservation_id='r-pgu1refj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1449301970',owner_user_name='tempest-TaggedBootDevicesTest_v242-1449301970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:35:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a349efc3ddaf48ed966109438d3f0625',uuid=63247a98-0dc4-4a87-9141-5ae713a462b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "address": "fa:16:3e:10:97:76", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42811c2a-5e", "ovs_interfaceid": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:36:18.914873 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converting VIF {"id": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "address": "fa:16:3e:10:97:76", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42811c2a-5e", "ovs_interfaceid": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:18.915308 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:97:76,bridge_name='br-int',has_traffic_filtering=True,id=42811c2a-5e1a-48c2-ae48-869cd5e416e6,network=Network(639c2651-b468-4473-890e-e2ee134e2afc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42811c2a-5e') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:18.915525 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:97:76,bridge_name='br-int',has_traffic_filtering=True,id=42811c2a-5e1a-48c2-ae48-869cd5e416e6,network=Network(639c2651-b468-4473-890e-e2ee134e2afc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42811c2a-5e') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:36:18.915768 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.915881 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.916006 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:36:18.916737 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.916865 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1811773-b7d5-5865-9f6e-813c79282eec', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.918201 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:18.928337 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Updating instance_info_cache with network_info: [{"id": "cb90c186-f98f-4d99-8292-e9600576dee1", "address": "fa:16:3e:76:e6:b5", "network": {"id": "1e5f24d0-88c4-41b8-9a87-3e61b964670c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839847895-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9a9429eac2d4f0da28551f059b1deeb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb90c186-f9", "ovs_interfaceid": "cb90c186-f98f-4d99-8292-e9600576dee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:18.939589 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.941751 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.941889 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42811c2a-5e, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.942193 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap42811c2a-5e, col_values=(('qos', UUID('91d36565-5b8a-4ed5-b83b-247d6dd6176d')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.942319 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap42811c2a-5e, col_values=(('external_ids', {'iface-id': '42811c2a-5e1a-48c2-ae48-869cd5e416e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:97:76', 'vm-uuid': '63247a98-0dc4-4a87-9141-5ae713a462b5'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.943235 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.944227 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:18.968845 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.969922 np0000001025 nova-compute[97981]: INFO os_vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:97:76,bridge_name='br-int',has_traffic_filtering=True,id=42811c2a-5e1a-48c2-ae48-869cd5e416e6,network=Network(639c2651-b468-4473-890e-e2ee134e2afc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42811c2a-5e')
May 19 04:36:18.970772 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-828285451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-828285451',id=11,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHptQgQOz8uzJWvG8VBqqugtU1+E4qrvwdyPZ0Pjq28H6o1y20pA6W+pQxEeyDhIOxGx4uDHTNe4uAHExnvV1cSus1abbFyIsDdDRP/0uFpv7SeZ38WmhWAVa0dVyukP+g==',key_name='tempest-keypair-392122288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fc088ff80284506af708277495c5882',ramdisk_id='',reservation_id='r-pgu1refj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1449301970',owner_user_name='tempest-TaggedBootDevicesTest_v242-1449301970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:35:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a349efc3ddaf48ed966109438d3f0625',uuid=63247a98-0dc4-4a87-9141-5ae713a462b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7648d4e-3e92-4c77-9347-91670c3b9113", "address": "fa:16:3e:2c:e3:ec", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7648d4e-3e", "ovs_interfaceid": "d7648d4e-3e92-4c77-9347-91670c3b9113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:36:18.970935 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converting VIF {"id": "d7648d4e-3e92-4c77-9347-91670c3b9113", "address": "fa:16:3e:2c:e3:ec", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7648d4e-3e", "ovs_interfaceid": "d7648d4e-3e92-4c77-9347-91670c3b9113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:18.971519 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e3:ec,bridge_name='br-int',has_traffic_filtering=True,id=d7648d4e-3e92-4c77-9347-91670c3b9113,network=Network(639c2651-b468-4473-890e-e2ee134e2afc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7648d4e-3e') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:18.971765 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e3:ec,bridge_name='br-int',has_traffic_filtering=True,id=d7648d4e-3e92-4c77-9347-91670c3b9113,network=Network(639c2651-b468-4473-890e-e2ee134e2afc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7648d4e-3e') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:36:18.972202 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.972341 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.972510 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:36:18.973256 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.973392 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77894494-b6be-5989-9ce9-f6e379426195', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:18.974172 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:18.974836 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:18.998685 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:19.000697 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:19.000864 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7648d4e-3e, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:19.001227 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd7648d4e-3e, col_values=(('qos', UUID('3a5da664-465a-4248-8105-5d2373d57951')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:19.001478 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd7648d4e-3e, col_values=(('external_ids', {'iface-id': 'd7648d4e-3e92-4c77-9347-91670c3b9113', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:e3:ec', 'vm-uuid': '63247a98-0dc4-4a87-9141-5ae713a462b5'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:19.002214 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:19.003337 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:19.032548 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:19.033559 np0000001025 nova-compute[97981]: INFO os_vif [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e3:ec,bridge_name='br-int',has_traffic_filtering=True,id=d7648d4e-3e92-4c77-9347-91670c3b9113,network=Network(639c2651-b468-4473-890e-e2ee134e2afc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7648d4e-3e')
May 19 04:36:19.111962 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-455e449b-aed2-4f82-98d1-bf2bab8f3811 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "interface-1081cdc6-540d-4cb8-9e0d-d7584411e539-312ea861-c69c-4976-ba37-408f1e7fe0dd" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 6.110s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:19.182434 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:19.182696 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:19.288937 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:19.430221 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Releasing lock "refresh_cache-7c91d680-72b2-4422-a3c6-fff9714d42cd" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:36:19.430588 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Instance network_info: |[{"id": "cb90c186-f98f-4d99-8292-e9600576dee1", "address": "fa:16:3e:76:e6:b5", "network": {"id": "1e5f24d0-88c4-41b8-9a87-3e61b964670c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839847895-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9a9429eac2d4f0da28551f059b1deeb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb90c186-f9", "ovs_interfaceid": "cb90c186-f98f-4d99-8292-e9600576dee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:36:19.432446 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Start _get_guest_xml network_info=[{"id": "cb90c186-f98f-4d99-8292-e9600576dee1", "address": "fa:16:3e:76:e6:b5", "network": {"id": "1e5f24d0-88c4-41b8-9a87-3e61b964670c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839847895-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9a9429eac2d4f0da28551f059b1deeb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb90c186-f9", "ovs_interfaceid": "cb90c186-f98f-4d99-8292-e9600576dee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:36:19.437009 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:36:19.438266 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-894375213', uuid='7c91d680-72b2-4422-a3c6-fff9714d42cd'), owner=OwnerMeta(userid='0bc4987fe170442c9ec50fd9652056f3', username='tempest-VolumesAdminNegativeTest-304022391-project-member', projectid='f9a9429eac2d4f0da28551f059b1deeb', projectname='tempest-VolumesAdminNegativeTest-304022391'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cb90c186-f98f-4d99-8292-e9600576dee1", "address": "fa:16:3e:76:e6:b5", "network": {"id": "1e5f24d0-88c4-41b8-9a87-3e61b964670c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839847895-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9a9429eac2d4f0da28551f059b1deeb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb90c186-f9", "ovs_interfaceid": "cb90c186-f98f-4d99-8292-e9600576dee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165379.4379056) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:36:19.439639 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:36:19.440127 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:36:19.441436 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:36:19.441594 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:36:19.442506 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:36:19.442801 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:36:19.442931 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:36:19.443013 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:36:19.443146 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:36:19.443232 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:36:19.443327 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:36:19.443547 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:36:19.443620 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:36:19.443740 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:36:19.443847 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:36:19.443952 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:36:19.455995 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-894375213',display_name='tempest-VolumesAdminNegativeTest-server-894375213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesadminnegativetest-server-894375213',id=13,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9a9429eac2d4f0da28551f059b1deeb',ramdisk_id='',reservation_id='r-k0ur5042',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-304022391',owner_user_name='tempest-VolumesAdminNegativeTest-304022391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:36:17Z,user_data=None,user_id='0bc4987fe170442c9ec50fd9652056f3',uuid=7c91d680-72b2-4422-a3c6-fff9714d42cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb90c186-f98f-4d99-8292-e9600576dee1", "address": "fa:16:3e:76:e6:b5", "network": {"id": "1e5f24d0-88c4-41b8-9a87-3e61b964670c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839847895-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9a9429eac2d4f0da28551f059b1deeb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb90c186-f9", "ovs_interfaceid": "cb90c186-f98f-4d99-8292-e9600576dee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:36:19.456251 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Converting VIF {"id": "cb90c186-f98f-4d99-8292-e9600576dee1", "address": "fa:16:3e:76:e6:b5", "network": {"id": "1e5f24d0-88c4-41b8-9a87-3e61b964670c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839847895-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9a9429eac2d4f0da28551f059b1deeb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb90c186-f9", "ovs_interfaceid": "cb90c186-f98f-4d99-8292-e9600576dee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:19.456661 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:e6:b5,bridge_name='br-int',has_traffic_filtering=True,id=cb90c186-f98f-4d99-8292-e9600576dee1,network=Network(1e5f24d0-88c4-41b8-9a87-3e61b964670c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb90c186-f9') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:19.457126 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c91d680-72b2-4422-a3c6-fff9714d42cd {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:19.617502 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9c1499b6-c716-493e-8f99-a775d9bbc7e7 req-084f0e1e-b7a9-4b8f-ba23-b6e491cb0c1e service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Received event network-changed-cb90c186-f98f-4d99-8292-e9600576dee1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:19.617640 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9c1499b6-c716-493e-8f99-a775d9bbc7e7 req-084f0e1e-b7a9-4b8f-ba23-b6e491cb0c1e service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Refreshing instance network info cache due to event network-changed-cb90c186-f98f-4d99-8292-e9600576dee1. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:36:19.617818 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9c1499b6-c716-493e-8f99-a775d9bbc7e7 req-084f0e1e-b7a9-4b8f-ba23-b6e491cb0c1e service nova] Acquiring lock "refresh_cache-7c91d680-72b2-4422-a3c6-fff9714d42cd" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:36:19.617945 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9c1499b6-c716-493e-8f99-a775d9bbc7e7 req-084f0e1e-b7a9-4b8f-ba23-b6e491cb0c1e service nova] Acquired lock "refresh_cache-7c91d680-72b2-4422-a3c6-fff9714d42cd" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:36:19.618282 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-9c1499b6-c716-493e-8f99-a775d9bbc7e7 req-084f0e1e-b7a9-4b8f-ba23-b6e491cb0c1e service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Refreshing network info cache for port cb90c186-f98f-4d99-8292-e9600576dee1 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:36:19.664711 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:19.684727 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lazy-loading 'migration_context' on Instance uuid 6ea060d2-e149-4189-b93b-66ce319b9157 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:19.846244 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Updating instance_info_cache with network_info: [{"id": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "address": "fa:16:3e:7d:73:e6", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe8167e8-42", "ovs_interfaceid": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:19.961181 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] End _get_guest_xml xml=<domain type="qemu">
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:   <uuid>7c91d680-72b2-4422-a3c6-fff9714d42cd</uuid>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:   <name>instance-0000000d</name>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <nova:name>tempest-VolumesAdminNegativeTest-server-894375213</nova:name>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:36:19</nova:creationTime>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:         <nova:user uuid="0bc4987fe170442c9ec50fd9652056f3">tempest-VolumesAdminNegativeTest-304022391-project-member</nova:user>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:         <nova:project uuid="f9a9429eac2d4f0da28551f059b1deeb">tempest-VolumesAdminNegativeTest-304022391</nova:project>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:         <nova:port uuid="cb90c186-f98f-4d99-8292-e9600576dee1">
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     <system>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <entry name="serial">7c91d680-72b2-4422-a3c6-fff9714d42cd</entry>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <entry name="uuid">7c91d680-72b2-4422-a3c6-fff9714d42cd</entry>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     </system>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:   <os>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:   </os>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:   <features>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:   </features>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:   <devices>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/7c91d680-72b2-4422-a3c6-fff9714d42cd/disk"/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/7c91d680-72b2-4422-a3c6-fff9714d42cd/disk.config"/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:76:e6:b5"/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <target dev="tapcb90c186-f9"/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     </interface>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/7c91d680-72b2-4422-a3c6-fff9714d42cd/console.log" append="off"/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     </serial>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     <video>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     </video>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     </rng>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:   </devices>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]: </domain>
May 19 04:36:19.961181 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:36:19.966242 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Preparing to wait for external event network-vif-plugged-cb90c186-f98f-4d99-8292-e9600576dee1 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:36:19.966242 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Acquiring lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:19.966242 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:19.966242 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:19.966242 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-894375213',display_name='tempest-VolumesAdminNegativeTest-server-894375213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesadminnegativetest-server-894375213',id=13,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9a9429eac2d4f0da28551f059b1deeb',ramdisk_id='',reservation_id='r-k0ur5042',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-304022391',owner_user_name='tempest-VolumesAdminNegativeTest-304022391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:36:17Z,user_data=None,user_id='0bc4987fe170442c9ec50fd9652056f3',uuid=7c91d680-72b2-4422-a3c6-fff9714d42cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb90c186-f98f-4d99-8292-e9600576dee1", "address": "fa:16:3e:76:e6:b5", "network": {"id": "1e5f24d0-88c4-41b8-9a87-3e61b964670c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839847895-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9a9429eac2d4f0da28551f059b1deeb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb90c186-f9", "ovs_interfaceid": "cb90c186-f98f-4d99-8292-e9600576dee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:36:19.966242 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Converting VIF {"id": "cb90c186-f98f-4d99-8292-e9600576dee1", "address": "fa:16:3e:76:e6:b5", "network": {"id": "1e5f24d0-88c4-41b8-9a87-3e61b964670c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839847895-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9a9429eac2d4f0da28551f059b1deeb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb90c186-f9", "ovs_interfaceid": "cb90c186-f98f-4d99-8292-e9600576dee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:19.966242 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:e6:b5,bridge_name='br-int',has_traffic_filtering=True,id=cb90c186-f98f-4d99-8292-e9600576dee1,network=Network(1e5f24d0-88c4-41b8-9a87-3e61b964670c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb90c186-f9') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:19.966242 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:e6:b5,bridge_name='br-int',has_traffic_filtering=True,id=cb90c186-f98f-4d99-8292-e9600576dee1,network=Network(1e5f24d0-88c4-41b8-9a87-3e61b964670c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb90c186-f9') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:36:19.966242 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:19.966242 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:19.966242 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:36:19.967633 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:19.967633 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a30ccd8-bb77-51de-8561-2dd60dd15190', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:19.968692 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:19.968692 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:20.004213 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:20.007573 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:20.007805 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb90c186-f9, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:20.008276 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb90c186-f9, col_values=(('qos', UUID('8d155394-62f3-49cd-92b8-42eaee1b44bc')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:20.008570 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb90c186-f9, col_values=(('external_ids', {'iface-id': 'cb90c186-f98f-4d99-8292-e9600576dee1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:e6:b5', 'vm-uuid': '7c91d680-72b2-4422-a3c6-fff9714d42cd'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:20.009694 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:20.011557 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:20.052469 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:20.054017 np0000001025 nova-compute[97981]: INFO os_vif [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:e6:b5,bridge_name='br-int',has_traffic_filtering=True,id=cb90c186-f98f-4d99-8292-e9600576dee1,network=Network(1e5f24d0-88c4-41b8-9a87-3e61b964670c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb90c186-f9')
May 19 04:36:20.121220 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-9c1499b6-c716-493e-8f99-a775d9bbc7e7 req-084f0e1e-b7a9-4b8f-ba23-b6e491cb0c1e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:20.186869 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Object Instance<6ea060d2-e149-4189-b93b-66ce319b9157> lazy-loaded attributes: resources,migration_context {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:36:20.348444 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Releasing lock "refresh_cache-b5f34a29-15f7-4f5e-a8bf-574abebd5c84" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:36:20.556807 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:36:20.557500 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:36:20.557668 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] No VIF found with MAC fa:16:3e:3b:78:32, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:36:20.557937 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] No VIF found with MAC fa:16:3e:50:b6:e3, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:36:20.558562 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Using config drive
May 19 04:36:20.725030 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:36:20.725429 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:36:20.799128 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquiring lock "1081cdc6-540d-4cb8-9e0d-d7584411e539" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:20.799277 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:20.799430 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquiring lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:20.799543 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:20.799652 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:20.801397 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Terminating instance
May 19 04:36:20.855266 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-9c1499b6-c716-493e-8f99-a775d9bbc7e7 req-084f0e1e-b7a9-4b8f-ba23-b6e491cb0c1e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:21.069281 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:21.100057 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-9c1499b6-c716-493e-8f99-a775d9bbc7e7 req-084f0e1e-b7a9-4b8f-ba23-b6e491cb0c1e service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Updated VIF entry in instance network info cache for port cb90c186-f98f-4d99-8292-e9600576dee1. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:36:21.101078 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-9c1499b6-c716-493e-8f99-a775d9bbc7e7 req-084f0e1e-b7a9-4b8f-ba23-b6e491cb0c1e service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Updating instance_info_cache with network_info: [{"id": "cb90c186-f98f-4d99-8292-e9600576dee1", "address": "fa:16:3e:76:e6:b5", "network": {"id": "1e5f24d0-88c4-41b8-9a87-3e61b964670c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839847895-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9a9429eac2d4f0da28551f059b1deeb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb90c186-f9", "ovs_interfaceid": "cb90c186-f98f-4d99-8292-e9600576dee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:21.228020 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:36:21.261444 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Creating config drive at /opt/stack/data/nova/instances/63247a98-0dc4-4a87-9141-5ae713a462b5/disk.config
May 19 04:36:21.266954 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/63247a98-0dc4-4a87-9141-5ae713a462b5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplcz1_d7i {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:21.305772 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:36:21.317879 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/63247a98-0dc4-4a87-9141-5ae713a462b5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplcz1_d7i" returned: 0 in 0.051s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:21.400091 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:21.401661 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:21.422229 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:21.426278 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:21.455984 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:21.553839 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:21.585308 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:36:21.585308 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:36:21.585308 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] No VIF found with MAC fa:16:3e:76:e6:b5, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:36:21.586226 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Using config drive
May 19 04:36:21.604176 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9c1499b6-c716-493e-8f99-a775d9bbc7e7 req-084f0e1e-b7a9-4b8f-ba23-b6e491cb0c1e service nova] Releasing lock "refresh_cache-7c91d680-72b2-4422-a3c6-fff9714d42cd" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:36:21.619101 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:21.660282 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-bfef3cd6-878b-46e4-bce5-fafb42eab058 req-a29120f5-67c6-47e0-ade7-8ee203080fa8 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Received event network-vif-unplugged-e0f5a2e8-4380-464f-99dd-c33eaa062d63 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:21.661405 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bfef3cd6-878b-46e4-bce5-fafb42eab058 req-a29120f5-67c6-47e0-ade7-8ee203080fa8 service nova] Acquiring lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:21.662171 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bfef3cd6-878b-46e4-bce5-fafb42eab058 req-a29120f5-67c6-47e0-ade7-8ee203080fa8 service nova] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:21.663153 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bfef3cd6-878b-46e4-bce5-fafb42eab058 req-a29120f5-67c6-47e0-ade7-8ee203080fa8 service nova] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:21.663224 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-bfef3cd6-878b-46e4-bce5-fafb42eab058 req-a29120f5-67c6-47e0-ade7-8ee203080fa8 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] No waiting events found dispatching network-vif-unplugged-e0f5a2e8-4380-464f-99dd-c33eaa062d63 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:21.663388 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-bfef3cd6-878b-46e4-bce5-fafb42eab058 req-a29120f5-67c6-47e0-ade7-8ee203080fa8 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Received event network-vif-unplugged-e0f5a2e8-4380-464f-99dd-c33eaa062d63 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:36:21.751258 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0004325760000938317 future=<Future at 0x72185017c6b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:21.751789 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779165366.7506742, 23196294-f311-4315-a76c-1b9509bfa082 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:21.752027 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:21.752264 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 23196294-f311-4315-a76c-1b9509bfa082] VM Stopped (Lifecycle Event)
May 19 04:36:21.753826 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=10.394497507000096 future=<Future at 0x721850713590 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:21.756297 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=10.394160641000099 future=<Future at 0x721850713590 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:21.986777 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999679613999888 future=<Future at 0x7218345caf60 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:21.991564 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Instance destroyed successfully.
May 19 04:36:21.993954 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lazy-loading 'resources' on Instance uuid 1081cdc6-540d-4cb8-9e0d-d7584411e539 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:22.046555 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:22.098835 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:22.105561 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:22.138960 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:22.187438 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:22.249666 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.067s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:22.249987 np0000001025 nova-compute[97981]: DEBUG nova.compute.rpcapi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97981) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 19 04:36:22.258682 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7a4ca998-fe83-45df-a4c4-dfd866244f8f None None] [instance: 23196294-f311-4315-a76c-1b9509bfa082] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:22.343332 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:22.393349 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:22.397444 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:22.443016 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:22.467017 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Creating config drive at /opt/stack/data/nova/instances/7c91d680-72b2-4422-a3c6-fff9714d42cd/disk.config
May 19 04:36:22.467393 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:22.482140 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7c91d680-72b2-4422-a3c6-fff9714d42cd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1a18l1ex {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:22.502884 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1629521735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1629521735',id=9,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEYnYF79S8BYxQZJ+dMTZjjdbQN3rcn72CWM+baGIlro7OTlpW3xu/PoWXZ+BC9Xw4nxCPqKjMoVyw2hgomsW56DUe6HIHrGodPsGgr/T3ioiXjmvIEBQenW8502hvJuQ==',key_name='tempest-keypair-1597632254',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:35:06Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbef1a3853c14e3daa34b934269bb404',ramdisk_id='',reservation_id='r-xqcyykie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-268161223',owner_user_name='tempest-TaggedAttachmentsTest-268161223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:35:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97454d937cea4489b1c5e2b7dbbde8d5',uuid=1081cdc6-540d-4cb8-9e0d-d7584411e539,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "address": "fa:16:3e:e5:ed:dc", "network": {"id": "637c588b-9807-4474-9ce4-42f9d9631794", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-90879599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f5a2e8-43", "ovs_interfaceid": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:36:22.502884 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Converting VIF {"id": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "address": "fa:16:3e:e5:ed:dc", "network": {"id": "637c588b-9807-4474-9ce4-42f9d9631794", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-90879599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dbef1a3853c14e3daa34b934269bb404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f5a2e8-43", "ovs_interfaceid": "e0f5a2e8-4380-464f-99dd-c33eaa062d63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:22.506310 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:ed:dc,bridge_name='br-int',has_traffic_filtering=True,id=e0f5a2e8-4380-464f-99dd-c33eaa062d63,network=Network(637c588b-9807-4474-9ce4-42f9d9631794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f5a2e8-43') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:22.506310 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:ed:dc,bridge_name='br-int',has_traffic_filtering=True,id=e0f5a2e8-4380-464f-99dd-c33eaa062d63,network=Network(637c588b-9807-4474-9ce4-42f9d9631794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f5a2e8-43') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:36:22.510366 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:22.518728 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0f5a2e8-43, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:22.518728 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999453566000057 future=<Future at 0x721850289010 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:22.520920 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:22.527022 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Instance destroyed successfully.
May 19 04:36:22.530612 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'numa_topology' on Instance uuid b5f34a29-15f7-4f5e-a8bf-574abebd5c84 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:22.547452 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7c91d680-72b2-4422-a3c6-fff9714d42cd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1a18l1ex" returned: 0 in 0.065s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:22.563246 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:22.586207 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:22.614161 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:22.615903 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:22.616212 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f08cddc-7f47-40da-b1a3-b0c30a013c8c) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:22.617562 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:22.641926 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:22.644567 np0000001025 nova-compute[97981]: INFO os_vif [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:ed:dc,bridge_name='br-int',has_traffic_filtering=True,id=e0f5a2e8-4380-464f-99dd-c33eaa062d63,network=Network(637c588b-9807-4474-9ce4-42f9d9631794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f5a2e8-43')
May 19 04:36:22.645220 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Deleting instance files /opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539_del
May 19 04:36:22.648196 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Deletion of /opt/stack/data/nova/instances/1081cdc6-540d-4cb8-9e0d-d7584411e539_del complete
May 19 04:36:22.685251 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:22.740838 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:22.786326 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-dfb527a9-ae2b-4a92-b816-3b14056535ab req-7714df2e-6c65-40c5-9cc8-bfccf98c1e84 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received event network-vif-unplugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:22.786542 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-dfb527a9-ae2b-4a92-b816-3b14056535ab req-7714df2e-6c65-40c5-9cc8-bfccf98c1e84 service nova] Acquiring lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:22.786733 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-dfb527a9-ae2b-4a92-b816-3b14056535ab req-7714df2e-6c65-40c5-9cc8-bfccf98c1e84 service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:22.786863 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-dfb527a9-ae2b-4a92-b816-3b14056535ab req-7714df2e-6c65-40c5-9cc8-bfccf98c1e84 service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:22.787712 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-dfb527a9-ae2b-4a92-b816-3b14056535ab req-7714df2e-6c65-40c5-9cc8-bfccf98c1e84 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] No waiting events found dispatching network-vif-unplugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:22.787712 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-dfb527a9-ae2b-4a92-b816-3b14056535ab req-7714df2e-6c65-40c5-9cc8-bfccf98c1e84 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received unexpected event network-vif-unplugged-fe8167e8-425b-4446-a2e8-84711a2be7dd for instance with vm_state active and task_state rescuing.
May 19 04:36:22.824953 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:22.846736 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:22.896134 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:22.965796 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:22.983405 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:23.004419 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:23.006564 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:23.037006 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Attempting rescue
May 19 04:36:23.037891 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=97981) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 19 04:36:23.041148 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Instance directory exists: not creating {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 19 04:36:23.041275 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Creating image(s)
May 19 04:36:23.041891 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:23.041980 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "/opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:23.042466 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "/opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:23.042669 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'trusted_certs' on Instance uuid b5f34a29-15f7-4f5e-a8bf-574abebd5c84 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:23.145986 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:23.160986 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Took 1.85 seconds to destroy the instance on the hypervisor.
May 19 04:36:23.162777 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:36:23.163067 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:36:23.163475 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:36:23.163828 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:23.184640 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:23.187573 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:23.196532 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:23.209611 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:23.213267 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:23.243179 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:23.255731 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:23.263134 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:23.364331 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:23.481852 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:23.496307 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:23.512576 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:23.546332 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Object Instance<b5f34a29-15f7-4f5e-a8bf-574abebd5c84> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:36:23.546674 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:36:23.551822 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:23.555760 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:36:23.561347 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:23.561347 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:23.561347 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:36:23.565344 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:36:23.565840 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:23.662264 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:23.670325 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.102s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:23.670325 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk.rescue {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:23.695704 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:23.711095 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:23.735192 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk.rescue" returned: 0 in 0.066s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:23.735650 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:23.736032 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'migration_context' on Instance uuid b5f34a29-15f7-4f5e-a8bf-574abebd5c84 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:23.863501 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Swapping old allocation on dict_keys(['086d5ca1-60c6-4d3b-acd3-87b1868e2eb6']) held by migration 43bd7291-90c6-4d03-8188-14763bc4ce41 for instance
May 19 04:36:23.884094 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:23.894390 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:23.987432 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Overwriting current allocation {'allocations': {'086d5ca1-60c6-4d3b-acd3-87b1868e2eb6': {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}, 'generation': 17}}, 'project_id': 'b34124f30156425cbda16473ccedeff4', 'user_id': 'cde403fc60ce4630af81e6bdfa2b4603', 'consumer_generation': 1} on consumer 6ea060d2-e149-4189-b93b-66ce319b9157 {{(pid=97981) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
May 19 04:36:24.133157 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:24.166472 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ab4a77da-d1fb-41e5-9514-7ccfe7ab826a req-ca32e05d-7923-40cd-9d96-ad2f7aaf53f0 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Received event network-vif-unplugged-e0f5a2e8-4380-464f-99dd-c33eaa062d63 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:24.167693 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ab4a77da-d1fb-41e5-9514-7ccfe7ab826a req-ca32e05d-7923-40cd-9d96-ad2f7aaf53f0 service nova] Acquiring lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:24.168386 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ab4a77da-d1fb-41e5-9514-7ccfe7ab826a req-ca32e05d-7923-40cd-9d96-ad2f7aaf53f0 service nova] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:24.168572 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ab4a77da-d1fb-41e5-9514-7ccfe7ab826a req-ca32e05d-7923-40cd-9d96-ad2f7aaf53f0 service nova] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:24.168998 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ab4a77da-d1fb-41e5-9514-7ccfe7ab826a req-ca32e05d-7923-40cd-9d96-ad2f7aaf53f0 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] No waiting events found dispatching network-vif-unplugged-e0f5a2e8-4380-464f-99dd-c33eaa062d63 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:24.169189 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ab4a77da-d1fb-41e5-9514-7ccfe7ab826a req-ca32e05d-7923-40cd-9d96-ad2f7aaf53f0 service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Received event network-vif-unplugged-e0f5a2e8-4380-464f-99dd-c33eaa062d63 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:36:24.169326 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ab4a77da-d1fb-41e5-9514-7ccfe7ab826a req-ca32e05d-7923-40cd-9d96-ad2f7aaf53f0 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-plugged-60124aa0-3747-4d4f-bac3-3c90e62b801c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:24.169487 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ab4a77da-d1fb-41e5-9514-7ccfe7ab826a req-ca32e05d-7923-40cd-9d96-ad2f7aaf53f0 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:24.170176 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ab4a77da-d1fb-41e5-9514-7ccfe7ab826a req-ca32e05d-7923-40cd-9d96-ad2f7aaf53f0 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:24.170176 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ab4a77da-d1fb-41e5-9514-7ccfe7ab826a req-ca32e05d-7923-40cd-9d96-ad2f7aaf53f0 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:24.170176 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ab4a77da-d1fb-41e5-9514-7ccfe7ab826a req-ca32e05d-7923-40cd-9d96-ad2f7aaf53f0 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Processing event network-vif-plugged-60124aa0-3747-4d4f-bac3-3c90e62b801c {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:36:24.170176 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ab4a77da-d1fb-41e5-9514-7ccfe7ab826a req-ca32e05d-7923-40cd-9d96-ad2f7aaf53f0 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-plugged-60124aa0-3747-4d4f-bac3-3c90e62b801c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:24.170349 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ab4a77da-d1fb-41e5-9514-7ccfe7ab826a req-ca32e05d-7923-40cd-9d96-ad2f7aaf53f0 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:24.170388 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ab4a77da-d1fb-41e5-9514-7ccfe7ab826a req-ca32e05d-7923-40cd-9d96-ad2f7aaf53f0 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:24.170494 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ab4a77da-d1fb-41e5-9514-7ccfe7ab826a req-ca32e05d-7923-40cd-9d96-ad2f7aaf53f0 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:24.170654 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ab4a77da-d1fb-41e5-9514-7ccfe7ab826a req-ca32e05d-7923-40cd-9d96-ad2f7aaf53f0 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] No event matching network-vif-plugged-60124aa0-3747-4d4f-bac3-3c90e62b801c in dict_keys([('network-vif-plugged', 'ad71ba07-449a-4565-bd5e-17c050975bd3'), ('network-vif-plugged', '137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a'), ('network-vif-plugged', '55210bd9-f231-4f7e-89be-c5779add4e83'), ('network-vif-plugged', 'c0ec0e22-8097-46a0-93bb-077e4e38a07c'), ('network-vif-plugged', '42811c2a-5e1a-48c2-ae48-869cd5e416e6'), ('network-vif-plugged', 'd7648d4e-3e92-4c77-9347-91670c3b9113')]) {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 19 04:36:24.170783 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-ab4a77da-d1fb-41e5-9514-7ccfe7ab826a req-ca32e05d-7923-40cd-9d96-ad2f7aaf53f0 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received unexpected event network-vif-plugged-60124aa0-3747-4d4f-bac3-3c90e62b801c for instance with vm_state building and task_state spawning.
May 19 04:36:24.170891 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ab4a77da-d1fb-41e5-9514-7ccfe7ab826a req-ca32e05d-7923-40cd-9d96-ad2f7aaf53f0 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-plugged-137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:24.171026 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ab4a77da-d1fb-41e5-9514-7ccfe7ab826a req-ca32e05d-7923-40cd-9d96-ad2f7aaf53f0 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:24.171684 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ab4a77da-d1fb-41e5-9514-7ccfe7ab826a req-ca32e05d-7923-40cd-9d96-ad2f7aaf53f0 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:24.171684 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ab4a77da-d1fb-41e5-9514-7ccfe7ab826a req-ca32e05d-7923-40cd-9d96-ad2f7aaf53f0 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:24.171684 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ab4a77da-d1fb-41e5-9514-7ccfe7ab826a req-ca32e05d-7923-40cd-9d96-ad2f7aaf53f0 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Processing event network-vif-plugged-137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:36:24.202345 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e331771d-762a-4c5e-8d24-cbc7d9a0828b req-4a47dd05-a1a2-402c-bd17-aaa73410d3ff service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Received event network-vif-deleted-e0f5a2e8-4380-464f-99dd-c33eaa062d63 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:24.204164 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-e331771d-762a-4c5e-8d24-cbc7d9a0828b req-4a47dd05-a1a2-402c-bd17-aaa73410d3ff service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Neutron deleted interface e0f5a2e8-4380-464f-99dd-c33eaa062d63; detaching it from the instance and deleting it from the info cache
May 19 04:36:24.204164 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e331771d-762a-4c5e-8d24-cbc7d9a0828b req-4a47dd05-a1a2-402c-bd17-aaa73410d3ff service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:24.221091 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "refresh_cache-6ea060d2-e149-4189-b93b-66ce319b9157" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:36:24.221283 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquired lock "refresh_cache-6ea060d2-e149-4189-b93b-66ce319b9157" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:36:24.221432 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:36:24.240829 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Object Instance<b5f34a29-15f7-4f5e-a8bf-574abebd5c84> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:36:24.241382 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:36:24.241488 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Start _get_guest_xml network_info=[{"id": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "address": "fa:16:3e:7d:73:e6", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "vif_mac": "fa:16:3e:7d:73:e6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe8167e8-42", "ovs_interfaceid": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:36:24.241609 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'resources' on Instance uuid b5f34a29-15f7-4f5e-a8bf-574abebd5c84 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:24.328122 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:24.344210 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:24.346305 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:24.368349 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:24.372429 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:24.431377 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:24.570557 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165384.5701602, 63247a98-0dc4-4a87-9141-5ae713a462b5 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:24.572067 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] VM Started (Lifecycle Event)
May 19 04:36:24.599061 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:24.605218 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:24.616513 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:36:24.616513 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Cleaning up deleted instances {{(pid=97981) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 19 04:36:24.711648 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e331771d-762a-4c5e-8d24-cbc7d9a0828b req-4a47dd05-a1a2-402c-bd17-aaa73410d3ff service nova] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Detach interface failed, port_id=e0f5a2e8-4380-464f-99dd-c33eaa062d63, reason: Instance 1081cdc6-540d-4cb8-9e0d-d7584411e539 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:36:24.726470 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:24.744827 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Object Instance<b5f34a29-15f7-4f5e-a8bf-574abebd5c84> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:36:24.748677 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:36:24.750813 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-610177958', uuid='b5f34a29-15f7-4f5e-a8bf-574abebd5c84'), owner=OwnerMeta(userid='7cdf106961084f0e941b5b65911c9b76', username='tempest-ServerRescueNegativeTestJSON-1305117099-project-member', projectid='334b83c8d3714844830f961673658b20', projectname='tempest-ServerRescueNegativeTestJSON-1305117099'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "address": "fa:16:3e:7d:73:e6", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "vif_mac": "fa:16:3e:7d:73:e6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe8167e8-42", "ovs_interfaceid": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165384.7502522) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:36:24.752288 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:36:24.752554 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:36:24.756243 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:36:24.756243 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:36:24.756801 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:36:24.757049 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:36:24.757222 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:36:24.757311 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:36:24.757472 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:36:24.757582 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:36:24.757731 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:36:24.757963 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:36:24.758154 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:36:24.758317 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:36:24.758471 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:36:24.758647 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:36:24.758850 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'vcpu_model' on Instance uuid b5f34a29-15f7-4f5e-a8bf-574abebd5c84 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:24.906040 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2c610f00-1bd2-48af-9def-cfb084b72265 req-665a2ef8-257f-489b-a7df-0f7291adc728 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received event network-vif-unplugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:24.906149 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2c610f00-1bd2-48af-9def-cfb084b72265 req-665a2ef8-257f-489b-a7df-0f7291adc728 service nova] Acquiring lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:24.906412 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2c610f00-1bd2-48af-9def-cfb084b72265 req-665a2ef8-257f-489b-a7df-0f7291adc728 service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:24.906412 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2c610f00-1bd2-48af-9def-cfb084b72265 req-665a2ef8-257f-489b-a7df-0f7291adc728 service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:24.906735 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2c610f00-1bd2-48af-9def-cfb084b72265 req-665a2ef8-257f-489b-a7df-0f7291adc728 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] No waiting events found dispatching network-vif-unplugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:24.906872 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-2c610f00-1bd2-48af-9def-cfb084b72265 req-665a2ef8-257f-489b-a7df-0f7291adc728 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received unexpected event network-vif-unplugged-fe8167e8-425b-4446-a2e8-84711a2be7dd for instance with vm_state active and task_state rescuing.
May 19 04:36:24.906872 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2c610f00-1bd2-48af-9def-cfb084b72265 req-665a2ef8-257f-489b-a7df-0f7291adc728 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-plugged-ad71ba07-449a-4565-bd5e-17c050975bd3 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:24.907157 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2c610f00-1bd2-48af-9def-cfb084b72265 req-665a2ef8-257f-489b-a7df-0f7291adc728 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:24.907272 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2c610f00-1bd2-48af-9def-cfb084b72265 req-665a2ef8-257f-489b-a7df-0f7291adc728 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:24.907365 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2c610f00-1bd2-48af-9def-cfb084b72265 req-665a2ef8-257f-489b-a7df-0f7291adc728 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:24.907457 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2c610f00-1bd2-48af-9def-cfb084b72265 req-665a2ef8-257f-489b-a7df-0f7291adc728 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Processing event network-vif-plugged-ad71ba07-449a-4565-bd5e-17c050975bd3 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:36:24.934784 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:24.936511 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Took 1.77 seconds to deallocate network for instance.
May 19 04:36:24.942747 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:24.946705 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:24.975224 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:24.983132 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:25.074196 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:25.076285 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165385.0758412, 63247a98-0dc4-4a87-9141-5ae713a462b5 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:25.076454 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] VM Paused (Lifecycle Event)
May 19 04:36:25.088600 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:25.118209 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] There are 0 instances to clean {{(pid=97981) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 19 04:36:25.119203 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:36:25.119389 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Cleaning up deleted instances with incomplete migration  {{(pid=97981) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 19 04:36:25.230785 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Updating instance_info_cache with network_info: [{"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:25.260946 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Object Instance<b5f34a29-15f7-4f5e-a8bf-574abebd5c84> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:36:25.273795 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-610177958',display_name='tempest-ServerRescueNegativeTestJSON-server-610177958',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverrescuenegativetestjson-server-610177958',id=10,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEof4N14+Ak1LVBtAkPut88JFqrfziujXkwzhlzzGWikBF+XeYH2EhInUSGhj5W54Gw3WfzaAmJeE58MxA5o/wrrspO3oas8tLUUdfN0O59dnL6RW93aVKiG3Fu6+namUQ==',key_name='tempest-keypair-541496426',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:35:28Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='334b83c8d3714844830f961673658b20',ramdisk_id='',reservation_id='r-rbufrcjf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1305117099',owner_user_name='tempest-ServerRescueNegativeTestJSON-1305117099-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:35:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cdf106961084f0e941b5b65911c9b76',uuid=b5f34a29-15f7-4f5e-a8bf-574abebd5c84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "address": "fa:16:3e:7d:73:e6", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "vif_mac": "fa:16:3e:7d:73:e6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe8167e8-42", "ovs_interfaceid": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:36:25.273990 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converting VIF {"id": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "address": "fa:16:3e:7d:73:e6", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "vif_mac": "fa:16:3e:7d:73:e6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe8167e8-42", "ovs_interfaceid": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:25.274749 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:73:e6,bridge_name='br-int',has_traffic_filtering=True,id=fe8167e8-425b-4446-a2e8-84711a2be7dd,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe8167e8-42') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:25.275721 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'pci_devices' on Instance uuid b5f34a29-15f7-4f5e-a8bf-574abebd5c84 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:25.445155 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:25.445380 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:25.581728 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:25.585034 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:36:25.622830 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:36:25.733466 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Releasing lock "refresh_cache-6ea060d2-e149-4189-b93b-66ce319b9157" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:36:25.734221 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:36:25.750650 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:36:25.780598 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:25.780973 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Object Instance<b5f34a29-15f7-4f5e-a8bf-574abebd5c84> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:36:25.784495 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] End _get_guest_xml xml=<domain type="qemu">
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:   <uuid>b5f34a29-15f7-4f5e-a8bf-574abebd5c84</uuid>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:   <name>instance-0000000a</name>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-610177958</nova:name>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:36:24</nova:creationTime>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:           <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:           <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:         <nova:user uuid="7cdf106961084f0e941b5b65911c9b76">tempest-ServerRescueNegativeTestJSON-1305117099-project-member</nova:user>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:         <nova:project uuid="334b83c8d3714844830f961673658b20">tempest-ServerRescueNegativeTestJSON-1305117099</nova:project>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:         <nova:port uuid="fe8167e8-425b-4446-a2e8-84711a2be7dd">
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     <system>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <entry name="serial">b5f34a29-15f7-4f5e-a8bf-574abebd5c84</entry>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <entry name="uuid">b5f34a29-15f7-4f5e-a8bf-574abebd5c84</entry>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     </system>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:   <os>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:   </os>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:   <features>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:   </features>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:   <devices>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk.rescue"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <target dev="vdb" bus="virtio"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk.config.rescue"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:7d:73:e6"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <target dev="tapfe8167e8-42"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     </interface>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/console.log" append="off"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     </serial>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     <video>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     </video>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     </rng>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:   </devices>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]: </domain>
May 19 04:36:25.784495 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:36:25.806674 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Instance destroyed successfully.
May 19 04:36:25.824028 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:36:25.824517 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:36:25.833299 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:36:25.834862 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::e86a:f3ff:fee3:83a1', 'fe80::fc16:3eff:fe8a:28ef', 'fe80::fc16:3eff:fe81:2190', 'fe80::fc16:3eff:fe3b:7832', 'fe80::fc16:3eff:fee7:64b0', 'fe80::40da:d4ff:fe7f:36e1', 'fe80::fc16:3eff:fec8:335b', 'fe80::fc16:3eff:fed0:413', 'fe80::fc16:3eff:fe50:b6e3', 'fe80::fc16:3eff:fe10:9776', 'fe80::bb:56ff:fe15:ec7', 'fe80::fc16:3eff:fe2c:e3ec', 'fe80::fc16:3eff:fe76:e6b5', 'fe80::649e:6aff:fe70:3377', 'fe80::f00c:78ff:fe38:37f9'] 
May 19 04:36:25.834993 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:36:25.835461 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:36:25.835665 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:36:25.951449 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:36:25.951716 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:36:26.087083 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:36:26.087384 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165386.0872197, 7c91d680-72b2-4422-a3c6-fff9714d42cd => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:26.087487 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] VM Started (Lifecycle Event)
May 19 04:36:26.125874 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:36:26.244226 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-458d4fd4-8ad0-43db-ba11-991ec0199364 req-38327ef7-fe9e-441c-ba42-9c5b5e63c237 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-plugged-137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:26.244627 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-458d4fd4-8ad0-43db-ba11-991ec0199364 req-38327ef7-fe9e-441c-ba42-9c5b5e63c237 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:26.244627 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-458d4fd4-8ad0-43db-ba11-991ec0199364 req-38327ef7-fe9e-441c-ba42-9c5b5e63c237 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:26.244698 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-458d4fd4-8ad0-43db-ba11-991ec0199364 req-38327ef7-fe9e-441c-ba42-9c5b5e63c237 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:26.244799 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-458d4fd4-8ad0-43db-ba11-991ec0199364 req-38327ef7-fe9e-441c-ba42-9c5b5e63c237 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] No event matching network-vif-plugged-137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a in dict_keys([('network-vif-plugged', '55210bd9-f231-4f7e-89be-c5779add4e83'), ('network-vif-plugged', 'c0ec0e22-8097-46a0-93bb-077e4e38a07c'), ('network-vif-plugged', '42811c2a-5e1a-48c2-ae48-869cd5e416e6'), ('network-vif-plugged', 'd7648d4e-3e92-4c77-9347-91670c3b9113')]) {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 19 04:36:26.244941 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-458d4fd4-8ad0-43db-ba11-991ec0199364 req-38327ef7-fe9e-441c-ba42-9c5b5e63c237 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received unexpected event network-vif-plugged-137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a for instance with vm_state building and task_state spawning.
May 19 04:36:26.302266 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-efbf03ea-6431-4dba-a76b-d9b650b7509f req-28e6afa8-1f10-4968-993f-d119761f1704 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-plugged-55210bd9-f231-4f7e-89be-c5779add4e83 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:26.303090 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-efbf03ea-6431-4dba-a76b-d9b650b7509f req-28e6afa8-1f10-4968-993f-d119761f1704 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:26.303090 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-efbf03ea-6431-4dba-a76b-d9b650b7509f req-28e6afa8-1f10-4968-993f-d119761f1704 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:26.303090 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-efbf03ea-6431-4dba-a76b-d9b650b7509f req-28e6afa8-1f10-4968-993f-d119761f1704 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:26.303261 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-efbf03ea-6431-4dba-a76b-d9b650b7509f req-28e6afa8-1f10-4968-993f-d119761f1704 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Processing event network-vif-plugged-55210bd9-f231-4f7e-89be-c5779add4e83 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:36:26.304234 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-efbf03ea-6431-4dba-a76b-d9b650b7509f req-28e6afa8-1f10-4968-993f-d119761f1704 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-plugged-55210bd9-f231-4f7e-89be-c5779add4e83 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:26.304234 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-efbf03ea-6431-4dba-a76b-d9b650b7509f req-28e6afa8-1f10-4968-993f-d119761f1704 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:26.304234 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-efbf03ea-6431-4dba-a76b-d9b650b7509f req-28e6afa8-1f10-4968-993f-d119761f1704 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:26.304234 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-efbf03ea-6431-4dba-a76b-d9b650b7509f req-28e6afa8-1f10-4968-993f-d119761f1704 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:26.304234 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-efbf03ea-6431-4dba-a76b-d9b650b7509f req-28e6afa8-1f10-4968-993f-d119761f1704 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] No event matching network-vif-plugged-55210bd9-f231-4f7e-89be-c5779add4e83 in dict_keys([('network-vif-plugged', 'c0ec0e22-8097-46a0-93bb-077e4e38a07c'), ('network-vif-plugged', '42811c2a-5e1a-48c2-ae48-869cd5e416e6'), ('network-vif-plugged', 'd7648d4e-3e92-4c77-9347-91670c3b9113')]) {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 19 04:36:26.304234 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-efbf03ea-6431-4dba-a76b-d9b650b7509f req-28e6afa8-1f10-4968-993f-d119761f1704 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received unexpected event network-vif-plugged-55210bd9-f231-4f7e-89be-c5779add4e83 for instance with vm_state building and task_state spawning.
May 19 04:36:26.304234 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-efbf03ea-6431-4dba-a76b-d9b650b7509f req-28e6afa8-1f10-4968-993f-d119761f1704 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-plugged-c0ec0e22-8097-46a0-93bb-077e4e38a07c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:26.304742 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-efbf03ea-6431-4dba-a76b-d9b650b7509f req-28e6afa8-1f10-4968-993f-d119761f1704 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:26.304742 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-efbf03ea-6431-4dba-a76b-d9b650b7509f req-28e6afa8-1f10-4968-993f-d119761f1704 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:26.304857 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-efbf03ea-6431-4dba-a76b-d9b650b7509f req-28e6afa8-1f10-4968-993f-d119761f1704 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:26.305042 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-efbf03ea-6431-4dba-a76b-d9b650b7509f req-28e6afa8-1f10-4968-993f-d119761f1704 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Processing event network-vif-plugged-c0ec0e22-8097-46a0-93bb-077e4e38a07c {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:36:26.305197 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-efbf03ea-6431-4dba-a76b-d9b650b7509f req-28e6afa8-1f10-4968-993f-d119761f1704 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-plugged-c0ec0e22-8097-46a0-93bb-077e4e38a07c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:26.305575 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-efbf03ea-6431-4dba-a76b-d9b650b7509f req-28e6afa8-1f10-4968-993f-d119761f1704 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:26.305703 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-efbf03ea-6431-4dba-a76b-d9b650b7509f req-28e6afa8-1f10-4968-993f-d119761f1704 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:26.305886 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-efbf03ea-6431-4dba-a76b-d9b650b7509f req-28e6afa8-1f10-4968-993f-d119761f1704 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:26.306056 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-efbf03ea-6431-4dba-a76b-d9b650b7509f req-28e6afa8-1f10-4968-993f-d119761f1704 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] No event matching network-vif-plugged-c0ec0e22-8097-46a0-93bb-077e4e38a07c in dict_keys([('network-vif-plugged', '42811c2a-5e1a-48c2-ae48-869cd5e416e6'), ('network-vif-plugged', 'd7648d4e-3e92-4c77-9347-91670c3b9113')]) {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 19 04:36:26.306208 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-efbf03ea-6431-4dba-a76b-d9b650b7509f req-28e6afa8-1f10-4968-993f-d119761f1704 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received unexpected event network-vif-plugged-c0ec0e22-8097-46a0-93bb-077e4e38a07c for instance with vm_state building and task_state spawning.
May 19 04:36:26.454805 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:36:26.590252 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:26.591796 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165386.5914924, 7c91d680-72b2-4422-a3c6-fff9714d42cd => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:26.591935 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] VM Paused (Lifecycle Event)
May 19 04:36:26.601677 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:26.788223 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Acquiring lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:26.788458 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:26.921838 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Starting finish_revert_migration {{(pid=97981) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12932}}
May 19 04:36:26.938690 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Start _get_guest_xml network_info=[{"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': 'c821a867-f811-46cd-9b38-f3dda87353f3', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b25ba87-624c-4d65-b535-95d5d14da486', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '6ea060d2-e149-4189-b93b-66ce319b9157', 'attached_at': '2026-05-19T04:36:26.000000', 'detached_at': '', 'volume_id': '4b25ba87-624c-4d65-b535-95d5d14da486', 'serial': '4b25ba87-624c-4d65-b535-95d5d14da486'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:36:26.940277 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:36:26.941657 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1325996205', uuid='6ea060d2-e149-4189-b93b-66ce319b9157'), owner=OwnerMeta(userid='cde403fc60ce4630af81e6bdfa2b4603', username='tempest-ServerActionsTestOtherB-1000009728-project-member', projectid='b34124f30156425cbda16473ccedeff4', projectname='tempest-ServerActionsTestOtherB-1000009728'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165386.9412735) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:36:26.942536 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:36:26.942919 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:36:26.943673 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:36:26.943881 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:36:26.945021 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:36:26.945317 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:36:26.945545 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:36:26.945643 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:36:26.945775 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:36:26.945894 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:36:26.946010 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:36:26.946219 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:36:26.946528 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:36:26.946711 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:36:26.946808 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:36:26.946963 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:36:26.947161 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6ea060d2-e149-4189-b93b-66ce319b9157 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:26.967134 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.522s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:27.017138 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-526db188-c327-459e-8ee3-54a0fb9ebd45 req-52bbabc4-fe3f-44da-a435-f9b77edb3843 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-plugged-ad71ba07-449a-4565-bd5e-17c050975bd3 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:27.017421 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-526db188-c327-459e-8ee3-54a0fb9ebd45 req-52bbabc4-fe3f-44da-a435-f9b77edb3843 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:27.017535 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-526db188-c327-459e-8ee3-54a0fb9ebd45 req-52bbabc4-fe3f-44da-a435-f9b77edb3843 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:27.017758 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-526db188-c327-459e-8ee3-54a0fb9ebd45 req-52bbabc4-fe3f-44da-a435-f9b77edb3843 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:27.017882 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-526db188-c327-459e-8ee3-54a0fb9ebd45 req-52bbabc4-fe3f-44da-a435-f9b77edb3843 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] No event matching network-vif-plugged-ad71ba07-449a-4565-bd5e-17c050975bd3 in dict_keys([('network-vif-plugged', '42811c2a-5e1a-48c2-ae48-869cd5e416e6'), ('network-vif-plugged', 'd7648d4e-3e92-4c77-9347-91670c3b9113')]) {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 19 04:36:27.018023 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-526db188-c327-459e-8ee3-54a0fb9ebd45 req-52bbabc4-fe3f-44da-a435-f9b77edb3843 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received unexpected event network-vif-plugged-ad71ba07-449a-4565-bd5e-17c050975bd3 for instance with vm_state building and task_state spawning.
May 19 04:36:27.018926 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-526db188-c327-459e-8ee3-54a0fb9ebd45 req-52bbabc4-fe3f-44da-a435-f9b77edb3843 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Received event network-vif-plugged-cb90c186-f98f-4d99-8292-e9600576dee1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:27.018926 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-526db188-c327-459e-8ee3-54a0fb9ebd45 req-52bbabc4-fe3f-44da-a435-f9b77edb3843 service nova] Acquiring lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:27.018926 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-526db188-c327-459e-8ee3-54a0fb9ebd45 req-52bbabc4-fe3f-44da-a435-f9b77edb3843 service nova] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:27.018926 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-526db188-c327-459e-8ee3-54a0fb9ebd45 req-52bbabc4-fe3f-44da-a435-f9b77edb3843 service nova] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:27.018926 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-526db188-c327-459e-8ee3-54a0fb9ebd45 req-52bbabc4-fe3f-44da-a435-f9b77edb3843 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Processing event network-vif-plugged-cb90c186-f98f-4d99-8292-e9600576dee1 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:36:27.018926 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-526db188-c327-459e-8ee3-54a0fb9ebd45 req-52bbabc4-fe3f-44da-a435-f9b77edb3843 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Received event network-vif-plugged-cb90c186-f98f-4d99-8292-e9600576dee1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:27.018926 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-526db188-c327-459e-8ee3-54a0fb9ebd45 req-52bbabc4-fe3f-44da-a435-f9b77edb3843 service nova] Acquiring lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:27.019290 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-526db188-c327-459e-8ee3-54a0fb9ebd45 req-52bbabc4-fe3f-44da-a435-f9b77edb3843 service nova] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:27.020366 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:36:27.020535 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-526db188-c327-459e-8ee3-54a0fb9ebd45 req-52bbabc4-fe3f-44da-a435-f9b77edb3843 service nova] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:27.020768 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-526db188-c327-459e-8ee3-54a0fb9ebd45 req-52bbabc4-fe3f-44da-a435-f9b77edb3843 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] No waiting events found dispatching network-vif-plugged-cb90c186-f98f-4d99-8292-e9600576dee1 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:27.020900 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-526db188-c327-459e-8ee3-54a0fb9ebd45 req-52bbabc4-fe3f-44da-a435-f9b77edb3843 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Received unexpected event network-vif-plugged-cb90c186-f98f-4d99-8292-e9600576dee1 for instance with vm_state building and task_state spawning.
May 19 04:36:27.025888 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Deleted allocations for instance 1081cdc6-540d-4cb8-9e0d-d7584411e539
May 19 04:36:27.029118 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:36:27.032617 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:27.038461 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Instance spawned successfully.
May 19 04:36:27.041075 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:36:27.095179 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:27.100267 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165387.0999637, 7c91d680-72b2-4422-a3c6-fff9714d42cd => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:27.100413 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] VM Resumed (Lifecycle Event)
May 19 04:36:27.291278 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:36:27.334542 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:36:27.334542 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:36:27.334542 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:36:27.334542 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] No VIF found with MAC fa:16:3e:7d:73:e6, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:36:27.335096 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Using config drive
May 19 04:36:27.465155 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk.config --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:27.547783 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:27.547941 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:27.548257 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:27.548510 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:27.548808 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:27.549119 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:27.557497 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk.config --force-share --output=json" returned: 0 in 0.093s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:27.557979 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:27.558235 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "/opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:27.558747 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "/opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:27.559065 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:36:27.559454 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b25ba87-624c-4d65-b535-95d5d14da486', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:36:27.559620 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:27.559964 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:27.560212 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b25ba87-624c-4d65-b535-95d5d14da486', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:36:27.577736 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:27.578635 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:27.579376 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:27.579626 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:36:27.580741 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:27.581079 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:36:27.595526 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:36:27.595526 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:27.602815 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:27.603449 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:36:27.603449 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:27.605221 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:36:27.614264 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486] added
May 19 04:36:27.614264 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:36:27.614264 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:27.614264 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:27.614264 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:27.614264 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:27.614264 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:27.614622 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:36:27.615154 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0355(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:36:27.616083 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486] added
May 19 04:36:27.616083 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:36:27.616083 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:27.616083 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:27.616083 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:27.616083 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:27.616083 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:27.616414 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:36:27.616548 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:36:27.616689 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0357(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:36:27.616799 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:36:27.623809 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:27.838554 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'ec2_ids' on Instance uuid b5f34a29-15f7-4f5e-a8bf-574abebd5c84 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:27.859371 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:27.859371 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:27.865958 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:36:27.866127 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Claim successful on node np0000001025
May 19 04:36:27.985137 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:28.043643 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-26dfc93c-a2a4-408b-969c-db1449d145f3 tempest-TaggedAttachmentsTest-268161223 tempest-TaggedAttachmentsTest-268161223-project-member] Lock "1081cdc6-540d-4cb8-9e0d-d7584411e539" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.244s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:28.056759 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Took 9.97 seconds to spawn the instance on the hypervisor.
May 19 04:36:28.056759 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:28.108140 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:36:28.343711 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Object Instance<b5f34a29-15f7-4f5e-a8bf-574abebd5c84> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:36:28.344037 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'keypairs' on Instance uuid b5f34a29-15f7-4f5e-a8bf-574abebd5c84 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:28.389491 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b976b8db-5ccb-4e0b-a5c9-fee777b53bcd req-ffe835b6-47b2-457b-84e3-1165523e886e service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-plugged-42811c2a-5e1a-48c2-ae48-869cd5e416e6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:28.390471 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b976b8db-5ccb-4e0b-a5c9-fee777b53bcd req-ffe835b6-47b2-457b-84e3-1165523e886e service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:28.390471 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b976b8db-5ccb-4e0b-a5c9-fee777b53bcd req-ffe835b6-47b2-457b-84e3-1165523e886e service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:28.390471 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b976b8db-5ccb-4e0b-a5c9-fee777b53bcd req-ffe835b6-47b2-457b-84e3-1165523e886e service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:28.390471 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b976b8db-5ccb-4e0b-a5c9-fee777b53bcd req-ffe835b6-47b2-457b-84e3-1165523e886e service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Processing event network-vif-plugged-42811c2a-5e1a-48c2-ae48-869cd5e416e6 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:36:28.390904 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b976b8db-5ccb-4e0b-a5c9-fee777b53bcd req-ffe835b6-47b2-457b-84e3-1165523e886e service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-plugged-42811c2a-5e1a-48c2-ae48-869cd5e416e6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:28.393023 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b976b8db-5ccb-4e0b-a5c9-fee777b53bcd req-ffe835b6-47b2-457b-84e3-1165523e886e service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:28.393023 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b976b8db-5ccb-4e0b-a5c9-fee777b53bcd req-ffe835b6-47b2-457b-84e3-1165523e886e service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:28.393023 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b976b8db-5ccb-4e0b-a5c9-fee777b53bcd req-ffe835b6-47b2-457b-84e3-1165523e886e service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:28.393023 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b976b8db-5ccb-4e0b-a5c9-fee777b53bcd req-ffe835b6-47b2-457b-84e3-1165523e886e service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] No event matching network-vif-plugged-42811c2a-5e1a-48c2-ae48-869cd5e416e6 in dict_keys([('network-vif-plugged', 'd7648d4e-3e92-4c77-9347-91670c3b9113')]) {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 19 04:36:28.393023 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-b976b8db-5ccb-4e0b-a5c9-fee777b53bcd req-ffe835b6-47b2-457b-84e3-1165523e886e service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received unexpected event network-vif-plugged-42811c2a-5e1a-48c2-ae48-869cd5e416e6 for instance with vm_state building and task_state spawning.
May 19 04:36:28.393023 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b976b8db-5ccb-4e0b-a5c9-fee777b53bcd req-ffe835b6-47b2-457b-84e3-1165523e886e service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-plugged-d7648d4e-3e92-4c77-9347-91670c3b9113 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:28.393023 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b976b8db-5ccb-4e0b-a5c9-fee777b53bcd req-ffe835b6-47b2-457b-84e3-1165523e886e service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:28.393023 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b976b8db-5ccb-4e0b-a5c9-fee777b53bcd req-ffe835b6-47b2-457b-84e3-1165523e886e service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:28.393023 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b976b8db-5ccb-4e0b-a5c9-fee777b53bcd req-ffe835b6-47b2-457b-84e3-1165523e886e service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:28.393023 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b976b8db-5ccb-4e0b-a5c9-fee777b53bcd req-ffe835b6-47b2-457b-84e3-1165523e886e service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Processing event network-vif-plugged-d7648d4e-3e92-4c77-9347-91670c3b9113 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:36:28.394214 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b976b8db-5ccb-4e0b-a5c9-fee777b53bcd req-ffe835b6-47b2-457b-84e3-1165523e886e service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-plugged-d7648d4e-3e92-4c77-9347-91670c3b9113 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:28.394897 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Instance event wait completed in 3 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:36:28.399169 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b976b8db-5ccb-4e0b-a5c9-fee777b53bcd req-ffe835b6-47b2-457b-84e3-1165523e886e service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:28.400199 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b976b8db-5ccb-4e0b-a5c9-fee777b53bcd req-ffe835b6-47b2-457b-84e3-1165523e886e service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:28.400199 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b976b8db-5ccb-4e0b-a5c9-fee777b53bcd req-ffe835b6-47b2-457b-84e3-1165523e886e service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:28.400199 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b976b8db-5ccb-4e0b-a5c9-fee777b53bcd req-ffe835b6-47b2-457b-84e3-1165523e886e service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] No waiting events found dispatching network-vif-plugged-d7648d4e-3e92-4c77-9347-91670c3b9113 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:28.400199 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-b976b8db-5ccb-4e0b-a5c9-fee777b53bcd req-ffe835b6-47b2-457b-84e3-1165523e886e service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received unexpected event network-vif-plugged-d7648d4e-3e92-4c77-9347-91670c3b9113 for instance with vm_state building and task_state spawning.
May 19 04:36:28.403632 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:36:28.404410 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165388.4041774, 63247a98-0dc4-4a87-9141-5ae713a462b5 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:28.404574 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] VM Resumed (Lifecycle Event)
May 19 04:36:28.414757 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Instance spawned successfully.
May 19 04:36:28.414757 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:36:28.544419 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Acquiring lock "f66a2b29-93d1-468a-94fc-77679fce8d64" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:28.544649 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "f66a2b29-93d1-468a-94fc-77679fce8d64" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:28.569095 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Took 15.64 seconds to build instance.
May 19 04:36:28.616845 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:36:28.617208 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:36:28.629147 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:36:28.629147 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:36:28.636274 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:36:28.636274 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:28.642229 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:28.648480 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:28.659377 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:28.659377 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:28.659377 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:28.659377 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:28.659377 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:28.659377 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:28.659377 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:28.659377 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:28.659377 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:28.659665 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:28.659665 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:28.659665 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:28.659665 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:28.659665 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:28.659665 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:28.659665 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:28.659665 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:28.659665 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:28.666835 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:28.666835 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:28.666835 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:28.666835 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:28.666835 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:28.666835 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:28.666835 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:28.666835 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:28.666835 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:28.667228 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:28.667228 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:28.667228 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:28.667228 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:28.667228 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:28.667228 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:28.667228 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:28.667228 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:28.667228 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:28.713602 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.50.100,3260]
May 19 04:36:28.713602 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.50.100,3260] successful.
May 19 04:36:28.713602 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:28.721827 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.40.100,3260]
May 19 04:36:28.721827 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.40.100,3260] successful.
May 19 04:36:28.721827 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:28.726264 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:28.734542 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:28.747244 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:28.747244 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:28.747244 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:28.747244 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:28.747244 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:28.747244 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:28.747244 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:28.747244 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:28.747244 np0000001025 nova-compute[97981]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:28.747244 np0000001025 nova-compute[97981]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:28.747244 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:28.747484 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:28.747484 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:28.747484 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:28.747484 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:28.747484 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:28.747484 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:28.747484 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:28.747484 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:28.747484 np0000001025 nova-compute[97981]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:28.747484 np0000001025 nova-compute[97981]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:28.747484 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:28.747768 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:28.747980 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:36:28.749218 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] HCTL ('11', '-', '-', 0) found on session 29 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:36:28.749357 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:36:28.754281 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:28.754281 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:28.754281 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:28.754281 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:28.754281 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:28.754281 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:28.754281 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:28.754281 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:28.754281 np0000001025 nova-compute[97981]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:28.754281 np0000001025 nova-compute[97981]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:28.754281 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:28.754741 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:28.754741 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:28.754741 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:28.754741 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:28.754741 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:28.754741 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:28.754741 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:28.754741 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:28.754741 np0000001025 nova-compute[97981]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:28.754741 np0000001025 nova-compute[97981]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:28.754741 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:28.754741 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:28.754953 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:36:28.755733 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] HCTL ('12', '-', '-', 0) found on session 30 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:36:28.755862 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:36:28.765656 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Searching for a device in session 29 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:36:28.765656 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4b25ba87-624c-4d65-b535-95d5d14da486', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:36:28.772874 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Searching for a device in session 30 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:36:28.773916 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b25ba87-624c-4d65-b535-95d5d14da486', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:36:28.852032 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Object Instance<b5f34a29-15f7-4f5e-a8bf-574abebd5c84> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:36:28.855635 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:28.910022 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:28.912401 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:36:28.921178 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:28.921317 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:28.921633 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:28.921912 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:28.922386 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:28.922665 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:29.020516 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Creating config drive at /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk.config.rescue
May 19 04:36:29.024910 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2k8dt31r {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:29.047920 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:36:29.072122 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8f3ef06a-21cf-44a6-a76f-cadef8760f12 tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.147s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:29.082004 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2k8dt31r" returned: 0 in 0.057s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:29.128883 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:36:29.129697 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:36:29.130145 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:36:29.130501 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:36:29.130851 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.48 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:36:29.415838 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:36:29.443297 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Took 36.53 seconds to spawn the instance on the hypervisor.
May 19 04:36:29.443542 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:29.503510 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:36:29.503943 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:36:29.582029 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:36:29.619018 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:36:29.619518 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:36:29.627077 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:29.633921 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:29.659125 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:29.750099 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:29.790404 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:29.794729 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:29.955317 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Took 51.40 seconds to build instance.
May 19 04:36:30.007462 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:36:30.126974 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:30.151909 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-19a4571a-15ea-4fea-8344-c2158623133a req-64997075-a857-4e6c-9bec-78c9d08be433 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received event network-vif-plugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:30.152493 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-19a4571a-15ea-4fea-8344-c2158623133a req-64997075-a857-4e6c-9bec-78c9d08be433 service nova] Acquiring lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:30.152677 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-19a4571a-15ea-4fea-8344-c2158623133a req-64997075-a857-4e6c-9bec-78c9d08be433 service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:30.152822 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-19a4571a-15ea-4fea-8344-c2158623133a req-64997075-a857-4e6c-9bec-78c9d08be433 service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:30.152954 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-19a4571a-15ea-4fea-8344-c2158623133a req-64997075-a857-4e6c-9bec-78c9d08be433 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] No waiting events found dispatching network-vif-plugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:30.153069 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-19a4571a-15ea-4fea-8344-c2158623133a req-64997075-a857-4e6c-9bec-78c9d08be433 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received unexpected event network-vif-plugged-fe8167e8-425b-4446-a2e8-84711a2be7dd for instance with vm_state active and task_state rescuing.
May 19 04:36:30.456711 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9880480b-fad7-4a59-bd86-7eec3a7d6133 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 52.904s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:30.508448 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Removed pending STOPPED event for b5f34a29-15f7-4f5e-a8bf-574abebd5c84 due to new event <LifecycleEvent: 1779165390.5081012, b5f34a29-15f7-4f5e-a8bf-574abebd5c84 => Resumed> {{(pid=97981) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 19 04:36:30.509676 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165390.5081012, b5f34a29-15f7-4f5e-a8bf-574abebd5c84 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:30.509676 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] VM Resumed (Lifecycle Event)
May 19 04:36:30.515528 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.656s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:30.515839 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:36:30.521070 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.883s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:30.523185 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9f9ef8dc-3b6c-49fb-a800-496d63861a81 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:30.530472 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:36:30.530728 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Claim successful on node np0000001025
May 19 04:36:30.600402 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Found WWN 330000000b045a358 for multipath device dm-4 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:36:30.600751 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:30.600927 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '330000000b045a358', 'path': '/dev/dm-4', 'multipath_id': '330000000b045a358'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:36:30.601033 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b045a358', 'path': '/dev/dm-4', 'multipath_id': '330000000b045a358'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:36:31.023719 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:31.027678 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:36:31.027833 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:36:31.031152 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:31.031330 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:31.034700 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:36:31.083702 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:31.105862 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1325996205',display_name='tempest-ServerActionsTestOtherB-server-1325996205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serveractionstestotherb-server-1325996205',id=8,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3jK8eIICR3l/4SHxst/8yPlILpDesN4+H3trAm2UFhRABDmHluvxgOWTGKox1jLYWeyqvab+bX/g483yAyobp3jhS/ZI5/84mWYZjjvl9ViemWFe558Ts8/0C9LeWLvw==',key_name='tempest-keypair-958107194',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:36:12Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001025',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b34124f30156425cbda16473ccedeff4',ramdisk_id='',reservation_id='r-k74jcc1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1000009728',owner_user_name='tempest-ServerActionsTestOtherB-1000009728-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cde403fc60ce4630af81e6bdfa2b4603',uuid=6ea060d2-e149-4189-b93b-66ce319b9157,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:36:31.106077 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Converting VIF {"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:31.106616 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:b1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7cdc75ea-9f5f-4944-92ae-1788cf00aea2,network=Network(8114a6bf-054f-469f-a788-9fd489f4ee76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cdc75ea-9f') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:31.108152 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] End _get_guest_xml xml=<domain type="qemu">
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:   <uuid>6ea060d2-e149-4189-b93b-66ce319b9157</uuid>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:   <name>instance-00000008</name>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServerActionsTestOtherB-server-1325996205</nova:name>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:36:26</nova:creationTime>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:           <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:           <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:         <nova:user uuid="cde403fc60ce4630af81e6bdfa2b4603">tempest-ServerActionsTestOtherB-1000009728-project-member</nova:user>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:         <nova:project uuid="b34124f30156425cbda16473ccedeff4">tempest-ServerActionsTestOtherB-1000009728</nova:project>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:         <nova:port uuid="7cdc75ea-9f5f-4944-92ae-1788cf00aea2">
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     <system>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <entry name="serial">6ea060d2-e149-4189-b93b-66ce319b9157</entry>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <entry name="uuid">6ea060d2-e149-4189-b93b-66ce319b9157</entry>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     </system>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:   <os>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:   </os>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:   <features>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:   </features>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:   <devices>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk.config"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <alias name="ua-4b25ba87-624c-4d65-b535-95d5d14da486"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-4"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <target dev="vdb" bus="virtio"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <serial>4b25ba87-624c-4d65-b535-95d5d14da486</serial>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:40:b1:c7"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <target dev="tap7cdc75ea-9f"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     </interface>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/console.log" append="off"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     </serial>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     <video>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     </video>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     </rng>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:   </devices>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]: </domain>
May 19 04:36:31.108152 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:36:31.110224 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Preparing to wait for external event network-vif-plugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:36:31.110224 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:31.110224 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:31.110224 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:31.110224 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1325996205',display_name='tempest-ServerActionsTestOtherB-server-1325996205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serveractionstestotherb-server-1325996205',id=8,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3jK8eIICR3l/4SHxst/8yPlILpDesN4+H3trAm2UFhRABDmHluvxgOWTGKox1jLYWeyqvab+bX/g483yAyobp3jhS/ZI5/84mWYZjjvl9ViemWFe558Ts8/0C9LeWLvw==',key_name='tempest-keypair-958107194',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:36:12Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001025',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b34124f30156425cbda16473ccedeff4',ramdisk_id='',reservation_id='r-k74jcc1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1000009728',owner_user_name='tempest-ServerActionsTestOtherB-1000009728-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cde403fc60ce4630af81e6bdfa2b4603',uuid=6ea060d2-e149-4189-b93b-66ce319b9157,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:36:31.110224 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Converting VIF {"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:31.110224 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:b1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7cdc75ea-9f5f-4944-92ae-1788cf00aea2,network=Network(8114a6bf-054f-469f-a788-9fd489f4ee76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cdc75ea-9f') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:31.110224 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:b1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7cdc75ea-9f5f-4944-92ae-1788cf00aea2,network=Network(8114a6bf-054f-469f-a788-9fd489f4ee76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cdc75ea-9f') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:36:31.110583 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:31.110813 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:31.111033 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:36:31.112038 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:31.112232 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0c494f0-3a9f-5aa8-8f24-c9a8e8e7579a', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:31.113384 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:31.113818 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:31.114765 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:31.118219 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:31.118364 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cdc75ea-9f, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:31.118663 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cdc75ea-9f, col_values=(('qos', UUID('a98e32a4-4fdd-41dd-93e8-0e589c628b07')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:31.118816 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cdc75ea-9f, col_values=(('external_ids', {'iface-id': '7cdc75ea-9f5f-4944-92ae-1788cf00aea2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:b1:c7', 'vm-uuid': '6ea060d2-e149-4189-b93b-66ce319b9157'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:31.119971 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:31.121070 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:31.125849 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:31.127418 np0000001025 nova-compute[97981]: INFO os_vif [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:b1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7cdc75ea-9f5f-4944-92ae-1788cf00aea2,network=Network(8114a6bf-054f-469f-a788-9fd489f4ee76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cdc75ea-9f')
May 19 04:36:31.264169 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c66118759a7481ea214f9d98369ec54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1b00cc4af14242a0806348f4fa9117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:36:31.528991 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:36:31.536845 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165391.5363672, b5f34a29-15f7-4f5e-a8bf-574abebd5c84 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:31.537793 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] VM Started (Lifecycle Event)
May 19 04:36:31.704414 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:31.737990 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:31.737990 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:31.854003 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:32.033385 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:36:32.042084 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:32.044439 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:36:32.132289 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Successfully created port: 74481730-a000-4409-b576-63d4431e1ac9 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:36:32.141401 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:32.149301 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0003146340000057535 future=<Future at 0x721850713590 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:32.149301 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:32.149301 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=4.8370325999999295 future=<Future at 0x7218345caf60 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:32.149301 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=4.8369581550000476 future=<Future at 0x7218345caf60 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:32.150719 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-7a4ca998-fe83-45df-a4c4-dfd866244f8f None None] Emitting event <LifecycleEvent: 1779165377.1481595, 6ea060d2-e149-4189-b93b-66ce319b9157 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:32.151003 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-7a4ca998-fe83-45df-a4c4-dfd866244f8f None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] VM Stopped (Lifecycle Event)
May 19 04:36:32.172750 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:32.188774 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:36:32.189054 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:36:32.543134 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Booting with volume 7f5972c8-8c2c-4892-aa74-3f37c4c31496 at /dev/vda
May 19 04:36:32.591669 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:32.619774 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:36:32.632079 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:36:32.655469 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7a4ca998-fe83-45df-a4c4-dfd866244f8f None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:32.658872 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:32.697997 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:36:32.711560 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:36:32.711915 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:36:32.727794 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:36:32.730873 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::e86a:f3ff:fee3:83a1', 'fe80::fc16:3eff:fe8a:28ef', 'fe80::fc16:3eff:fe81:2190', 'fe80::fc16:3eff:fe3b:7832', 'fe80::fc16:3eff:fee7:64b0', 'fe80::40da:d4ff:fe7f:36e1', 'fe80::fc16:3eff:fec8:335b', 'fe80::fc16:3eff:fed0:413', 'fe80::fc16:3eff:fe50:b6e3', 'fe80::fc16:3eff:fe10:9776', 'fe80::bb:56ff:fe15:ec7', 'fe80::fc16:3eff:fe2c:e3ec', 'fe80::fc16:3eff:fe76:e6b5', 'fe80::649e:6aff:fe70:3377', 'fe80::f00c:78ff:fe38:37f9', 'fe80::fc16:3eff:fe7d:73e6', 'fe80::fc16:3eff:fe40:b1c7', 'fe80::74d3:60ff:fec2:dcbf'] 
May 19 04:36:32.730873 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:36:32.730873 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:36:32.731890 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:36:32.732816 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Updating existing volume attachment record: ff91c28e-9940-4560-b6f0-8591d717347e {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:36:32.814632 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165392.81304, 6ea060d2-e149-4189-b93b-66ce319b9157 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:32.814632 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] VM Started (Lifecycle Event)
May 19 04:36:32.986040 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:33.148213 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Successfully updated port: 74481730-a000-4409-b576-63d4431e1ac9 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:36:33.214392 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.698s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:33.214945 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:36:33.221002 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 3.094s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:33.221192 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:33.221420 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:36:33.316857 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:33.320312 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165393.3198218, 6ea060d2-e149-4189-b93b-66ce319b9157 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:33.320312 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] VM Paused (Lifecycle Event)
May 19 04:36:33.465634 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-001def99-a2fa-4e73-8c3b-fa288bbe72b1 req-7fa36cf7-687c-4a72-85be-08be874c970c service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received event network-vif-plugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:33.465876 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-001def99-a2fa-4e73-8c3b-fa288bbe72b1 req-7fa36cf7-687c-4a72-85be-08be874c970c service nova] Acquiring lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:33.466204 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-001def99-a2fa-4e73-8c3b-fa288bbe72b1 req-7fa36cf7-687c-4a72-85be-08be874c970c service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:33.466315 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-001def99-a2fa-4e73-8c3b-fa288bbe72b1 req-7fa36cf7-687c-4a72-85be-08be874c970c service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:33.466510 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-001def99-a2fa-4e73-8c3b-fa288bbe72b1 req-7fa36cf7-687c-4a72-85be-08be874c970c service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] No waiting events found dispatching network-vif-plugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:33.466684 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-001def99-a2fa-4e73-8c3b-fa288bbe72b1 req-7fa36cf7-687c-4a72-85be-08be874c970c service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received unexpected event network-vif-plugged-fe8167e8-425b-4446-a2e8-84711a2be7dd for instance with vm_state rescued and task_state None.
May 19 04:36:33.516913 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6844506d-7698-4235-9450-3ff72b1cc5be req-95d118f7-9181-4676-8113-f585cac905bc service nova] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Received event network-changed-74481730-a000-4409-b576-63d4431e1ac9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:33.517222 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6844506d-7698-4235-9450-3ff72b1cc5be req-95d118f7-9181-4676-8113-f585cac905bc service nova] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Refreshing instance network info cache due to event network-changed-74481730-a000-4409-b576-63d4431e1ac9. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:36:33.517222 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6844506d-7698-4235-9450-3ff72b1cc5be req-95d118f7-9181-4676-8113-f585cac905bc service nova] Acquiring lock "refresh_cache-d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:36:33.517373 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6844506d-7698-4235-9450-3ff72b1cc5be req-95d118f7-9181-4676-8113-f585cac905bc service nova] Acquired lock "refresh_cache-d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:36:33.517531 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-6844506d-7698-4235-9450-3ff72b1cc5be req-95d118f7-9181-4676-8113-f585cac905bc service nova] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Refreshing network info cache for port 74481730-a000-4409-b576-63d4431e1ac9 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:36:33.650744 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Acquiring lock "refresh_cache-d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:36:33.725497 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:36:33.725879 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:36:33.726085 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:33.726493 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:33.824991 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:33.828871 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 3 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:36:33.876288 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e23a65f9-e29b-4d24-9850-960b93fc75d2 req-e69f35ef-1e14-45f4-8a81-5c4cb1be2e0c service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-changed-ad71ba07-449a-4565-bd5e-17c050975bd3 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:33.877620 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e23a65f9-e29b-4d24-9850-960b93fc75d2 req-e69f35ef-1e14-45f4-8a81-5c4cb1be2e0c service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Refreshing instance network info cache due to event network-changed-ad71ba07-449a-4565-bd5e-17c050975bd3. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:36:33.877798 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e23a65f9-e29b-4d24-9850-960b93fc75d2 req-e69f35ef-1e14-45f4-8a81-5c4cb1be2e0c service nova] Acquiring lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:36:33.877912 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e23a65f9-e29b-4d24-9850-960b93fc75d2 req-e69f35ef-1e14-45f4-8a81-5c4cb1be2e0c service nova] Acquired lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:36:33.878044 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e23a65f9-e29b-4d24-9850-960b93fc75d2 req-e69f35ef-1e14-45f4-8a81-5c4cb1be2e0c service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Refreshing network info cache for port ad71ba07-449a-4565-bd5e-17c050975bd3 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:36:33.970858 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c73c832155da49cdb7faad111acd01e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35e596ed4643ba9e73bcfe8f8c03d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:36:34.024383 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-6844506d-7698-4235-9450-3ff72b1cc5be req-95d118f7-9181-4676-8113-f585cac905bc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:34.051303 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Acquiring lock "7c91d680-72b2-4422-a3c6-fff9714d42cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:34.051303 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:34.051303 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Acquiring lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:34.051303 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:34.052347 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:34.054327 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Terminating instance
May 19 04:36:34.230182 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:36:34.266999 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:34.307212 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-60db5967-54f4-4aa0-9a68-b65b1f61d984 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Unrescuing
May 19 04:36:34.307705 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-60db5967-54f4-4aa0-9a68-b65b1f61d984 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "refresh_cache-b5f34a29-15f7-4f5e-a8bf-574abebd5c84" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:36:34.307850 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-60db5967-54f4-4aa0-9a68-b65b1f61d984 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquired lock "refresh_cache-b5f34a29-15f7-4f5e-a8bf-574abebd5c84" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:36:34.308083 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-60db5967-54f4-4aa0-9a68-b65b1f61d984 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:36:34.336272 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 19 04:36:34.372745 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:34.374375 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:34.385973 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-e23a65f9-e29b-4d24-9850-960b93fc75d2 req-e69f35ef-1e14-45f4-8a81-5c4cb1be2e0c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:34.478523 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:34.483281 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:34.561806 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:36:34.587133 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:34.587133 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:34.602165 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:34.602708 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:34.618373 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:34.645682 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:34.649287 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:34.656752 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Successfully created port: 7d465039-2df5-4a2d-bb08-e10e97b40fd7 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:36:34.701513 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:34.701978 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:36:34.707602 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.rescue --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:34.735217 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:36:34.746847 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-6844506d-7698-4235-9450-3ff72b1cc5be req-95d118f7-9181-4676-8113-f585cac905bc service nova] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:36:34.812874 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-60db5967-54f4-4aa0-9a68-b65b1f61d984 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:34.829179 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.rescue --force-share --output=json" returned: 0 in 0.122s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:34.829837 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.rescue --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:34.897962 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:34.906864 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:36:34.911595 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:36:34.911769 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Creating image(s)
May 19 04:36:34.912713 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:36:34.912713 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Ensure instance console log exists: /opt/stack/data/nova/instances/d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:36:34.912713 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:34.913747 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:34.913929 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:34.933096 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.rescue --force-share --output=json" returned: 0 in 0.102s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:34.933882 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.99972152800001 future=<Future at 0x721834471d90 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:34.936270 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:34.936474 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:34.959450 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Instance destroyed successfully.
May 19 04:36:34.961099 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Lazy-loading 'resources' on Instance uuid 7c91d680-72b2-4422-a3c6-fff9714d42cd {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:34.965293 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:35.045461 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:35.045921 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:35.153007 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:35.157934 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:36:35.158098 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:36:35.158165 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-6 (vdc) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:36:35.159557 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c91d680-72b2-4422-a3c6-fff9714d42cd/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:35.264125 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:35.266434 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c91d680-72b2-4422-a3c6-fff9714d42cd/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:35.266815 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c91d680-72b2-4422-a3c6-fff9714d42cd/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:35.317314 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:35.330316 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:35.361091 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:35.364374 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c91d680-72b2-4422-a3c6-fff9714d42cd/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:35.367442 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:35.372649 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk.rescue --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:35.470870 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-894375213',display_name='tempest-VolumesAdminNegativeTest-server-894375213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesadminnegativetest-server-894375213',id=13,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:36:28Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9a9429eac2d4f0da28551f059b1deeb',ramdisk_id='',reservation_id='r-k0ur5042',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-304022391',owner_user_name='tempest-VolumesAdminNegativeTest-304022391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:36:28Z,user_data=None,user_id='0bc4987fe170442c9ec50fd9652056f3',uuid=7c91d680-72b2-4422-a3c6-fff9714d42cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb90c186-f98f-4d99-8292-e9600576dee1", "address": "fa:16:3e:76:e6:b5", "network": {"id": "1e5f24d0-88c4-41b8-9a87-3e61b964670c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839847895-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9a9429eac2d4f0da28551f059b1deeb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb90c186-f9", "ovs_interfaceid": "cb90c186-f98f-4d99-8292-e9600576dee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:36:35.474554 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Converting VIF {"id": "cb90c186-f98f-4d99-8292-e9600576dee1", "address": "fa:16:3e:76:e6:b5", "network": {"id": "1e5f24d0-88c4-41b8-9a87-3e61b964670c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-839847895-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9a9429eac2d4f0da28551f059b1deeb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb90c186-f9", "ovs_interfaceid": "cb90c186-f98f-4d99-8292-e9600576dee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:35.475395 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:e6:b5,bridge_name='br-int',has_traffic_filtering=True,id=cb90c186-f98f-4d99-8292-e9600576dee1,network=Network(1e5f24d0-88c4-41b8-9a87-3e61b964670c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb90c186-f9') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:35.478573 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:e6:b5,bridge_name='br-int',has_traffic_filtering=True,id=cb90c186-f98f-4d99-8292-e9600576dee1,network=Network(1e5f24d0-88c4-41b8-9a87-3e61b964670c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb90c186-f9') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:36:35.481284 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:35.481284 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb90c186-f9, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:35.485678 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:35.487099 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:35.487888 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:35.488145 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d155394-62f3-49cd-92b8-42eaee1b44bc) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:35.490171 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:35.490171 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:35.492474 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk.rescue --force-share --output=json" returned: 0 in 0.118s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:35.493599 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk.rescue --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:35.513277 np0000001025 nova-compute[97981]: INFO os_vif [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:e6:b5,bridge_name='br-int',has_traffic_filtering=True,id=cb90c186-f98f-4d99-8292-e9600576dee1,network=Network(1e5f24d0-88c4-41b8-9a87-3e61b964670c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb90c186-f9')
May 19 04:36:35.513277 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:35.516972 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Deleting instance files /opt/stack/data/nova/instances/7c91d680-72b2-4422-a3c6-fff9714d42cd_del
May 19 04:36:35.517864 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Deletion of /opt/stack/data/nova/instances/7c91d680-72b2-4422-a3c6-fff9714d42cd_del complete
May 19 04:36:35.533056 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:35.610271 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-6844506d-7698-4235-9450-3ff72b1cc5be req-95d118f7-9181-4676-8113-f585cac905bc service nova] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:35.612497 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk.rescue --force-share --output=json" returned: 0 in 0.119s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:35.612812 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84/disk (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:36:35.615494 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:36:35.616437 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:35.643457 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6fc744c5-729e-486e-a106-bd858ab4f6e4 req-c4f72487-2e34-4982-9bd4-2d527b988d43 service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received event network-vif-plugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:35.644088 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6fc744c5-729e-486e-a106-bd858ab4f6e4 req-c4f72487-2e34-4982-9bd4-2d527b988d43 service nova] Acquiring lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:35.644495 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6fc744c5-729e-486e-a106-bd858ab4f6e4 req-c4f72487-2e34-4982-9bd4-2d527b988d43 service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:35.644966 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6fc744c5-729e-486e-a106-bd858ab4f6e4 req-c4f72487-2e34-4982-9bd4-2d527b988d43 service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:35.645121 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6fc744c5-729e-486e-a106-bd858ab4f6e4 req-c4f72487-2e34-4982-9bd4-2d527b988d43 service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Processing event network-vif-plugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:36:35.645324 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6fc744c5-729e-486e-a106-bd858ab4f6e4 req-c4f72487-2e34-4982-9bd4-2d527b988d43 service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received event network-vif-plugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:35.645493 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6fc744c5-729e-486e-a106-bd858ab4f6e4 req-c4f72487-2e34-4982-9bd4-2d527b988d43 service nova] Acquiring lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:35.645666 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6fc744c5-729e-486e-a106-bd858ab4f6e4 req-c4f72487-2e34-4982-9bd4-2d527b988d43 service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:35.645721 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6fc744c5-729e-486e-a106-bd858ab4f6e4 req-c4f72487-2e34-4982-9bd4-2d527b988d43 service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:35.645825 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6fc744c5-729e-486e-a106-bd858ab4f6e4 req-c4f72487-2e34-4982-9bd4-2d527b988d43 service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] No waiting events found dispatching network-vif-plugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:35.645958 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-6fc744c5-729e-486e-a106-bd858ab4f6e4 req-c4f72487-2e34-4982-9bd4-2d527b988d43 service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received unexpected event network-vif-plugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 for instance with vm_state resized and task_state resize_reverting.
May 19 04:36:35.646054 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6fc744c5-729e-486e-a106-bd858ab4f6e4 req-c4f72487-2e34-4982-9bd4-2d527b988d43 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Received event network-vif-unplugged-cb90c186-f98f-4d99-8292-e9600576dee1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:35.646212 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6fc744c5-729e-486e-a106-bd858ab4f6e4 req-c4f72487-2e34-4982-9bd4-2d527b988d43 service nova] Acquiring lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:35.646347 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6fc744c5-729e-486e-a106-bd858ab4f6e4 req-c4f72487-2e34-4982-9bd4-2d527b988d43 service nova] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:35.646465 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6fc744c5-729e-486e-a106-bd858ab4f6e4 req-c4f72487-2e34-4982-9bd4-2d527b988d43 service nova] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:35.646552 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6fc744c5-729e-486e-a106-bd858ab4f6e4 req-c4f72487-2e34-4982-9bd4-2d527b988d43 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] No waiting events found dispatching network-vif-unplugged-cb90c186-f98f-4d99-8292-e9600576dee1 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:35.646663 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6fc744c5-729e-486e-a106-bd858ab4f6e4 req-c4f72487-2e34-4982-9bd4-2d527b988d43 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Received event network-vif-unplugged-cb90c186-f98f-4d99-8292-e9600576dee1 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:36:35.646757 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6fc744c5-729e-486e-a106-bd858ab4f6e4 req-c4f72487-2e34-4982-9bd4-2d527b988d43 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Received event network-vif-unplugged-cb90c186-f98f-4d99-8292-e9600576dee1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:35.646865 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6fc744c5-729e-486e-a106-bd858ab4f6e4 req-c4f72487-2e34-4982-9bd4-2d527b988d43 service nova] Acquiring lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:35.646967 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6fc744c5-729e-486e-a106-bd858ab4f6e4 req-c4f72487-2e34-4982-9bd4-2d527b988d43 service nova] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:35.647055 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6fc744c5-729e-486e-a106-bd858ab4f6e4 req-c4f72487-2e34-4982-9bd4-2d527b988d43 service nova] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:35.647183 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6fc744c5-729e-486e-a106-bd858ab4f6e4 req-c4f72487-2e34-4982-9bd4-2d527b988d43 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] No waiting events found dispatching network-vif-unplugged-cb90c186-f98f-4d99-8292-e9600576dee1 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:35.647862 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6fc744c5-729e-486e-a106-bd858ab4f6e4 req-c4f72487-2e34-4982-9bd4-2d527b988d43 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Received event network-vif-unplugged-cb90c186-f98f-4d99-8292-e9600576dee1 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:36:35.649529 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:36:35.658684 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165395.6573553, 6ea060d2-e149-4189-b93b-66ce319b9157 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:35.659076 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] VM Resumed (Lifecycle Event)
May 19 04:36:35.664728 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:35.665129 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=13340MB free_disk=74.59543991088867GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:36:35.665407 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:35.665642 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:35.672670 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Instance running successfully.
May 19 04:36:35.673070 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] finish_revert_migration finished successfully. {{(pid=97981) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12978}}
May 19 04:36:35.754610 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:36:35.758140 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:36:35.758140 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Creating image(s)
May 19 04:36:35.758140 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Acquiring lock "/opt/stack/data/nova/instances/f66a2b29-93d1-468a-94fc-77679fce8d64/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:35.758140 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "/opt/stack/data/nova/instances/f66a2b29-93d1-468a-94fc-77679fce8d64/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:35.758689 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "/opt/stack/data/nova/instances/f66a2b29-93d1-468a-94fc-77679fce8d64/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:35.759190 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:36:35.762459 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:36:35.763606 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:35.876988 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.113s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:35.882497 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:35.883432 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:35.884391 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:36:35.887172 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:36:35.887705 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:35.932265 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-e23a65f9-e29b-4d24-9850-960b93fc75d2 req-e69f35ef-1e14-45f4-8a81-5c4cb1be2e0c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:35.986940 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-60db5967-54f4-4aa0-9a68-b65b1f61d984 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:36.016007 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.128s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:36.019037 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/f66a2b29-93d1-468a-94fc-77679fce8d64/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:36.052355 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Took 1.49 seconds to destroy the instance on the hypervisor.
May 19 04:36:36.056620 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:36:36.057124 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:36:36.057493 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:36:36.058795 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:36.083654 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/f66a2b29-93d1-468a-94fc-77679fce8d64/disk 1073741824" returned: 0 in 0.064s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:36.083966 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:36.084384 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:36.117696 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6844506d-7698-4235-9450-3ff72b1cc5be req-95d118f7-9181-4676-8113-f585cac905bc service nova] Releasing lock "refresh_cache-d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:36:36.120811 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Acquired lock "refresh_cache-d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:36:36.121672 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:36:36.165166 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:36.170741 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:36.172692 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:36:36.208521 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e23a65f9-e29b-4d24-9850-960b93fc75d2 req-e69f35ef-1e14-45f4-8a81-5c4cb1be2e0c service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Updated VIF entry in instance network info cache for port ad71ba07-449a-4565-bd5e-17c050975bd3. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:36:36.208521 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e23a65f9-e29b-4d24-9850-960b93fc75d2 req-e69f35ef-1e14-45f4-8a81-5c4cb1be2e0c service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Updating instance_info_cache with network_info: [{"id": "ad71ba07-449a-4565-bd5e-17c050975bd3", "address": "fa:16:3e:3b:78:32", "network": {"id": "a3b3266f-28a3-47fc-b52c-26f42a06a1bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1135470460-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad71ba07-44", "ovs_interfaceid": "ad71ba07-449a-4565-bd5e-17c050975bd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "address": "fa:16:3e:e7:64:b0", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60124aa0-37", "ovs_interfaceid": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "address": "fa:16:3e:c8:33:5b", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap137c6f2c-dd", "ovs_interfaceid": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "55210bd9-f231-4f7e-89be-c5779add4e83", "address": "fa:16:3e:d0:04:13", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55210bd9-f2", "ovs_interfaceid": "55210bd9-f231-4f7e-89be-c5779add4e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "address": "fa:16:3e:50:b6:e3", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ec0e22-80", "ovs_interfaceid": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "address": "fa:16:3e:10:97:76", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42811c2a-5e", "ovs_interfaceid": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7648d4e-3e92-4c77-9347-91670c3b9113", "address": "fa:16:3e:2c:e3:ec", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7648d4e-3e", "ovs_interfaceid": "d7648d4e-3e92-4c77-9347-91670c3b9113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:36.218742 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.133s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:36.219743 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f66a2b29-93d1-468a-94fc-77679fce8d64/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:36:36.220454 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66a2b29-93d1-468a-94fc-77679fce8d64/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:36.272701 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-60db5967-54f4-4aa0-9a68-b65b1f61d984 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Updating instance_info_cache with network_info: [{"id": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "address": "fa:16:3e:7d:73:e6", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe8167e8-42", "ovs_interfaceid": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:36.327878 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66a2b29-93d1-468a-94fc-77679fce8d64/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:36.328347 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Cannot resize image /opt/stack/data/nova/instances/f66a2b29-93d1-468a-94fc-77679fce8d64/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:36:36.328689 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:36:36.328835 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Ensure instance console log exists: /opt/stack/data/nova/instances/f66a2b29-93d1-468a-94fc-77679fce8d64/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:36:36.329122 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:36.330714 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:36.330714 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:36.361949 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:36.423780 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Successfully updated port: 7d465039-2df5-4a2d-bb08-e10e97b40fd7 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:36:36.517374 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-38dbcc8d-fc72-4b69-8b86-decd0883ec12 req-540ec3e9-6194-4c27-bd59-8d6cbf348946 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Received event network-vif-deleted-cb90c186-f98f-4d99-8292-e9600576dee1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:36.519615 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-38dbcc8d-fc72-4b69-8b86-decd0883ec12 req-540ec3e9-6194-4c27-bd59-8d6cbf348946 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Neutron deleted interface cb90c186-f98f-4d99-8292-e9600576dee1; detaching it from the instance and deleting it from the info cache
May 19 04:36:36.519615 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-38dbcc8d-fc72-4b69-8b86-decd0883ec12 req-540ec3e9-6194-4c27-bd59-8d6cbf348946 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:36.700464 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 19 04:36:36.714715 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e23a65f9-e29b-4d24-9850-960b93fc75d2 req-e69f35ef-1e14-45f4-8a81-5c4cb1be2e0c service nova] Releasing lock "refresh_cache-63247a98-0dc4-4a87-9141-5ae713a462b5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:36:36.719195 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:36:36.759598 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-483bcf46-091b-4884-9e77-0a763ee637d0 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Updating instance to original state: 'active'
May 19 04:36:36.766315 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:36:36.766607 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:36:36.769707 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance b5f34a29-15f7-4f5e-a8bf-574abebd5c84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:36:36.769707 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 63247a98-0dc4-4a87-9141-5ae713a462b5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:36:36.769707 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 6ea060d2-e149-4189-b93b-66ce319b9157 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:36:36.769707 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 7c91d680-72b2-4422-a3c6-fff9714d42cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:36:36.769707 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:36:36.769707 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance f66a2b29-93d1-468a-94fc-77679fce8d64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:36:36.769707 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:36:36.769707 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=2048MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:36:35 up 27 min,  2 users,  load average: 8.23, 4.57, 2.14\n', 'num_instances': '8', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '8', 'num_proj_334b83c8d3714844830f961673658b20': '3', 'io_workload': '2', 'num_vm_rescued': '2', 'num_vm_resized': '1', 'num_task_resize_reverting': '1', 'num_proj_b34124f30156425cbda16473ccedeff4': '1', 'num_task_unrescuing': '1', 'num_proj_7fc088ff80284506af708277495c5882': '1', 'num_task_deleting': '1', 'num_proj_f9a9429eac2d4f0da28551f059b1deeb': '1', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_3e1b00cc4af14242a0806348f4fa9117': '1', 'num_proj_8a35e596ed4643ba9e73bcfe8f8c03d2': '1'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:36:36.778179 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-60db5967-54f4-4aa0-9a68-b65b1f61d984 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Releasing lock "refresh_cache-b5f34a29-15f7-4f5e-a8bf-574abebd5c84" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:36:36.778970 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-60db5967-54f4-4aa0-9a68-b65b1f61d984 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'flavor' on Instance uuid b5f34a29-15f7-4f5e-a8bf-574abebd5c84 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:36.920289 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:36.926059 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Acquiring lock "refresh_cache-f66a2b29-93d1-468a-94fc-77679fce8d64" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:36:36.926224 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Acquired lock "refresh_cache-f66a2b29-93d1-468a-94fc-77679fce8d64" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:36:36.926405 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:36:36.970707 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:36.987353 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0007253129999753583 future=<Future at 0x7218345caf60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:36.987353 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:36.987353 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=0.5301691619999929 future=<Future at 0x721850289010 state=cancelled>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:36.987353 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=0.5300623709999854 future=<Future at 0x721850289010 state=cancelled>) was cancelled while queued, skipping {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:36.987353 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:36.987353 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=12.9463254100001 future=<Future at 0x721834471d90 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:36.987353 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=12.946219309000071 future=<Future at 0x721834471d90 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:36.988406 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Emitting event <LifecycleEvent: 1779165381.9858391, 1081cdc6-540d-4cb8-9e0d-d7584411e539 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:36.988641 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] VM Stopped (Lifecycle Event)
May 19 04:36:37.024783 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-38dbcc8d-fc72-4b69-8b86-decd0883ec12 req-540ec3e9-6194-4c27-bd59-8d6cbf348946 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Detach interface failed, port_id=cb90c186-f98f-4d99-8292-e9600576dee1, reason: Instance 7c91d680-72b2-4422-a3c6-fff9714d42cd could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:36:37.119257 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Updating instance_info_cache with network_info: [{"id": "74481730-a000-4409-b576-63d4431e1ac9", "address": "fa:16:3e:4d:15:35", "network": {"id": "65e495fa-ccc2-48b7-9b32-ef75280bef22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "579b33395d4a41479b805cf02294060a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74481730-a0", "ovs_interfaceid": "74481730-a000-4409-b576-63d4431e1ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:37.292582 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:36:37.292811 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:36:37.316948 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:37.317557 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:37.346827 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:37.464747 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:37.471189 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:37.477803 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Took 1.42 seconds to deallocate network for instance.
May 19 04:36:37.494767 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: 1081cdc6-540d-4cb8-9e0d-d7584411e539] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:37.609835 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:37.619979 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:37.627675 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Releasing lock "refresh_cache-d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:36:37.627980 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Instance network_info: |[{"id": "74481730-a000-4409-b576-63d4431e1ac9", "address": "fa:16:3e:4d:15:35", "network": {"id": "65e495fa-ccc2-48b7-9b32-ef75280bef22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "579b33395d4a41479b805cf02294060a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74481730-a0", "ovs_interfaceid": "74481730-a000-4409-b576-63d4431e1ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:36:37.629917 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Start _get_guest_xml network_info=[{"id": "74481730-a000-4409-b576-63d4431e1ac9", "address": "fa:16:3e:4d:15:35", "network": {"id": "65e495fa-ccc2-48b7-9b32-ef75280bef22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "579b33395d4a41479b805cf02294060a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74481730-a0", "ovs_interfaceid": "74481730-a000-4409-b576-63d4431e1ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'ff91c28e-9940-4560-b6f0-8591d717347e', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496', 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f5972c8-8c2c-4892-aa74-3f37c4c31496', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd04a3ae5-77b3-4aa4-a37c-5f5d23178c8e', 'attached_at': '', 'detached_at': '', 'volume_id': '7f5972c8-8c2c-4892-aa74-3f37c4c31496', 'serial': '7f5972c8-8c2c-4892-aa74-3f37c4c31496'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:36:37.640325 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:36:37.642374 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='instance-depend-image', uuid='d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e'), owner=OwnerMeta(userid='5c66118759a7481ea214f9d98369ec54', username='tempest-ImageDependencyTests-922756248-project-member', projectid='3e1b00cc4af14242a0806348f4fa9117', projectname='tempest-ImageDependencyTests-922756248'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "74481730-a000-4409-b576-63d4431e1ac9", "address": "fa:16:3e:4d:15:35", "network": {"id": "65e495fa-ccc2-48b7-9b32-ef75280bef22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "579b33395d4a41479b805cf02294060a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74481730-a0", "ovs_interfaceid": "74481730-a000-4409-b576-63d4431e1ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165397.6418567) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:36:37.645042 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:36:37.645464 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:36:37.648807 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:36:37.649046 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:36:37.650382 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:36:37.652190 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:36:37.652313 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:36:37.652411 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:36:37.652524 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:36:37.652609 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:36:37.652707 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:36:37.652855 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:36:37.654598 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:36:37.654926 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:36:37.655674 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:36:37.655965 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.99905045000014 future=<Future at 0x7218345ca810 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:37.657018 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Instance destroyed successfully.
May 19 04:36:37.657479 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:36:37.663083 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-60db5967-54f4-4aa0-9a68-b65b1f61d984 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'numa_topology' on Instance uuid b5f34a29-15f7-4f5e-a8bf-574abebd5c84 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:37.671057 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:36:37.671802 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496', 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f5972c8-8c2c-4892-aa74-3f37c4c31496', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:36:37.672258 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:37.672791 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:37.673129 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496', 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f5972c8-8c2c-4892-aa74-3f37c4c31496', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:36:37.689818 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:37.690789 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:37.691315 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:37.691523 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:36:37.692306 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:37.692564 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:36:37.709664 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:36:37.709664 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:37.720670 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Received event network-vif-plugged-cb90c186-f98f-4d99-8292-e9600576dee1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:37.720670 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] Acquiring lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:37.720670 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:37.721047 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:37.721047 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] No waiting events found dispatching network-vif-plugged-cb90c186-f98f-4d99-8292-e9600576dee1 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:37.721047 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Received unexpected event network-vif-plugged-cb90c186-f98f-4d99-8292-e9600576dee1 for instance with vm_state deleted and task_state None.
May 19 04:36:37.721394 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Received event network-vif-plugged-cb90c186-f98f-4d99-8292-e9600576dee1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:37.721535 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] Acquiring lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:37.721535 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:37.721734 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:37.721875 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] No waiting events found dispatching network-vif-plugged-cb90c186-f98f-4d99-8292-e9600576dee1 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:37.721875 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Received unexpected event network-vif-plugged-cb90c186-f98f-4d99-8292-e9600576dee1 for instance with vm_state deleted and task_state None.
May 19 04:36:37.722136 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Received event network-vif-unplugged-cb90c186-f98f-4d99-8292-e9600576dee1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:37.722136 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] Acquiring lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:37.722336 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:37.722336 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:37.722540 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] No waiting events found dispatching network-vif-unplugged-cb90c186-f98f-4d99-8292-e9600576dee1 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:37.722540 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Received unexpected event network-vif-unplugged-cb90c186-f98f-4d99-8292-e9600576dee1 for instance with vm_state deleted and task_state None.
May 19 04:36:37.723992 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Received event network-changed-7d465039-2df5-4a2d-bb08-e10e97b40fd7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:37.724404 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Refreshing instance network info cache due to event network-changed-7d465039-2df5-4a2d-bb08-e10e97b40fd7. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:36:37.724404 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] Acquiring lock "refresh_cache-f66a2b29-93d1-468a-94fc-77679fce8d64" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:36:37.729374 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:36:37.729374 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:37.730555 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496] added
May 19 04:36:37.730555 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:36:37.730555 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:37.730555 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:37.730555 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:37.730555 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:37.730555 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:37.731045 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:36:37.731352 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0387(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:36:37.731693 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:36:37.740429 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496] added
May 19 04:36:37.740429 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:36:37.740429 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:37.740429 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:37.740429 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:37.740429 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:37.740429 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:37.740722 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:36:37.740900 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0493(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:36:37.741099 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:36:37.795613 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:36:37.986217 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:37.988138 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:38.045797 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:36:38.171468 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-60db5967-54f4-4aa0-9a68-b65b1f61d984 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Object Instance<b5f34a29-15f7-4f5e-a8bf-574abebd5c84> lazy-loaded attributes: flavor,numa_topology {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:36:38.245971 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:38.302906 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:36:38.303088 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.637s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:38.303517 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.317s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:38.304729 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:36:38.397271 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Updating instance_info_cache with network_info: [{"id": "7d465039-2df5-4a2d-bb08-e10e97b40fd7", "address": "fa:16:3e:f6:d8:28", "network": {"id": "010dbd36-41b4-476f-b0a7-34c9dbc108af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1030058809-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a35e596ed4643ba9e73bcfe8f8c03d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d465039-2d", "ovs_interfaceid": "7d465039-2df5-4a2d-bb08-e10e97b40fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:38.687012 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:38.701433 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:38.701612 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:38.719521 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:38.723122 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:38.734296 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:36:38.741464 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:36:38.749080 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:36:38.749080 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:36:38.759021 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:36:38.759021 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:38.767936 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:38.778473 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:38.793413 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:38.793413 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:38.793413 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:38.793413 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:38.793413 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:38.793413 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:38.793413 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:38.793413 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:38.793413 np0000001025 nova-compute[97981]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:38.793413 np0000001025 nova-compute[97981]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:38.793413 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:38.793413 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:38.793413 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:38.793413 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:38.793413 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:38.793413 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:38.793413 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:38.793413 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:38.793413 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:38.793413 np0000001025 nova-compute[97981]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:38.793413 np0000001025 nova-compute[97981]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:38.793413 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:38.806356 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:38.806356 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:38.806356 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:38.806356 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:38.806356 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:38.806356 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:38.806356 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:38.806356 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:38.806356 np0000001025 nova-compute[97981]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:38.806356 np0000001025 nova-compute[97981]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:38.806356 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:38.806356 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:38.806356 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:38.806356 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:38.806356 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:38.806356 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:38.806356 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:38.806356 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:38.806356 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:38.806356 np0000001025 nova-compute[97981]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:38.806356 np0000001025 nova-compute[97981]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:38.806356 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:38.807076 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:38.840876 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:38.842191 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:38.846622 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496, portal: 192.168.50.100,3260]
May 19 04:36:38.846622 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496, portal: 192.168.50.100,3260] successful.
May 19 04:36:38.846622 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:38.859307 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:38.865127 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496, portal: 192.168.40.100,3260]
May 19 04:36:38.865127 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496, portal: 192.168.40.100,3260] successful.
May 19 04:36:38.865127 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:38.875070 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:38.881408 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:38.881408 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:38.881408 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:38.881408 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:38.881408 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:38.881408 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:38.881408 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:38.881408 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:38.881408 np0000001025 nova-compute[97981]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:38.881408 np0000001025 nova-compute[97981]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:38.881408 np0000001025 nova-compute[97981]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:38.881408 np0000001025 nova-compute[97981]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:38.881408 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:38.881841 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:38.881841 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:38.881841 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:38.881841 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:38.881841 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:38.881841 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:38.881841 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:38.881841 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:38.881841 np0000001025 nova-compute[97981]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:38.881841 np0000001025 nova-compute[97981]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:38.881841 np0000001025 nova-compute[97981]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:38.881841 np0000001025 nova-compute[97981]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:38.881841 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:38.882065 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:38.882222 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:36:38.883953 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] HCTL ('17', '-', '-', 0) found on session 31 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:36:38.884118 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:36:38.897604 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Releasing lock "refresh_cache-f66a2b29-93d1-468a-94fc-77679fce8d64" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:36:38.897880 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Instance network_info: |[{"id": "7d465039-2df5-4a2d-bb08-e10e97b40fd7", "address": "fa:16:3e:f6:d8:28", "network": {"id": "010dbd36-41b4-476f-b0a7-34c9dbc108af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1030058809-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a35e596ed4643ba9e73bcfe8f8c03d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d465039-2d", "ovs_interfaceid": "7d465039-2df5-4a2d-bb08-e10e97b40fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:36:38.901002 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Start _get_guest_xml network_info=[{"id": "7d465039-2df5-4a2d-bb08-e10e97b40fd7", "address": "fa:16:3e:f6:d8:28", "network": {"id": "010dbd36-41b4-476f-b0a7-34c9dbc108af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1030058809-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a35e596ed4643ba9e73bcfe8f8c03d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d465039-2d", "ovs_interfaceid": "7d465039-2df5-4a2d-bb08-e10e97b40fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:36:38.901823 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] Acquired lock "refresh_cache-f66a2b29-93d1-468a-94fc-77679fce8d64" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:36:38.902072 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Refreshing network info cache for port 7d465039-2df5-4a2d-bb08-e10e97b40fd7 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:36:38.904050 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:38.904050 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:38.904050 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:38.904050 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:38.904050 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:38.904050 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:38.904050 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:38.904050 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:38.904050 np0000001025 nova-compute[97981]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:38.904050 np0000001025 nova-compute[97981]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:38.904050 np0000001025 nova-compute[97981]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:38.904050 np0000001025 nova-compute[97981]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:38.904050 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:38.904329 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:38.904329 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:38.904329 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:38.904329 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:38.904329 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:38.904329 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:38.904329 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:38.904329 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:38.904329 np0000001025 nova-compute[97981]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:38.904329 np0000001025 nova-compute[97981]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:38.904329 np0000001025 nova-compute[97981]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:38.904329 np0000001025 nova-compute[97981]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:38.904329 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:38.905272 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.213s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:38.910500 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:36:38.913197 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Searching for a device in session 31 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:36:38.913380 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7f5972c8-8c2c-4892-aa74-3f37c4c31496', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:36:38.915666 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:36:38.915735 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-888768224', uuid='f66a2b29-93d1-468a-94fc-77679fce8d64'), owner=OwnerMeta(userid='c73c832155da49cdb7faad111acd01e5', username='tempest-ServersNegativeTestJSON-1193290315-project-member', projectid='8a35e596ed4643ba9e73bcfe8f8c03d2', projectname='tempest-ServersNegativeTestJSON-1193290315'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7d465039-2df5-4a2d-bb08-e10e97b40fd7", "address": "fa:16:3e:f6:d8:28", "network": {"id": "010dbd36-41b4-476f-b0a7-34c9dbc108af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1030058809-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a35e596ed4643ba9e73bcfe8f8c03d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d465039-2d", "ovs_interfaceid": "7d465039-2df5-4a2d-bb08-e10e97b40fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165398.915453) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:36:38.928183 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] HCTL ('18', '-', '-', 0) found on session 32 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:36:38.928183 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:36:38.929778 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:36:38.930308 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:36:38.936708 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:36:38.936845 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:36:38.937617 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:36:38.937896 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:36:38.938051 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:36:38.938147 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:36:38.938294 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:36:38.938369 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:36:38.938413 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:36:38.938536 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:36:38.938683 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:36:38.938727 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:36:38.938806 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:36:38.938906 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:36:38.951059 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Searching for a device in session 32 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:36:38.951059 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f5972c8-8c2c-4892-aa74-3f37c4c31496', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:36:38.955066 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:36:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-888768224',display_name='tempest-ServersNegativeTestJSON-server-888768224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serversnegativetestjson-server-888768224',id=15,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a35e596ed4643ba9e73bcfe8f8c03d2',ramdisk_id='',reservation_id='r-r8m9zftk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1193290315',owner_user_name='tempest-ServersNegativeTestJSON-1193290315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:36:35Z,user_data=None,user_id='c73c832155da49cdb7faad111acd01e5',uuid=f66a2b29-93d1-468a-94fc-77679fce8d64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d465039-2df5-4a2d-bb08-e10e97b40fd7", "address": "fa:16:3e:f6:d8:28", "network": {"id": "010dbd36-41b4-476f-b0a7-34c9dbc108af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1030058809-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a35e596ed4643ba9e73bcfe8f8c03d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d465039-2d", "ovs_interfaceid": "7d465039-2df5-4a2d-bb08-e10e97b40fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:36:38.955066 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Converting VIF {"id": "7d465039-2df5-4a2d-bb08-e10e97b40fd7", "address": "fa:16:3e:f6:d8:28", "network": {"id": "010dbd36-41b4-476f-b0a7-34c9dbc108af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1030058809-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a35e596ed4643ba9e73bcfe8f8c03d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d465039-2d", "ovs_interfaceid": "7d465039-2df5-4a2d-bb08-e10e97b40fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:38.955552 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d8:28,bridge_name='br-int',has_traffic_filtering=True,id=7d465039-2df5-4a2d-bb08-e10e97b40fd7,network=Network(010dbd36-41b4-476f-b0a7-34c9dbc108af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d465039-2d') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:38.956144 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lazy-loading 'pci_devices' on Instance uuid f66a2b29-93d1-468a-94fc-77679fce8d64 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:38.995195 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:36:38.995195 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:36:39.133476 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "6ea060d2-e149-4189-b93b-66ce319b9157" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:39.133707 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "6ea060d2-e149-4189-b93b-66ce319b9157" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:39.133871 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:39.134013 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:39.134159 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:39.137794 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Terminating instance
May 19 04:36:39.207912 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:36:39.300225 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:36:39.300787 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:36:39.300964 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:36:39.301449 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.31 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:36:39.412463 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:39.462435 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] End _get_guest_xml xml=<domain type="qemu">
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:   <uuid>f66a2b29-93d1-468a-94fc-77679fce8d64</uuid>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:   <name>instance-0000000f</name>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServersNegativeTestJSON-server-888768224</nova:name>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:36:38</nova:creationTime>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:         <nova:user uuid="c73c832155da49cdb7faad111acd01e5">tempest-ServersNegativeTestJSON-1193290315-project-member</nova:user>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:         <nova:project uuid="8a35e596ed4643ba9e73bcfe8f8c03d2">tempest-ServersNegativeTestJSON-1193290315</nova:project>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:         <nova:port uuid="7d465039-2df5-4a2d-bb08-e10e97b40fd7">
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     <system>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <entry name="serial">f66a2b29-93d1-468a-94fc-77679fce8d64</entry>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <entry name="uuid">f66a2b29-93d1-468a-94fc-77679fce8d64</entry>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     </system>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:   <os>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:   </os>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:   <features>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:   </features>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:   <devices>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/f66a2b29-93d1-468a-94fc-77679fce8d64/disk"/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/f66a2b29-93d1-468a-94fc-77679fce8d64/disk.config"/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:f6:d8:28"/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <target dev="tap7d465039-2d"/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     </interface>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/f66a2b29-93d1-468a-94fc-77679fce8d64/console.log" append="off"/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     </serial>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     <video>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     </video>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     </rng>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:   </devices>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]: </domain>
May 19 04:36:39.462435 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:36:39.470426 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Preparing to wait for external event network-vif-plugged-7d465039-2df5-4a2d-bb08-e10e97b40fd7 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:36:39.470426 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Acquiring lock "f66a2b29-93d1-468a-94fc-77679fce8d64-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:39.470426 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "f66a2b29-93d1-468a-94fc-77679fce8d64-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:39.470426 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "f66a2b29-93d1-468a-94fc-77679fce8d64-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:39.470426 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:36:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-888768224',display_name='tempest-ServersNegativeTestJSON-server-888768224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serversnegativetestjson-server-888768224',id=15,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a35e596ed4643ba9e73bcfe8f8c03d2',ramdisk_id='',reservation_id='r-r8m9zftk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1193290315',owner_user_name='tempest-ServersNegativeTestJSON-1193290315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:36:35Z,user_data=None,user_id='c73c832155da49cdb7faad111acd01e5',uuid=f66a2b29-93d1-468a-94fc-77679fce8d64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d465039-2df5-4a2d-bb08-e10e97b40fd7", "address": "fa:16:3e:f6:d8:28", "network": {"id": "010dbd36-41b4-476f-b0a7-34c9dbc108af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1030058809-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a35e596ed4643ba9e73bcfe8f8c03d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d465039-2d", "ovs_interfaceid": "7d465039-2df5-4a2d-bb08-e10e97b40fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:36:39.470426 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Converting VIF {"id": "7d465039-2df5-4a2d-bb08-e10e97b40fd7", "address": "fa:16:3e:f6:d8:28", "network": {"id": "010dbd36-41b4-476f-b0a7-34c9dbc108af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1030058809-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a35e596ed4643ba9e73bcfe8f8c03d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d465039-2d", "ovs_interfaceid": "7d465039-2df5-4a2d-bb08-e10e97b40fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:39.470426 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d8:28,bridge_name='br-int',has_traffic_filtering=True,id=7d465039-2df5-4a2d-bb08-e10e97b40fd7,network=Network(010dbd36-41b4-476f-b0a7-34c9dbc108af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d465039-2d') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:39.470426 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d8:28,bridge_name='br-int',has_traffic_filtering=True,id=7d465039-2df5-4a2d-bb08-e10e97b40fd7,network=Network(010dbd36-41b4-476f-b0a7-34c9dbc108af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d465039-2d') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:36:39.470426 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:39.470426 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:39.470426 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:36:39.470426 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:39.470426 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '170593c5-e3bf-5cad-8e20-6e501856a83e', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:39.470426 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:39.470426 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:39.470426 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:39.470426 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d465039-2d, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:39.470426 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d465039-2d, col_values=(('qos', UUID('f2f87ebd-7e7b-4ef6-a5ab-3a59657c62c8')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:39.470426 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d465039-2d, col_values=(('external_ids', {'iface-id': '7d465039-2df5-4a2d-bb08-e10e97b40fd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:d8:28', 'vm-uuid': 'f66a2b29-93d1-468a-94fc-77679fce8d64'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:39.472300 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:39.479182 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:39.480486 np0000001025 nova-compute[97981]: INFO os_vif [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d8:28,bridge_name='br-int',has_traffic_filtering=True,id=7d465039-2df5-4a2d-bb08-e10e97b40fd7,network=Network(010dbd36-41b4-476f-b0a7-34c9dbc108af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d465039-2d')
May 19 04:36:39.496711 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:36:39.605398 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Removed pending STOPPED event for b5f34a29-15f7-4f5e-a8bf-574abebd5c84 due to new event <LifecycleEvent: 1779165399.6050441, b5f34a29-15f7-4f5e-a8bf-574abebd5c84 => Resumed> {{(pid=97981) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 19 04:36:39.606597 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165399.6050441, b5f34a29-15f7-4f5e-a8bf-574abebd5c84 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:39.606597 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] VM Resumed (Lifecycle Event)
May 19 04:36:39.608955 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-60db5967-54f4-4aa0-9a68-b65b1f61d984 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:39.646544 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:36:39.676392 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:39.679872 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:39.691699 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:36:39.707968 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:39.722414 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:39.745247 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:39.754671 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:39.794501 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:39.798014 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:39.835454 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-884b8390-daaa-441c-8168-e10ea88e4060 req-e03b49af-bbbb-4d1a-991d-aa32d86d41e7 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received event network-vif-unplugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:39.837392 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-884b8390-daaa-441c-8168-e10ea88e4060 req-e03b49af-bbbb-4d1a-991d-aa32d86d41e7 service nova] Acquiring lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:39.837695 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-884b8390-daaa-441c-8168-e10ea88e4060 req-e03b49af-bbbb-4d1a-991d-aa32d86d41e7 service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:39.839038 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-884b8390-daaa-441c-8168-e10ea88e4060 req-e03b49af-bbbb-4d1a-991d-aa32d86d41e7 service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:39.839290 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-884b8390-daaa-441c-8168-e10ea88e4060 req-e03b49af-bbbb-4d1a-991d-aa32d86d41e7 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] No waiting events found dispatching network-vif-unplugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:39.840442 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-884b8390-daaa-441c-8168-e10ea88e4060 req-e03b49af-bbbb-4d1a-991d-aa32d86d41e7 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received unexpected event network-vif-unplugged-fe8167e8-425b-4446-a2e8-84711a2be7dd for instance with vm_state active and task_state None.
May 19 04:36:39.840669 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-884b8390-daaa-441c-8168-e10ea88e4060 req-e03b49af-bbbb-4d1a-991d-aa32d86d41e7 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received event network-vif-plugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:39.840887 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-884b8390-daaa-441c-8168-e10ea88e4060 req-e03b49af-bbbb-4d1a-991d-aa32d86d41e7 service nova] Acquiring lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:39.841116 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-884b8390-daaa-441c-8168-e10ea88e4060 req-e03b49af-bbbb-4d1a-991d-aa32d86d41e7 service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:39.842224 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-884b8390-daaa-441c-8168-e10ea88e4060 req-e03b49af-bbbb-4d1a-991d-aa32d86d41e7 service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:39.842402 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-884b8390-daaa-441c-8168-e10ea88e4060 req-e03b49af-bbbb-4d1a-991d-aa32d86d41e7 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] No waiting events found dispatching network-vif-plugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:39.842585 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-884b8390-daaa-441c-8168-e10ea88e4060 req-e03b49af-bbbb-4d1a-991d-aa32d86d41e7 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received unexpected event network-vif-plugged-fe8167e8-425b-4446-a2e8-84711a2be7dd for instance with vm_state active and task_state None.
May 19 04:36:39.842895 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-884b8390-daaa-441c-8168-e10ea88e4060 req-e03b49af-bbbb-4d1a-991d-aa32d86d41e7 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received event network-vif-plugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:39.842895 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-884b8390-daaa-441c-8168-e10ea88e4060 req-e03b49af-bbbb-4d1a-991d-aa32d86d41e7 service nova] Acquiring lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:39.843051 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-884b8390-daaa-441c-8168-e10ea88e4060 req-e03b49af-bbbb-4d1a-991d-aa32d86d41e7 service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:39.843254 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-884b8390-daaa-441c-8168-e10ea88e4060 req-e03b49af-bbbb-4d1a-991d-aa32d86d41e7 service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:39.843391 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-884b8390-daaa-441c-8168-e10ea88e4060 req-e03b49af-bbbb-4d1a-991d-aa32d86d41e7 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] No waiting events found dispatching network-vif-plugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:39.843488 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-884b8390-daaa-441c-8168-e10ea88e4060 req-e03b49af-bbbb-4d1a-991d-aa32d86d41e7 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received unexpected event network-vif-plugged-fe8167e8-425b-4446-a2e8-84711a2be7dd for instance with vm_state active and task_state None.
May 19 04:36:39.989132 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Updated VIF entry in instance network info cache for port 7d465039-2df5-4a2d-bb08-e10e97b40fd7. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:36:39.989132 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Updating instance_info_cache with network_info: [{"id": "7d465039-2df5-4a2d-bb08-e10e97b40fd7", "address": "fa:16:3e:f6:d8:28", "network": {"id": "010dbd36-41b4-476f-b0a7-34c9dbc108af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1030058809-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a35e596ed4643ba9e73bcfe8f8c03d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d465039-2d", "ovs_interfaceid": "7d465039-2df5-4a2d-bb08-e10e97b40fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:40.006849 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.703s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:40.009606 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.212s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:40.016581 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:36:40.019155 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Instance destroyed successfully.
May 19 04:36:40.019155 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Claim successful on node np0000001025
May 19 04:36:40.021746 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lazy-loading 'resources' on Instance uuid 6ea060d2-e149-4189-b93b-66ce319b9157 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:40.082626 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Deleted allocations for instance 7c91d680-72b2-4422-a3c6-fff9714d42cd
May 19 04:36:40.114917 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:40.118555 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:36:40.491533 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] Releasing lock "refresh_cache-f66a2b29-93d1-468a-94fc-77679fce8d64" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:36:40.491533 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Received event network-vif-unplugged-cb90c186-f98f-4d99-8292-e9600576dee1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:40.491533 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] Acquiring lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:40.491689 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:40.491689 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:40.491847 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] No waiting events found dispatching network-vif-unplugged-cb90c186-f98f-4d99-8292-e9600576dee1 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:40.491994 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Received unexpected event network-vif-unplugged-cb90c186-f98f-4d99-8292-e9600576dee1 for instance with vm_state deleted and task_state None.
May 19 04:36:40.492140 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received event network-vif-unplugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:40.492289 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] Acquiring lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:40.492581 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:40.492581 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:40.492666 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] No waiting events found dispatching network-vif-unplugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:40.492773 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-6e7f03c4-c70e-4d7a-87b0-63bfa50f84bb req-d89aadce-2c50-4325-806e-a26190386718 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received unexpected event network-vif-unplugged-fe8167e8-425b-4446-a2e8-84711a2be7dd for instance with vm_state rescued and task_state unrescuing.
May 19 04:36:40.529086 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1325996205',display_name='tempest-ServerActionsTestOtherB-server-1325996205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serveractionstestotherb-server-1325996205',id=8,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3jK8eIICR3l/4SHxst/8yPlILpDesN4+H3trAm2UFhRABDmHluvxgOWTGKox1jLYWeyqvab+bX/g483yAyobp3jhS/ZI5/84mWYZjjvl9ViemWFe558Ts8/0C9LeWLvw==',key_name='tempest-keypair-958107194',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:36:36Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b34124f30156425cbda16473ccedeff4',ramdisk_id='',reservation_id='r-k74jcc1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1000009728',owner_user_name='tempest-ServerActionsTestOtherB-1000009728-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:36:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cde403fc60ce4630af81e6bdfa2b4603',uuid=6ea060d2-e149-4189-b93b-66ce319b9157,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:36:40.529382 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Converting VIF {"id": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "address": "fa:16:3e:40:b1:c7", "network": {"id": "8114a6bf-054f-469f-a788-9fd489f4ee76", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1819520594-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b34124f30156425cbda16473ccedeff4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cdc75ea-9f", "ovs_interfaceid": "7cdc75ea-9f5f-4944-92ae-1788cf00aea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:40.530252 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:b1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7cdc75ea-9f5f-4944-92ae-1788cf00aea2,network=Network(8114a6bf-054f-469f-a788-9fd489f4ee76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cdc75ea-9f') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:40.530584 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:b1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7cdc75ea-9f5f-4944-92ae-1788cf00aea2,network=Network(8114a6bf-054f-469f-a788-9fd489f4ee76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cdc75ea-9f') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:36:40.532511 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:40.532733 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cdc75ea-9f, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:40.536693 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:40.541212 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:40.542009 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:40.542170 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a98e32a4-4fdd-41dd-93e8-0e589c628b07) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:40.542749 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:40.543233 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:40.547685 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:40.553772 np0000001025 nova-compute[97981]: INFO os_vif [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:b1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7cdc75ea-9f5f-4944-92ae-1788cf00aea2,network=Network(8114a6bf-054f-469f-a788-9fd489f4ee76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cdc75ea-9f')
May 19 04:36:40.554892 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:36:40.555248 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b25ba87-624c-4d65-b535-95d5d14da486', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:36:40.555407 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:40.627366 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165400.6269531, b5f34a29-15f7-4f5e-a8bf-574abebd5c84 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:40.627561 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] VM Started (Lifecycle Event)
May 19 04:36:40.708317 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Found WWN 3300000008bcdfb9f for multipath device dm-7 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:36:40.708602 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:40.708750 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000008bcdfb9f', 'path': '/dev/dm-7', 'multipath_id': '3300000008bcdfb9f'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:36:40.708874 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008bcdfb9f', 'path': '/dev/dm-7', 'multipath_id': '3300000008bcdfb9f'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:36:40.710170 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.155s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:40.710424 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b25ba87-624c-4d65-b535-95d5d14da486', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:36:40.710861 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:36:40.745707 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:40.745707 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:40.745707 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:40.745707 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:40.745707 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:40.745707 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:40.745707 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:40.745707 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:40.745707 np0000001025 nova-compute[97981]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:40.745707 np0000001025 nova-compute[97981]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:40.745707 np0000001025 nova-compute[97981]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:40.745707 np0000001025 nova-compute[97981]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:40.745707 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:40.746477 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:40.746477 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:40.746477 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:40.746477 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:40.746477 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:40.746477 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:40.746477 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:40.746477 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:40.746477 np0000001025 nova-compute[97981]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:40.746477 np0000001025 nova-compute[97981]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486 (non-flash)
May 19 04:36:40.746477 np0000001025 nova-compute[97981]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:40.746477 np0000001025 nova-compute[97981]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:40.746477 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:40.746477 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496', '32')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:36:40.746477 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', '30')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:36:40.749277 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486', '29')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:36:40.750810 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721834484b80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486'): ({'sdf'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:36:40.751102 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Removing multipathed devices sdg, sdf {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:36:40.751393 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Flush multipath device 330000000b045a358 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:36:40.789705 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:36:40.839757 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:36:40.851825 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1895dd08-204b-43b3-a28a-14a7da415846 req-ccfb9c08-5c28-4c21-8f05-e7d303df1905 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received event network-changed-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:40.851825 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1895dd08-204b-43b3-a28a-14a7da415846 req-ccfb9c08-5c28-4c21-8f05-e7d303df1905 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Refreshing instance network info cache due to event network-changed-fe8167e8-425b-4446-a2e8-84711a2be7dd. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:36:40.852130 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1895dd08-204b-43b3-a28a-14a7da415846 req-ccfb9c08-5c28-4c21-8f05-e7d303df1905 service nova] Acquiring lock "refresh_cache-b5f34a29-15f7-4f5e-a8bf-574abebd5c84" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:36:40.852130 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1895dd08-204b-43b3-a28a-14a7da415846 req-ccfb9c08-5c28-4c21-8f05-e7d303df1905 service nova] Acquired lock "refresh_cache-b5f34a29-15f7-4f5e-a8bf-574abebd5c84" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:36:40.852918 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1895dd08-204b-43b3-a28a-14a7da415846 req-ccfb9c08-5c28-4c21-8f05-e7d303df1905 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Refreshing network info cache for port fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:36:40.891490 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:36:40.891674 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:36:40.892968 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:36:40.905197 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:36:40.905388 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:36:40.921978 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:40.961459 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.40.100,3260]
May 19 04:36:40.961459 np0000001025 nova-compute[97981]: Logout of [sid: 30, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.40.100,3260] successful.
May 19 04:36:40.961459 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:40.983054 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:40.993651 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:41.002126 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:36:41.002310 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:36:41.002437 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] No VIF found with MAC fa:16:3e:f6:d8:28, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:36:41.002866 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Using config drive
May 19 04:36:41.030784 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.50.100,3260]
May 19 04:36:41.030784 np0000001025 nova-compute[97981]: Logout of [sid: 29, target: iqn.2023-03.storpool.com:os--volume-4b25ba87-624c-4d65-b535-95d5d14da486, portal: 192.168.50.100,3260] successful.
May 19 04:36:41.030784 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:41.055700 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:41.056015 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:41.056212 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] <== disconnect_volume: return (500ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:36:41.056373 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:36:41.056686 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Deleting instance files /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157_del
May 19 04:36:41.063407 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Deletion of /opt/stack/data/nova/instances/6ea060d2-e149-4189-b93b-66ce319b9157_del complete
May 19 04:36:41.091804 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5f15333-c80c-4912-a7d5-19d3aea77e1a tempest-VolumesAdminNegativeTest-304022391 tempest-VolumesAdminNegativeTest-304022391-project-member] Lock "7c91d680-72b2-4422-a3c6-fff9714d42cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.041s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:41.132987 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:41.135720 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:36:41.216383 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:36:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='instance-depend-image',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e1b00cc4af14242a0806348f4fa9117',ramdisk_id='',reservation_id='r-gv750q24',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-922756248',owner_user_name='tempest-ImageDependencyTests-922756248-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:36:32Z,user_data=None,user_id='5c66118759a7481ea214f9d98369ec54',uuid=d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74481730-a000-4409-b576-63d4431e1ac9", "address": "fa:16:3e:4d:15:35", "network": {"id": "65e495fa-ccc2-48b7-9b32-ef75280bef22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "579b33395d4a41479b805cf02294060a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74481730-a0", "ovs_interfaceid": "74481730-a000-4409-b576-63d4431e1ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:36:41.216589 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Converting VIF {"id": "74481730-a000-4409-b576-63d4431e1ac9", "address": "fa:16:3e:4d:15:35", "network": {"id": "65e495fa-ccc2-48b7-9b32-ef75280bef22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "579b33395d4a41479b805cf02294060a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74481730-a0", "ovs_interfaceid": "74481730-a000-4409-b576-63d4431e1ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:41.217156 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:15:35,bridge_name='br-int',has_traffic_filtering=True,id=74481730-a000-4409-b576-63d4431e1ac9,network=Network(65e495fa-ccc2-48b7-9b32-ef75280bef22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74481730-a0') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:41.217668 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lazy-loading 'pci_devices' on Instance uuid d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:41.319026 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:41.357968 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-1895dd08-204b-43b3-a28a-14a7da415846 req-ccfb9c08-5c28-4c21-8f05-e7d303df1905 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:41.507693 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:41.531958 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:36:41.532163 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:36:41.572431 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Took 1.92 seconds to destroy the instance on the hypervisor.
May 19 04:36:41.573160 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:36:41.573624 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:36:41.574222 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:36:41.574222 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:41.637442 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999302745000023 future=<Future at 0x7218345bd640 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:41.684484 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:41.728622 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] End _get_guest_xml xml=<domain type="qemu">
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:   <uuid>d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e</uuid>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:   <name>instance-0000000e</name>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <nova:name>instance-depend-image</nova:name>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:36:37</nova:creationTime>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:         <nova:properties/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:         <nova:user uuid="5c66118759a7481ea214f9d98369ec54">tempest-ImageDependencyTests-922756248-project-member</nova:user>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:         <nova:project uuid="3e1b00cc4af14242a0806348f4fa9117">tempest-ImageDependencyTests-922756248</nova:project>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:         <nova:port uuid="74481730-a000-4409-b576-63d4431e1ac9">
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="192.168.233.223" ipVersion="4"/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     <system>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <entry name="serial">d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e</entry>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <entry name="uuid">d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e</entry>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     </system>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:   <os>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:   </os>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:   <features>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:   </features>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:   <devices>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e/disk.config"/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <alias name="ua-7f5972c8-8c2c-4892-aa74-3f37c4c31496"/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-7"/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <serial>7f5972c8-8c2c-4892-aa74-3f37c4c31496</serial>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:4d:15:35"/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <target dev="tap74481730-a0"/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     </interface>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e/console.log" append="off"/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     </serial>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     <video>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     </video>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     </rng>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:   </devices>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]: </domain>
May 19 04:36:41.728622 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:36:41.730555 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Preparing to wait for external event network-vif-plugged-74481730-a000-4409-b576-63d4431e1ac9 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:36:41.730555 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Acquiring lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:41.730555 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:41.730555 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:41.730555 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:36:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='instance-depend-image',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e1b00cc4af14242a0806348f4fa9117',ramdisk_id='',reservation_id='r-gv750q24',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-922756248',owner_user_name='tempest-ImageDependencyTests-922756248-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:36:32Z,user_data=None,user_id='5c66118759a7481ea214f9d98369ec54',uuid=d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74481730-a000-4409-b576-63d4431e1ac9", "address": "fa:16:3e:4d:15:35", "network": {"id": "65e495fa-ccc2-48b7-9b32-ef75280bef22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "579b33395d4a41479b805cf02294060a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74481730-a0", "ovs_interfaceid": "74481730-a000-4409-b576-63d4431e1ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:36:41.730555 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Converting VIF {"id": "74481730-a000-4409-b576-63d4431e1ac9", "address": "fa:16:3e:4d:15:35", "network": {"id": "65e495fa-ccc2-48b7-9b32-ef75280bef22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "579b33395d4a41479b805cf02294060a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74481730-a0", "ovs_interfaceid": "74481730-a000-4409-b576-63d4431e1ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:41.732720 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:15:35,bridge_name='br-int',has_traffic_filtering=True,id=74481730-a000-4409-b576-63d4431e1ac9,network=Network(65e495fa-ccc2-48b7-9b32-ef75280bef22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74481730-a0') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:41.733854 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:15:35,bridge_name='br-int',has_traffic_filtering=True,id=74481730-a000-4409-b576-63d4431e1ac9,network=Network(65e495fa-ccc2-48b7-9b32-ef75280bef22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74481730-a0') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:36:41.733854 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:41.734188 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:41.735762 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:36:41.736197 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:41.736448 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8945be62-5a16-5867-ba60-0ce557d206b6', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:41.738443 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:41.745267 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:41.747723 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:41.748095 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74481730-a0, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:41.748221 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74481730-a0, col_values=(('qos', UUID('0dbf32d3-9997-430d-98a5-833aebfbe357')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:41.748371 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74481730-a0, col_values=(('external_ids', {'iface-id': '74481730-a000-4409-b576-63d4431e1ac9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:15:35', 'vm-uuid': 'd04a3ae5-77b3-4aa4-a37c-5f5d23178c8e'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:41.749429 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:41.750484 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:41.755057 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Creating config drive at /opt/stack/data/nova/instances/f66a2b29-93d1-468a-94fc-77679fce8d64/disk.config
May 19 04:36:41.759533 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f66a2b29-93d1-468a-94fc-77679fce8d64/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptsq61vxx {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:41.774296 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:41.782439 np0000001025 nova-compute[97981]: INFO os_vif [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:15:35,bridge_name='br-int',has_traffic_filtering=True,id=74481730-a000-4409-b576-63d4431e1ac9,network=Network(65e495fa-ccc2-48b7-9b32-ef75280bef22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74481730-a0')
May 19 04:36:41.813619 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f66a2b29-93d1-468a-94fc-77679fce8d64/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptsq61vxx" returned: 0 in 0.054s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:41.938101 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-aa2e5fe5-6875-4bde-9c0c-778cc9241f99 req-37bb7de7-7d51-461b-bfb7-67c900aac9ef service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received event network-vif-unplugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:41.940230 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-aa2e5fe5-6875-4bde-9c0c-778cc9241f99 req-37bb7de7-7d51-461b-bfb7-67c900aac9ef service nova] Acquiring lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:41.940230 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-aa2e5fe5-6875-4bde-9c0c-778cc9241f99 req-37bb7de7-7d51-461b-bfb7-67c900aac9ef service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:41.940230 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-aa2e5fe5-6875-4bde-9c0c-778cc9241f99 req-37bb7de7-7d51-461b-bfb7-67c900aac9ef service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:41.940230 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-aa2e5fe5-6875-4bde-9c0c-778cc9241f99 req-37bb7de7-7d51-461b-bfb7-67c900aac9ef service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] No waiting events found dispatching network-vif-unplugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:41.940230 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-aa2e5fe5-6875-4bde-9c0c-778cc9241f99 req-37bb7de7-7d51-461b-bfb7-67c900aac9ef service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received event network-vif-unplugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:36:41.940230 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-aa2e5fe5-6875-4bde-9c0c-778cc9241f99 req-37bb7de7-7d51-461b-bfb7-67c900aac9ef service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received event network-vif-unplugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:41.940230 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-aa2e5fe5-6875-4bde-9c0c-778cc9241f99 req-37bb7de7-7d51-461b-bfb7-67c900aac9ef service nova] Acquiring lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:41.940230 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-aa2e5fe5-6875-4bde-9c0c-778cc9241f99 req-37bb7de7-7d51-461b-bfb7-67c900aac9ef service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:41.940230 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-aa2e5fe5-6875-4bde-9c0c-778cc9241f99 req-37bb7de7-7d51-461b-bfb7-67c900aac9ef service nova] Lock "6ea060d2-e149-4189-b93b-66ce319b9157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:41.940230 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-aa2e5fe5-6875-4bde-9c0c-778cc9241f99 req-37bb7de7-7d51-461b-bfb7-67c900aac9ef service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] No waiting events found dispatching network-vif-unplugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:41.940230 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-aa2e5fe5-6875-4bde-9c0c-778cc9241f99 req-37bb7de7-7d51-461b-bfb7-67c900aac9ef service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received event network-vif-unplugged-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:36:42.036348 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:36:42.325701 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:42.368409 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:42.373332 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:42.429981 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-1895dd08-204b-43b3-a28a-14a7da415846 req-ccfb9c08-5c28-4c21-8f05-e7d303df1905 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:42.470518 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:42.548467 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.539s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:42.548717 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:36:42.627271 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1895dd08-204b-43b3-a28a-14a7da415846 req-ccfb9c08-5c28-4c21-8f05-e7d303df1905 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Updated VIF entry in instance network info cache for port fe8167e8-425b-4446-a2e8-84711a2be7dd. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:36:42.628223 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1895dd08-204b-43b3-a28a-14a7da415846 req-ccfb9c08-5c28-4c21-8f05-e7d303df1905 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Updating instance_info_cache with network_info: [{"id": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "address": "fa:16:3e:7d:73:e6", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe8167e8-42", "ovs_interfaceid": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:42.686444 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:42.721823 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:42.730734 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:42.734370 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:42.764842 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:42.774294 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:42.974356 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cc9491c7-a0c2-4d31-b0f1-eff658829c21 req-490d8550-488a-406a-b96f-cb7f002af0b5 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received event network-changed-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:42.976672 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cc9491c7-a0c2-4d31-b0f1-eff658829c21 req-490d8550-488a-406a-b96f-cb7f002af0b5 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Refreshing instance network info cache due to event network-changed-fe8167e8-425b-4446-a2e8-84711a2be7dd. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:36:42.978284 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cc9491c7-a0c2-4d31-b0f1-eff658829c21 req-490d8550-488a-406a-b96f-cb7f002af0b5 service nova] Acquiring lock "refresh_cache-b5f34a29-15f7-4f5e-a8bf-574abebd5c84" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:36:42.990935 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:43.055420 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:36:43.055686 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:36:43.056068 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:43.057472 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:43.132468 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c46088fb3e74b819bb456461716a801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b3c0fa8f894ed2a7c3bcfac99ce74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:36:43.134832 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1895dd08-204b-43b3-a28a-14a7da415846 req-ccfb9c08-5c28-4c21-8f05-e7d303df1905 service nova] Releasing lock "refresh_cache-b5f34a29-15f7-4f5e-a8bf-574abebd5c84" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:36:43.136100 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cc9491c7-a0c2-4d31-b0f1-eff658829c21 req-490d8550-488a-406a-b96f-cb7f002af0b5 service nova] Acquired lock "refresh_cache-b5f34a29-15f7-4f5e-a8bf-574abebd5c84" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:36:43.136304 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-cc9491c7-a0c2-4d31-b0f1-eff658829c21 req-490d8550-488a-406a-b96f-cb7f002af0b5 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Refreshing network info cache for port fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:36:43.188489 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Took 1.61 seconds to deallocate network for instance.
May 19 04:36:43.294266 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165403.2937844, f66a2b29-93d1-468a-94fc-77679fce8d64 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:43.294852 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] VM Started (Lifecycle Event)
May 19 04:36:43.312603 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:36:43.312747 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:36:43.313220 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] No VIF found with MAC fa:16:3e:4d:15:35, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:36:43.313619 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Using config drive
May 19 04:36:43.557066 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:36:43.561082 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:43.617345 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Successfully created port: 42511b94-b74e-4f65-8515-0c5e7a411348 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:36:43.638768 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-cc9491c7-a0c2-4d31-b0f1-eff658829c21 req-490d8550-488a-406a-b96f-cb7f002af0b5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:43.769752 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Took 0.58 seconds to detach 1 volumes for instance.
May 19 04:36:43.797536 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:43.802948 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165403.801587, f66a2b29-93d1-468a-94fc-77679fce8d64 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:43.802948 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] VM Paused (Lifecycle Event)
May 19 04:36:43.825287 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:44.062356 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:36:44.130160 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c48dbd6e-e28a-47d6-84a9-84aef3e9e99a req-eee02c7c-f6fa-4879-8464-ea2731f62b30 service nova] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Received event network-vif-deleted-7cdc75ea-9f5f-4944-92ae-1788cf00aea2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:44.130404 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c48dbd6e-e28a-47d6-84a9-84aef3e9e99a req-eee02c7c-f6fa-4879-8464-ea2731f62b30 service nova] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Received event network-vif-plugged-7d465039-2df5-4a2d-bb08-e10e97b40fd7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:44.130865 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c48dbd6e-e28a-47d6-84a9-84aef3e9e99a req-eee02c7c-f6fa-4879-8464-ea2731f62b30 service nova] Acquiring lock "f66a2b29-93d1-468a-94fc-77679fce8d64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:44.131053 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c48dbd6e-e28a-47d6-84a9-84aef3e9e99a req-eee02c7c-f6fa-4879-8464-ea2731f62b30 service nova] Lock "f66a2b29-93d1-468a-94fc-77679fce8d64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:44.131209 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c48dbd6e-e28a-47d6-84a9-84aef3e9e99a req-eee02c7c-f6fa-4879-8464-ea2731f62b30 service nova] Lock "f66a2b29-93d1-468a-94fc-77679fce8d64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:44.131320 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c48dbd6e-e28a-47d6-84a9-84aef3e9e99a req-eee02c7c-f6fa-4879-8464-ea2731f62b30 service nova] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Processing event network-vif-plugged-7d465039-2df5-4a2d-bb08-e10e97b40fd7 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:36:44.133249 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:36:44.138960 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:36:44.141994 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Instance spawned successfully.
May 19 04:36:44.143336 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:36:44.279207 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:44.279480 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:44.305033 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:44.307402 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165404.3070993, f66a2b29-93d1-468a-94fc-77679fce8d64 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:44.307554 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] VM Resumed (Lifecycle Event)
May 19 04:36:44.489952 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Successfully updated port: 42511b94-b74e-4f65-8515-0c5e7a411348 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:36:44.526860 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:44.552387 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Refreshing inventories for resource provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 19 04:36:44.569595 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Booting with volume 7b6c6b34-5903-4349-9469-29afd9a160da at /dev/vda
May 19 04:36:44.574920 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Creating config drive at /opt/stack/data/nova/instances/d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e/disk.config
May 19 04:36:44.583139 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx296r7kz {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:44.645208 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx296r7kz" returned: 0 in 0.063s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:44.663755 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:44.663994 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:44.664462 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:44.664815 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:44.665894 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:44.669312 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:36:44.671283 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:44.682741 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Updating ProviderTree inventory for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 19 04:36:44.682741 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Updating inventory in ProviderTree for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 19 04:36:44.691904 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:36:44.720619 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:44.755148 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Refreshing aggregate associations for resource provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6, aggregates: None {{(pid=97981) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 19 04:36:44.761825 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:36:44.762652 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:36:44.771479 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:36:44.774804 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::e86a:f3ff:fee3:83a1', 'fe80::fc16:3eff:fe8a:28ef', 'fe80::fc16:3eff:fe81:2190', 'fe80::fc16:3eff:fe3b:7832', 'fe80::fc16:3eff:fee7:64b0', 'fe80::40da:d4ff:fe7f:36e1', 'fe80::fc16:3eff:fec8:335b', 'fe80::fc16:3eff:fed0:413', 'fe80::fc16:3eff:fe50:b6e3', 'fe80::fc16:3eff:fe10:9776', 'fe80::bb:56ff:fe15:ec7', 'fe80::fc16:3eff:fe2c:e3ec', 'fe80::649e:6aff:fe70:3377', 'fe80::fc16:3eff:fe7d:73e6', 'fe80::fc16:3eff:fef6:d828', 'fe80::42e:9cff:fe3b:b5fe'] 
May 19 04:36:44.774804 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:36:44.774804 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:36:44.774996 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:36:44.775402 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Updating existing volume attachment record: b3d1616d-c702-4ace-a94f-b0d208fea941 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:36:44.810540 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-cc9491c7-a0c2-4d31-b0f1-eff658829c21 req-490d8550-488a-406a-b96f-cb7f002af0b5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:44.813855 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:44.818128 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:36:44.836462 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Refreshing trait associations for resource provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6, traits: COMPUTE_SOUND_MODEL_AC97,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ARCH_S390X,COMPUTE_SOUND_MODEL_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SOUND_MODEL_ICH9,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ARCH_MIPSEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_SOUND_MODEL_ICH6,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIF_MODEL_IGB,HW_ARCH_X86_64,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ARCH_X86_64,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ARCH_RISCV64,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_ARCH_AARCH64,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_STORAGE_VIRTIO_FS {{(pid=97981) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 19 04:36:44.982161 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-cc9491c7-a0c2-4d31-b0f1-eff658829c21 req-490d8550-488a-406a-b96f-cb7f002af0b5 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Updated VIF entry in instance network info cache for port fe8167e8-425b-4446-a2e8-84711a2be7dd. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:36:44.982542 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-cc9491c7-a0c2-4d31-b0f1-eff658829c21 req-490d8550-488a-406a-b96f-cb7f002af0b5 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Updating instance_info_cache with network_info: [{"id": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "address": "fa:16:3e:7d:73:e6", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe8167e8-42", "ovs_interfaceid": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:44.993975 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "refresh_cache-65dfcdfb-ef42-4b25-aea4-617d643d61e5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:36:44.995182 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquired lock "refresh_cache-65dfcdfb-ef42-4b25-aea4-617d643d61e5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:36:44.995182 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:36:45.161344 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:45.200947 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Took 9.45 seconds to spawn the instance on the hypervisor.
May 19 04:36:45.202067 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:45.237667 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:45.244737 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:45.299391 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:45.322321 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:36:45.347197 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:45.416313 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:36:45.416563 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:36:45.485074 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cc9491c7-a0c2-4d31-b0f1-eff658829c21 req-490d8550-488a-406a-b96f-cb7f002af0b5 service nova] Releasing lock "refresh_cache-b5f34a29-15f7-4f5e-a8bf-574abebd5c84" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:36:45.489743 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1444526e-6641-47d4-98ae-aaeb3902ae5b req-4442c535-4238-4d08-9ab6-9c2abb5bbdab service nova] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Received event network-vif-plugged-74481730-a000-4409-b576-63d4431e1ac9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:45.489927 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1444526e-6641-47d4-98ae-aaeb3902ae5b req-4442c535-4238-4d08-9ab6-9c2abb5bbdab service nova] Acquiring lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:45.490221 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1444526e-6641-47d4-98ae-aaeb3902ae5b req-4442c535-4238-4d08-9ab6-9c2abb5bbdab service nova] Lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:45.490221 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1444526e-6641-47d4-98ae-aaeb3902ae5b req-4442c535-4238-4d08-9ab6-9c2abb5bbdab service nova] Lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:45.490338 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1444526e-6641-47d4-98ae-aaeb3902ae5b req-4442c535-4238-4d08-9ab6-9c2abb5bbdab service nova] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Processing event network-vif-plugged-74481730-a000-4409-b576-63d4431e1ac9 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:36:45.525946 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:45.526216 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:45.529588 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:45.556193 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:45.560179 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:45.584595 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:36:45.720277 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Took 16.16 seconds to build instance.
May 19 04:36:45.796047 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:45.922506 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:36:45.970747 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Updating instance_info_cache with network_info: [{"id": "42511b94-b74e-4f65-8515-0c5e7a411348", "address": "fa:16:3e:f3:04:77", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42511b94-b7", "ovs_interfaceid": "42511b94-b74e-4f65-8515-0c5e7a411348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:46.129510 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165406.1290646, d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:46.130060 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:36:46.130624 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] VM Started (Lifecycle Event)
May 19 04:36:46.135352 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:36:46.137036 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Instance spawned successfully.
May 19 04:36:46.137302 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:36:46.222310 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-09218846-8b63-4f4e-a2c6-b804b8fec0b1 tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "f66a2b29-93d1-468a-94fc-77679fce8d64" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.677s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:46.241052 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1cd3547b-692c-4719-8634-b1d38d86c7aa req-13ac5ab3-0167-4c14-ba95-44e7ecc76f5d service nova] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Received event network-vif-plugged-7d465039-2df5-4a2d-bb08-e10e97b40fd7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:46.241232 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1cd3547b-692c-4719-8634-b1d38d86c7aa req-13ac5ab3-0167-4c14-ba95-44e7ecc76f5d service nova] Acquiring lock "f66a2b29-93d1-468a-94fc-77679fce8d64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:46.241406 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1cd3547b-692c-4719-8634-b1d38d86c7aa req-13ac5ab3-0167-4c14-ba95-44e7ecc76f5d service nova] Lock "f66a2b29-93d1-468a-94fc-77679fce8d64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:46.241516 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1cd3547b-692c-4719-8634-b1d38d86c7aa req-13ac5ab3-0167-4c14-ba95-44e7ecc76f5d service nova] Lock "f66a2b29-93d1-468a-94fc-77679fce8d64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:46.241654 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1cd3547b-692c-4719-8634-b1d38d86c7aa req-13ac5ab3-0167-4c14-ba95-44e7ecc76f5d service nova] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] No waiting events found dispatching network-vif-plugged-7d465039-2df5-4a2d-bb08-e10e97b40fd7 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:46.241784 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-1cd3547b-692c-4719-8634-b1d38d86c7aa req-13ac5ab3-0167-4c14-ba95-44e7ecc76f5d service nova] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Received unexpected event network-vif-plugged-7d465039-2df5-4a2d-bb08-e10e97b40fd7 for instance with vm_state active and task_state None.
May 19 04:36:46.241910 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1cd3547b-692c-4719-8634-b1d38d86c7aa req-13ac5ab3-0167-4c14-ba95-44e7ecc76f5d service nova] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Received event network-changed-42511b94-b74e-4f65-8515-0c5e7a411348 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:46.242018 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1cd3547b-692c-4719-8634-b1d38d86c7aa req-13ac5ab3-0167-4c14-ba95-44e7ecc76f5d service nova] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Refreshing instance network info cache due to event network-changed-42511b94-b74e-4f65-8515-0c5e7a411348. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:36:46.243157 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1cd3547b-692c-4719-8634-b1d38d86c7aa req-13ac5ab3-0167-4c14-ba95-44e7ecc76f5d service nova] Acquiring lock "refresh_cache-65dfcdfb-ef42-4b25-aea4-617d643d61e5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:36:46.433567 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.154s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:46.475634 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Releasing lock "refresh_cache-65dfcdfb-ef42-4b25-aea4-617d643d61e5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:36:46.475957 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Instance network_info: |[{"id": "42511b94-b74e-4f65-8515-0c5e7a411348", "address": "fa:16:3e:f3:04:77", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42511b94-b7", "ovs_interfaceid": "42511b94-b74e-4f65-8515-0c5e7a411348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:36:46.476362 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1cd3547b-692c-4719-8634-b1d38d86c7aa req-13ac5ab3-0167-4c14-ba95-44e7ecc76f5d service nova] Acquired lock "refresh_cache-65dfcdfb-ef42-4b25-aea4-617d643d61e5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:36:46.476555 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1cd3547b-692c-4719-8634-b1d38d86c7aa req-13ac5ab3-0167-4c14-ba95-44e7ecc76f5d service nova] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Refreshing network info cache for port 42511b94-b74e-4f65-8515-0c5e7a411348 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:36:46.517203 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Deleted allocations for instance 6ea060d2-e149-4189-b93b-66ce319b9157
May 19 04:36:46.540630 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:46.633251 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:46.636679 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:36:46.643078 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:46.643201 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:46.643440 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:46.643604 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:46.643819 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:46.644046 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:36:46.749467 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:46.917328 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:36:46.918239 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:36:46.918483 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Creating image(s)
May 19 04:36:46.918754 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:36:46.918862 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Ensure instance console log exists: /opt/stack/data/nova/instances/65dfcdfb-ef42-4b25-aea4-617d643d61e5/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:36:46.919079 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:46.919333 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:46.919444 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:46.919865 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Start _get_guest_xml network_info=[{"id": "42511b94-b74e-4f65-8515-0c5e7a411348", "address": "fa:16:3e:f3:04:77", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42511b94-b7", "ovs_interfaceid": "42511b94-b74e-4f65-8515-0c5e7a411348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'b3d1616d-c702-4ace-a94f-b0d208fea941', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7b6c6b34-5903-4349-9469-29afd9a160da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '65dfcdfb-ef42-4b25-aea4-617d643d61e5', 'attached_at': '', 'detached_at': '', 'volume_id': '7b6c6b34-5903-4349-9469-29afd9a160da', 'serial': '7b6c6b34-5903-4349-9469-29afd9a160da'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:36:46.923518 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:36:46.924439 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1139633655', uuid='65dfcdfb-ef42-4b25-aea4-617d643d61e5'), owner=OwnerMeta(userid='5c46088fb3e74b819bb456461716a801', username='tempest-TestVolumeBootPattern-1071176852-project-member', projectid='28b3c0fa8f894ed2a7c3bcfac99ce74c', projectname='tempest-TestVolumeBootPattern-1071176852'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "42511b94-b74e-4f65-8515-0c5e7a411348", "address": "fa:16:3e:f3:04:77", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42511b94-b7", "ovs_interfaceid": "42511b94-b74e-4f65-8515-0c5e7a411348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165406.924138) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:36:46.925174 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:36:46.925460 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:36:46.926573 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:36:46.926743 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:36:46.927572 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:36:46.927798 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:36:46.927930 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:36:46.928025 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:36:46.928233 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:36:46.928297 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:36:46.928422 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:36:46.928589 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:36:46.928752 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:36:46.928913 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:36:46.929009 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:36:46.929135 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:36:46.953805 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:36:46.954164 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7b6c6b34-5903-4349-9469-29afd9a160da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:36:46.954401 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:46.955487 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:46.955668 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7b6c6b34-5903-4349-9469-29afd9a160da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:36:46.970397 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:46.971405 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:46.972128 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:46.972357 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:36:46.972799 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:46.973050 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:36:46.979373 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-1cd3547b-692c-4719-8634-b1d38d86c7aa req-13ac5ab3-0167-4c14-ba95-44e7ecc76f5d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:46.986271 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:36:46.986271 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:46.993991 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:36:46.993991 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:47.001961 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da] added
May 19 04:36:47.001961 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:36:47.001961 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:47.001961 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:47.001961 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:47.001961 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:47.001961 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:47.002220 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:36:47.002452 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.03(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:36:47.002649 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:36:47.003613 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da] added
May 19 04:36:47.003613 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:36:47.003613 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:47.003613 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:47.003613 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:36:47.003613 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:36:47.003613 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:47.003846 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:36:47.004039 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:36:47.004251 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:36:47.138859 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:36:47.139161 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165407.138935, d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:47.139303 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] VM Paused (Lifecycle Event)
May 19 04:36:47.148897 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Took 12.24 seconds to spawn the instance on the hypervisor.
May 19 04:36:47.150242 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:47.443004 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-1cd3547b-692c-4719-8634-b1d38d86c7aa req-13ac5ab3-0167-4c14-ba95-44e7ecc76f5d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:47.529137 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dca659df-c743-4337-92ce-b1b48c1b0eb3 tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Lock "6ea060d2-e149-4189-b93b-66ce319b9157" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.395s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:47.587586 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2ad3db01-40b1-4103-bf9e-661f906b0c27 req-631815f8-d8c8-4303-93e9-d3e0ae8a9d20 service nova] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Received event network-vif-plugged-74481730-a000-4409-b576-63d4431e1ac9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:47.588383 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2ad3db01-40b1-4103-bf9e-661f906b0c27 req-631815f8-d8c8-4303-93e9-d3e0ae8a9d20 service nova] Acquiring lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:47.589149 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2ad3db01-40b1-4103-bf9e-661f906b0c27 req-631815f8-d8c8-4303-93e9-d3e0ae8a9d20 service nova] Lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:47.589149 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2ad3db01-40b1-4103-bf9e-661f906b0c27 req-631815f8-d8c8-4303-93e9-d3e0ae8a9d20 service nova] Lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:47.589149 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2ad3db01-40b1-4103-bf9e-661f906b0c27 req-631815f8-d8c8-4303-93e9-d3e0ae8a9d20 service nova] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] No waiting events found dispatching network-vif-plugged-74481730-a000-4409-b576-63d4431e1ac9 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:47.589266 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-2ad3db01-40b1-4103-bf9e-661f906b0c27 req-631815f8-d8c8-4303-93e9-d3e0ae8a9d20 service nova] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Received unexpected event network-vif-plugged-74481730-a000-4409-b576-63d4431e1ac9 for instance with vm_state active and task_state None.
May 19 04:36:47.642166 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:47.644120 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165407.6433468, d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:47.644120 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] VM Resumed (Lifecycle Event)
May 19 04:36:47.660383 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Took 19.86 seconds to build instance.
May 19 04:36:47.674822 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1cd3547b-692c-4719-8634-b1d38d86c7aa req-13ac5ab3-0167-4c14-ba95-44e7ecc76f5d service nova] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Updated VIF entry in instance network info cache for port 42511b94-b74e-4f65-8515-0c5e7a411348. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:36:47.675603 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1cd3547b-692c-4719-8634-b1d38d86c7aa req-13ac5ab3-0167-4c14-ba95-44e7ecc76f5d service nova] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Updating instance_info_cache with network_info: [{"id": "42511b94-b74e-4f65-8515-0c5e7a411348", "address": "fa:16:3e:f3:04:77", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42511b94-b7", "ovs_interfaceid": "42511b94-b74e-4f65-8515-0c5e7a411348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:47.995367 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:48.003337 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:36:48.005239 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:36:48.022308 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:36:48.022308 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:36:48.022308 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:48.038609 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:48.042803 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:48.058942 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:48.058942 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:48.058942 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:48.058942 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:48.058942 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:48.058942 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:48.058942 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:48.058942 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:48.058942 np0000001025 nova-compute[97981]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:48.058942 np0000001025 nova-compute[97981]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:48.058942 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:48.059270 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:48.059270 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:48.059270 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:48.059270 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:48.059270 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:48.059270 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:48.059270 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:48.059270 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:48.059270 np0000001025 nova-compute[97981]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:48.059270 np0000001025 nova-compute[97981]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:48.059270 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:48.068522 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:48.068522 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:48.068522 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:48.068522 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:48.068522 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:48.068522 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:48.068522 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:48.068522 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:48.068522 np0000001025 nova-compute[97981]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:48.068522 np0000001025 nova-compute[97981]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:48.068522 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:48.068522 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:48.068522 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:48.068522 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:48.068522 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:48.068522 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:48.068522 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:48.068522 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:48.068522 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:48.068522 np0000001025 nova-compute[97981]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:48.068522 np0000001025 nova-compute[97981]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:48.068522 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:48.088161 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:48.120165 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da, portal: 192.168.40.100,3260]
May 19 04:36:48.120165 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da, portal: 192.168.40.100,3260] successful.
May 19 04:36:48.120165 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:48.130135 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da, portal: 192.168.50.100,3260]
May 19 04:36:48.130135 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da, portal: 192.168.50.100,3260] successful.
May 19 04:36:48.130135 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:48.135616 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:48.143222 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:48.146670 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:48.148305 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:36:48.162482 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:48.162482 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:48.162482 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:48.162482 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:48.162482 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:48.162482 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:48.162482 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:48.162482 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:48.162482 np0000001025 nova-compute[97981]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:48.162482 np0000001025 nova-compute[97981]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:48.162482 np0000001025 nova-compute[97981]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da (non-flash)
May 19 04:36:48.162482 np0000001025 nova-compute[97981]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da (non-flash)
May 19 04:36:48.162482 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:48.163514 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:48.163514 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:48.163514 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:48.163514 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:48.163514 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:48.163514 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:48.163514 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:48.163514 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:48.163514 np0000001025 nova-compute[97981]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:48.163514 np0000001025 nova-compute[97981]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:48.163514 np0000001025 nova-compute[97981]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da (non-flash)
May 19 04:36:48.163514 np0000001025 nova-compute[97981]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da (non-flash)
May 19 04:36:48.163514 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:48.163514 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:48.163514 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:36:48.165611 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] HCTL ('11', '-', '-', 0) found on session 33 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:36:48.165611 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:36:48.165797 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.377s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:48.180486 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching for a device in session 33 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:36:48.180486 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7b6c6b34-5903-4349-9469-29afd9a160da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:36:48.180486 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1cd3547b-692c-4719-8634-b1d38d86c7aa req-13ac5ab3-0167-4c14-ba95-44e7ecc76f5d service nova] Releasing lock "refresh_cache-65dfcdfb-ef42-4b25-aea4-617d643d61e5" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da (non-flash)
May 19 04:36:48.183982 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.209s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] HCTL ('12', '-', '-', 0) found on session 34 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:36:48.183982 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:36:48.194695 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Acquiring lock "50deb249-66c3-410d-9521-f82821bed951" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:48.194695 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "50deb249-66c3-410d-9521-f82821bed951" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:48.212643 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching for a device in session 34 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:36:48.212643 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7b6c6b34-5903-4349-9469-29afd9a160da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:36:48.665522 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:48.698196 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:36:48.973002 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:36:49.282792 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:49.282792 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:49.285527 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:36:49.285527 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Claim successful on node np0000001025
May 19 04:36:49.937492 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.003879532999917501 future=<Future at 0x721834471d90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:49.937569 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:49.937653 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=2.7173322850001114 future=<Future at 0x7218345ca810 state=cancelled>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:49.937723 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=2.7172616980001294 future=<Future at 0x7218345ca810 state=cancelled>) was cancelled while queued, skipping {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:49.937777 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:49.937895 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=6.698820151000064 future=<Future at 0x7218345bd640 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:49.937932 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=6.698753249999982 future=<Future at 0x7218345bd640 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:49.941302 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] Emitting event <LifecycleEvent: 1779165394.933499, 7c91d680-72b2-4422-a3c6-fff9714d42cd => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:49.941754 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] VM Stopped (Lifecycle Event)
May 19 04:36:49.987514 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:49.988281 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Found WWN 330000000979bd0bb for multipath device dm-4 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:36:49.988580 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:49.989753 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000979bd0bb', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '330000000979bd0bb'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:36:49.989870 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000979bd0bb', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '330000000979bd0bb'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:36:50.033901 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7b6c6b34-5903-4349-9469-29afd9a160da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': '65dfcdfb-ef42-4b25-aea4-617d643d61e5', 'attached_at': '', 'detached_at': '', 'volume_id': '7b6c6b34-5903-4349-9469-29afd9a160da', 'serial': '7b6c6b34-5903-4349-9469-29afd9a160da'} {{(pid=97981) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 19 04:36:50.034048 np0000001025 nova-compute[97981]: WARNING stevedore.named [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 19 04:36:50.034102 np0000001025 nova-compute[97981]: WARNING castellan.key_manager [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:36:50.036261 np0000001025 nova-compute[97981]: WARNING nova.keymgr.conf_key_mgr [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:36:50.060646 np0000001025 nova-compute[97981]: WARNING os_brick.encryptors.luks [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 19 04:36:50.061068 np0000001025 nova-compute[97981]: WARNING stevedore.named [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 19 04:36:50.061305 np0000001025 nova-compute[97981]: WARNING castellan.key_manager [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:36:50.061494 np0000001025 nova-compute[97981]: WARNING nova.keymgr.conf_key_mgr [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:36:50.062064 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x72185015b530>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7b6c6b34-5903-4349-9469-29afd9a160da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': '65dfcdfb-ef42-4b25-aea4-617d643d61e5', 'attached_at': '', 'detached_at': '', 'volume_id': '7b6c6b34-5903-4349-9469-29afd9a160da', 'serial': '7b6c6b34-5903-4349-9469-29afd9a160da'} {{(pid=97981) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 19 04:36:50.062243 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors.luks [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] formatting encrypted volume /dev/dm-4 {{(pid=97981) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 19 04:36:50.449489 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4da10af-0a49-4081-9502-fe869715e60d tempest-ServerActionsTestOtherB-1000009728 tempest-ServerActionsTestOtherB-1000009728-project-member] [instance: 7c91d680-72b2-4422-a3c6-fff9714d42cd] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:50.869832 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:36:50.869936 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:36:51.373445 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:36:51.605195 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:51.750696 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:51.884385 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.601s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:51.884515 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:36:52.391044 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:36:52.391282 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:36:52.392049 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:52.393020 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:52.504499 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c73c832155da49cdb7faad111acd01e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a35e596ed4643ba9e73bcfe8f8c03d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:36:52.897456 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:36:52.997725 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:53.128833 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Successfully created port: eba2392d-142a-4d46-a12a-6e55a864bf14 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:36:53.408348 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:36:53.882675 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Successfully updated port: eba2392d-142a-4d46-a12a-6e55a864bf14 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:36:53.942691 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2d1e6b2e-b1d0-424e-8152-f6e03006a6a0 req-22724d4c-164d-46d4-9c99-d5f099a22862 service nova] [instance: 50deb249-66c3-410d-9521-f82821bed951] Received event network-changed-eba2392d-142a-4d46-a12a-6e55a864bf14 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:53.943138 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2d1e6b2e-b1d0-424e-8152-f6e03006a6a0 req-22724d4c-164d-46d4-9c99-d5f099a22862 service nova] [instance: 50deb249-66c3-410d-9521-f82821bed951] Refreshing instance network info cache due to event network-changed-eba2392d-142a-4d46-a12a-6e55a864bf14. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:36:53.943138 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2d1e6b2e-b1d0-424e-8152-f6e03006a6a0 req-22724d4c-164d-46d4-9c99-d5f099a22862 service nova] Acquiring lock "refresh_cache-50deb249-66c3-410d-9521-f82821bed951" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:36:53.943255 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2d1e6b2e-b1d0-424e-8152-f6e03006a6a0 req-22724d4c-164d-46d4-9c99-d5f099a22862 service nova] Acquired lock "refresh_cache-50deb249-66c3-410d-9521-f82821bed951" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:36:53.943690 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2d1e6b2e-b1d0-424e-8152-f6e03006a6a0 req-22724d4c-164d-46d4-9c99-d5f099a22862 service nova] [instance: 50deb249-66c3-410d-9521-f82821bed951] Refreshing network info cache for port eba2392d-142a-4d46-a12a-6e55a864bf14 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:36:54.056001 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Acquiring lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:54.056233 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:54.056443 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Acquiring lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:54.056606 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:54.056734 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:54.059576 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Terminating instance
May 19 04:36:54.113633 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Secret XML: <secret ephemeral="no" private="no">
May 19 04:36:54.113633 np0000001025 nova-compute[97981]:   <usage type="volume">
May 19 04:36:54.113633 np0000001025 nova-compute[97981]:     <volume>7b6c6b34-5903-4349-9469-29afd9a160da</volume>
May 19 04:36:54.113633 np0000001025 nova-compute[97981]:   </usage>
May 19 04:36:54.113633 np0000001025 nova-compute[97981]: </secret>
May 19 04:36:54.113633 np0000001025 nova-compute[97981]:  {{(pid=97981) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 19 04:36:54.385353 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Acquiring lock "refresh_cache-50deb249-66c3-410d-9521-f82821bed951" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:36:54.421771 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:36:54.422550 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:36:54.422765 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Creating image(s)
May 19 04:36:54.423285 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Acquiring lock "/opt/stack/data/nova/instances/50deb249-66c3-410d-9521-f82821bed951/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:54.423396 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "/opt/stack/data/nova/instances/50deb249-66c3-410d-9521-f82821bed951/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:54.423822 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "/opt/stack/data/nova/instances/50deb249-66c3-410d-9521-f82821bed951/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:54.424453 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:36:54.426645 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:36:54.427503 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:54.452173 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-2d1e6b2e-b1d0-424e-8152-f6e03006a6a0 req-22724d4c-164d-46d4-9c99-d5f099a22862 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:54.516424 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.089s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:54.517152 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:54.517687 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:54.518247 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:36:54.520716 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:36:54.520999 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:54.536051 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2d1e6b2e-b1d0-424e-8152-f6e03006a6a0 req-22724d4c-164d-46d4-9c99-d5f099a22862 service nova] [instance: 50deb249-66c3-410d-9521-f82821bed951] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:36:54.564167 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:36:54.596309 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:54.610352 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.089s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:54.614952 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/50deb249-66c3-410d-9521-f82821bed951/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:54.615261 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:54.637635 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1139633655',display_name='tempest-TestVolumeBootPattern-server-1139633655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-1139633655',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-gc2h4z8l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:36:44Z,user_data=None,user_id='5c46088fb3e74b819bb456461716a801',uuid=65dfcdfb-ef42-4b25-aea4-617d643d61e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42511b94-b74e-4f65-8515-0c5e7a411348", "address": "fa:16:3e:f3:04:77", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42511b94-b7", "ovs_interfaceid": "42511b94-b74e-4f65-8515-0c5e7a411348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:36:54.637635 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "42511b94-b74e-4f65-8515-0c5e7a411348", "address": "fa:16:3e:f3:04:77", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42511b94-b7", "ovs_interfaceid": "42511b94-b74e-4f65-8515-0c5e7a411348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:54.640459 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:04:77,bridge_name='br-int',has_traffic_filtering=True,id=42511b94-b74e-4f65-8515-0c5e7a411348,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42511b94-b7') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:54.642520 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'pci_devices' on Instance uuid 65dfcdfb-ef42-4b25-aea4-617d643d61e5 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:54.646599 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:54.658829 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:54.676501 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/50deb249-66c3-410d-9521-f82821bed951/disk 1073741824" returned: 0 in 0.064s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:54.677463 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.160s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:54.677778 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:54.774129 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2d1e6b2e-b1d0-424e-8152-f6e03006a6a0 req-22724d4c-164d-46d4-9c99-d5f099a22862 service nova] [instance: 50deb249-66c3-410d-9521-f82821bed951] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:54.832721 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.155s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:54.833117 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Checking if we can resize image /opt/stack/data/nova/instances/50deb249-66c3-410d-9521-f82821bed951/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:36:54.835473 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50deb249-66c3-410d-9521-f82821bed951/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:54.857920 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-71857a31-6783-4f8a-b6c9-d1d1b0253135 req-b7842aea-0d4a-48a1-ac49-19e7d2c6d222 service nova] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Received event network-vif-unplugged-74481730-a000-4409-b576-63d4431e1ac9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:54.859879 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-71857a31-6783-4f8a-b6c9-d1d1b0253135 req-b7842aea-0d4a-48a1-ac49-19e7d2c6d222 service nova] Acquiring lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:54.860265 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-71857a31-6783-4f8a-b6c9-d1d1b0253135 req-b7842aea-0d4a-48a1-ac49-19e7d2c6d222 service nova] Lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:54.860496 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-71857a31-6783-4f8a-b6c9-d1d1b0253135 req-b7842aea-0d4a-48a1-ac49-19e7d2c6d222 service nova] Lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:54.862369 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-71857a31-6783-4f8a-b6c9-d1d1b0253135 req-b7842aea-0d4a-48a1-ac49-19e7d2c6d222 service nova] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] No waiting events found dispatching network-vif-unplugged-74481730-a000-4409-b576-63d4431e1ac9 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:54.862369 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-71857a31-6783-4f8a-b6c9-d1d1b0253135 req-b7842aea-0d4a-48a1-ac49-19e7d2c6d222 service nova] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Received event network-vif-unplugged-74481730-a000-4409-b576-63d4431e1ac9 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:36:54.874962 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:54.909796 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999672690999887 future=<Future at 0x72185230fe00 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:54.915048 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Instance destroyed successfully.
May 19 04:36:54.915806 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lazy-loading 'resources' on Instance uuid d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:54.954487 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50deb249-66c3-410d-9521-f82821bed951/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:54.954940 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Cannot resize image /opt/stack/data/nova/instances/50deb249-66c3-410d-9521-f82821bed951/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:36:54.955373 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:36:54.955526 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Ensure instance console log exists: /opt/stack/data/nova/instances/50deb249-66c3-410d-9521-f82821bed951/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:36:54.955774 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:54.955980 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:54.956079 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:55.166045 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] End _get_guest_xml xml=<domain type="qemu">
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:   <uuid>65dfcdfb-ef42-4b25-aea4-617d643d61e5</uuid>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:   <name>instance-00000010</name>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestVolumeBootPattern-server-1139633655</nova:name>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:36:46</nova:creationTime>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:         <nova:properties/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:         <nova:user uuid="5c46088fb3e74b819bb456461716a801">tempest-TestVolumeBootPattern-1071176852-project-member</nova:user>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:         <nova:project uuid="28b3c0fa8f894ed2a7c3bcfac99ce74c">tempest-TestVolumeBootPattern-1071176852</nova:project>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:         <nova:port uuid="42511b94-b74e-4f65-8515-0c5e7a411348">
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     <system>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <entry name="serial">65dfcdfb-ef42-4b25-aea4-617d643d61e5</entry>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <entry name="uuid">65dfcdfb-ef42-4b25-aea4-617d643d61e5</entry>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     </system>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:   <os>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:   </os>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:   <features>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:   </features>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:   <devices>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/65dfcdfb-ef42-4b25-aea4-617d643d61e5/disk.config"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <alias name="ua-7b6c6b34-5903-4349-9469-29afd9a160da"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <serial>7b6c6b34-5903-4349-9469-29afd9a160da</serial>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <encryption format="luks">
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:         <secret type="passphrase" uuid="d8da4dfa-67cf-426a-baf7-0fad0fdd8b22"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       </encryption>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:f3:04:77"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <target dev="tap42511b94-b7"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     </interface>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/65dfcdfb-ef42-4b25-aea4-617d643d61e5/console.log" append="off"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     </serial>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     <video>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     </video>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     </rng>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:   </devices>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]: </domain>
May 19 04:36:55.166045 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:36:55.168534 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Preparing to wait for external event network-vif-plugged-42511b94-b74e-4f65-8515-0c5e7a411348 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:36:55.168534 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:55.168534 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:55.168534 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:55.168534 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1139633655',display_name='tempest-TestVolumeBootPattern-server-1139633655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-1139633655',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-gc2h4z8l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:36:44Z,user_data=None,user_id='5c46088fb3e74b819bb456461716a801',uuid=65dfcdfb-ef42-4b25-aea4-617d643d61e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42511b94-b74e-4f65-8515-0c5e7a411348", "address": "fa:16:3e:f3:04:77", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42511b94-b7", "ovs_interfaceid": "42511b94-b74e-4f65-8515-0c5e7a411348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:36:55.168710 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "42511b94-b74e-4f65-8515-0c5e7a411348", "address": "fa:16:3e:f3:04:77", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42511b94-b7", "ovs_interfaceid": "42511b94-b74e-4f65-8515-0c5e7a411348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:55.169834 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:04:77,bridge_name='br-int',has_traffic_filtering=True,id=42511b94-b74e-4f65-8515-0c5e7a411348,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42511b94-b7') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:55.170748 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:04:77,bridge_name='br-int',has_traffic_filtering=True,id=42511b94-b74e-4f65-8515-0c5e7a411348,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42511b94-b7') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:36:55.171398 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:55.171649 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:55.171876 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:36:55.172959 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:55.173182 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc8c44ee-371f-59af-b583-fe0bead92633', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:55.173910 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:55.174664 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:55.174863 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:55.182949 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:55.187886 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:55.188800 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42511b94-b7, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:55.189208 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap42511b94-b7, col_values=(('qos', UUID('7dea52b0-c2d2-42ef-9a55-8976026c56e2')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:55.189391 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap42511b94-b7, col_values=(('external_ids', {'iface-id': '42511b94-b74e-4f65-8515-0c5e7a411348', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:04:77', 'vm-uuid': '65dfcdfb-ef42-4b25-aea4-617d643d61e5'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:55.192917 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:55.203877 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:55.204492 np0000001025 nova-compute[97981]: INFO os_vif [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:04:77,bridge_name='br-int',has_traffic_filtering=True,id=42511b94-b74e-4f65-8515-0c5e7a411348,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42511b94-b7')
May 19 04:36:55.278697 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2d1e6b2e-b1d0-424e-8152-f6e03006a6a0 req-22724d4c-164d-46d4-9c99-d5f099a22862 service nova] Releasing lock "refresh_cache-50deb249-66c3-410d-9521-f82821bed951" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:36:55.281163 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Acquired lock "refresh_cache-50deb249-66c3-410d-9521-f82821bed951" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:36:55.281163 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:36:55.420371 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:36:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='instance-depend-image',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:36:47Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e1b00cc4af14242a0806348f4fa9117',ramdisk_id='',reservation_id='r-gv750q24',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-ImageDependencyTests-922756248',owner_user_name='tempest-ImageDependencyTests-922756248-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:36:47Z,user_data=None,user_id='5c66118759a7481ea214f9d98369ec54',uuid=d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74481730-a000-4409-b576-63d4431e1ac9", "address": "fa:16:3e:4d:15:35", "network": {"id": "65e495fa-ccc2-48b7-9b32-ef75280bef22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "579b33395d4a41479b805cf02294060a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74481730-a0", "ovs_interfaceid": "74481730-a000-4409-b576-63d4431e1ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:36:55.420584 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Converting VIF {"id": "74481730-a000-4409-b576-63d4431e1ac9", "address": "fa:16:3e:4d:15:35", "network": {"id": "65e495fa-ccc2-48b7-9b32-ef75280bef22", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "579b33395d4a41479b805cf02294060a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74481730-a0", "ovs_interfaceid": "74481730-a000-4409-b576-63d4431e1ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:55.421830 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:15:35,bridge_name='br-int',has_traffic_filtering=True,id=74481730-a000-4409-b576-63d4431e1ac9,network=Network(65e495fa-ccc2-48b7-9b32-ef75280bef22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74481730-a0') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:55.422799 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:15:35,bridge_name='br-int',has_traffic_filtering=True,id=74481730-a000-4409-b576-63d4431e1ac9,network=Network(65e495fa-ccc2-48b7-9b32-ef75280bef22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74481730-a0') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:36:55.424923 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:55.425479 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74481730-a0, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:55.430096 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:55.436175 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:55.436175 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:55.436175 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0dbf32d3-9997-430d-98a5-833aebfbe357) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:55.437818 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:55.438561 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:55.444474 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:55.447024 np0000001025 nova-compute[97981]: INFO os_vif [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:15:35,bridge_name='br-int',has_traffic_filtering=True,id=74481730-a000-4409-b576-63d4431e1ac9,network=Network(65e495fa-ccc2-48b7-9b32-ef75280bef22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74481730-a0')
May 19 04:36:55.448554 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:36:55.448962 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496', 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f5972c8-8c2c-4892-aa74-3f37c4c31496', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:36:55.449241 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:36:55.450888 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:36:55.450888 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496', 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f5972c8-8c2c-4892-aa74-3f37c4c31496', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:36:55.450888 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:36:55.481850 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:55.481850 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:55.481850 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:55.481850 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:55.481850 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:55.481850 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:55.481850 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:55.481850 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:55.481850 np0000001025 nova-compute[97981]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:55.481850 np0000001025 nova-compute[97981]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:55.481850 np0000001025 nova-compute[97981]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da (non-flash)
May 19 04:36:55.481850 np0000001025 nova-compute[97981]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da (non-flash)
May 19 04:36:55.481850 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:36:55.482350 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:55.482350 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:36:55.482350 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:55.482350 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:36:55.482350 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:55.482350 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:36:55.482350 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:55.482350 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:36:55.482350 np0000001025 nova-compute[97981]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:55.482350 np0000001025 nova-compute[97981]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496 (non-flash)
May 19 04:36:55.482350 np0000001025 nova-compute[97981]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da (non-flash)
May 19 04:36:55.482350 np0000001025 nova-compute[97981]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da (non-flash)
May 19 04:36:55.482350 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:36:55.482350 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', '34')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:36:55.482672 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496', '32')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:36:55.484220 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496', '31')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:36:55.486439 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218345974c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496'): ({'sdl'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:36:55.487033 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Removing multipathed devices sdm, sdl {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:36:55.487740 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Flush multipath device 3300000008bcdfb9f {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:36:55.517316 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:36:55.562626 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:36:55.607748 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:36:55.607748 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:36:55.609703 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:36:55.624759 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:36:55.625051 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:36:55.637382 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:55.675399 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496, portal: 192.168.40.100,3260]
May 19 04:36:55.675399 np0000001025 nova-compute[97981]: Logout of [sid: 32, target: iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496, portal: 192.168.40.100,3260] successful.
May 19 04:36:55.675399 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:55.698281 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:55.710886 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:55.760468 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496, portal: 192.168.50.100,3260]
May 19 04:36:55.760468 np0000001025 nova-compute[97981]: Logout of [sid: 31, target: iqn.2023-03.storpool.com:os--volume-7f5972c8-8c2c-4892-aa74-3f37c4c31496, portal: 192.168.50.100,3260] successful.
May 19 04:36:55.760468 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:55.779521 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:36:55.779681 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:36:55.779789 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] <== disconnect_volume: return (331ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:36:55.779891 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:36:55.780152 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Deleting instance files /opt/stack/data/nova/instances/d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e_del
May 19 04:36:55.780631 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Deletion of /opt/stack/data/nova/instances/d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e_del complete
May 19 04:36:55.888241 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:36:56.106716 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:56.296779 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Took 1.73 seconds to destroy the instance on the hypervisor.
May 19 04:36:56.297893 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:36:56.297893 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:36:56.297893 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:36:56.298165 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:56.331911 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Updating instance_info_cache with network_info: [{"id": "eba2392d-142a-4d46-a12a-6e55a864bf14", "address": "fa:16:3e:20:a8:f2", "network": {"id": "010dbd36-41b4-476f-b0a7-34c9dbc108af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1030058809-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a35e596ed4643ba9e73bcfe8f8c03d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba2392d-14", "ovs_interfaceid": "eba2392d-142a-4d46-a12a-6e55a864bf14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:56.425365 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:56.637121 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0003616609999426146 future=<Future at 0x7218345bd640 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:56.637463 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:56.637567 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=13.271882675999905 future=<Future at 0x72185230fe00 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:56.637832 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Emitting event <LifecycleEvent: 1779165401.6366365, 6ea060d2-e149-4189-b93b-66ce319b9157 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:56.638023 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=13.271429749999925 future=<Future at 0x72185230fe00 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:36:56.638279 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] VM Stopped (Lifecycle Event)
May 19 04:36:56.721767 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ac9705c9-67bb-4733-ab68-b77d68189202 req-9037da8a-66c3-41f4-8826-2974edcf3590 service nova] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Received event network-vif-deleted-74481730-a000-4409-b576-63d4431e1ac9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:56.722294 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-ac9705c9-67bb-4733-ab68-b77d68189202 req-9037da8a-66c3-41f4-8826-2974edcf3590 service nova] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Neutron deleted interface 74481730-a000-4409-b576-63d4431e1ac9; detaching it from the instance and deleting it from the info cache
May 19 04:36:56.722789 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-ac9705c9-67bb-4733-ab68-b77d68189202 req-9037da8a-66c3-41f4-8826-2974edcf3590 service nova] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:56.727015 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:36:56.727218 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:36:56.727369 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No VIF found with MAC fa:16:3e:f3:04:77, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:36:56.727838 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Using config drive
May 19 04:36:56.835156 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Releasing lock "refresh_cache-50deb249-66c3-410d-9521-f82821bed951" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:36:56.835970 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Instance network_info: |[{"id": "eba2392d-142a-4d46-a12a-6e55a864bf14", "address": "fa:16:3e:20:a8:f2", "network": {"id": "010dbd36-41b4-476f-b0a7-34c9dbc108af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1030058809-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a35e596ed4643ba9e73bcfe8f8c03d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba2392d-14", "ovs_interfaceid": "eba2392d-142a-4d46-a12a-6e55a864bf14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:36:56.837169 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Start _get_guest_xml network_info=[{"id": "eba2392d-142a-4d46-a12a-6e55a864bf14", "address": "fa:16:3e:20:a8:f2", "network": {"id": "010dbd36-41b4-476f-b0a7-34c9dbc108af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1030058809-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a35e596ed4643ba9e73bcfe8f8c03d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba2392d-14", "ovs_interfaceid": "eba2392d-142a-4d46-a12a-6e55a864bf14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:36:56.840347 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:36:56.840493 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-1416575896', uuid='50deb249-66c3-410d-9521-f82821bed951'), owner=OwnerMeta(userid='c73c832155da49cdb7faad111acd01e5', username='tempest-ServersNegativeTestJSON-1193290315-project-member', projectid='8a35e596ed4643ba9e73bcfe8f8c03d2', projectname='tempest-ServersNegativeTestJSON-1193290315'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "eba2392d-142a-4d46-a12a-6e55a864bf14", "address": "fa:16:3e:20:a8:f2", "network": {"id": "010dbd36-41b4-476f-b0a7-34c9dbc108af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1030058809-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a35e596ed4643ba9e73bcfe8f8c03d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba2392d-14", "ovs_interfaceid": "eba2392d-142a-4d46-a12a-6e55a864bf14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165416.8401003) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:36:56.841849 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:36:56.842346 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:36:56.843260 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:36:56.843567 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:36:56.844928 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:36:56.845410 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:36:56.845671 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:36:56.845724 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:36:56.845919 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:36:56.846063 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:36:56.847254 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:36:56.847254 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:36:56.847254 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:36:56.847254 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:36:56.847254 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:36:56.847254 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:36:56.866217 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:36:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1416575896',display_name='tempest-ServersNegativeTestJSON-server-1416575896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serversnegativetestjson-server-1416575896',id=17,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a35e596ed4643ba9e73bcfe8f8c03d2',ramdisk_id='',reservation_id='r-6whm9nr6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1193290315',owner_user_name='tempest-ServersNegativeTestJSON-1193290315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:36:53Z,user_data=None,user_id='c73c832155da49cdb7faad111acd01e5',uuid=50deb249-66c3-410d-9521-f82821bed951,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eba2392d-142a-4d46-a12a-6e55a864bf14", "address": "fa:16:3e:20:a8:f2", "network": {"id": "010dbd36-41b4-476f-b0a7-34c9dbc108af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1030058809-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a35e596ed4643ba9e73bcfe8f8c03d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba2392d-14", "ovs_interfaceid": "eba2392d-142a-4d46-a12a-6e55a864bf14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:36:56.866590 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Converting VIF {"id": "eba2392d-142a-4d46-a12a-6e55a864bf14", "address": "fa:16:3e:20:a8:f2", "network": {"id": "010dbd36-41b4-476f-b0a7-34c9dbc108af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1030058809-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a35e596ed4643ba9e73bcfe8f8c03d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba2392d-14", "ovs_interfaceid": "eba2392d-142a-4d46-a12a-6e55a864bf14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:56.867340 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:a8:f2,bridge_name='br-int',has_traffic_filtering=True,id=eba2392d-142a-4d46-a12a-6e55a864bf14,network=Network(010dbd36-41b4-476f-b0a7-34c9dbc108af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba2392d-14') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:56.868469 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lazy-loading 'pci_devices' on Instance uuid 50deb249-66c3-410d-9521-f82821bed951 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:36:57.115098 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8caa20a1-be03-45b8-815b-1754a48fe9eb req-148e082e-8677-40d9-9e1a-4e7fc265f299 service nova] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Received event network-vif-unplugged-74481730-a000-4409-b576-63d4431e1ac9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:57.115524 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8caa20a1-be03-45b8-815b-1754a48fe9eb req-148e082e-8677-40d9-9e1a-4e7fc265f299 service nova] Acquiring lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:57.115614 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8caa20a1-be03-45b8-815b-1754a48fe9eb req-148e082e-8677-40d9-9e1a-4e7fc265f299 service nova] Lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:57.115807 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8caa20a1-be03-45b8-815b-1754a48fe9eb req-148e082e-8677-40d9-9e1a-4e7fc265f299 service nova] Lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:57.115958 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8caa20a1-be03-45b8-815b-1754a48fe9eb req-148e082e-8677-40d9-9e1a-4e7fc265f299 service nova] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] No waiting events found dispatching network-vif-unplugged-74481730-a000-4409-b576-63d4431e1ac9 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:57.116392 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8caa20a1-be03-45b8-815b-1754a48fe9eb req-148e082e-8677-40d9-9e1a-4e7fc265f299 service nova] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Received event network-vif-unplugged-74481730-a000-4409-b576-63d4431e1ac9 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:36:57.142324 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: 6ea060d2-e149-4189-b93b-66ce319b9157] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:36:57.154720 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:57.156691 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:36:57.226634 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ac9705c9-67bb-4733-ab68-b77d68189202 req-9037da8a-66c3-41f4-8826-2974edcf3590 service nova] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Detach interface failed, port_id=74481730-a000-4409-b576-63d4431e1ac9, reason: Instance d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:36:57.233167 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:57.371816 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] End _get_guest_xml xml=<domain type="qemu">
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:   <uuid>50deb249-66c3-410d-9521-f82821bed951</uuid>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:   <name>instance-00000011</name>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServersNegativeTestJSON-server-1416575896</nova:name>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:36:56</nova:creationTime>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:         <nova:user uuid="c73c832155da49cdb7faad111acd01e5">tempest-ServersNegativeTestJSON-1193290315-project-member</nova:user>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:         <nova:project uuid="8a35e596ed4643ba9e73bcfe8f8c03d2">tempest-ServersNegativeTestJSON-1193290315</nova:project>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:         <nova:port uuid="eba2392d-142a-4d46-a12a-6e55a864bf14">
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     <system>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <entry name="serial">50deb249-66c3-410d-9521-f82821bed951</entry>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <entry name="uuid">50deb249-66c3-410d-9521-f82821bed951</entry>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     </system>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:   <os>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:   </os>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:   <features>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:   </features>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:   <devices>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/50deb249-66c3-410d-9521-f82821bed951/disk"/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/50deb249-66c3-410d-9521-f82821bed951/disk.config"/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     </disk>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:20:a8:f2"/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <target dev="tapeba2392d-14"/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     </interface>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/50deb249-66c3-410d-9521-f82821bed951/console.log" append="off"/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     </serial>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     <video>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     </video>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     </rng>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:   </devices>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]: </domain>
May 19 04:36:57.371816 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:36:57.377635 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Preparing to wait for external event network-vif-plugged-eba2392d-142a-4d46-a12a-6e55a864bf14 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:36:57.377635 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Acquiring lock "50deb249-66c3-410d-9521-f82821bed951-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:57.377635 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "50deb249-66c3-410d-9521-f82821bed951-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:57.377635 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "50deb249-66c3-410d-9521-f82821bed951-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:57.377635 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:36:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1416575896',display_name='tempest-ServersNegativeTestJSON-server-1416575896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serversnegativetestjson-server-1416575896',id=17,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a35e596ed4643ba9e73bcfe8f8c03d2',ramdisk_id='',reservation_id='r-6whm9nr6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1193290315',owner_user_name='tempest-ServersNegativeTestJSON-1193290315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:36:53Z,user_data=None,user_id='c73c832155da49cdb7faad111acd01e5',uuid=50deb249-66c3-410d-9521-f82821bed951,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eba2392d-142a-4d46-a12a-6e55a864bf14", "address": "fa:16:3e:20:a8:f2", "network": {"id": "010dbd36-41b4-476f-b0a7-34c9dbc108af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1030058809-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a35e596ed4643ba9e73bcfe8f8c03d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba2392d-14", "ovs_interfaceid": "eba2392d-142a-4d46-a12a-6e55a864bf14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:36:57.377635 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Converting VIF {"id": "eba2392d-142a-4d46-a12a-6e55a864bf14", "address": "fa:16:3e:20:a8:f2", "network": {"id": "010dbd36-41b4-476f-b0a7-34c9dbc108af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1030058809-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a35e596ed4643ba9e73bcfe8f8c03d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba2392d-14", "ovs_interfaceid": "eba2392d-142a-4d46-a12a-6e55a864bf14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:36:57.377635 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:a8:f2,bridge_name='br-int',has_traffic_filtering=True,id=eba2392d-142a-4d46-a12a-6e55a864bf14,network=Network(010dbd36-41b4-476f-b0a7-34c9dbc108af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba2392d-14') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:36:57.377635 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:a8:f2,bridge_name='br-int',has_traffic_filtering=True,id=eba2392d-142a-4d46-a12a-6e55a864bf14,network=Network(010dbd36-41b4-476f-b0a7-34c9dbc108af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba2392d-14') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:36:57.377635 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:57.377635 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:57.377635 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:36:57.378288 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:57.378288 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dff37d43-2175-5148-92d6-882536f83477', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:57.380934 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:57.385206 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Creating config drive at /opt/stack/data/nova/instances/65dfcdfb-ef42-4b25-aea4-617d643d61e5/disk.config
May 19 04:36:57.387745 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:57.392333 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/65dfcdfb-ef42-4b25-aea4-617d643d61e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvbspy3vf {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:57.409012 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:57.409863 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeba2392d-14, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:57.410945 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeba2392d-14, col_values=(('qos', UUID('cbb1a9d3-b309-444e-870e-d11a263ef5af')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:57.411637 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeba2392d-14, col_values=(('external_ids', {'iface-id': 'eba2392d-142a-4d46-a12a-6e55a864bf14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:a8:f2', 'vm-uuid': '50deb249-66c3-410d-9521-f82821bed951'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:36:57.422759 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:36:57.429461 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:57.433667 np0000001025 nova-compute[97981]: INFO os_vif [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:a8:f2,bridge_name='br-int',has_traffic_filtering=True,id=eba2392d-142a-4d46-a12a-6e55a864bf14,network=Network(010dbd36-41b4-476f-b0a7-34c9dbc108af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba2392d-14')
May 19 04:36:57.461942 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/65dfcdfb-ef42-4b25-aea4-617d643d61e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvbspy3vf" returned: 0 in 0.069s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:57.661260 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Took 1.36 seconds to deallocate network for instance.
May 19 04:36:57.949496 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:57.989982 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:57.995620 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:58.002096 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:58.102765 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:58.234050 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Took 0.57 seconds to detach 1 volumes for instance.
May 19 04:36:58.236515 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Deleting volume: 7f5972c8-8c2c-4892-aa74-3f37c4c31496 {{(pid=97981) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 19 04:36:58.305304 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:58.316327 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:58.350411 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:36:58.797619 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:58.797964 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:58.957454 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:36:58.957616 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:36:58.957731 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] No VIF found with MAC fa:16:3e:20:a8:f2, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:36:58.958398 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Using config drive
May 19 04:36:59.199307 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-77c9a625-b56d-4bd5-b462-429db3c414a8 req-ea77341c-ce0b-4b01-a66a-6a8d5133643b service nova] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Received event network-vif-plugged-42511b94-b74e-4f65-8515-0c5e7a411348 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:59.199672 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-77c9a625-b56d-4bd5-b462-429db3c414a8 req-ea77341c-ce0b-4b01-a66a-6a8d5133643b service nova] Acquiring lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:59.200145 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-77c9a625-b56d-4bd5-b462-429db3c414a8 req-ea77341c-ce0b-4b01-a66a-6a8d5133643b service nova] Lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:59.200289 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-77c9a625-b56d-4bd5-b462-429db3c414a8 req-ea77341c-ce0b-4b01-a66a-6a8d5133643b service nova] Lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:59.200468 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-77c9a625-b56d-4bd5-b462-429db3c414a8 req-ea77341c-ce0b-4b01-a66a-6a8d5133643b service nova] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Processing event network-vif-plugged-42511b94-b74e-4f65-8515-0c5e7a411348 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:36:59.200600 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-77c9a625-b56d-4bd5-b462-429db3c414a8 req-ea77341c-ce0b-4b01-a66a-6a8d5133643b service nova] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Received event network-vif-plugged-42511b94-b74e-4f65-8515-0c5e7a411348 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:36:59.200719 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-77c9a625-b56d-4bd5-b462-429db3c414a8 req-ea77341c-ce0b-4b01-a66a-6a8d5133643b service nova] Acquiring lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:36:59.201039 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-77c9a625-b56d-4bd5-b462-429db3c414a8 req-ea77341c-ce0b-4b01-a66a-6a8d5133643b service nova] Lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:36:59.201183 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-77c9a625-b56d-4bd5-b462-429db3c414a8 req-ea77341c-ce0b-4b01-a66a-6a8d5133643b service nova] Lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:36:59.201272 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-77c9a625-b56d-4bd5-b462-429db3c414a8 req-ea77341c-ce0b-4b01-a66a-6a8d5133643b service nova] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] No waiting events found dispatching network-vif-plugged-42511b94-b74e-4f65-8515-0c5e7a411348 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:36:59.201386 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-77c9a625-b56d-4bd5-b462-429db3c414a8 req-ea77341c-ce0b-4b01-a66a-6a8d5133643b service nova] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Received unexpected event network-vif-plugged-42511b94-b74e-4f65-8515-0c5e7a411348 for instance with vm_state building and task_state spawning.
May 19 04:36:59.287963 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:36:59.288737 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:36:59.465154 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:36:59.631673 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Creating config drive at /opt/stack/data/nova/instances/50deb249-66c3-410d-9521-f82821bed951/disk.config
May 19 04:36:59.636767 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/50deb249-66c3-410d-9521-f82821bed951/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpymdvov4c {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:36:59.684728 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/50deb249-66c3-410d-9521-f82821bed951/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpymdvov4c" returned: 0 in 0.048s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:36:59.780268 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:36:59.781017 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165419.7803586, 65dfcdfb-ef42-4b25-aea4-617d643d61e5 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:36:59.781220 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] VM Started (Lifecycle Event)
May 19 04:36:59.785145 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:36:59.790035 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Instance spawned successfully.
May 19 04:36:59.793153 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:36:59.797253 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:37:00.182538 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:00.213357 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:00.216572 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:00.284981 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:00.292784 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:37:00.298612 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:00.302199 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.504s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:00.309250 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:00.309250 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:00.309324 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:00.309511 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:00.309719 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:00.309968 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:00.354433 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:00.372926 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Deleted allocations for instance d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e
May 19 04:37:00.748489 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "5951341b-0ad5-4fb0-82ad-b464c081f37f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:00.748679 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "5951341b-0ad5-4fb0-82ad-b464c081f37f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:00.795024 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:37:00.795295 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165420.795081, 65dfcdfb-ef42-4b25-aea4-617d643d61e5 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:00.795380 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] VM Paused (Lifecycle Event)
May 19 04:37:00.815570 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Took 13.90 seconds to spawn the instance on the hypervisor.
May 19 04:37:00.815754 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:01.253624 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:37:01.282100 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-97b48080-70ef-44f4-b619-4ac931a84693 req-6efbb3d8-49d8-445f-9c66-275429491aa7 service nova] [instance: 50deb249-66c3-410d-9521-f82821bed951] Received event network-vif-plugged-eba2392d-142a-4d46-a12a-6e55a864bf14 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:01.282100 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-97b48080-70ef-44f4-b619-4ac931a84693 req-6efbb3d8-49d8-445f-9c66-275429491aa7 service nova] Acquiring lock "50deb249-66c3-410d-9521-f82821bed951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:01.282100 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-97b48080-70ef-44f4-b619-4ac931a84693 req-6efbb3d8-49d8-445f-9c66-275429491aa7 service nova] Lock "50deb249-66c3-410d-9521-f82821bed951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:01.282100 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-97b48080-70ef-44f4-b619-4ac931a84693 req-6efbb3d8-49d8-445f-9c66-275429491aa7 service nova] Lock "50deb249-66c3-410d-9521-f82821bed951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:01.282100 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-97b48080-70ef-44f4-b619-4ac931a84693 req-6efbb3d8-49d8-445f-9c66-275429491aa7 service nova] [instance: 50deb249-66c3-410d-9521-f82821bed951] Processing event network-vif-plugged-eba2392d-142a-4d46-a12a-6e55a864bf14 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:37:01.283231 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-97b48080-70ef-44f4-b619-4ac931a84693 req-6efbb3d8-49d8-445f-9c66-275429491aa7 service nova] [instance: 50deb249-66c3-410d-9521-f82821bed951] Received event network-vif-plugged-eba2392d-142a-4d46-a12a-6e55a864bf14 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:01.283811 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-97b48080-70ef-44f4-b619-4ac931a84693 req-6efbb3d8-49d8-445f-9c66-275429491aa7 service nova] Acquiring lock "50deb249-66c3-410d-9521-f82821bed951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:01.284925 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:37:01.285627 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-97b48080-70ef-44f4-b619-4ac931a84693 req-6efbb3d8-49d8-445f-9c66-275429491aa7 service nova] Lock "50deb249-66c3-410d-9521-f82821bed951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:01.286048 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-97b48080-70ef-44f4-b619-4ac931a84693 req-6efbb3d8-49d8-445f-9c66-275429491aa7 service nova] Lock "50deb249-66c3-410d-9521-f82821bed951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:01.286667 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-97b48080-70ef-44f4-b619-4ac931a84693 req-6efbb3d8-49d8-445f-9c66-275429491aa7 service nova] [instance: 50deb249-66c3-410d-9521-f82821bed951] No waiting events found dispatching network-vif-plugged-eba2392d-142a-4d46-a12a-6e55a864bf14 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:01.286667 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-97b48080-70ef-44f4-b619-4ac931a84693 req-6efbb3d8-49d8-445f-9c66-275429491aa7 service nova] [instance: 50deb249-66c3-410d-9521-f82821bed951] Received unexpected event network-vif-plugged-eba2392d-142a-4d46-a12a-6e55a864bf14 for instance with vm_state building and task_state spawning.
May 19 04:37:01.293734 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:37:01.299524 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:01.301734 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 50deb249-66c3-410d-9521-f82821bed951] Instance spawned successfully.
May 19 04:37:01.302177 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165421.30189, 65dfcdfb-ef42-4b25-aea4-617d643d61e5 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:01.302349 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] VM Resumed (Lifecycle Event)
May 19 04:37:01.303570 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:37:01.323833 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Took 21.61 seconds to build instance.
May 19 04:37:01.384040 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-843e5324-133c-4646-982a-ca04c232753f tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Lock "d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.327s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:01.817361 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:01.819820 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:01.820800 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:01.820800 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:01.821001 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:01.821185 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:01.821418 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:01.822192 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:01.825034 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:37:01.825195 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:01.827578 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:37:01.833408 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Claim successful on node np0000001025
May 19 04:37:01.837987 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2b1d5a0c-d7ef-4a3a-9302-aa13e8d01093 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.126s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:02.335539 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Took 7.91 seconds to spawn the instance on the hypervisor.
May 19 04:37:02.335539 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:02.337628 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165422.3372827, 50deb249-66c3-410d-9521-f82821bed951 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:02.337829 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 50deb249-66c3-410d-9521-f82821bed951] VM Started (Lifecycle Event)
May 19 04:37:02.416594 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:02.584581 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:02.585041 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:02.585395 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:02.585761 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:02.586137 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:02.588463 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Terminating instance
May 19 04:37:02.852124 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 50deb249-66c3-410d-9521-f82821bed951] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:02.855619 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Took 13.65 seconds to build instance.
May 19 04:37:02.856369 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 50deb249-66c3-410d-9521-f82821bed951] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:37:03.002991 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:03.091640 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:37:03.116330 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:03.120737 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:03.144278 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:03.152034 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:03.179694 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:03.351777 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:37:03.352165 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:37:03.359260 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "50deb249-66c3-410d-9521-f82821bed951" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.165s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:03.363140 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165423.361407, 50deb249-66c3-410d-9521-f82821bed951 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:03.363140 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 50deb249-66c3-410d-9521-f82821bed951] VM Paused (Lifecycle Event)
May 19 04:37:03.370579 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a437b363-6fdf-42d2-89e5-491ff847d6bc req-c2ec9757-1eb2-4b8e-b551-70afd191c863 service nova] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Received event network-vif-unplugged-42511b94-b74e-4f65-8515-0c5e7a411348 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:03.371742 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a437b363-6fdf-42d2-89e5-491ff847d6bc req-c2ec9757-1eb2-4b8e-b551-70afd191c863 service nova] Acquiring lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:03.372220 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a437b363-6fdf-42d2-89e5-491ff847d6bc req-c2ec9757-1eb2-4b8e-b551-70afd191c863 service nova] Lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:03.372404 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a437b363-6fdf-42d2-89e5-491ff847d6bc req-c2ec9757-1eb2-4b8e-b551-70afd191c863 service nova] Lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:03.372598 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a437b363-6fdf-42d2-89e5-491ff847d6bc req-c2ec9757-1eb2-4b8e-b551-70afd191c863 service nova] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] No waiting events found dispatching network-vif-unplugged-42511b94-b74e-4f65-8515-0c5e7a411348 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:03.372762 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a437b363-6fdf-42d2-89e5-491ff847d6bc req-c2ec9757-1eb2-4b8e-b551-70afd191c863 service nova] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Received event network-vif-unplugged-42511b94-b74e-4f65-8515-0c5e7a411348 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:03.445866 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Instance destroyed successfully.
May 19 04:37:03.446428 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'resources' on Instance uuid 65dfcdfb-ef42-4b25-aea4-617d643d61e5 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:37:03.539529 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Acquiring lock "50deb249-66c3-410d-9521-f82821bed951" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:03.539725 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "50deb249-66c3-410d-9521-f82821bed951" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:03.539884 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Acquiring lock "50deb249-66c3-410d-9521-f82821bed951-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:03.540017 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "50deb249-66c3-410d-9521-f82821bed951-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:03.540133 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "50deb249-66c3-410d-9521-f82821bed951-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:03.543983 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Terminating instance
May 19 04:37:03.855073 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:37:03.864640 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 50deb249-66c3-410d-9521-f82821bed951] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:03.865868 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165423.8656814, 50deb249-66c3-410d-9521-f82821bed951 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:03.865975 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 50deb249-66c3-410d-9521-f82821bed951] VM Resumed (Lifecycle Event)
May 19 04:37:03.951800 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1139633655',display_name='tempest-TestVolumeBootPattern-server-1139633655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-1139633655',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:37:00Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-gc2h4z8l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:37:01Z,user_data=None,user_id='5c46088fb3e74b819bb456461716a801',uuid=65dfcdfb-ef42-4b25-aea4-617d643d61e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42511b94-b74e-4f65-8515-0c5e7a411348", "address": "fa:16:3e:f3:04:77", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42511b94-b7", "ovs_interfaceid": "42511b94-b74e-4f65-8515-0c5e7a411348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:37:03.951800 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "42511b94-b74e-4f65-8515-0c5e7a411348", "address": "fa:16:3e:f3:04:77", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42511b94-b7", "ovs_interfaceid": "42511b94-b74e-4f65-8515-0c5e7a411348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:03.953967 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:04:77,bridge_name='br-int',has_traffic_filtering=True,id=42511b94-b74e-4f65-8515-0c5e7a411348,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42511b94-b7') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:03.954296 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:04:77,bridge_name='br-int',has_traffic_filtering=True,id=42511b94-b74e-4f65-8515-0c5e7a411348,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42511b94-b7') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:37:03.960721 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:03.960721 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42511b94-b7, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:03.963457 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:03.965404 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:03.965623 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7dea52b0-c2d2-42ef-9a55-8976026c56e2) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:03.967741 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:03.967741 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:03.968372 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:03.973077 np0000001025 nova-compute[97981]: INFO os_vif [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:04:77,bridge_name='br-int',has_traffic_filtering=True,id=42511b94-b74e-4f65-8515-0c5e7a411348,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42511b94-b7')
May 19 04:37:03.975151 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:37:03.975480 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7b6c6b34-5903-4349-9469-29afd9a160da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:37:03.975668 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:37:03.976011 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:37:03.976487 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7b6c6b34-5903-4349-9469-29afd9a160da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:37:03.976487 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:37:04.011427 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:37:04.011427 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:37:04.011427 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:37:04.011427 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:37:04.011427 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:37:04.011427 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:37:04.011427 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:37:04.011427 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:37:04.011427 np0000001025 nova-compute[97981]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da (non-flash)
May 19 04:37:04.011427 np0000001025 nova-compute[97981]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da (non-flash)
May 19 04:37:04.011427 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:37:04.011821 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:37:04.011821 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:37:04.011821 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:37:04.011821 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:37:04.011821 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:37:04.011821 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:37:04.011821 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:37:04.011821 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:37:04.011821 np0000001025 nova-compute[97981]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da (non-flash)
May 19 04:37:04.011821 np0000001025 nova-compute[97981]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da (non-flash)
May 19 04:37:04.011821 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:37:04.011821 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', '34')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:37:04.012286 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', '33')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:37:04.016869 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da', '34')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:37:04.018428 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185018d620>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da'): ({'sdg'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:37:04.018725 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Removing multipathed devices sdf, sdg {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:37:04.019022 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flush multipath device 330000000979bd0bb {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:37:04.047848 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:37:04.051186 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:37:04.069086 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:04.075742 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:04.088540 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:37:04.098685 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:04.133484 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:37:04.133697 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:37:04.135195 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:37:04.151122 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:37:04.151122 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:37:04.165020 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:04.202727 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da, portal: 192.168.40.100,3260]
May 19 04:37:04.202727 np0000001025 nova-compute[97981]: Logout of [sid: 33, target: iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da, portal: 192.168.40.100,3260] successful.
May 19 04:37:04.202727 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:04.213894 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:04.214421 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:04.220450 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:04.221464 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:04.225577 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:04.240718 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:04.283574 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da, portal: 192.168.50.100,3260]
May 19 04:37:04.283574 np0000001025 nova-compute[97981]: Logout of [sid: 34, target: iqn.2023-03.storpool.com:os--volume-7b6c6b34-5903-4349-9469-29afd9a160da, portal: 192.168.50.100,3260] successful.
May 19 04:37:04.283574 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:04.307494 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:04.309017 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:37:04.309137 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== disconnect_volume: return (333ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:37:04.309284 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:37:04.309562 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Deleting instance files /opt/stack/data/nova/instances/65dfcdfb-ef42-4b25-aea4-617d643d61e5_del
May 19 04:37:04.309977 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Deletion of /opt/stack/data/nova/instances/65dfcdfb-ef42-4b25-aea4-617d643d61e5_del complete
May 19 04:37:04.361659 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.541s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:04.362161 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:37:04.372895 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 50deb249-66c3-410d-9521-f82821bed951] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:04.389551 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999630215000025 future=<Future at 0x721834311160 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:04.390075 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999615386999949 future=<Future at 0x7218343291c0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:04.390859 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 50deb249-66c3-410d-9521-f82821bed951] Instance destroyed successfully.
May 19 04:37:04.392288 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lazy-loading 'resources' on Instance uuid 50deb249-66c3-410d-9521-f82821bed951 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:37:04.719162 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:37:04.819491 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Took 1.73 seconds to destroy the instance on the hypervisor.
May 19 04:37:04.820191 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:37:04.820471 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:37:04.820601 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:37:04.820854 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:04.869062 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:37:04.869256 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:37:04.869911 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:04.870953 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:04.895461 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:04.897919 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:36:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1416575896',display_name='tempest-ServersNegativeTestJSON-server-1416575896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serversnegativetestjson-server-1416575896',id=17,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:37:02Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a35e596ed4643ba9e73bcfe8f8c03d2',ramdisk_id='',reservation_id='r-6whm9nr6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1193290315',owner_user_name='tempest-ServersNegativeTestJSON-1193290315-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:37:02Z,user_data=None,user_id='c73c832155da49cdb7faad111acd01e5',uuid=50deb249-66c3-410d-9521-f82821bed951,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eba2392d-142a-4d46-a12a-6e55a864bf14", "address": "fa:16:3e:20:a8:f2", "network": {"id": "010dbd36-41b4-476f-b0a7-34c9dbc108af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1030058809-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a35e596ed4643ba9e73bcfe8f8c03d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba2392d-14", "ovs_interfaceid": "eba2392d-142a-4d46-a12a-6e55a864bf14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:37:04.897919 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Converting VIF {"id": "eba2392d-142a-4d46-a12a-6e55a864bf14", "address": "fa:16:3e:20:a8:f2", "network": {"id": "010dbd36-41b4-476f-b0a7-34c9dbc108af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1030058809-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a35e596ed4643ba9e73bcfe8f8c03d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba2392d-14", "ovs_interfaceid": "eba2392d-142a-4d46-a12a-6e55a864bf14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:04.898532 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:a8:f2,bridge_name='br-int',has_traffic_filtering=True,id=eba2392d-142a-4d46-a12a-6e55a864bf14,network=Network(010dbd36-41b4-476f-b0a7-34c9dbc108af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba2392d-14') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:04.899006 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:a8:f2,bridge_name='br-int',has_traffic_filtering=True,id=eba2392d-142a-4d46-a12a-6e55a864bf14,network=Network(010dbd36-41b4-476f-b0a7-34c9dbc108af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba2392d-14') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:37:04.902459 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:04.902459 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeba2392d-14, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:04.904257 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:04.905430 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:04.906092 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:04.906317 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbb1a9d3-b309-444e-870e-d11a263ef5af) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:04.906713 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:04.907463 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:04.909801 np0000001025 nova-compute[97981]: INFO os_vif [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:a8:f2,bridge_name='br-int',has_traffic_filtering=True,id=eba2392d-142a-4d46-a12a-6e55a864bf14,network=Network(010dbd36-41b4-476f-b0a7-34c9dbc108af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba2392d-14')
May 19 04:37:04.910213 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Deleting instance files /opt/stack/data/nova/instances/50deb249-66c3-410d-9521-f82821bed951_del
May 19 04:37:04.911097 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Deletion of /opt/stack/data/nova/instances/50deb249-66c3-410d-9521-f82821bed951_del complete
May 19 04:37:04.961790 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6374f2e55af946f9abf35d0c8a1cd206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d55ae51114828ba5ad8c0ac87ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:37:05.190803 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7e789f59-f25e-4b1c-9a17-207f81e760ea req-fbafee0e-f431-4eed-b18c-1458f5f6ad15 service nova] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Received event network-vif-deleted-42511b94-b74e-4f65-8515-0c5e7a411348 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:05.190803 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-7e789f59-f25e-4b1c-9a17-207f81e760ea req-fbafee0e-f431-4eed-b18c-1458f5f6ad15 service nova] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Neutron deleted interface 42511b94-b74e-4f65-8515-0c5e7a411348; detaching it from the instance and deleting it from the info cache
May 19 04:37:05.190803 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-7e789f59-f25e-4b1c-9a17-207f81e760ea req-fbafee0e-f431-4eed-b18c-1458f5f6ad15 service nova] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:05.275404 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:05.275546 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:05.279049 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:37:05.279235 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Claim successful on node np0000001025
May 19 04:37:05.373957 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:37:05.416714 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Took 1.37 seconds to destroy the instance on the hypervisor.
May 19 04:37:05.417849 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:37:05.417849 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 50deb249-66c3-410d-9521-f82821bed951] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:37:05.417849 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 50deb249-66c3-410d-9521-f82821bed951] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:37:05.418064 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:05.477206 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Successfully created port: 198ee052-a44f-474c-87e1-409937e2e3c2 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:37:05.481377 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7aed034d-5f1e-44ac-8409-7aff6cfd843c req-6f02bc38-4eb9-4d72-8254-10b3d1cf78bf service nova] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Received event network-vif-unplugged-42511b94-b74e-4f65-8515-0c5e7a411348 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:05.482640 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7aed034d-5f1e-44ac-8409-7aff6cfd843c req-6f02bc38-4eb9-4d72-8254-10b3d1cf78bf service nova] Acquiring lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:05.482881 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7aed034d-5f1e-44ac-8409-7aff6cfd843c req-6f02bc38-4eb9-4d72-8254-10b3d1cf78bf service nova] Lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:05.483055 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7aed034d-5f1e-44ac-8409-7aff6cfd843c req-6f02bc38-4eb9-4d72-8254-10b3d1cf78bf service nova] Lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:05.483169 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7aed034d-5f1e-44ac-8409-7aff6cfd843c req-6f02bc38-4eb9-4d72-8254-10b3d1cf78bf service nova] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] No waiting events found dispatching network-vif-unplugged-42511b94-b74e-4f65-8515-0c5e7a411348 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:05.483363 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7aed034d-5f1e-44ac-8409-7aff6cfd843c req-6f02bc38-4eb9-4d72-8254-10b3d1cf78bf service nova] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Received event network-vif-unplugged-42511b94-b74e-4f65-8515-0c5e7a411348 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:05.484220 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7aed034d-5f1e-44ac-8409-7aff6cfd843c req-6f02bc38-4eb9-4d72-8254-10b3d1cf78bf service nova] [instance: 50deb249-66c3-410d-9521-f82821bed951] Received event network-vif-unplugged-eba2392d-142a-4d46-a12a-6e55a864bf14 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:05.484380 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7aed034d-5f1e-44ac-8409-7aff6cfd843c req-6f02bc38-4eb9-4d72-8254-10b3d1cf78bf service nova] Acquiring lock "50deb249-66c3-410d-9521-f82821bed951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:05.485076 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7aed034d-5f1e-44ac-8409-7aff6cfd843c req-6f02bc38-4eb9-4d72-8254-10b3d1cf78bf service nova] Lock "50deb249-66c3-410d-9521-f82821bed951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:05.485250 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7aed034d-5f1e-44ac-8409-7aff6cfd843c req-6f02bc38-4eb9-4d72-8254-10b3d1cf78bf service nova] Lock "50deb249-66c3-410d-9521-f82821bed951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:05.485389 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7aed034d-5f1e-44ac-8409-7aff6cfd843c req-6f02bc38-4eb9-4d72-8254-10b3d1cf78bf service nova] [instance: 50deb249-66c3-410d-9521-f82821bed951] No waiting events found dispatching network-vif-unplugged-eba2392d-142a-4d46-a12a-6e55a864bf14 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:05.485555 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7aed034d-5f1e-44ac-8409-7aff6cfd843c req-6f02bc38-4eb9-4d72-8254-10b3d1cf78bf service nova] [instance: 50deb249-66c3-410d-9521-f82821bed951] Received event network-vif-unplugged-eba2392d-142a-4d46-a12a-6e55a864bf14 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:05.485631 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7aed034d-5f1e-44ac-8409-7aff6cfd843c req-6f02bc38-4eb9-4d72-8254-10b3d1cf78bf service nova] [instance: 50deb249-66c3-410d-9521-f82821bed951] Received event network-vif-unplugged-eba2392d-142a-4d46-a12a-6e55a864bf14 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:05.485694 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7aed034d-5f1e-44ac-8409-7aff6cfd843c req-6f02bc38-4eb9-4d72-8254-10b3d1cf78bf service nova] Acquiring lock "50deb249-66c3-410d-9521-f82821bed951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:05.485843 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7aed034d-5f1e-44ac-8409-7aff6cfd843c req-6f02bc38-4eb9-4d72-8254-10b3d1cf78bf service nova] Lock "50deb249-66c3-410d-9521-f82821bed951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:05.485978 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7aed034d-5f1e-44ac-8409-7aff6cfd843c req-6f02bc38-4eb9-4d72-8254-10b3d1cf78bf service nova] Lock "50deb249-66c3-410d-9521-f82821bed951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:05.486065 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7aed034d-5f1e-44ac-8409-7aff6cfd843c req-6f02bc38-4eb9-4d72-8254-10b3d1cf78bf service nova] [instance: 50deb249-66c3-410d-9521-f82821bed951] No waiting events found dispatching network-vif-unplugged-eba2392d-142a-4d46-a12a-6e55a864bf14 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:05.486165 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7aed034d-5f1e-44ac-8409-7aff6cfd843c req-6f02bc38-4eb9-4d72-8254-10b3d1cf78bf service nova] [instance: 50deb249-66c3-410d-9521-f82821bed951] Received event network-vif-unplugged-eba2392d-142a-4d46-a12a-6e55a864bf14 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:05.505406 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:05.641203 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:05.696459 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7e789f59-f25e-4b1c-9a17-207f81e760ea req-fbafee0e-f431-4eed-b18c-1458f5f6ad15 service nova] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Detach interface failed, port_id=42511b94-b74e-4f65-8515-0c5e7a411348, reason: Instance 65dfcdfb-ef42-4b25-aea4-617d643d61e5 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:37:05.881305 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:37:06.104949 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Successfully updated port: 198ee052-a44f-474c-87e1-409937e2e3c2 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:37:06.143554 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Took 1.32 seconds to deallocate network for instance.
May 19 04:37:06.314208 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 50deb249-66c3-410d-9521-f82821bed951] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:06.607509 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "refresh_cache-5951341b-0ad5-4fb0-82ad-b464c081f37f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:37:06.608559 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquired lock "refresh_cache-5951341b-0ad5-4fb0-82ad-b464c081f37f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:37:06.608559 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:37:06.697371 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Took 0.55 seconds to detach 1 volumes for instance.
May 19 04:37:06.760204 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:37:06.760407 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:37:06.816855 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 50deb249-66c3-410d-9521-f82821bed951] Took 1.40 seconds to deallocate network for instance.
May 19 04:37:06.890136 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:37:06.890136 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:37:06.890136 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Creating image(s)
May 19 04:37:06.890136 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "/opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:06.890136 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "/opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:06.890665 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "/opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:06.891362 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:37:06.895145 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:37:06.896136 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:06.984627 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.087s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:37:06.988363 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:06.988363 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:06.988363 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:37:06.989231 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:37:06.989646 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:07.079910 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.090s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:37:07.083132 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:07.136751 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk 1073741824" returned: 0 in 0.056s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:37:07.137372 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.152s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:07.137794 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:07.197328 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:37:07.205518 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:07.237598 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.100s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:37:07.240136 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:37:07.240136 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:07.271762 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:37:07.285734 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ce2c77fd-dfad-4882-a379-43a3ca0268bf req-70666f65-4133-4b12-ba2d-2b8fbbc4a487 service nova] [instance: 50deb249-66c3-410d-9521-f82821bed951] Received event network-vif-deleted-eba2392d-142a-4d46-a12a-6e55a864bf14 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:07.324037 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:07.340855 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:37:07.341399 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Cannot resize image /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:37:07.341759 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:37:07.341982 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Ensure instance console log exists: /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:37:07.342357 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:07.342645 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:07.342847 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:07.387131 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:07.532295 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Updating instance_info_cache with network_info: [{"id": "198ee052-a44f-474c-87e1-409937e2e3c2", "address": "fa:16:3e:bc:20:08", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap198ee052-a4", "ovs_interfaceid": "198ee052-a44f-474c-87e1-409937e2e3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:07.535737 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-807ac711-bb03-48fc-8e2c-cc1ecdbfc2b2 req-45ad222f-9370-494f-823a-41125b05d497 service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Received event network-changed-198ee052-a44f-474c-87e1-409937e2e3c2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:07.535737 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-807ac711-bb03-48fc-8e2c-cc1ecdbfc2b2 req-45ad222f-9370-494f-823a-41125b05d497 service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Refreshing instance network info cache due to event network-changed-198ee052-a44f-474c-87e1-409937e2e3c2. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:37:07.535737 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-807ac711-bb03-48fc-8e2c-cc1ecdbfc2b2 req-45ad222f-9370-494f-823a-41125b05d497 service nova] Acquiring lock "refresh_cache-5951341b-0ad5-4fb0-82ad-b464c081f37f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:37:07.787497 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.512s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:07.787980 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:37:07.790678 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.585s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:08.016231 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:08.036386 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Releasing lock "refresh_cache-5951341b-0ad5-4fb0-82ad-b464c081f37f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:37:08.036516 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Instance network_info: |[{"id": "198ee052-a44f-474c-87e1-409937e2e3c2", "address": "fa:16:3e:bc:20:08", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap198ee052-a4", "ovs_interfaceid": "198ee052-a44f-474c-87e1-409937e2e3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:37:08.038745 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Start _get_guest_xml network_info=[{"id": "198ee052-a44f-474c-87e1-409937e2e3c2", "address": "fa:16:3e:bc:20:08", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap198ee052-a4", "ovs_interfaceid": "198ee052-a44f-474c-87e1-409937e2e3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:37:08.039531 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-807ac711-bb03-48fc-8e2c-cc1ecdbfc2b2 req-45ad222f-9370-494f-823a-41125b05d497 service nova] Acquired lock "refresh_cache-5951341b-0ad5-4fb0-82ad-b464c081f37f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:37:08.039531 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-807ac711-bb03-48fc-8e2c-cc1ecdbfc2b2 req-45ad222f-9370-494f-823a-41125b05d497 service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Refreshing network info cache for port 198ee052-a44f-474c-87e1-409937e2e3c2 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:37:08.042577 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:37:08.044557 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-907040062', uuid='5951341b-0ad5-4fb0-82ad-b464c081f37f'), owner=OwnerMeta(userid='6374f2e55af946f9abf35d0c8a1cd206', username='tempest-ServerActionsTestOtherA-281327203-project-member', projectid='336d55ae51114828ba5ad8c0ac87ca9b', projectname='tempest-ServerActionsTestOtherA-281327203'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "198ee052-a44f-474c-87e1-409937e2e3c2", "address": "fa:16:3e:bc:20:08", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap198ee052-a4", "ovs_interfaceid": "198ee052-a44f-474c-87e1-409937e2e3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165428.044177) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:37:08.048903 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:37:08.048903 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:37:08.049606 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:37:08.052151 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:37:08.052151 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:37:08.052151 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:37:08.052151 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:37:08.052151 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:37:08.052151 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:37:08.052151 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:37:08.052151 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:37:08.052151 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:37:08.052151 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:37:08.052151 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:37:08.052836 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:37:08.053120 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:37:08.069472 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-907040062',display_name='tempest-ServerActionsTestOtherA-server-907040062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serveractionstestothera-server-907040062',id=18,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqj+0kbBWHZ0D/eo4rT8/WyGDsPmK39aJPuM7kZk3S1G8n90+lv56y6gVhWC3CbNq9VY5ET/dAXNaLkqY+SWcJuj+SOKIN1mmus3K/MEswW9TbpiRqq7lxkb6x7vjc6rQ==',key_name='tempest-keypair-762825136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='336d55ae51114828ba5ad8c0ac87ca9b',ramdisk_id='',reservation_id='r-vmxfumpp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-281327203',owner_user_name='tempest-ServerActionsTestOtherA-281327203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:37:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6374f2e55af946f9abf35d0c8a1cd206',uuid=5951341b-0ad5-4fb0-82ad-b464c081f37f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "198ee052-a44f-474c-87e1-409937e2e3c2", "address": "fa:16:3e:bc:20:08", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap198ee052-a4", "ovs_interfaceid": "198ee052-a44f-474c-87e1-409937e2e3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:37:08.069825 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converting VIF {"id": "198ee052-a44f-474c-87e1-409937e2e3c2", "address": "fa:16:3e:bc:20:08", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap198ee052-a4", "ovs_interfaceid": "198ee052-a44f-474c-87e1-409937e2e3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:08.070551 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:20:08,bridge_name='br-int',has_traffic_filtering=True,id=198ee052-a44f-474c-87e1-409937e2e3c2,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap198ee052-a4') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:08.071199 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lazy-loading 'pci_devices' on Instance uuid 5951341b-0ad5-4fb0-82ad-b464c081f37f {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:37:08.300385 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:37:08.300633 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:37:08.300959 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:08.301258 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:08.316274 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:37:08.316522 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:37:08.538696 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2dad74db8b9240b1a3e3e145265f8b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc136a1f1fe94373a04ae534d82f8673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:37:08.541344 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-807ac711-bb03-48fc-8e2c-cc1ecdbfc2b2 req-45ad222f-9370-494f-823a-41125b05d497 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:08.578148 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] End _get_guest_xml xml=<domain type="qemu">
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:   <uuid>5951341b-0ad5-4fb0-82ad-b464c081f37f</uuid>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:   <name>instance-00000012</name>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServerActionsTestOtherA-server-907040062</nova:name>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:37:08</nova:creationTime>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:         <nova:user uuid="6374f2e55af946f9abf35d0c8a1cd206">tempest-ServerActionsTestOtherA-281327203-project-member</nova:user>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:         <nova:project uuid="336d55ae51114828ba5ad8c0ac87ca9b">tempest-ServerActionsTestOtherA-281327203</nova:project>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:         <nova:port uuid="198ee052-a44f-474c-87e1-409937e2e3c2">
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     <system>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <entry name="serial">5951341b-0ad5-4fb0-82ad-b464c081f37f</entry>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <entry name="uuid">5951341b-0ad5-4fb0-82ad-b464c081f37f</entry>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     </system>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:   <os>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:   </os>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:   <features>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:   </features>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:   <devices>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk"/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     </disk>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk.config"/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     </disk>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:bc:20:08"/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <target dev="tap198ee052-a4"/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     </interface>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/console.log" append="off"/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     </serial>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     <video>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     </video>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     </rng>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:   </devices>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]: </domain>
May 19 04:37:08.578148 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:37:08.578148 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Preparing to wait for external event network-vif-plugged-198ee052-a44f-474c-87e1-409937e2e3c2 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:37:08.578148 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "5951341b-0ad5-4fb0-82ad-b464c081f37f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:08.578148 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "5951341b-0ad5-4fb0-82ad-b464c081f37f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:08.578148 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "5951341b-0ad5-4fb0-82ad-b464c081f37f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:08.578148 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-907040062',display_name='tempest-ServerActionsTestOtherA-server-907040062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serveractionstestothera-server-907040062',id=18,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqj+0kbBWHZ0D/eo4rT8/WyGDsPmK39aJPuM7kZk3S1G8n90+lv56y6gVhWC3CbNq9VY5ET/dAXNaLkqY+SWcJuj+SOKIN1mmus3K/MEswW9TbpiRqq7lxkb6x7vjc6rQ==',key_name='tempest-keypair-762825136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='336d55ae51114828ba5ad8c0ac87ca9b',ramdisk_id='',reservation_id='r-vmxfumpp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-281327203',owner_user_name='tempest-ServerActionsTestOtherA-281327203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:37:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6374f2e55af946f9abf35d0c8a1cd206',uuid=5951341b-0ad5-4fb0-82ad-b464c081f37f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "198ee052-a44f-474c-87e1-409937e2e3c2", "address": "fa:16:3e:bc:20:08", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap198ee052-a4", "ovs_interfaceid": "198ee052-a44f-474c-87e1-409937e2e3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:37:08.578148 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converting VIF {"id": "198ee052-a44f-474c-87e1-409937e2e3c2", "address": "fa:16:3e:bc:20:08", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap198ee052-a4", "ovs_interfaceid": "198ee052-a44f-474c-87e1-409937e2e3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:08.580401 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:20:08,bridge_name='br-int',has_traffic_filtering=True,id=198ee052-a44f-474c-87e1-409937e2e3c2,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap198ee052-a4') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:08.580691 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:20:08,bridge_name='br-int',has_traffic_filtering=True,id=198ee052-a44f-474c-87e1-409937e2e3c2,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap198ee052-a4') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:37:08.581168 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:08.581513 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:08.581775 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:37:08.582857 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:08.583118 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9200999-2b6c-5656-80a0-dbb839a13239', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:08.584745 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:08.584805 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:08.586644 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:08.591477 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:08.591668 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap198ee052-a4, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:08.592080 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap198ee052-a4, col_values=(('qos', UUID('88210ff4-9050-4cb2-84fe-0738a49b4160')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:08.592591 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap198ee052-a4, col_values=(('external_ids', {'iface-id': '198ee052-a44f-474c-87e1-409937e2e3c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:20:08', 'vm-uuid': '5951341b-0ad5-4fb0-82ad-b464c081f37f'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:08.593225 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:08.594372 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:08.601927 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:08.603530 np0000001025 nova-compute[97981]: INFO os_vif [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:20:08,bridge_name='br-int',has_traffic_filtering=True,id=198ee052-a44f-474c-87e1-409937e2e3c2,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap198ee052-a4')
May 19 04:37:08.810002 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:37:08.821585 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:37:08.868254 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-807ac711-bb03-48fc-8e2c-cc1ecdbfc2b2 req-45ad222f-9370-494f-823a-41125b05d497 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:09.022172 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-807ac711-bb03-48fc-8e2c-cc1ecdbfc2b2 req-45ad222f-9370-494f-823a-41125b05d497 service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Updated VIF entry in instance network info cache for port 198ee052-a44f-474c-87e1-409937e2e3c2. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:37:09.024342 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-807ac711-bb03-48fc-8e2c-cc1ecdbfc2b2 req-45ad222f-9370-494f-823a-41125b05d497 service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Updating instance_info_cache with network_info: [{"id": "198ee052-a44f-474c-87e1-409937e2e3c2", "address": "fa:16:3e:bc:20:08", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap198ee052-a4", "ovs_interfaceid": "198ee052-a44f-474c-87e1-409937e2e3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:09.030967 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Successfully created port: 34d50a64-6aed-47ee-ae9c-851a9fe0161b {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:37:09.331361 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.540s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:09.333620 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.010s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:09.416912 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Deleted allocations for instance 65dfcdfb-ef42-4b25-aea4-617d643d61e5
May 19 04:37:09.497850 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Successfully created port: 371fc2a1-7883-4eef-a3cc-0085db83dfc7 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:37:09.526435 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-807ac711-bb03-48fc-8e2c-cc1ecdbfc2b2 req-45ad222f-9370-494f-823a-41125b05d497 service nova] Releasing lock "refresh_cache-5951341b-0ad5-4fb0-82ad-b464c081f37f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:37:09.795321 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:37:09.795487 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:37:09.910255 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0007475449999674311 future=<Future at 0x72185230fe00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:09.910789 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:09.910789 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=9.47834935600008 future=<Future at 0x721834311160 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:09.910789 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=9.478219922000108 future=<Future at 0x721834311160 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:09.911148 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Emitting event <LifecycleEvent: 1779165414.9093673, d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:09.911324 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] VM Stopped (Lifecycle Event)
May 19 04:37:09.932014 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Successfully created port: 3e688b23-684d-4dcf-95a1-2f44d8ea1649 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:37:10.122943 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:37:10.123135 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:37:10.123451 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] No VIF found with MAC fa:16:3e:bc:20:08, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:37:10.123740 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Using config drive
May 19 04:37:10.298180 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:37:10.325460 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:37:10.329908 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Successfully created port: ea620a14-2efe-4797-9ee1-c004ba488769 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:37:10.414168 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: d04a3ae5-77b3-4aa4-a37c-5f5d23178c8e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:10.428976 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ea77da5f-5f82-47d0-8b16-2180019ec011 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "65dfcdfb-ef42-4b25-aea4-617d643d61e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.844s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:10.630855 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:10.805310 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.472s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:10.813676 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Creating config drive at /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk.config
May 19 04:37:10.819992 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqmpwqp4y {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:10.849468 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Booting with volume 826a781c-5976-4c74-8ca4-447a075fb902 at /dev/vda
May 19 04:37:10.888690 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqmpwqp4y" returned: 0 in 0.069s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:37:10.894276 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Successfully created port: 0fdb83aa-cd21-410a-8823-a52276cc6fb1 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:37:10.917002 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Deleted allocations for instance 50deb249-66c3-410d-9521-f82821bed951
May 19 04:37:10.924616 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:37:10.939161 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:37:10.967546 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:11.013413 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:37:11.013770 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:37:11.024022 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:37:11.025526 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::e86a:f3ff:fee3:83a1', 'fe80::fc16:3eff:fe8a:28ef', 'fe80::fc16:3eff:fe81:2190', 'fe80::fc16:3eff:fe3b:7832', 'fe80::fc16:3eff:fee7:64b0', 'fe80::40da:d4ff:fe7f:36e1', 'fe80::fc16:3eff:fec8:335b', 'fe80::fc16:3eff:fed0:413', 'fe80::fc16:3eff:fe50:b6e3', 'fe80::fc16:3eff:fe10:9776', 'fe80::bb:56ff:fe15:ec7', 'fe80::fc16:3eff:fe2c:e3ec', 'fe80::649e:6aff:fe70:3377', 'fe80::fc16:3eff:fe7d:73e6', 'fe80::fc16:3eff:fef6:d828', 'fe80::42e:9cff:fe3b:b5fe'] 
May 19 04:37:11.025648 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:37:11.025751 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:37:11.026017 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:37:11.026332 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Updating existing volume attachment record: 1a4c99f6-a989-4937-9d51-6fb3bc96cdc1 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:37:11.381957 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:11.409281 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:11.471438 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Successfully updated port: 34d50a64-6aed-47ee-ae9c-851a9fe0161b {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:37:11.496090 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:11.527668 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e329b089-cc55-4a97-808f-4081bd66ec80 req-9de9e6df-d58c-45d6-96a1-f656b028eabe service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-changed-34d50a64-6aed-47ee-ae9c-851a9fe0161b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:11.527668 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e329b089-cc55-4a97-808f-4081bd66ec80 req-9de9e6df-d58c-45d6-96a1-f656b028eabe service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Refreshing instance network info cache due to event network-changed-34d50a64-6aed-47ee-ae9c-851a9fe0161b. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:37:11.527668 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e329b089-cc55-4a97-808f-4081bd66ec80 req-9de9e6df-d58c-45d6-96a1-f656b028eabe service nova] Acquiring lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:37:11.527668 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e329b089-cc55-4a97-808f-4081bd66ec80 req-9de9e6df-d58c-45d6-96a1-f656b028eabe service nova] Acquired lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:37:11.527812 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e329b089-cc55-4a97-808f-4081bd66ec80 req-9de9e6df-d58c-45d6-96a1-f656b028eabe service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Refreshing network info cache for port 34d50a64-6aed-47ee-ae9c-851a9fe0161b {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:37:11.607681 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b3887139-68a7-43b1-ab15-bfdbc870fe60 req-f3e1dcdd-17bb-4a66-bebd-d22f9f642bec service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Received event network-vif-plugged-198ee052-a44f-474c-87e1-409937e2e3c2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:11.609889 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b3887139-68a7-43b1-ab15-bfdbc870fe60 req-f3e1dcdd-17bb-4a66-bebd-d22f9f642bec service nova] Acquiring lock "5951341b-0ad5-4fb0-82ad-b464c081f37f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:11.610047 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b3887139-68a7-43b1-ab15-bfdbc870fe60 req-f3e1dcdd-17bb-4a66-bebd-d22f9f642bec service nova] Lock "5951341b-0ad5-4fb0-82ad-b464c081f37f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:11.610256 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b3887139-68a7-43b1-ab15-bfdbc870fe60 req-f3e1dcdd-17bb-4a66-bebd-d22f9f642bec service nova] Lock "5951341b-0ad5-4fb0-82ad-b464c081f37f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:11.610331 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b3887139-68a7-43b1-ab15-bfdbc870fe60 req-f3e1dcdd-17bb-4a66-bebd-d22f9f642bec service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Processing event network-vif-plugged-198ee052-a44f-474c-87e1-409937e2e3c2 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:37:11.701649 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:11.701649 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:11.712188 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:11.727387 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:11.928273 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d557eb9c-67a3-4365-946a-940a82e3c7ea tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "50deb249-66c3-410d-9521-f82821bed951" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.388s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:12.030734 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-e329b089-cc55-4a97-808f-4081bd66ec80 req-9de9e6df-d58c-45d6-96a1-f656b028eabe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:12.126391 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e329b089-cc55-4a97-808f-4081bd66ec80 req-9de9e6df-d58c-45d6-96a1-f656b028eabe service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:37:12.290244 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e329b089-cc55-4a97-808f-4081bd66ec80 req-9de9e6df-d58c-45d6-96a1-f656b028eabe service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:12.325340 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165432.32479, 5951341b-0ad5-4fb0-82ad-b464c081f37f => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:12.325433 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] VM Started (Lifecycle Event)
May 19 04:37:12.327979 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:37:12.330606 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:37:12.333881 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Instance spawned successfully.
May 19 04:37:12.335015 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:37:12.531730 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Successfully updated port: 5add6c4e-9889-49d8-9fa6-2db045c6b4ae {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:37:12.601681 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c88a929e-4eaa-4317-9be1-40350f29238a req-5beb81ad-be28-44b0-9d0d-2184885b2722 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-changed-5add6c4e-9889-49d8-9fa6-2db045c6b4ae {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:12.601996 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c88a929e-4eaa-4317-9be1-40350f29238a req-5beb81ad-be28-44b0-9d0d-2184885b2722 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Refreshing instance network info cache due to event network-changed-5add6c4e-9889-49d8-9fa6-2db045c6b4ae. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:37:12.602156 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c88a929e-4eaa-4317-9be1-40350f29238a req-5beb81ad-be28-44b0-9d0d-2184885b2722 service nova] Acquiring lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:37:12.656853 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Booting with volume 5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 at /dev/vdb
May 19 04:37:12.708989 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:37:12.722275 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:37:12.746749 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:12.780797 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:37:12.781216 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:37:12.790038 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:37:12.792473 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::e86a:f3ff:fee3:83a1', 'fe80::fc16:3eff:fe8a:28ef', 'fe80::fc16:3eff:fe81:2190', 'fe80::fc16:3eff:fe3b:7832', 'fe80::fc16:3eff:fee7:64b0', 'fe80::40da:d4ff:fe7f:36e1', 'fe80::fc16:3eff:fec8:335b', 'fe80::fc16:3eff:fed0:413', 'fe80::fc16:3eff:fe50:b6e3', 'fe80::fc16:3eff:fe10:9776', 'fe80::bb:56ff:fe15:ec7', 'fe80::fc16:3eff:fe2c:e3ec', 'fe80::649e:6aff:fe70:3377', 'fe80::fc16:3eff:fe7d:73e6', 'fe80::fc16:3eff:fef6:d828', 'fe80::42e:9cff:fe3b:b5fe', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1'] 
May 19 04:37:12.792703 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:37:12.792839 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:37:12.793245 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:37:12.793613 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Updating existing volume attachment record: 8014cd22-832f-426f-a2f8-6c390c1d876e {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:37:12.798316 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e329b089-cc55-4a97-808f-4081bd66ec80 req-9de9e6df-d58c-45d6-96a1-f656b028eabe service nova] Releasing lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:37:12.800903 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c88a929e-4eaa-4317-9be1-40350f29238a req-5beb81ad-be28-44b0-9d0d-2184885b2722 service nova] Acquired lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:37:12.801163 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c88a929e-4eaa-4317-9be1-40350f29238a req-5beb81ad-be28-44b0-9d0d-2184885b2722 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Refreshing network info cache for port 5add6c4e-9889-49d8-9fa6-2db045c6b4ae {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:37:12.828781 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:12.831251 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:37:12.846135 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:12.846135 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:12.846135 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:12.846135 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:12.846449 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:12.846663 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:13.022125 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:13.304045 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-c88a929e-4eaa-4317-9be1-40350f29238a req-5beb81ad-be28-44b0-9d0d-2184885b2722 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:13.333439 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:37:13.333774 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165433.333568, 5951341b-0ad5-4fb0-82ad-b464c081f37f => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:13.333932 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] VM Paused (Lifecycle Event)
May 19 04:37:13.353996 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Took 6.47 seconds to spawn the instance on the hypervisor.
May 19 04:37:13.354250 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:13.409577 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c88a929e-4eaa-4317-9be1-40350f29238a req-5beb81ad-be28-44b0-9d0d-2184885b2722 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:37:13.549002 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Successfully updated port: 856804f2-648b-4cf3-a2d8-a2d4cf97e84f {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:37:13.609639 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:13.610573 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c88a929e-4eaa-4317-9be1-40350f29238a req-5beb81ad-be28-44b0-9d0d-2184885b2722 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:13.677567 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e68dc66e-3808-46cf-9551-051c7d78565f req-f7bb10f1-d087-4364-b137-0649ea53cefa service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Received event network-vif-plugged-198ee052-a44f-474c-87e1-409937e2e3c2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:13.678055 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e68dc66e-3808-46cf-9551-051c7d78565f req-f7bb10f1-d087-4364-b137-0649ea53cefa service nova] Acquiring lock "5951341b-0ad5-4fb0-82ad-b464c081f37f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:13.678676 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e68dc66e-3808-46cf-9551-051c7d78565f req-f7bb10f1-d087-4364-b137-0649ea53cefa service nova] Lock "5951341b-0ad5-4fb0-82ad-b464c081f37f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:13.679038 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e68dc66e-3808-46cf-9551-051c7d78565f req-f7bb10f1-d087-4364-b137-0649ea53cefa service nova] Lock "5951341b-0ad5-4fb0-82ad-b464c081f37f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:13.679748 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e68dc66e-3808-46cf-9551-051c7d78565f req-f7bb10f1-d087-4364-b137-0649ea53cefa service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] No waiting events found dispatching network-vif-plugged-198ee052-a44f-474c-87e1-409937e2e3c2 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:13.680317 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-e68dc66e-3808-46cf-9551-051c7d78565f req-f7bb10f1-d087-4364-b137-0649ea53cefa service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Received unexpected event network-vif-plugged-198ee052-a44f-474c-87e1-409937e2e3c2 for instance with vm_state active and task_state None.
May 19 04:37:13.842669 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:13.845541 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165433.845317, 5951341b-0ad5-4fb0-82ad-b464c081f37f => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:13.845659 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] VM Resumed (Lifecycle Event)
May 19 04:37:13.873350 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Took 12.11 seconds to build instance.
May 19 04:37:14.112713 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c88a929e-4eaa-4317-9be1-40350f29238a req-5beb81ad-be28-44b0-9d0d-2184885b2722 service nova] Releasing lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:37:14.350566 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:14.353083 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:37:14.377230 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "5951341b-0ad5-4fb0-82ad-b464c081f37f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.628s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:14.426620 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Booting with volume 2f628dad-4b63-4812-a34d-a3b52215814b at /dev/vdc
May 19 04:37:14.465550 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:14.465698 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:14.474075 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:37:14.490560 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:37:14.513226 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:14.553032 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:37:14.553436 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:37:14.565256 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:37:14.569203 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::e86a:f3ff:fee3:83a1', 'fe80::fc16:3eff:fe8a:28ef', 'fe80::fc16:3eff:fe81:2190', 'fe80::fc16:3eff:fe3b:7832', 'fe80::fc16:3eff:fee7:64b0', 'fe80::40da:d4ff:fe7f:36e1', 'fe80::fc16:3eff:fec8:335b', 'fe80::fc16:3eff:fed0:413', 'fe80::fc16:3eff:fe50:b6e3', 'fe80::fc16:3eff:fe10:9776', 'fe80::bb:56ff:fe15:ec7', 'fe80::fc16:3eff:fe2c:e3ec', 'fe80::649e:6aff:fe70:3377', 'fe80::fc16:3eff:fe7d:73e6', 'fe80::fc16:3eff:fef6:d828', 'fe80::42e:9cff:fe3b:b5fe', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1'] 
May 19 04:37:14.569203 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:37:14.569203 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:37:14.569203 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:37:14.569203 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Updating existing volume attachment record: bedf815a-f68d-42c7-be12-da4ea2bfed06 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:37:14.585271 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Successfully updated port: 371fc2a1-7883-4eef-a3cc-0085db83dfc7 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:37:14.702491 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c910326b-33c0-436d-960c-488ac881e84b req-d20751b0-f867-46b4-abe0-647ff003b919 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-changed-371fc2a1-7883-4eef-a3cc-0085db83dfc7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:14.702491 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c910326b-33c0-436d-960c-488ac881e84b req-d20751b0-f867-46b4-abe0-647ff003b919 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Refreshing instance network info cache due to event network-changed-371fc2a1-7883-4eef-a3cc-0085db83dfc7. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:37:14.702491 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c910326b-33c0-436d-960c-488ac881e84b req-d20751b0-f867-46b4-abe0-647ff003b919 service nova] Acquiring lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:37:14.702491 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c910326b-33c0-436d-960c-488ac881e84b req-d20751b0-f867-46b4-abe0-647ff003b919 service nova] Acquired lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:37:14.702491 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c910326b-33c0-436d-960c-488ac881e84b req-d20751b0-f867-46b4-abe0-647ff003b919 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Refreshing network info cache for port 371fc2a1-7883-4eef-a3cc-0085db83dfc7 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:37:14.720761 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9ef2edcb-b640-446d-ae23-836d8cdd3c5a req-be611bbf-f7fc-4b11-b84a-3ee95743032c service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-changed-856804f2-648b-4cf3-a2d8-a2d4cf97e84f {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:14.720761 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9ef2edcb-b640-446d-ae23-836d8cdd3c5a req-be611bbf-f7fc-4b11-b84a-3ee95743032c service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Refreshing instance network info cache due to event network-changed-856804f2-648b-4cf3-a2d8-a2d4cf97e84f. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:37:14.720872 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9ef2edcb-b640-446d-ae23-836d8cdd3c5a req-be611bbf-f7fc-4b11-b84a-3ee95743032c service nova] Acquiring lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:37:14.950285 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:14.951792 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:14.952062 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:14.952243 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:14.952390 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:14.957778 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Terminating instance
May 19 04:37:14.969608 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:37:15.205303 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-c910326b-33c0-436d-960c-488ac881e84b req-d20751b0-f867-46b4-abe0-647ff003b919 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:15.326270 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c910326b-33c0-436d-960c-488ac881e84b req-d20751b0-f867-46b4-abe0-647ff003b919 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:37:15.465117 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:37:15.486306 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:15.489203 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c910326b-33c0-436d-960c-488ac881e84b req-d20751b0-f867-46b4-abe0-647ff003b919 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:15.493841 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:15.509160 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:15.524382 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:15.544375 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:15.548794 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:15.548994 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:15.552584 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:37:15.552584 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Claim successful on node np0000001025
May 19 04:37:15.561512 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:15.655731 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:15.691013 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:15.741735 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:15.749254 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:15.806058 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:15.822563 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Successfully updated port: 3e688b23-684d-4dcf-95a1-2f44d8ea1649 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:37:15.856827 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:15.879594 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:15.892342 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7105f23e-1a02-4f10-8402-d8cb7840f732 req-c1e9e600-6b43-4dc8-afd1-dd40b708a48f service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-changed-3e688b23-684d-4dcf-95a1-2f44d8ea1649 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:15.892487 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7105f23e-1a02-4f10-8402-d8cb7840f732 req-c1e9e600-6b43-4dc8-afd1-dd40b708a48f service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Refreshing instance network info cache due to event network-changed-3e688b23-684d-4dcf-95a1-2f44d8ea1649. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:37:15.892677 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7105f23e-1a02-4f10-8402-d8cb7840f732 req-c1e9e600-6b43-4dc8-afd1-dd40b708a48f service nova] Acquiring lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:37:15.957011 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:15.996008 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c910326b-33c0-436d-960c-488ac881e84b req-d20751b0-f867-46b4-abe0-647ff003b919 service nova] Releasing lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:37:15.996505 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9ef2edcb-b640-446d-ae23-836d8cdd3c5a req-be611bbf-f7fc-4b11-b84a-3ee95743032c service nova] Acquired lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:37:15.996671 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-9ef2edcb-b640-446d-ae23-836d8cdd3c5a req-be611bbf-f7fc-4b11-b84a-3ee95743032c service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Refreshing network info cache for port 856804f2-648b-4cf3-a2d8-a2d4cf97e84f {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:37:16.018418 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.139714 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999669053999924 future=<Future at 0x7218343063f0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:16.145143 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Instance destroyed successfully.
May 19 04:37:16.145143 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lazy-loading 'resources' on Instance uuid 63247a98-0dc4-4a87-9141-5ae713a462b5 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:37:16.502079 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-9ef2edcb-b640-446d-ae23-836d8cdd3c5a req-be611bbf-f7fc-4b11-b84a-3ee95743032c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:16.651314 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-828285451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-828285451',id=11,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHptQgQOz8uzJWvG8VBqqugtU1+E4qrvwdyPZ0Pjq28H6o1y20pA6W+pQxEeyDhIOxGx4uDHTNe4uAHExnvV1cSus1abbFyIsDdDRP/0uFpv7SeZ38WmhWAVa0dVyukP+g==',key_name='tempest-keypair-392122288',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:36:29Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7fc088ff80284506af708277495c5882',ramdisk_id='',reservation_id='r-pgu1refj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1449301970',owner_user_name='tempest-TaggedBootDevicesTest_v242-1449301970-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:36:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a349efc3ddaf48ed966109438d3f0625',uuid=63247a98-0dc4-4a87-9141-5ae713a462b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad71ba07-449a-4565-bd5e-17c050975bd3", "address": "fa:16:3e:3b:78:32", "network": {"id": "a3b3266f-28a3-47fc-b52c-26f42a06a1bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1135470460-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad71ba07-44", "ovs_interfaceid": "ad71ba07-449a-4565-bd5e-17c050975bd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:37:16.651744 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converting VIF {"id": "ad71ba07-449a-4565-bd5e-17c050975bd3", "address": "fa:16:3e:3b:78:32", "network": {"id": "a3b3266f-28a3-47fc-b52c-26f42a06a1bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1135470460-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad71ba07-44", "ovs_interfaceid": "ad71ba07-449a-4565-bd5e-17c050975bd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:16.652627 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:78:32,bridge_name='br-int',has_traffic_filtering=True,id=ad71ba07-449a-4565-bd5e-17c050975bd3,network=Network(a3b3266f-28a3-47fc-b52c-26f42a06a1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad71ba07-44') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:16.652990 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:78:32,bridge_name='br-int',has_traffic_filtering=True,id=ad71ba07-449a-4565-bd5e-17c050975bd3,network=Network(a3b3266f-28a3-47fc-b52c-26f42a06a1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad71ba07-44') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:37:16.655301 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.655608 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad71ba07-44, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:16.656868 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.659309 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:16.689012 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.692323 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.692571 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ab8e260-b2ed-400d-8115-853c319c2e6f) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:16.693660 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.694425 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:16.710095 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:37:16.713026 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:37:16.714186 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Creating image(s)
May 19 04:37:16.716331 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:37:16.716543 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Ensure instance console log exists: /opt/stack/data/nova/instances/7859dfab-f702-4d0b-a9e9-bb856c5004e6/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:37:16.716876 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:16.718955 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:16.718955 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:16.725713 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.729701 np0000001025 nova-compute[97981]: INFO os_vif [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:78:32,bridge_name='br-int',has_traffic_filtering=True,id=ad71ba07-449a-4565-bd5e-17c050975bd3,network=Network(a3b3266f-28a3-47fc-b52c-26f42a06a1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad71ba07-44')
May 19 04:37:16.730765 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-828285451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-828285451',id=11,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHptQgQOz8uzJWvG8VBqqugtU1+E4qrvwdyPZ0Pjq28H6o1y20pA6W+pQxEeyDhIOxGx4uDHTNe4uAHExnvV1cSus1abbFyIsDdDRP/0uFpv7SeZ38WmhWAVa0dVyukP+g==',key_name='tempest-keypair-392122288',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:36:29Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7fc088ff80284506af708277495c5882',ramdisk_id='',reservation_id='r-pgu1refj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1449301970',owner_user_name='tempest-TaggedBootDevicesTest_v242-1449301970-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:36:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a349efc3ddaf48ed966109438d3f0625',uuid=63247a98-0dc4-4a87-9141-5ae713a462b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "address": "fa:16:3e:e7:64:b0", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60124aa0-37", "ovs_interfaceid": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:37:16.731184 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converting VIF {"id": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "address": "fa:16:3e:e7:64:b0", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60124aa0-37", "ovs_interfaceid": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:16.731640 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:64:b0,bridge_name='br-int',has_traffic_filtering=True,id=60124aa0-3747-4d4f-bac3-3c90e62b801c,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60124aa0-37') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:16.731994 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:64:b0,bridge_name='br-int',has_traffic_filtering=True,id=60124aa0-3747-4d4f-bac3-3c90e62b801c,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60124aa0-37') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:37:16.733220 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.733561 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60124aa0-37, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:16.737538 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.739342 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:16.764092 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.766714 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.767706 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=73a6efb1-f33b-475c-aa18-2d1a3b616150) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:16.767706 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.768251 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:16.801015 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.802846 np0000001025 nova-compute[97981]: INFO os_vif [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:64:b0,bridge_name='br-int',has_traffic_filtering=True,id=60124aa0-3747-4d4f-bac3-3c90e62b801c,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60124aa0-37')
May 19 04:37:16.803512 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-828285451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-828285451',id=11,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHptQgQOz8uzJWvG8VBqqugtU1+E4qrvwdyPZ0Pjq28H6o1y20pA6W+pQxEeyDhIOxGx4uDHTNe4uAHExnvV1cSus1abbFyIsDdDRP/0uFpv7SeZ38WmhWAVa0dVyukP+g==',key_name='tempest-keypair-392122288',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:36:29Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7fc088ff80284506af708277495c5882',ramdisk_id='',reservation_id='r-pgu1refj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1449301970',owner_user_name='tempest-TaggedBootDevicesTest_v242-1449301970-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:36:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a349efc3ddaf48ed966109438d3f0625',uuid=63247a98-0dc4-4a87-9141-5ae713a462b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "address": "fa:16:3e:c8:33:5b", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap137c6f2c-dd", "ovs_interfaceid": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:37:16.803664 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converting VIF {"id": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "address": "fa:16:3e:c8:33:5b", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap137c6f2c-dd", "ovs_interfaceid": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:16.804798 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:33:5b,bridge_name='br-int',has_traffic_filtering=True,id=137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap137c6f2c-dd') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:16.804798 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:33:5b,bridge_name='br-int',has_traffic_filtering=True,id=137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap137c6f2c-dd') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:37:16.806379 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.806614 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap137c6f2c-dd, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:16.808509 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.809517 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:16.813233 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-13ee5722-0b88-4187-a349-294afe71c6d9 req-c4b57557-cf54-474e-ad6f-b528f741e6f9 service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Received event network-changed-198ee052-a44f-474c-87e1-409937e2e3c2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:16.813365 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-13ee5722-0b88-4187-a349-294afe71c6d9 req-c4b57557-cf54-474e-ad6f-b528f741e6f9 service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Refreshing instance network info cache due to event network-changed-198ee052-a44f-474c-87e1-409937e2e3c2. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:37:16.813535 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-13ee5722-0b88-4187-a349-294afe71c6d9 req-c4b57557-cf54-474e-ad6f-b528f741e6f9 service nova] Acquiring lock "refresh_cache-5951341b-0ad5-4fb0-82ad-b464c081f37f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:37:16.813667 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-13ee5722-0b88-4187-a349-294afe71c6d9 req-c4b57557-cf54-474e-ad6f-b528f741e6f9 service nova] Acquired lock "refresh_cache-5951341b-0ad5-4fb0-82ad-b464c081f37f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:37:16.813799 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-13ee5722-0b88-4187-a349-294afe71c6d9 req-c4b57557-cf54-474e-ad6f-b528f741e6f9 service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Refreshing network info cache for port 198ee052-a44f-474c-87e1-409937e2e3c2 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:37:16.822262 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:16.822664 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:16.823406 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:16.823567 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:16.823739 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] No waiting events found dispatching network-vif-unplugged-137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:16.823946 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:16.824087 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:16.824267 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:16.824433 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:16.824567 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:16.824710 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] No waiting events found dispatching network-vif-unplugged-137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:16.824875 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:16.825019 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-60124aa0-3747-4d4f-bac3-3c90e62b801c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:16.825462 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:16.825866 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:16.826084 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:16.826359 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] No waiting events found dispatching network-vif-unplugged-60124aa0-3747-4d4f-bac3-3c90e62b801c {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:16.826728 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-60124aa0-3747-4d4f-bac3-3c90e62b801c for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:16.827058 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-60124aa0-3747-4d4f-bac3-3c90e62b801c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:16.827281 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:16.828193 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:16.828754 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:16.829034 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] No waiting events found dispatching network-vif-unplugged-60124aa0-3747-4d4f-bac3-3c90e62b801c {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:16.829322 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-da195cd1-6582-4791-be4b-e1a7a0377e8a req-b9fd7e95-a238-4856-91c4-146cbe349ee5 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-60124aa0-3747-4d4f-bac3-3c90e62b801c for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:16.832772 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.836453 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.836737 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fc52e336-35f2-4d49-abc2-782d661816fe) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:16.837412 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.838237 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:16.844328 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-9ef2edcb-b640-446d-ae23-836d8cdd3c5a req-be611bbf-f7fc-4b11-b84a-3ee95743032c service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:37:16.856593 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.858654 np0000001025 nova-compute[97981]: INFO os_vif [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:33:5b,bridge_name='br-int',has_traffic_filtering=True,id=137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap137c6f2c-dd')
May 19 04:37:16.859491 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-828285451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-828285451',id=11,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHptQgQOz8uzJWvG8VBqqugtU1+E4qrvwdyPZ0Pjq28H6o1y20pA6W+pQxEeyDhIOxGx4uDHTNe4uAHExnvV1cSus1abbFyIsDdDRP/0uFpv7SeZ38WmhWAVa0dVyukP+g==',key_name='tempest-keypair-392122288',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:36:29Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7fc088ff80284506af708277495c5882',ramdisk_id='',reservation_id='r-pgu1refj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1449301970',owner_user_name='tempest-TaggedBootDevicesTest_v242-1449301970-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:36:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a349efc3ddaf48ed966109438d3f0625',uuid=63247a98-0dc4-4a87-9141-5ae713a462b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55210bd9-f231-4f7e-89be-c5779add4e83", "address": "fa:16:3e:d0:04:13", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55210bd9-f2", "ovs_interfaceid": "55210bd9-f231-4f7e-89be-c5779add4e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:37:16.859675 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converting VIF {"id": "55210bd9-f231-4f7e-89be-c5779add4e83", "address": "fa:16:3e:d0:04:13", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55210bd9-f2", "ovs_interfaceid": "55210bd9-f231-4f7e-89be-c5779add4e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:16.860273 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:04:13,bridge_name='br-int',has_traffic_filtering=True,id=55210bd9-f231-4f7e-89be-c5779add4e83,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55210bd9-f2') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:16.860517 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:04:13,bridge_name='br-int',has_traffic_filtering=True,id=55210bd9-f231-4f7e-89be-c5779add4e83,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55210bd9-f2') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:37:16.861649 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.861958 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55210bd9-f2, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:16.863266 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.865367 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:16.881767 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.886854 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.887188 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea8fc0f9-0e8f-4f6e-b44c-ab27e058d68e) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:16.887877 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.888680 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:16.916885 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.919533 np0000001025 nova-compute[97981]: INFO os_vif [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:04:13,bridge_name='br-int',has_traffic_filtering=True,id=55210bd9-f231-4f7e-89be-c5779add4e83,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55210bd9-f2')
May 19 04:37:16.920236 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-828285451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-828285451',id=11,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHptQgQOz8uzJWvG8VBqqugtU1+E4qrvwdyPZ0Pjq28H6o1y20pA6W+pQxEeyDhIOxGx4uDHTNe4uAHExnvV1cSus1abbFyIsDdDRP/0uFpv7SeZ38WmhWAVa0dVyukP+g==',key_name='tempest-keypair-392122288',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:36:29Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7fc088ff80284506af708277495c5882',ramdisk_id='',reservation_id='r-pgu1refj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1449301970',owner_user_name='tempest-TaggedBootDevicesTest_v242-1449301970-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:36:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a349efc3ddaf48ed966109438d3f0625',uuid=63247a98-0dc4-4a87-9141-5ae713a462b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "address": "fa:16:3e:50:b6:e3", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ec0e22-80", "ovs_interfaceid": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:37:16.920425 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converting VIF {"id": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "address": "fa:16:3e:50:b6:e3", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ec0e22-80", "ovs_interfaceid": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:16.920933 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:b6:e3,bridge_name='br-int',has_traffic_filtering=True,id=c0ec0e22-8097-46a0-93bb-077e4e38a07c,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ec0e22-80') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:16.921195 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:b6:e3,bridge_name='br-int',has_traffic_filtering=True,id=c0ec0e22-8097-46a0-93bb-077e4e38a07c,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ec0e22-80') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:37:16.922079 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.922370 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0ec0e22-80, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:16.923424 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.926486 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:16.934119 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.935191 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.935381 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=02a65cdc-011f-43b5-9923-bd16708a2675) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:16.935883 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.936454 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:16.946672 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.948742 np0000001025 nova-compute[97981]: INFO os_vif [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:b6:e3,bridge_name='br-int',has_traffic_filtering=True,id=c0ec0e22-8097-46a0-93bb-077e4e38a07c,network=Network(8efe1d5d-4cf4-465c-ac37-06d7ba032e84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ec0e22-80')
May 19 04:37:16.949490 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-828285451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-828285451',id=11,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHptQgQOz8uzJWvG8VBqqugtU1+E4qrvwdyPZ0Pjq28H6o1y20pA6W+pQxEeyDhIOxGx4uDHTNe4uAHExnvV1cSus1abbFyIsDdDRP/0uFpv7SeZ38WmhWAVa0dVyukP+g==',key_name='tempest-keypair-392122288',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:36:29Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7fc088ff80284506af708277495c5882',ramdisk_id='',reservation_id='r-pgu1refj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1449301970',owner_user_name='tempest-TaggedBootDevicesTest_v242-1449301970-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:36:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a349efc3ddaf48ed966109438d3f0625',uuid=63247a98-0dc4-4a87-9141-5ae713a462b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "address": "fa:16:3e:10:97:76", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42811c2a-5e", "ovs_interfaceid": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:37:16.949639 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converting VIF {"id": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "address": "fa:16:3e:10:97:76", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42811c2a-5e", "ovs_interfaceid": "42811c2a-5e1a-48c2-ae48-869cd5e416e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:16.950872 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:97:76,bridge_name='br-int',has_traffic_filtering=True,id=42811c2a-5e1a-48c2-ae48-869cd5e416e6,network=Network(639c2651-b468-4473-890e-e2ee134e2afc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42811c2a-5e') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:16.950872 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:97:76,bridge_name='br-int',has_traffic_filtering=True,id=42811c2a-5e1a-48c2-ae48-869cd5e416e6,network=Network(639c2651-b468-4473-890e-e2ee134e2afc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42811c2a-5e') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:37:16.952912 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.953201 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42811c2a-5e, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:16.954132 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.957198 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:16.961588 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.964094 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.965055 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91d36565-5b8a-4ed5-b83b-247d6dd6176d) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:16.969020 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:16.974558 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.977147 np0000001025 nova-compute[97981]: INFO os_vif [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:97:76,bridge_name='br-int',has_traffic_filtering=True,id=42811c2a-5e1a-48c2-ae48-869cd5e416e6,network=Network(639c2651-b468-4473-890e-e2ee134e2afc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42811c2a-5e')
May 19 04:37:16.978157 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-828285451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-828285451',id=11,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHptQgQOz8uzJWvG8VBqqugtU1+E4qrvwdyPZ0Pjq28H6o1y20pA6W+pQxEeyDhIOxGx4uDHTNe4uAHExnvV1cSus1abbFyIsDdDRP/0uFpv7SeZ38WmhWAVa0dVyukP+g==',key_name='tempest-keypair-392122288',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:36:29Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7fc088ff80284506af708277495c5882',ramdisk_id='',reservation_id='r-pgu1refj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1449301970',owner_user_name='tempest-TaggedBootDevicesTest_v242-1449301970-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:36:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a349efc3ddaf48ed966109438d3f0625',uuid=63247a98-0dc4-4a87-9141-5ae713a462b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7648d4e-3e92-4c77-9347-91670c3b9113", "address": "fa:16:3e:2c:e3:ec", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7648d4e-3e", "ovs_interfaceid": "d7648d4e-3e92-4c77-9347-91670c3b9113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:37:16.982293 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converting VIF {"id": "d7648d4e-3e92-4c77-9347-91670c3b9113", "address": "fa:16:3e:2c:e3:ec", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7648d4e-3e", "ovs_interfaceid": "d7648d4e-3e92-4c77-9347-91670c3b9113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:16.982681 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e3:ec,bridge_name='br-int',has_traffic_filtering=True,id=d7648d4e-3e92-4c77-9347-91670c3b9113,network=Network(639c2651-b468-4473-890e-e2ee134e2afc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7648d4e-3e') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:16.986262 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e3:ec,bridge_name='br-int',has_traffic_filtering=True,id=d7648d4e-3e92-4c77-9347-91670c3b9113,network=Network(639c2651-b468-4473-890e-e2ee134e2afc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7648d4e-3e') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:37:16.989513 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.989716 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7648d4e-3e, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:16.990966 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.991736 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:16.992729 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.996929 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.997127 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a5da664-465a-4248-8105-5d2373d57951) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:16.997669 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:16.998213 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:16.998969 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:17.000964 np0000001025 nova-compute[97981]: INFO os_vif [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e3:ec,bridge_name='br-int',has_traffic_filtering=True,id=d7648d4e-3e92-4c77-9347-91670c3b9113,network=Network(639c2651-b468-4473-890e-e2ee134e2afc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7648d4e-3e')
May 19 04:37:17.003368 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:37:17.003848 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1d04e1a5-6059-4dec-9127-3ffa039dd625', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:37:17.004319 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:37:17.004773 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:37:17.005519 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1d04e1a5-6059-4dec-9127-3ffa039dd625', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:37:17.005738 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:37:17.055461 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:37:17.055461 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:37:17.055461 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:37:17.055461 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:37:17.055461 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:37:17.055461 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:37:17.055461 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:37:17.055461 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:37:17.055461 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:37:17.055701 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:37:17.055701 np0000001025 nova-compute[97981]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625 (non-flash)
May 19 04:37:17.055701 np0000001025 nova-compute[97981]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:37:17.055701 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:37:17.055701 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:37:17.055701 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:37:17.055701 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:37:17.055701 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:37:17.055701 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:37:17.055883 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', '26')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:37:17.055971 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', '17')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:37:17.056927 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625', '18')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:37:17.057819 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721850760ea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625'): ({'sde'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:37:17.058479 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Removing multipathed devices sde, sdd {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:37:17.058710 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Flush multipath device 33000000060c8f6a6 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:37:17.106064 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Successfully updated port: ea620a14-2efe-4797-9ee1-c004ba488769 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:37:17.128433 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:37:17.161080 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:37:17.161361 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:37:17.191508 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:37:17.242686 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:37:17.242686 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:37:17.246076 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:37:17.260646 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:37:17.260646 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:37:17.274498 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:17.309452 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625, portal: 192.168.40.100,3260]
May 19 04:37:17.309452 np0000001025 nova-compute[97981]: Logout of [sid: 17, target: iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625, portal: 192.168.40.100,3260] successful.
May 19 04:37:17.309452 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:17.318510 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-13ee5722-0b88-4187-a349-294afe71c6d9 req-c4b57557-cf54-474e-ad6f-b528f741e6f9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:17.334958 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:17.348330 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:17.394724 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625, portal: 192.168.50.100,3260]
May 19 04:37:17.394724 np0000001025 nova-compute[97981]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-1d04e1a5-6059-4dec-9127-3ffa039dd625, portal: 192.168.50.100,3260] successful.
May 19 04:37:17.394724 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:17.416716 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-9ef2edcb-b640-446d-ae23-836d8cdd3c5a req-be611bbf-f7fc-4b11-b84a-3ee95743032c service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:17.419750 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:17.419750 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:37:17.419750 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] <== disconnect_volume: return (414ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:37:17.419750 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:37:17.421529 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:37:17.421529 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1fe9afac-3374-4e79-bff5-27405bd5fd0f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:37:17.421529 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:37:17.422061 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:37:17.422348 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1fe9afac-3374-4e79-bff5-27405bd5fd0f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:37:17.422544 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:37:17.461706 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:37:17.461706 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:37:17.461706 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:37:17.461706 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:37:17.461706 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:37:17.461706 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:37:17.461706 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:37:17.462607 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:37:17.462607 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:37:17.462607 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:37:17.462607 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:37:17.462607 np0000001025 nova-compute[97981]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:37:17.462607 np0000001025 nova-compute[97981]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f (non-flash)
May 19 04:37:17.462607 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:37:17.462607 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', '26')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:37:17.462607 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', '25')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:37:17.467573 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f', '26')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:37:17.469565 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721850271300>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f'): ({'sdj'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:37:17.469565 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Removing multipathed devices sdk, sdj {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:37:17.470633 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Flush multipath device 330000000743a0bb2 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:37:17.505963 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:37:17.530548 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:17.530810 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:17.556501 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:37:17.612507 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:37:17.615349 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:37:17.615349 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:37:17.632746 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:37:17.633060 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:37:17.648035 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:17.664554 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:37:17.682644 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f, portal: 192.168.40.100,3260]
May 19 04:37:17.682644 np0000001025 nova-compute[97981]: Logout of [sid: 25, target: iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f, portal: 192.168.40.100,3260] successful.
May 19 04:37:17.682644 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:17.701918 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:17.714235 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:17.761545 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f, portal: 192.168.50.100,3260]
May 19 04:37:17.761545 np0000001025 nova-compute[97981]: Logout of [sid: 26, target: iqn.2023-03.storpool.com:os--volume-1fe9afac-3374-4e79-bff5-27405bd5fd0f, portal: 192.168.50.100,3260] successful.
May 19 04:37:17.761545 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:17.782982 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:17.783249 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:37:17.783529 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] <== disconnect_volume: return (361ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:37:17.783684 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:37:17.787029 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:37:17.787407 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df86bd40-0f7a-447e-86d5-0494d1928695', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:37:17.787636 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:37:17.788078 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:37:17.788806 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df86bd40-0f7a-447e-86d5-0494d1928695', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:37:17.788980 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:37:17.827805 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:37:17.827805 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:37:17.827805 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:37:17.827805 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:37:17.827805 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:37:17.828078 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:37:17.828078 np0000001025 nova-compute[97981]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695 (non-flash)
May 19 04:37:17.828078 np0000001025 nova-compute[97981]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:37:17.828078 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:37:17.828078 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:37:17.828347 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', '24')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:37:17.828347 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', '21')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:37:17.829137 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695', '22')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:37:17.830353 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721850270e00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695'): ({'sdi'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:37:17.830572 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Removing multipathed devices sdh, sdi {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:37:17.830842 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Flush multipath device 330000000dba96718 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:37:17.874141 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:37:17.882451 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-13ee5722-0b88-4187-a349-294afe71c6d9 req-c4b57557-cf54-474e-ad6f-b528f741e6f9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:17.921017 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9ef2edcb-b640-446d-ae23-836d8cdd3c5a req-be611bbf-f7fc-4b11-b84a-3ee95743032c service nova] Releasing lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:37:17.926883 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7105f23e-1a02-4f10-8402-d8cb7840f732 req-c1e9e600-6b43-4dc8-afd1-dd40b708a48f service nova] Acquired lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:37:17.928729 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-7105f23e-1a02-4f10-8402-d8cb7840f732 req-c1e9e600-6b43-4dc8-afd1-dd40b708a48f service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Refreshing network info cache for port 3e688b23-684d-4dcf-95a1-2f44d8ea1649 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:37:17.931605 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:37:17.970407 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-55210bd9-f231-4f7e-89be-c5779add4e83 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:17.970407 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:17.970407 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:17.970407 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:17.970407 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] No waiting events found dispatching network-vif-unplugged-55210bd9-f231-4f7e-89be-c5779add4e83 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:17.970407 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-55210bd9-f231-4f7e-89be-c5779add4e83 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:17.970407 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-55210bd9-f231-4f7e-89be-c5779add4e83 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:17.970407 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:17.970994 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:17.971561 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:17.973020 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] No waiting events found dispatching network-vif-unplugged-55210bd9-f231-4f7e-89be-c5779add4e83 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:17.973020 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-55210bd9-f231-4f7e-89be-c5779add4e83 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:17.973020 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-c0ec0e22-8097-46a0-93bb-077e4e38a07c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:17.973020 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:17.973020 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:17.973020 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:17.973020 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] No waiting events found dispatching network-vif-unplugged-c0ec0e22-8097-46a0-93bb-077e4e38a07c {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:17.973020 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-c0ec0e22-8097-46a0-93bb-077e4e38a07c for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:17.975572 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-c0ec0e22-8097-46a0-93bb-077e4e38a07c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:17.975572 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:17.975572 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:17.975572 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:17.975572 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] No waiting events found dispatching network-vif-unplugged-c0ec0e22-8097-46a0-93bb-077e4e38a07c {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:17.976509 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-c0ec0e22-8097-46a0-93bb-077e4e38a07c for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:17.977156 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-42811c2a-5e1a-48c2-ae48-869cd5e416e6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:17.978301 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:17.978301 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:17.978301 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:17.978301 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] No waiting events found dispatching network-vif-unplugged-42811c2a-5e1a-48c2-ae48-869cd5e416e6 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:17.978301 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-42811c2a-5e1a-48c2-ae48-869cd5e416e6 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:17.978301 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-42811c2a-5e1a-48c2-ae48-869cd5e416e6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:17.978301 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:17.979072 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:17.980984 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:17.980984 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] No waiting events found dispatching network-vif-unplugged-42811c2a-5e1a-48c2-ae48-869cd5e416e6 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:17.980984 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-42811c2a-5e1a-48c2-ae48-869cd5e416e6 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:17.980984 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-d7648d4e-3e92-4c77-9347-91670c3b9113 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:17.980984 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:17.980984 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:17.980984 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:17.980984 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] No waiting events found dispatching network-vif-unplugged-d7648d4e-3e92-4c77-9347-91670c3b9113 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:17.980984 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50537a87-7bc8-4cb5-8418-c2d902ffb946 req-06f10f4d-fd6f-4ff5-90c8-7f8a9d96d756 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-d7648d4e-3e92-4c77-9347-91670c3b9113 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:17.986380 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:37:17.987454 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:37:17.988461 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:37:18.004148 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:37:18.004148 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:37:18.019215 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:18.022544 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:18.038304 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Detaching volume 34fabdf8-c75f-4180-af5a-8be2ffaca881
May 19 04:37:18.046709 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695, portal: 192.168.40.100,3260]
May 19 04:37:18.046709 np0000001025 nova-compute[97981]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695, portal: 192.168.40.100,3260] successful.
May 19 04:37:18.046709 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:18.066243 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:18.076458 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-13ee5722-0b88-4187-a349-294afe71c6d9 req-c4b57557-cf54-474e-ad6f-b528f741e6f9 service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Updated VIF entry in instance network info cache for port 198ee052-a44f-474c-87e1-409937e2e3c2. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:37:18.076864 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-13ee5722-0b88-4187-a349-294afe71c6d9 req-c4b57557-cf54-474e-ad6f-b528f741e6f9 service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Updating instance_info_cache with network_info: [{"id": "198ee052-a44f-474c-87e1-409937e2e3c2", "address": "fa:16:3e:bc:20:08", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap198ee052-a4", "ovs_interfaceid": "198ee052-a44f-474c-87e1-409937e2e3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:18.079992 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:18.089081 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Attempting to driver detach volume 34fabdf8-c75f-4180-af5a-8be2ffaca881 from mountpoint /dev/vdb
May 19 04:37:18.094956 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Found disk vdb by alias ua-34fabdf8-c75f-4180-af5a-8be2ffaca881 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:37:18.097031 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Found disk vdb by alias ua-34fabdf8-c75f-4180-af5a-8be2ffaca881 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:37:18.097429 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Attempting to detach device vdb from instance b5f34a29-15f7-4f5e-a8bf-574abebd5c84 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:37:18.097650 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:37:18.097650 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:37:18.097650 np0000001025 nova-compute[97981]:   <alias name="ua-34fabdf8-c75f-4180-af5a-8be2ffaca881"/>
May 19 04:37:18.097650 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:37:18.097650 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:37:18.097650 np0000001025 nova-compute[97981]:   <serial>34fabdf8-c75f-4180-af5a-8be2ffaca881</serial>
May 19 04:37:18.097650 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:37:18.097650 np0000001025 nova-compute[97981]: </disk>
May 19 04:37:18.097650 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:37:18.103072 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Successfully detached device vdb from instance b5f34a29-15f7-4f5e-a8bf-574abebd5c84 from the persistent domain config.
May 19 04:37:18.104505 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] (1/8): Attempting to detach device vdb with device alias ua-34fabdf8-c75f-4180-af5a-8be2ffaca881 from instance b5f34a29-15f7-4f5e-a8bf-574abebd5c84 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:37:18.104811 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:37:18.104811 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:37:18.104811 np0000001025 nova-compute[97981]:   <alias name="ua-34fabdf8-c75f-4180-af5a-8be2ffaca881"/>
May 19 04:37:18.104811 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:37:18.104811 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:37:18.104811 np0000001025 nova-compute[97981]:   <serial>34fabdf8-c75f-4180-af5a-8be2ffaca881</serial>
May 19 04:37:18.104811 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:37:18.104811 np0000001025 nova-compute[97981]: </disk>
May 19 04:37:18.104811 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:37:18.108480 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695, portal: 192.168.50.100,3260]
May 19 04:37:18.108480 np0000001025 nova-compute[97981]: Logout of [sid: 22, target: iqn.2023-03.storpool.com:os--volume-df86bd40-0f7a-447e-86d5-0494d1928695, portal: 192.168.50.100,3260] successful.
May 19 04:37:18.108480 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:18.121166 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:18.121852 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:37:18.122026 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] <== disconnect_volume: return (334ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:37:18.122180 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:37:18.122481 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Deleting instance files /opt/stack/data/nova/instances/63247a98-0dc4-4a87-9141-5ae713a462b5_del
May 19 04:37:18.124807 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Deletion of /opt/stack/data/nova/instances/63247a98-0dc4-4a87-9141-5ae713a462b5_del complete
May 19 04:37:18.172704 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.624s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:18.173024 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:37:18.277700 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Successfully updated port: 0fdb83aa-cd21-410a-8823-a52276cc6fb1 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:37:18.432954 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-7105f23e-1a02-4f10-8402-d8cb7840f732 req-c1e9e600-6b43-4dc8-afd1-dd40b708a48f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:18.545604 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-7105f23e-1a02-4f10-8402-d8cb7840f732 req-c1e9e600-6b43-4dc8-afd1-dd40b708a48f service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:37:18.580935 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-13ee5722-0b88-4187-a349-294afe71c6d9 req-c4b57557-cf54-474e-ad6f-b528f741e6f9 service nova] Releasing lock "refresh_cache-5951341b-0ad5-4fb0-82ad-b464c081f37f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:37:18.581136 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-13ee5722-0b88-4187-a349-294afe71c6d9 req-c4b57557-cf54-474e-ad6f-b528f741e6f9 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-ad71ba07-449a-4565-bd5e-17c050975bd3 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:18.581293 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-13ee5722-0b88-4187-a349-294afe71c6d9 req-c4b57557-cf54-474e-ad6f-b528f741e6f9 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:18.581742 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-13ee5722-0b88-4187-a349-294afe71c6d9 req-c4b57557-cf54-474e-ad6f-b528f741e6f9 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:18.581874 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-13ee5722-0b88-4187-a349-294afe71c6d9 req-c4b57557-cf54-474e-ad6f-b528f741e6f9 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:18.581996 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-13ee5722-0b88-4187-a349-294afe71c6d9 req-c4b57557-cf54-474e-ad6f-b528f741e6f9 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] No waiting events found dispatching network-vif-unplugged-ad71ba07-449a-4565-bd5e-17c050975bd3 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:18.582142 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-13ee5722-0b88-4187-a349-294afe71c6d9 req-c4b57557-cf54-474e-ad6f-b528f741e6f9 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-ad71ba07-449a-4565-bd5e-17c050975bd3 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:18.582266 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-13ee5722-0b88-4187-a349-294afe71c6d9 req-c4b57557-cf54-474e-ad6f-b528f741e6f9 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-ad71ba07-449a-4565-bd5e-17c050975bd3 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:18.582413 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-13ee5722-0b88-4187-a349-294afe71c6d9 req-c4b57557-cf54-474e-ad6f-b528f741e6f9 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:18.582626 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-13ee5722-0b88-4187-a349-294afe71c6d9 req-c4b57557-cf54-474e-ad6f-b528f741e6f9 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:18.582732 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-13ee5722-0b88-4187-a349-294afe71c6d9 req-c4b57557-cf54-474e-ad6f-b528f741e6f9 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:18.582921 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-13ee5722-0b88-4187-a349-294afe71c6d9 req-c4b57557-cf54-474e-ad6f-b528f741e6f9 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] No waiting events found dispatching network-vif-unplugged-ad71ba07-449a-4565-bd5e-17c050975bd3 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:18.583096 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-13ee5722-0b88-4187-a349-294afe71c6d9 req-c4b57557-cf54-474e-ad6f-b528f741e6f9 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-ad71ba07-449a-4565-bd5e-17c050975bd3 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:18.633213 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Took 3.17 seconds to destroy the instance on the hypervisor.
May 19 04:37:18.633774 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:37:18.634067 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:37:18.634174 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:37:18.634357 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:18.683684 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:37:18.683684 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:37:18.683828 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:18.684316 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:18.692017 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165438.6915758, b5f34a29-15f7-4f5e-a8bf-574abebd5c84 => ua-34fabdf8-c75f-4180-af5a-8be2ffaca881> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:37:18.697128 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-34fabdf8-c75f-4180-af5a-8be2ffaca881 for instance b5f34a29-15f7-4f5e-a8bf-574abebd5c84 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:37:18.699147 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Successfully detached device vdb from instance b5f34a29-15f7-4f5e-a8bf-574abebd5c84 from the live domain config.
May 19 04:37:18.700092 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:37:18.701198 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '34fabdf8-c75f-4180-af5a-8be2ffaca881', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:37:18.701198 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:37:18.701980 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:37:18.702315 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '34fabdf8-c75f-4180-af5a-8be2ffaca881', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:37:18.702438 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:37:18.728268 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-7105f23e-1a02-4f10-8402-d8cb7840f732 req-c1e9e600-6b43-4dc8-afd1-dd40b708a48f service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:18.728423 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:37:18.728423 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:37:18.728423 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:37:18.728586 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:37:18.728586 np0000001025 nova-compute[97981]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881 (non-flash)
May 19 04:37:18.728586 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:37:18.728683 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', '24')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:37:18.728854 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', '24')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:37:18.729818 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881', '23')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:37:18.730399 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218501060c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881'): ({'sdb'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:37:18.730574 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Removing multipathed devices sdc, sdb {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:37:18.730843 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Flush multipath device 330000000d7bcc730 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:37:18.760564 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:37:18.776262 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c46088fb3e74b819bb456461716a801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b3c0fa8f894ed2a7c3bcfac99ce74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:37:18.781519 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:37:18.804774 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:37:18.844483 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:37:18.844483 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:37:18.845036 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:37:18.861072 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:37:18.861394 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:37:18.878009 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:18.880153 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:18.915881 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-16953a51-9dc4-48a6-9a32-febe8e89707c req-8720806e-51b6-4bd5-9545-cdbda69cfa19 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-changed-0fdb83aa-cd21-410a-8823-a52276cc6fb1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:18.916224 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881, portal: 192.168.40.100,3260]
May 19 04:37:18.916224 np0000001025 nova-compute[97981]: Logout of [sid: 24, target: iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881, portal: 192.168.40.100,3260] successful.
May 19 04:37:18.916224 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:18.916429 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-16953a51-9dc4-48a6-9a32-febe8e89707c req-8720806e-51b6-4bd5-9545-cdbda69cfa19 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Refreshing instance network info cache due to event network-changed-0fdb83aa-cd21-410a-8823-a52276cc6fb1. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:37:18.916593 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-16953a51-9dc4-48a6-9a32-febe8e89707c req-8720806e-51b6-4bd5-9545-cdbda69cfa19 service nova] Acquiring lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:37:18.929347 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:18.938845 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-44ff0a75-2122-47da-922c-7cf07f7fbd63 req-fd6dd35c-3767-48fa-ae3d-6ae647338c23 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-changed-ea620a14-2efe-4797-9ee1-c004ba488769 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:18.938987 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-44ff0a75-2122-47da-922c-7cf07f7fbd63 req-fd6dd35c-3767-48fa-ae3d-6ae647338c23 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Refreshing instance network info cache due to event network-changed-ea620a14-2efe-4797-9ee1-c004ba488769. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:37:18.939152 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-44ff0a75-2122-47da-922c-7cf07f7fbd63 req-fd6dd35c-3767-48fa-ae3d-6ae647338c23 service nova] Acquiring lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:37:18.945098 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:18.978927 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881, portal: 192.168.50.100,3260]
May 19 04:37:18.978927 np0000001025 nova-compute[97981]: Logout of [sid: 23, target: iqn.2023-03.storpool.com:os--volume-34fabdf8-c75f-4180-af5a-8be2ffaca881, portal: 192.168.50.100,3260] successful.
May 19 04:37:18.978927 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:18.989781 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:18.990010 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:37:18.990161 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] <== disconnect_volume: return (289ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:37:18.990319 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:37:19.186947 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:37:19.229857 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7105f23e-1a02-4f10-8402-d8cb7840f732 req-c1e9e600-6b43-4dc8-afd1-dd40b708a48f service nova] Releasing lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:37:19.230767 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquired lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:37:19.231046 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:37:19.256613 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Successfully created port: 205c6b38-e8f4-4a6a-8de5-5fc6546c8821 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:37:19.389496 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0005556799999340001 future=<Future at 0x721834311160 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:19.392143 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Emitting event <LifecycleEvent: 1779165424.3888235, 65dfcdfb-ef42-4b25-aea4-617d643d61e5 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:19.392143 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:19.392143 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] VM Stopped (Lifecycle Event)
May 19 04:37:19.393729 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.004037328000094931 future=<Future at 0x7218343291c0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:19.394553 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.004270837999911237 future=<Future at 0x7218343291c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:19.395248 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Emitting event <LifecycleEvent: 1779165424.389618, 50deb249-66c3-410d-9521-f82821bed951 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:19.395429 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:19.395637 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] VM Stopped (Lifecycle Event)
May 19 04:37:19.396887 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=11.742464271000017 future=<Future at 0x7218343063f0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:19.397045 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=11.742290979000018 future=<Future at 0x7218343063f0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:19.540999 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'flavor' on Instance uuid b5f34a29-15f7-4f5e-a8bf-574abebd5c84 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:37:19.693354 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:37:19.812065 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Successfully updated port: 205c6b38-e8f4-4a6a-8de5-5fc6546c8821 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:37:19.896000 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2a2e2f4f-79cd-4c78-948c-506dad7d8c0b tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 65dfcdfb-ef42-4b25-aea4-617d643d61e5] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:19.898325 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 50deb249-66c3-410d-9521-f82821bed951] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:19.915978 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:37:20.013533 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Acquiring lock "f66a2b29-93d1-468a-94fc-77679fce8d64" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:20.013533 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "f66a2b29-93d1-468a-94fc-77679fce8d64" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:20.013533 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Acquiring lock "f66a2b29-93d1-468a-94fc-77679fce8d64-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:20.013689 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "f66a2b29-93d1-468a-94fc-77679fce8d64-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:20.013827 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "f66a2b29-93d1-468a-94fc-77679fce8d64-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:20.019593 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Terminating instance
May 19 04:37:20.050896 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a91ff36a-228e-409f-8bbd-5a0f13ec0808 req-32af34be-6ed3-4900-84e6-602848da9676 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-d7648d4e-3e92-4c77-9347-91670c3b9113 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:20.052921 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a91ff36a-228e-409f-8bbd-5a0f13ec0808 req-32af34be-6ed3-4900-84e6-602848da9676 service nova] Acquiring lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:20.053971 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a91ff36a-228e-409f-8bbd-5a0f13ec0808 req-32af34be-6ed3-4900-84e6-602848da9676 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:20.053971 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a91ff36a-228e-409f-8bbd-5a0f13ec0808 req-32af34be-6ed3-4900-84e6-602848da9676 service nova] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:20.053971 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a91ff36a-228e-409f-8bbd-5a0f13ec0808 req-32af34be-6ed3-4900-84e6-602848da9676 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] No waiting events found dispatching network-vif-unplugged-d7648d4e-3e92-4c77-9347-91670c3b9113 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:20.054166 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a91ff36a-228e-409f-8bbd-5a0f13ec0808 req-32af34be-6ed3-4900-84e6-602848da9676 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-unplugged-d7648d4e-3e92-4c77-9347-91670c3b9113 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:20.055058 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a91ff36a-228e-409f-8bbd-5a0f13ec0808 req-32af34be-6ed3-4900-84e6-602848da9676 service nova] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Received event network-changed-205c6b38-e8f4-4a6a-8de5-5fc6546c8821 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:20.055058 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a91ff36a-228e-409f-8bbd-5a0f13ec0808 req-32af34be-6ed3-4900-84e6-602848da9676 service nova] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Refreshing instance network info cache due to event network-changed-205c6b38-e8f4-4a6a-8de5-5fc6546c8821. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:37:20.055058 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a91ff36a-228e-409f-8bbd-5a0f13ec0808 req-32af34be-6ed3-4900-84e6-602848da9676 service nova] Acquiring lock "refresh_cache-0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:37:20.055058 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a91ff36a-228e-409f-8bbd-5a0f13ec0808 req-32af34be-6ed3-4900-84e6-602848da9676 service nova] Acquired lock "refresh_cache-0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:37:20.055058 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a91ff36a-228e-409f-8bbd-5a0f13ec0808 req-32af34be-6ed3-4900-84e6-602848da9676 service nova] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Refreshing network info cache for port 205c6b38-e8f4-4a6a-8de5-5fc6546c8821 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:37:20.198319 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Booting with volume 652c0598-ca18-49bf-ab6d-a836f9af9eb3 at /dev/vda
May 19 04:37:20.241409 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:20.247938 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:37:20.268404 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:37:20.300177 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:20.316655 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "refresh_cache-0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:37:20.343548 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:37:20.343882 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:37:20.353330 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:37:20.354698 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::e86a:f3ff:fee3:83a1', 'fe80::fc16:3eff:fe8a:28ef', 'fe80::fc16:3eff:fe81:2190', 'fe80::fc16:3eff:fe7d:73e6', 'fe80::fc16:3eff:fef6:d828', 'fe80::42e:9cff:fe3b:b5fe', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1'] 
May 19 04:37:20.354893 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:37:20.355057 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:37:20.355365 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:37:20.355643 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Updating existing volume attachment record: d88bfbd3-ecf4-4cd5-8874-67195456333c {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:37:20.525284 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:37:20.547154 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ca8479b7-0785-460c-9e47-5950fb05bbfd tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.016s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:20.550662 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:20.556806 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-a91ff36a-228e-409f-8bbd-5a0f13ec0808 req-32af34be-6ed3-4900-84e6-602848da9676 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:20.573748 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:20.575752 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:20.606615 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:20.607420 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:20.728625 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a91ff36a-228e-409f-8bbd-5a0f13ec0808 req-32af34be-6ed3-4900-84e6-602848da9676 service nova] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:37:20.752589 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:20.891169 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999363292999988 future=<Future at 0x721850710b30 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:20.893853 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Instance destroyed successfully.
May 19 04:37:20.894639 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lazy-loading 'resources' on Instance uuid f66a2b29-93d1-468a-94fc-77679fce8d64 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:37:20.914662 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:20.915998 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:20.916279 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:20.916918 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:20.917949 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:20.921093 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Terminating instance
May 19 04:37:21.022852 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a91ff36a-228e-409f-8bbd-5a0f13ec0808 req-32af34be-6ed3-4900-84e6-602848da9676 service nova] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:21.038063 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fb5c35c0-677a-4e92-b1e6-d3b863815290 req-502262fb-508d-4412-ad35-7eb683990c4b service nova] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Received event network-vif-unplugged-7d465039-2df5-4a2d-bb08-e10e97b40fd7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:21.038988 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fb5c35c0-677a-4e92-b1e6-d3b863815290 req-502262fb-508d-4412-ad35-7eb683990c4b service nova] Acquiring lock "f66a2b29-93d1-468a-94fc-77679fce8d64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:21.045319 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fb5c35c0-677a-4e92-b1e6-d3b863815290 req-502262fb-508d-4412-ad35-7eb683990c4b service nova] Lock "f66a2b29-93d1-468a-94fc-77679fce8d64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:21.045319 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fb5c35c0-677a-4e92-b1e6-d3b863815290 req-502262fb-508d-4412-ad35-7eb683990c4b service nova] Lock "f66a2b29-93d1-468a-94fc-77679fce8d64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:21.045518 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fb5c35c0-677a-4e92-b1e6-d3b863815290 req-502262fb-508d-4412-ad35-7eb683990c4b service nova] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] No waiting events found dispatching network-vif-unplugged-7d465039-2df5-4a2d-bb08-e10e97b40fd7 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:21.045713 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fb5c35c0-677a-4e92-b1e6-d3b863815290 req-502262fb-508d-4412-ad35-7eb683990c4b service nova] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Received event network-vif-unplugged-7d465039-2df5-4a2d-bb08-e10e97b40fd7 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:21.266567 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:21.397458 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:36:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-888768224',display_name='tempest-ServersNegativeTestJSON-server-888768224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serversnegativetestjson-server-888768224',id=15,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:36:45Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a35e596ed4643ba9e73bcfe8f8c03d2',ramdisk_id='',reservation_id='r-r8m9zftk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1193290315',owner_user_name='tempest-ServersNegativeTestJSON-1193290315-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:36:45Z,user_data=None,user_id='c73c832155da49cdb7faad111acd01e5',uuid=f66a2b29-93d1-468a-94fc-77679fce8d64,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d465039-2df5-4a2d-bb08-e10e97b40fd7", "address": "fa:16:3e:f6:d8:28", "network": {"id": "010dbd36-41b4-476f-b0a7-34c9dbc108af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1030058809-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a35e596ed4643ba9e73bcfe8f8c03d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d465039-2d", "ovs_interfaceid": "7d465039-2df5-4a2d-bb08-e10e97b40fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:37:21.397667 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Converting VIF {"id": "7d465039-2df5-4a2d-bb08-e10e97b40fd7", "address": "fa:16:3e:f6:d8:28", "network": {"id": "010dbd36-41b4-476f-b0a7-34c9dbc108af", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1030058809-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a35e596ed4643ba9e73bcfe8f8c03d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d465039-2d", "ovs_interfaceid": "7d465039-2df5-4a2d-bb08-e10e97b40fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:21.398285 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d8:28,bridge_name='br-int',has_traffic_filtering=True,id=7d465039-2df5-4a2d-bb08-e10e97b40fd7,network=Network(010dbd36-41b4-476f-b0a7-34c9dbc108af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d465039-2d') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:21.398550 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d8:28,bridge_name='br-int',has_traffic_filtering=True,id=7d465039-2df5-4a2d-bb08-e10e97b40fd7,network=Network(010dbd36-41b4-476f-b0a7-34c9dbc108af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d465039-2d') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:37:21.399805 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:21.400142 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d465039-2d, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:21.412119 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:21.413214 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:21.416363 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:21.423903 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:21.424197 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2f87ebd-7e7b-4ef6-a5ab-3a59657c62c8) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:21.431821 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:21.435257 np0000001025 nova-compute[97981]: INFO os_vif [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:d8:28,bridge_name='br-int',has_traffic_filtering=True,id=7d465039-2df5-4a2d-bb08-e10e97b40fd7,network=Network(010dbd36-41b4-476f-b0a7-34c9dbc108af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d465039-2d')
May 19 04:37:21.435406 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Deleting instance files /opt/stack/data/nova/instances/f66a2b29-93d1-468a-94fc-77679fce8d64_del
May 19 04:37:21.436142 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Deletion of /opt/stack/data/nova/instances/f66a2b29-93d1-468a-94fc-77679fce8d64_del complete
May 19 04:37:21.441868 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:37:21.467804 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:21.469096 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:21.495954 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:21.526748 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a91ff36a-228e-409f-8bbd-5a0f13ec0808 req-32af34be-6ed3-4900-84e6-602848da9676 service nova] Releasing lock "refresh_cache-0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:37:21.526748 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquired lock "refresh_cache-0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:37:21.526748 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:37:21.619960 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:21.627179 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:21.636953 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:21.799836 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999653354999964 future=<Future at 0x721834470500 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:21.800737 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Instance destroyed successfully.
May 19 04:37:21.801246 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'resources' on Instance uuid b5f34a29-15f7-4f5e-a8bf-574abebd5c84 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:37:21.945069 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Took 1.42 seconds to destroy the instance on the hypervisor.
May 19 04:37:21.945763 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:37:21.946087 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:37:21.946251 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:37:21.946728 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:22.013553 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:22.094972 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:22.119703 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:37:22.126999 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6a5f9243-3363-425d-a1ec-9db6080d1e11 req-c674b076-3ab5-4f61-ad71-5383944986d7 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-deleted-42811c2a-5e1a-48c2-ae48-869cd5e416e6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:22.127177 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-6a5f9243-3363-425d-a1ec-9db6080d1e11 req-c674b076-3ab5-4f61-ad71-5383944986d7 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Neutron deleted interface 42811c2a-5e1a-48c2-ae48-869cd5e416e6; detaching it from the instance and deleting it from the info cache
May 19 04:37:22.127619 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-6a5f9243-3363-425d-a1ec-9db6080d1e11 req-c674b076-3ab5-4f61-ad71-5383944986d7 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Updating instance_info_cache with network_info: [{"id": "ad71ba07-449a-4565-bd5e-17c050975bd3", "address": "fa:16:3e:3b:78:32", "network": {"id": "a3b3266f-28a3-47fc-b52c-26f42a06a1bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1135470460-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad71ba07-44", "ovs_interfaceid": "ad71ba07-449a-4565-bd5e-17c050975bd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "address": "fa:16:3e:e7:64:b0", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60124aa0-37", "ovs_interfaceid": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "address": "fa:16:3e:c8:33:5b", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap137c6f2c-dd", "ovs_interfaceid": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "55210bd9-f231-4f7e-89be-c5779add4e83", "address": "fa:16:3e:d0:04:13", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55210bd9-f2", "ovs_interfaceid": "55210bd9-f231-4f7e-89be-c5779add4e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "address": "fa:16:3e:50:b6:e3", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ec0e22-80", "ovs_interfaceid": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7648d4e-3e92-4c77-9347-91670c3b9113", "address": "fa:16:3e:2c:e3:ec", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7648d4e-3e", "ovs_interfaceid": "d7648d4e-3e92-4c77-9347-91670c3b9113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:22.274700 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:22.303596 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-610177958',display_name='tempest-ServerRescueNegativeTestJSON-server-610177958',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverrescuenegativetestjson-server-610177958',id=10,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEof4N14+Ak1LVBtAkPut88JFqrfziujXkwzhlzzGWikBF+XeYH2EhInUSGhj5W54Gw3WfzaAmJeE58MxA5o/wrrspO3oas8tLUUdfN0O59dnL6RW93aVKiG3Fu6+namUQ==',key_name='tempest-keypair-541496426',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:36:30Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='334b83c8d3714844830f961673658b20',ramdisk_id='',reservation_id='r-rbufrcjf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1305117099',owner_user_name='tempest-ServerRescueNegativeTestJSON-1305117099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:36:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cdf106961084f0e941b5b65911c9b76',uuid=b5f34a29-15f7-4f5e-a8bf-574abebd5c84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "address": "fa:16:3e:7d:73:e6", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe8167e8-42", "ovs_interfaceid": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:37:22.306916 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converting VIF {"id": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "address": "fa:16:3e:7d:73:e6", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe8167e8-42", "ovs_interfaceid": "fe8167e8-425b-4446-a2e8-84711a2be7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:22.307558 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:73:e6,bridge_name='br-int',has_traffic_filtering=True,id=fe8167e8-425b-4446-a2e8-84711a2be7dd,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe8167e8-42') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:22.308226 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:73:e6,bridge_name='br-int',has_traffic_filtering=True,id=fe8167e8-425b-4446-a2e8-84711a2be7dd,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe8167e8-42') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:37:22.310517 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:22.315197 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:22.315417 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe8167e8-42, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:22.316385 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:22.318763 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:22.318763 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:22.318763 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:22.318955 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c088ddc2-a5f1-42eb-9d3a-5d942694b2c0) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:22.319316 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:22.319755 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:22.320541 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:22.326901 np0000001025 nova-compute[97981]: INFO os_vif [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:73:e6,bridge_name='br-int',has_traffic_filtering=True,id=fe8167e8-425b-4446-a2e8-84711a2be7dd,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe8167e8-42')
May 19 04:37:22.326901 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Deleting instance files /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84_del
May 19 04:37:22.326901 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Deletion of /opt/stack/data/nova/instances/b5f34a29-15f7-4f5e-a8bf-574abebd5c84_del complete
May 19 04:37:22.386731 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:22.495142 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Updating instance_info_cache with network_info: [{"id": "205c6b38-e8f4-4a6a-8de5-5fc6546c8821", "address": "fa:16:3e:2f:e4:f9", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap205c6b38-e8", "ovs_interfaceid": "205c6b38-e8f4-4a6a-8de5-5fc6546c8821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:22.522870 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:37:22.524087 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:37:22.524608 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Creating image(s)
May 19 04:37:22.524751 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:37:22.525624 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Ensure instance console log exists: /opt/stack/data/nova/instances/0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:37:22.525624 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:22.525624 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:22.525624 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:22.633203 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6a5f9243-3363-425d-a1ec-9db6080d1e11 req-c674b076-3ab5-4f61-ad71-5383944986d7 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Detach interface failed, port_id=42811c2a-5e1a-48c2-ae48-869cd5e416e6, reason: Instance 63247a98-0dc4-4a87-9141-5ae713a462b5 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:37:22.633371 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6a5f9243-3363-425d-a1ec-9db6080d1e11 req-c674b076-3ab5-4f61-ad71-5383944986d7 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-deleted-55210bd9-f231-4f7e-89be-c5779add4e83 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:22.633563 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-6a5f9243-3363-425d-a1ec-9db6080d1e11 req-c674b076-3ab5-4f61-ad71-5383944986d7 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Neutron deleted interface 55210bd9-f231-4f7e-89be-c5779add4e83; detaching it from the instance and deleting it from the info cache
May 19 04:37:22.633934 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-6a5f9243-3363-425d-a1ec-9db6080d1e11 req-c674b076-3ab5-4f61-ad71-5383944986d7 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Updating instance_info_cache with network_info: [{"id": "ad71ba07-449a-4565-bd5e-17c050975bd3", "address": "fa:16:3e:3b:78:32", "network": {"id": "a3b3266f-28a3-47fc-b52c-26f42a06a1bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1135470460-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad71ba07-44", "ovs_interfaceid": "ad71ba07-449a-4565-bd5e-17c050975bd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "address": "fa:16:3e:e7:64:b0", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60124aa0-37", "ovs_interfaceid": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "address": "fa:16:3e:c8:33:5b", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap137c6f2c-dd", "ovs_interfaceid": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "address": "fa:16:3e:50:b6:e3", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ec0e22-80", "ovs_interfaceid": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7648d4e-3e92-4c77-9347-91670c3b9113", "address": "fa:16:3e:2c:e3:ec", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7648d4e-3e", "ovs_interfaceid": "d7648d4e-3e92-4c77-9347-91670c3b9113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:22.751808 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:22.777141 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Took 4.14 seconds to deallocate network for instance.
May 19 04:37:22.831915 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Took 1.39 seconds to destroy the instance on the hypervisor.
May 19 04:37:22.833362 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:37:22.833613 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:37:22.833651 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:37:22.833890 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:22.855294 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:22.915130 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Updating instance_info_cache with network_info: [{"id": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "address": "fa:16:3e:74:c7:cf", "network": {"id": "274fbf5f-057a-48b4-8049-70f366638ce8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1968961134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d50a64-6a", "ovs_interfaceid": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "address": "fa:16:3e:ce:a6:b1", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5add6c4e-98", "ovs_interfaceid": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "address": "fa:16:3e:9b:1a:bc", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap856804f2-64", "ovs_interfaceid": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "address": "fa:16:3e:12:e9:10", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371fc2a1-78", "ovs_interfaceid": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "address": "fa:16:3e:97:55:fe", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e688b23-68", "ovs_interfaceid": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea620a14-2efe-4797-9ee1-c004ba488769", "address": "fa:16:3e:2d:30:c5", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea620a14-2e", "ovs_interfaceid": "ea620a14-2efe-4797-9ee1-c004ba488769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "address": "fa:16:3e:92:1a:3d", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fdb83aa-cd", "ovs_interfaceid": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:22.997235 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:22.998216 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Releasing lock "refresh_cache-0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:37:22.998895 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Instance network_info: |[{"id": "205c6b38-e8f4-4a6a-8de5-5fc6546c8821", "address": "fa:16:3e:2f:e4:f9", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap205c6b38-e8", "ovs_interfaceid": "205c6b38-e8f4-4a6a-8de5-5fc6546c8821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:37:22.999899 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Start _get_guest_xml network_info=[{"id": "205c6b38-e8f4-4a6a-8de5-5fc6546c8821", "address": "fa:16:3e:2f:e4:f9", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap205c6b38-e8", "ovs_interfaceid": "205c6b38-e8f4-4a6a-8de5-5fc6546c8821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'd88bfbd3-ecf4-4cd5-8874-67195456333c', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c', 'attached_at': '', 'detached_at': '', 'volume_id': '652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'serial': '652c0598-ca18-49bf-ab6d-a836f9af9eb3'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:37:23.004747 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:37:23.005913 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-720936815', uuid='0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c'), owner=OwnerMeta(userid='5c46088fb3e74b819bb456461716a801', username='tempest-TestVolumeBootPattern-1071176852-project-member', projectid='28b3c0fa8f894ed2a7c3bcfac99ce74c', projectname='tempest-TestVolumeBootPattern-1071176852'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "205c6b38-e8f4-4a6a-8de5-5fc6546c8821", "address": "fa:16:3e:2f:e4:f9", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap205c6b38-e8", "ovs_interfaceid": "205c6b38-e8f4-4a6a-8de5-5fc6546c8821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165443.005557) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:37:23.006790 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:37:23.007124 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:37:23.007897 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:37:23.008085 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:37:23.008975 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:37:23.009227 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:37:23.009355 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:37:23.009460 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:37:23.009603 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:37:23.009693 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:37:23.009783 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:37:23.009996 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:37:23.010139 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:37:23.010292 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:37:23.010410 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:37:23.010647 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:37:23.026217 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:37:23.027301 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:37:23.027301 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:37:23.027301 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:37:23.027631 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:37:23.029168 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:23.039225 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:37:23.039813 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:37:23.040245 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:37:23.043068 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:37:23.043695 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:37:23.043925 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:37:23.054374 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:37:23.054374 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:23.059485 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:37:23.059485 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:23.066861 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3] added
May 19 04:37:23.066861 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:37:23.066861 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:37:23.066861 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:37:23.066861 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:37:23.066861 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:37:23.066861 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:23.067204 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:37:23.067368 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0244(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:37:23.067590 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:37:23.072559 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3] added
May 19 04:37:23.072559 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:37:23.072559 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:37:23.072559 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:37:23.072559 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:37:23.072559 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:37:23.072559 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:23.072810 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:37:23.072988 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.029(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:37:23.073201 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:37:23.121558 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-49724f1f-b101-4fb5-9b1f-17ff38ae9a81 req-1b0149a1-2ae4-4fbc-be1f-188f6f8084e8 service nova] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Received event network-vif-unplugged-7d465039-2df5-4a2d-bb08-e10e97b40fd7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:23.121774 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-49724f1f-b101-4fb5-9b1f-17ff38ae9a81 req-1b0149a1-2ae4-4fbc-be1f-188f6f8084e8 service nova] Acquiring lock "f66a2b29-93d1-468a-94fc-77679fce8d64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:23.121928 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-49724f1f-b101-4fb5-9b1f-17ff38ae9a81 req-1b0149a1-2ae4-4fbc-be1f-188f6f8084e8 service nova] Lock "f66a2b29-93d1-468a-94fc-77679fce8d64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:23.122071 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-49724f1f-b101-4fb5-9b1f-17ff38ae9a81 req-1b0149a1-2ae4-4fbc-be1f-188f6f8084e8 service nova] Lock "f66a2b29-93d1-468a-94fc-77679fce8d64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:23.122278 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-49724f1f-b101-4fb5-9b1f-17ff38ae9a81 req-1b0149a1-2ae4-4fbc-be1f-188f6f8084e8 service nova] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] No waiting events found dispatching network-vif-unplugged-7d465039-2df5-4a2d-bb08-e10e97b40fd7 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:23.122472 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-49724f1f-b101-4fb5-9b1f-17ff38ae9a81 req-1b0149a1-2ae4-4fbc-be1f-188f6f8084e8 service nova] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Received event network-vif-unplugged-7d465039-2df5-4a2d-bb08-e10e97b40fd7 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:23.122879 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-49724f1f-b101-4fb5-9b1f-17ff38ae9a81 req-1b0149a1-2ae4-4fbc-be1f-188f6f8084e8 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-deleted-d7648d4e-3e92-4c77-9347-91670c3b9113 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:23.122879 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-49724f1f-b101-4fb5-9b1f-17ff38ae9a81 req-1b0149a1-2ae4-4fbc-be1f-188f6f8084e8 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Neutron deleted interface d7648d4e-3e92-4c77-9347-91670c3b9113; detaching it from the instance and deleting it from the info cache
May 19 04:37:23.123213 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-49724f1f-b101-4fb5-9b1f-17ff38ae9a81 req-1b0149a1-2ae4-4fbc-be1f-188f6f8084e8 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Updating instance_info_cache with network_info: [{"id": "ad71ba07-449a-4565-bd5e-17c050975bd3", "address": "fa:16:3e:3b:78:32", "network": {"id": "a3b3266f-28a3-47fc-b52c-26f42a06a1bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1135470460-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad71ba07-44", "ovs_interfaceid": "ad71ba07-449a-4565-bd5e-17c050975bd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "address": "fa:16:3e:e7:64:b0", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60124aa0-37", "ovs_interfaceid": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "address": "fa:16:3e:c8:33:5b", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap137c6f2c-dd", "ovs_interfaceid": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "address": "fa:16:3e:50:b6:e3", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ec0e22-80", "ovs_interfaceid": "c0ec0e22-8097-46a0-93bb-077e4e38a07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:23.139060 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6a5f9243-3363-425d-a1ec-9db6080d1e11 req-c674b076-3ab5-4f61-ad71-5383944986d7 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Detach interface failed, port_id=55210bd9-f231-4f7e-89be-c5779add4e83, reason: Instance 63247a98-0dc4-4a87-9141-5ae713a462b5 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:37:23.139548 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6a5f9243-3363-425d-a1ec-9db6080d1e11 req-c674b076-3ab5-4f61-ad71-5383944986d7 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-deleted-c0ec0e22-8097-46a0-93bb-077e4e38a07c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:23.141439 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-6a5f9243-3363-425d-a1ec-9db6080d1e11 req-c674b076-3ab5-4f61-ad71-5383944986d7 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Neutron deleted interface c0ec0e22-8097-46a0-93bb-077e4e38a07c; detaching it from the instance and deleting it from the info cache
May 19 04:37:23.141439 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-6a5f9243-3363-425d-a1ec-9db6080d1e11 req-c674b076-3ab5-4f61-ad71-5383944986d7 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Updating instance_info_cache with network_info: [{"id": "ad71ba07-449a-4565-bd5e-17c050975bd3", "address": "fa:16:3e:3b:78:32", "network": {"id": "a3b3266f-28a3-47fc-b52c-26f42a06a1bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1135470460-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad71ba07-44", "ovs_interfaceid": "ad71ba07-449a-4565-bd5e-17c050975bd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "address": "fa:16:3e:e7:64:b0", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60124aa0-37", "ovs_interfaceid": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "address": "fa:16:3e:c8:33:5b", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap137c6f2c-dd", "ovs_interfaceid": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7648d4e-3e92-4c77-9347-91670c3b9113", "address": "fa:16:3e:2c:e3:ec", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7648d4e-3e", "ovs_interfaceid": "d7648d4e-3e92-4c77-9347-91670c3b9113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:23.358170 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Took 1.41 seconds to deallocate network for instance.
May 19 04:37:23.416284 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Releasing lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:37:23.416284 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Instance network_info: |[{"id": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "address": "fa:16:3e:74:c7:cf", "network": {"id": "274fbf5f-057a-48b4-8049-70f366638ce8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1968961134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d50a64-6a", "ovs_interfaceid": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "address": "fa:16:3e:ce:a6:b1", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5add6c4e-98", "ovs_interfaceid": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "address": "fa:16:3e:9b:1a:bc", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap856804f2-64", "ovs_interfaceid": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "address": "fa:16:3e:12:e9:10", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371fc2a1-78", "ovs_interfaceid": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "address": "fa:16:3e:97:55:fe", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e688b23-68", "ovs_interfaceid": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea620a14-2efe-4797-9ee1-c004ba488769", "address": "fa:16:3e:2d:30:c5", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea620a14-2e", "ovs_interfaceid": "ea620a14-2efe-4797-9ee1-c004ba488769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "address": "fa:16:3e:92:1a:3d", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fdb83aa-cd", "ovs_interfaceid": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:37:23.416577 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-16953a51-9dc4-48a6-9a32-febe8e89707c req-8720806e-51b6-4bd5-9545-cdbda69cfa19 service nova] Acquired lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:37:23.417029 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-16953a51-9dc4-48a6-9a32-febe8e89707c req-8720806e-51b6-4bd5-9545-cdbda69cfa19 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Refreshing network info cache for port 0fdb83aa-cd21-410a-8823-a52276cc6fb1 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:37:23.420135 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Start _get_guest_xml network_info=[{"id": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "address": "fa:16:3e:74:c7:cf", "network": {"id": "274fbf5f-057a-48b4-8049-70f366638ce8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1968961134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d50a64-6a", "ovs_interfaceid": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "address": "fa:16:3e:ce:a6:b1", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5add6c4e-98", "ovs_interfaceid": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "address": "fa:16:3e:9b:1a:bc", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap856804f2-64", "ovs_interfaceid": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "address": "fa:16:3e:12:e9:10", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371fc2a1-78", "ovs_interfaceid": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "address": "fa:16:3e:97:55:fe", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e688b23-68", "ovs_interfaceid": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea620a14-2efe-4797-9ee1-c004ba488769", "address": "fa:16:3e:2d:30:c5", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea620a14-2e", "ovs_interfaceid": "ea620a14-2efe-4797-9ee1-c004ba488769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "address": "fa:16:3e:92:1a:3d", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fdb83aa-cd", "ovs_interfaceid": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '1a4c99f6-a989-4937-9d51-6fb3bc96cdc1', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '826a781c-5976-4c74-8ca4-447a075fb902', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7859dfab-f702-4d0b-a9e9-bb856c5004e6', 'attached_at': '', 'detached_at': '', 'volume_id': '826a781c-5976-4c74-8ca4-447a075fb902', 'serial': '826a781c-5976-4c74-8ca4-447a075fb902'}, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': 1, 'attachment_id': '8014cd22-832f-426f-a2f8-6c390c1d876e', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7859dfab-f702-4d0b-a9e9-bb856c5004e6', 'attached_at': '', 'detached_at': '', 'volume_id': '5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', 'serial': '5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844'}, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': 2, 'attachment_id': 'bedf815a-f68d-42c7-be12-da4ea2bfed06', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b', 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f628dad-4b63-4812-a34d-a3b52215814b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7859dfab-f702-4d0b-a9e9-bb856c5004e6', 'attached_at': '', 'detached_at': '', 'volume_id': '2f628dad-4b63-4812-a34d-a3b52215814b', 'serial': '2f628dad-4b63-4812-a34d-a3b52215814b'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:37:23.421825 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:37:23.423237 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1508815012', uuid='7859dfab-f702-4d0b-a9e9-bb856c5004e6'), owner=OwnerMeta(userid='2dad74db8b9240b1a3e3e145265f8b99', username='tempest-TaggedBootDevicesTest-171323133-project-member', projectid='bc136a1f1fe94373a04ae534d82f8673', projectname='tempest-TaggedBootDevicesTest-171323133'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "address": "fa:16:3e:74:c7:cf", "network": {"id": "274fbf5f-057a-48b4-8049-70f366638ce8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1968961134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d50a64-6a", "ovs_interfaceid": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "address": "fa:16:3e:ce:a6:b1", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5add6c4e-98", "ovs_interfaceid": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "address": "fa:16:3e:9b:1a:bc", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap856804f2-64", "ovs_interfaceid": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "address": "fa:16:3e:12:e9:10", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371fc2a1-78", "ovs_interfaceid": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "address": "fa:16:3e:97:55:fe", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e688b23-68", "ovs_interfaceid": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea620a14-2efe-4797-9ee1-c004ba488769", "address": "fa:16:3e:2d:30:c5", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea620a14-2e", "ovs_interfaceid": "ea620a14-2efe-4797-9ee1-c004ba488769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "address": "fa:16:3e:92:1a:3d", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fdb83aa-cd", "ovs_interfaceid": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165443.4226305) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:37:23.424384 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:37:23.425387 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:37:23.426536 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:37:23.426710 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:37:23.427752 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:37:23.427931 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:37:23.428073 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:37:23.428205 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:37:23.428475 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:37:23.428588 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:37:23.428819 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:37:23.428998 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:37:23.429151 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:37:23.429493 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:37:23.429630 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:37:23.429726 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:37:23.448650 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:37:23.448961 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '826a781c-5976-4c74-8ca4-447a075fb902', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:37:23.449123 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:37:23.627035 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-49724f1f-b101-4fb5-9b1f-17ff38ae9a81 req-1b0149a1-2ae4-4fbc-be1f-188f6f8084e8 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Detach interface failed, port_id=d7648d4e-3e92-4c77-9347-91670c3b9113, reason: Instance 63247a98-0dc4-4a87-9141-5ae713a462b5 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:37:23.627255 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-49724f1f-b101-4fb5-9b1f-17ff38ae9a81 req-1b0149a1-2ae4-4fbc-be1f-188f6f8084e8 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received event network-vif-unplugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:23.627570 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-49724f1f-b101-4fb5-9b1f-17ff38ae9a81 req-1b0149a1-2ae4-4fbc-be1f-188f6f8084e8 service nova] Acquiring lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:23.627657 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-49724f1f-b101-4fb5-9b1f-17ff38ae9a81 req-1b0149a1-2ae4-4fbc-be1f-188f6f8084e8 service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:23.627813 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-49724f1f-b101-4fb5-9b1f-17ff38ae9a81 req-1b0149a1-2ae4-4fbc-be1f-188f6f8084e8 service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:23.627971 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-49724f1f-b101-4fb5-9b1f-17ff38ae9a81 req-1b0149a1-2ae4-4fbc-be1f-188f6f8084e8 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] No waiting events found dispatching network-vif-unplugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:23.628121 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-49724f1f-b101-4fb5-9b1f-17ff38ae9a81 req-1b0149a1-2ae4-4fbc-be1f-188f6f8084e8 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received event network-vif-unplugged-fe8167e8-425b-4446-a2e8-84711a2be7dd for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:23.628295 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-49724f1f-b101-4fb5-9b1f-17ff38ae9a81 req-1b0149a1-2ae4-4fbc-be1f-188f6f8084e8 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received event network-vif-unplugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:23.628501 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-49724f1f-b101-4fb5-9b1f-17ff38ae9a81 req-1b0149a1-2ae4-4fbc-be1f-188f6f8084e8 service nova] Acquiring lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:23.628662 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-49724f1f-b101-4fb5-9b1f-17ff38ae9a81 req-1b0149a1-2ae4-4fbc-be1f-188f6f8084e8 service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:23.628794 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-49724f1f-b101-4fb5-9b1f-17ff38ae9a81 req-1b0149a1-2ae4-4fbc-be1f-188f6f8084e8 service nova] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:23.628935 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-49724f1f-b101-4fb5-9b1f-17ff38ae9a81 req-1b0149a1-2ae4-4fbc-be1f-188f6f8084e8 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] No waiting events found dispatching network-vif-unplugged-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:23.629073 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-49724f1f-b101-4fb5-9b1f-17ff38ae9a81 req-1b0149a1-2ae4-4fbc-be1f-188f6f8084e8 service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received event network-vif-unplugged-fe8167e8-425b-4446-a2e8-84711a2be7dd for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:23.644927 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6a5f9243-3363-425d-a1ec-9db6080d1e11 req-c674b076-3ab5-4f61-ad71-5383944986d7 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Detach interface failed, port_id=c0ec0e22-8097-46a0-93bb-077e4e38a07c, reason: Instance 63247a98-0dc4-4a87-9141-5ae713a462b5 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:37:23.644927 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6a5f9243-3363-425d-a1ec-9db6080d1e11 req-c674b076-3ab5-4f61-ad71-5383944986d7 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Received event network-vif-deleted-ad71ba07-449a-4565-bd5e-17c050975bd3 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:23.644927 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-6a5f9243-3363-425d-a1ec-9db6080d1e11 req-c674b076-3ab5-4f61-ad71-5383944986d7 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Neutron deleted interface ad71ba07-449a-4565-bd5e-17c050975bd3; detaching it from the instance and deleting it from the info cache
May 19 04:37:23.644927 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-6a5f9243-3363-425d-a1ec-9db6080d1e11 req-c674b076-3ab5-4f61-ad71-5383944986d7 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Updating instance_info_cache with network_info: [{"id": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "address": "fa:16:3e:e7:64:b0", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60124aa0-37", "ovs_interfaceid": "60124aa0-3747-4d4f-bac3-3c90e62b801c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "address": "fa:16:3e:c8:33:5b", "network": {"id": "8efe1d5d-4cf4-465c-ac37-06d7ba032e84", "bridge": "br-int", "label": "tempest-device-tagging-net1-51275329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap137c6f2c-dd", "ovs_interfaceid": "137c6f2c-ddbe-4bc8-b61b-6abbd87dbd7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7648d4e-3e92-4c77-9347-91670c3b9113", "address": "fa:16:3e:2c:e3:ec", "network": {"id": "639c2651-b468-4473-890e-e2ee134e2afc", "bridge": "br-int", "label": "tempest-device-tagging-net2-94587912", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fc088ff80284506af708277495c5882", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7648d4e-3e", "ovs_interfaceid": "d7648d4e-3e92-4c77-9347-91670c3b9113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:23.867621 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:23.867960 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:23.921722 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-16953a51-9dc4-48a6-9a32-febe8e89707c req-8720806e-51b6-4bd5-9545-cdbda69cfa19 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:23.949716 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:24.068286 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:37:24.074980 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:37:24.084475 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:37:24.084475 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:37:24.093669 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:37:24.093669 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:24.108477 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:24.117096 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:24.126691 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 19 04:37:24.126691 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:37:24.126691 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 19 04:37:24.126691 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:37:24.126691 np0000001025 nova-compute[97981]: WARNING os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 19 04:37:24.126691 np0000001025 nova-compute[97981]: 
May 19 04:37:24.127443 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 19 04:37:24.127443 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:37:24.127443 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 19 04:37:24.127443 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:37:24.127443 np0000001025 nova-compute[97981]: WARNING os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 19 04:37:24.127443 np0000001025 nova-compute[97981]: 
May 19 04:37:24.154294 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6a5f9243-3363-425d-a1ec-9db6080d1e11 req-c674b076-3ab5-4f61-ad71-5383944986d7 service nova] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Detach interface failed, port_id=ad71ba07-449a-4565-bd5e-17c050975bd3, reason: Instance 63247a98-0dc4-4a87-9141-5ae713a462b5 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:37:24.155667 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3, portal: 192.168.40.100,3260]
May 19 04:37:24.155667 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3, portal: 192.168.40.100,3260] successful.
May 19 04:37:24.155667 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:24.169301 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:24.170077 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3, portal: 192.168.50.100,3260]
May 19 04:37:24.170077 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3, portal: 192.168.50.100,3260] successful.
May 19 04:37:24.170077 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:24.182944 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:24.182944 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:24.182944 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:37:24.182944 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:24.182944 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:24.182944 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:37:24.182944 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:37:24.183259 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:37:24.183640 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] HCTL ('7', '-', '-', 0) found on session 35 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:37:24.184318 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:37:24.189313 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:24.205706 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching for a device in session 35 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:37:24.205706 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:37:24.207403 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:24.207403 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:24.207403 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:37:24.207600 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:24.207600 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:24.207600 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:37:24.207929 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:37:24.208550 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:37:24.208927 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] HCTL ('8', '-', '-', 0) found on session 36 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:37:24.209858 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:37:24.231841 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching for a device in session 36 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:37:24.231841 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:37:24.234447 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a2188e81-ed33-4289-8204-e16a7b27f0e9 req-cdcd2da2-d041-41ac-9f70-a6a269dd1b5e service nova] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Received event network-vif-deleted-7d465039-2df5-4a2d-bb08-e10e97b40fd7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:24.427709 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:37:24.428001 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:37:24.445604 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-16953a51-9dc4-48a6-9a32-febe8e89707c req-8720806e-51b6-4bd5-9545-cdbda69cfa19 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:24.452912 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Took 1.62 seconds to deallocate network for instance.
May 19 04:37:24.496039 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Took 1.72 seconds to detach 3 volumes for instance.
May 19 04:37:24.599727 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-16953a51-9dc4-48a6-9a32-febe8e89707c req-8720806e-51b6-4bd5-9545-cdbda69cfa19 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Updated VIF entry in instance network info cache for port 0fdb83aa-cd21-410a-8823-a52276cc6fb1. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:37:24.600925 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-16953a51-9dc4-48a6-9a32-febe8e89707c req-8720806e-51b6-4bd5-9545-cdbda69cfa19 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Updating instance_info_cache with network_info: [{"id": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "address": "fa:16:3e:74:c7:cf", "network": {"id": "274fbf5f-057a-48b4-8049-70f366638ce8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1968961134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d50a64-6a", "ovs_interfaceid": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "address": "fa:16:3e:ce:a6:b1", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5add6c4e-98", "ovs_interfaceid": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "address": "fa:16:3e:9b:1a:bc", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap856804f2-64", "ovs_interfaceid": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "address": "fa:16:3e:12:e9:10", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371fc2a1-78", "ovs_interfaceid": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "address": "fa:16:3e:97:55:fe", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e688b23-68", "ovs_interfaceid": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea620a14-2efe-4797-9ee1-c004ba488769", "address": "fa:16:3e:2d:30:c5", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea620a14-2e", "ovs_interfaceid": "ea620a14-2efe-4797-9ee1-c004ba488769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "address": "fa:16:3e:92:1a:3d", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fdb83aa-cd", "ovs_interfaceid": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:24.935915 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:37:24.960978 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:25.002406 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:25.043024 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:37:25.104171 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-16953a51-9dc4-48a6-9a32-febe8e89707c req-8720806e-51b6-4bd5-9545-cdbda69cfa19 service nova] Releasing lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:37:25.106077 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-44ff0a75-2122-47da-922c-7cf07f7fbd63 req-fd6dd35c-3767-48fa-ae3d-6ae647338c23 service nova] Acquired lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:37:25.106077 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-44ff0a75-2122-47da-922c-7cf07f7fbd63 req-fd6dd35c-3767-48fa-ae3d-6ae647338c23 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Refreshing network info cache for port ea620a14-2efe-4797-9ee1-c004ba488769 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:37:25.204185 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e480674c-1b69-43df-bc1a-44505199029b req-88654590-2eb5-4193-8bd3-95e82e717b9a service nova] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Received event network-vif-deleted-fe8167e8-425b-4446-a2e8-84711a2be7dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:25.443954 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.576s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:25.446695 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.486s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:25.507290 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Deleted allocations for instance f66a2b29-93d1-468a-94fc-77679fce8d64
May 19 04:37:25.612148 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-44ff0a75-2122-47da-922c-7cf07f7fbd63 req-fd6dd35c-3767-48fa-ae3d-6ae647338c23 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:25.947037 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:37:25.947544 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:37:25.986605 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-44ff0a75-2122-47da-922c-7cf07f7fbd63 req-fd6dd35c-3767-48fa-ae3d-6ae647338c23 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:26.062495 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Found WWN 330000000ce5b9835 for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:37:26.062904 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:37:26.064543 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '330000000ce5b9835', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000ce5b9835'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:37:26.064720 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ce5b9835', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000ce5b9835'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:37:26.065149 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.616s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:37:26.065473 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '826a781c-5976-4c74-8ca4-447a075fb902', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:37:26.077571 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:37:26.078299 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:37:26.078720 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:37:26.079042 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:37:26.079407 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:37:26.079628 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:37:26.091589 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:37:26.091589 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:26.099047 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:37:26.099047 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:26.108297 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902] added
May 19 04:37:26.108297 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:37:26.108297 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:37:26.108297 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:37:26.108297 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:37:26.108297 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:37:26.108297 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:26.108487 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:37:26.110985 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0297(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:37:26.110985 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:37:26.110985 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902] added
May 19 04:37:26.110985 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:37:26.110985 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:37:26.110985 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:37:26.110985 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:37:26.110985 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:37:26.110985 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:26.110985 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:37:26.110985 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0304(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:37:26.110985 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:37:26.120848 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c', 'attached_at': '', 'detached_at': '', 'volume_id': '652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'serial': '652c0598-ca18-49bf-ab6d-a836f9af9eb3'} {{(pid=97981) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 19 04:37:26.121535 np0000001025 nova-compute[97981]: WARNING stevedore.named [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 19 04:37:26.121795 np0000001025 nova-compute[97981]: WARNING castellan.key_manager [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:37:26.121977 np0000001025 nova-compute[97981]: WARNING nova.keymgr.conf_key_mgr [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:37:26.122613 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x72185022c890>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c', 'attached_at': '', 'detached_at': '', 'volume_id': '652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'serial': '652c0598-ca18-49bf-ab6d-a836f9af9eb3'} {{(pid=97981) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 19 04:37:26.122813 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=97981) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 19 04:37:26.122964 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors.luks [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] opening encrypted volume /dev/dm-0 {{(pid=97981) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 19 04:37:26.152363 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-44ff0a75-2122-47da-922c-7cf07f7fbd63 req-fd6dd35c-3767-48fa-ae3d-6ae647338c23 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Updated VIF entry in instance network info cache for port ea620a14-2efe-4797-9ee1-c004ba488769. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:37:26.153066 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-44ff0a75-2122-47da-922c-7cf07f7fbd63 req-fd6dd35c-3767-48fa-ae3d-6ae647338c23 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Updating instance_info_cache with network_info: [{"id": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "address": "fa:16:3e:74:c7:cf", "network": {"id": "274fbf5f-057a-48b4-8049-70f366638ce8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1968961134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d50a64-6a", "ovs_interfaceid": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "address": "fa:16:3e:ce:a6:b1", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5add6c4e-98", "ovs_interfaceid": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "address": "fa:16:3e:9b:1a:bc", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap856804f2-64", "ovs_interfaceid": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "address": "fa:16:3e:12:e9:10", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371fc2a1-78", "ovs_interfaceid": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "address": "fa:16:3e:97:55:fe", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e688b23-68", "ovs_interfaceid": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea620a14-2efe-4797-9ee1-c004ba488769", "address": "fa:16:3e:2d:30:c5", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea620a14-2e", "ovs_interfaceid": "ea620a14-2efe-4797-9ee1-c004ba488769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "address": "fa:16:3e:92:1a:3d", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fdb83aa-cd", "ovs_interfaceid": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:26.157476 np0000001025 nova-compute[97981]: WARNING os_brick.encryptors.luks [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 19 04:37:26.157719 np0000001025 nova-compute[97981]: INFO os_brick.encryptors.luks [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] /dev/dm-0 is not a valid LUKS device; formatting device for first use
May 19 04:37:26.157891 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors.luks [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] formatting encrypted volume /dev/dm-0 {{(pid=97981) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 19 04:37:26.449665 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:37:26.517445 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6ea2fb3a-5f2c-4805-8277-fdbeebbcd65b tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Lock "f66a2b29-93d1-468a-94fc-77679fce8d64" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.504s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:26.611605 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:37:26.611863 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:37:26.655757 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-44ff0a75-2122-47da-922c-7cf07f7fbd63 req-fd6dd35c-3767-48fa-ae3d-6ae647338c23 service nova] Releasing lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:37:26.957556 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.511s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:26.963135 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.956s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:27.032067 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Deleted allocations for instance b5f34a29-15f7-4f5e-a8bf-574abebd5c84
May 19 04:37:27.109844 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:37:27.111123 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:37:27.128626 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:37:27.128626 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:37:27.135504 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:37:27.135504 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:27.139593 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:27.148484 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:27.157517 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:27.157517 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:27.157517 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:37:27.157668 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:27.157668 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:27.157668 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:37:27.164458 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:27.164458 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:27.164458 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:37:27.164590 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:27.164590 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:27.164590 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:37:27.193163 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902, portal: 192.168.50.100,3260]
May 19 04:37:27.193163 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902, portal: 192.168.50.100,3260] successful.
May 19 04:37:27.193163 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:27.205601 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:27.212396 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902, portal: 192.168.40.100,3260]
May 19 04:37:27.212396 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902, portal: 192.168.40.100,3260] successful.
May 19 04:37:27.212396 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:27.224518 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:27.225802 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:27.225802 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:27.225802 np0000001025 nova-compute[97981]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:27.225802 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:27.225802 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:37:27.226013 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:27.226013 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:27.226013 np0000001025 nova-compute[97981]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:27.226013 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:27.226013 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:37:27.226279 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:37:27.226420 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:37:27.227081 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] HCTL ('9', '-', '-', 0) found on session 37 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:37:27.227287 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:37:27.243503 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:27.243503 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:27.243503 np0000001025 nova-compute[97981]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:27.243503 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:27.243503 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:37:27.243728 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:27.243728 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:27.243728 np0000001025 nova-compute[97981]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:27.243728 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:27.243728 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:37:27.247328 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:37:27.247328 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:37:27.247557 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] HCTL ('10', '-', '-', 0) found on session 38 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:37:27.247700 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:37:27.248725 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Searching for a device in session 37 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:37:27.250211 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '826a781c-5976-4c74-8ca4-447a075fb902', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:37:27.268560 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Searching for a device in session 38 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:37:27.269048 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '826a781c-5976-4c74-8ca4-447a075fb902', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:37:27.320027 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:27.416603 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:37:27.416897 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:37:27.539315 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:27.617342 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:37:27.617342 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:37:27.919948 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:37:28.031217 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:28.041525 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8fdca054-b29c-4318-800d-08aa3f60d15a tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "b5f34a29-15f7-4f5e-a8bf-574abebd5c84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.125s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:28.079027 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:37:28.430339 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.472s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:28.507905 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Deleted allocations for instance 63247a98-0dc4-4a87-9141-5ae713a462b5
May 19 04:37:28.610627 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:37:28.612131 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:37:28.616606 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:37:28.616606 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:37:28.844139 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:29.104538 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Found WWN 330000000d5af5e45 for multipath device dm-1 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:37:29.104997 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:37:29.104997 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] <== connect_volume: return (5656ms) {'type': 'block', 'scsi_wwn': '330000000d5af5e45', 'path': '/dev/dm-1', 'multipath_id': '330000000d5af5e45'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:37:29.106774 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d5af5e45', 'path': '/dev/dm-1', 'multipath_id': '330000000d5af5e45'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:37:29.520225 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-93f3c68a-6d51-4794-94de-95aabda1d638 tempest-TaggedBootDevicesTest_v242-1449301970 tempest-TaggedBootDevicesTest_v242-1449301970-project-member] Lock "63247a98-0dc4-4a87-9141-5ae713a462b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.570s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:29.618127 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:37:29.618127 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:37:29.618127 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:37:29.618127 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:37:29.618127 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:37:29.618127 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:37:29.618127 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:37:29.628326 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:37:29.628928 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:37:29.632610 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:37:29.632844 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:37:29.633999 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:37:29.634244 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:37:29.651343 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:37:29.651343 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:29.656442 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:37:29.656442 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:29.664643 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844] added
May 19 04:37:29.664643 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:37:29.664643 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:37:29.664643 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:37:29.664643 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:37:29.664643 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:37:29.664643 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:29.664883 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:37:29.665016 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0322(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:37:29.665192 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:37:29.672762 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844] added
May 19 04:37:29.672762 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:37:29.672762 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:37:29.672762 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:37:29.672762 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:37:29.672762 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:37:29.672762 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:29.673056 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:37:29.673264 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0389(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:37:29.673452 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:37:30.615450 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:37:30.615843 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:37:30.668559 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:37:30.675493 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:37:30.694135 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:37:30.694135 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:37:30.716436 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:37:30.716436 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:30.724838 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:30.742587 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:30.752137 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:30.752137 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:30.752137 np0000001025 nova-compute[97981]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:30.752137 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:30.752137 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:37:30.752378 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:30.752378 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:30.752378 np0000001025 nova-compute[97981]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:30.752378 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:30.752378 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:37:30.761148 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:30.761148 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:30.761148 np0000001025 nova-compute[97981]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:30.761148 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:30.761148 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:37:30.761397 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:30.761397 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:30.761397 np0000001025 nova-compute[97981]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:30.761397 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:30.761397 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:37:30.800055 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844, portal: 192.168.40.100,3260]
May 19 04:37:30.800055 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844, portal: 192.168.40.100,3260] successful.
May 19 04:37:30.800055 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:30.815191 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:30.823897 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844, portal: 192.168.50.100,3260]
May 19 04:37:30.823897 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844, portal: 192.168.50.100,3260] successful.
May 19 04:37:30.823897 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:30.836470 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:30.836470 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:30.836470 np0000001025 nova-compute[97981]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:30.836470 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:30.836470 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:30.836470 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:30.836470 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:37:30.837431 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:30.837431 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:30.837431 np0000001025 nova-compute[97981]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:30.837431 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:30.837431 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:30.837431 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:30.837431 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:37:30.837431 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.204s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:37:30.837431 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:37:30.837980 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] HCTL ('11', '-', '-', 0) found on session 39 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:37:30.838195 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:37:30.839609 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:30.864561 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Searching for a device in session 39 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:37:30.864778 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:37:30.865560 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:30.865560 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:30.865560 np0000001025 nova-compute[97981]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:30.865560 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:30.865560 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:30.865560 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:30.865560 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:37:30.865923 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:30.865923 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:30.865923 np0000001025 nova-compute[97981]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:30.865923 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:30.865923 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:30.865923 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:30.865923 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:37:30.866562 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.232s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:37:30.866562 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:37:30.867454 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] HCTL ('12', '-', '-', 0) found on session 40 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:37:30.867454 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:37:30.886749 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Searching for a device in session 40 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:37:30.886749 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:37:31.141979 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.002167222000025504 future=<Future at 0x7218343063f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:31.141979 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:31.141979 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=4.748545387999911 future=<Future at 0x721850710b30 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:31.141979 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=4.748433084999988 future=<Future at 0x721850710b30 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:31.148618 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] Emitting event <LifecycleEvent: 1779165436.1392617, 63247a98-0dc4-4a87-9141-5ae713a462b5 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:31.148618 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] VM Stopped (Lifecycle Event)
May 19 04:37:31.568049 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:31.617199 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:37:31.617199 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:37:31.635370 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:37:31.669025 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:31.669321 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:31.669572 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:31.669782 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:31.669962 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:31.674948 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Terminating instance
May 19 04:37:31.682534 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c78c2781-7d0d-4d1d-8f25-ceb8ff27316b tempest-ImageDependencyTests-922756248 tempest-ImageDependencyTests-922756248-project-member] [instance: 63247a98-0dc4-4a87-9141-5ae713a462b5] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:32.127708 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:32.128031 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:32.128088 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:32.128278 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:37:32.184043 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:37:32.204842 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:32.206485 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:32.228087 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:32.321702 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:32.354079 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:32.359723 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:32.385758 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6ba9e5f9-b9e5-4027-a906-5b48abdc7368 req-14b474e2-b02d-4b13-bb7b-d469c5498546 service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received event network-vif-unplugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:32.385960 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6ba9e5f9-b9e5-4027-a906-5b48abdc7368 req-14b474e2-b02d-4b13-bb7b-d469c5498546 service nova] Acquiring lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:32.386300 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6ba9e5f9-b9e5-4027-a906-5b48abdc7368 req-14b474e2-b02d-4b13-bb7b-d469c5498546 service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:32.386436 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6ba9e5f9-b9e5-4027-a906-5b48abdc7368 req-14b474e2-b02d-4b13-bb7b-d469c5498546 service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:32.386732 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6ba9e5f9-b9e5-4027-a906-5b48abdc7368 req-14b474e2-b02d-4b13-bb7b-d469c5498546 service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] No waiting events found dispatching network-vif-unplugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:32.386820 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6ba9e5f9-b9e5-4027-a906-5b48abdc7368 req-14b474e2-b02d-4b13-bb7b-d469c5498546 service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received event network-vif-unplugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:32.539802 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999670045999892 future=<Future at 0x7218344018e0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:32.541454 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Instance destroyed successfully.
May 19 04:37:32.543092 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'resources' on Instance uuid 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:37:32.657101 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Found WWN 33000000088024718 for multipath device dm-4 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:37:32.657571 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:37:32.657738 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] <== connect_volume: return (3045ms) {'type': 'block', 'scsi_wwn': '33000000088024718', 'path': '/dev/dm-4', 'multipath_id': '33000000088024718'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:37:32.657884 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000088024718', 'path': '/dev/dm-4', 'multipath_id': '33000000088024718'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:37:33.032948 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:33.044993 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-843635983',display_name='tempest-ServerRescueNegativeTestJSON-server-843635983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverrescuenegativetestjson-server-843635983',id=3,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:34:45Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='334b83c8d3714844830f961673658b20',ramdisk_id='',reservation_id='r-gxkwrxjh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1305117099',owner_user_name='tempest-ServerRescueNegativeTestJSON-1305117099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:34:46Z,user_data=None,user_id='7cdf106961084f0e941b5b65911c9b76',uuid=5f3f7abc-978d-4a0e-8ae1-0d813ad77f35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "address": "fa:16:3e:8a:28:ef", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91a50f4f-e3", "ovs_interfaceid": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:37:33.045270 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converting VIF {"id": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "address": "fa:16:3e:8a:28:ef", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91a50f4f-e3", "ovs_interfaceid": "91a50f4f-e3ff-4e6f-80f9-472e706603f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:33.046026 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:28:ef,bridge_name='br-int',has_traffic_filtering=True,id=91a50f4f-e3ff-4e6f-80f9-472e706603f0,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91a50f4f-e3') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:33.046406 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:28:ef,bridge_name='br-int',has_traffic_filtering=True,id=91a50f4f-e3ff-4e6f-80f9-472e706603f0,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91a50f4f-e3') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:37:33.047392 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:33.047573 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91a50f4f-e3, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:33.049889 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:33.049889 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:33.050148 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:33.050637 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:33.050777 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6af4a8e-ca00-4aeb-8583-7d49876d3dd6) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:33.051252 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:33.051681 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:33.052158 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:33.054079 np0000001025 nova-compute[97981]: INFO os_vif [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:28:ef,bridge_name='br-int',has_traffic_filtering=True,id=91a50f4f-e3ff-4e6f-80f9-472e706603f0,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91a50f4f-e3')
May 19 04:37:33.054407 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Deleting instance files /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35_del
May 19 04:37:33.055411 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Deletion of /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35_del complete
May 19 04:37:33.154162 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:33.170470 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:37:33.172047 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b', 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f628dad-4b63-4812-a34d-a3b52215814b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:37:33.172339 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:37:33.173744 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:37:33.173984 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b', 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f628dad-4b63-4812-a34d-a3b52215814b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:37:33.191184 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:37:33.191184 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:37:33.191184 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:37:33.194670 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:37:33.195369 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:37:33.195565 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:37:33.206777 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:37:33.206777 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:33.211570 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:37:33.211570 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:33.218801 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b] added
May 19 04:37:33.218801 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:37:33.218801 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:37:33.218801 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:37:33.218801 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:37:33.218801 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:37:33.218801 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:33.218801 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:37:33.218801 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0276(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:37:33.218801 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:37:33.225043 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b] added
May 19 04:37:33.225043 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:37:33.225043 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:37:33.225043 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:37:33.225043 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:37:33.225043 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:37:33.225043 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:33.225043 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:37:33.225043 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0293(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:37:33.225043 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:37:33.254339 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:37:33.254339 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:33.362083 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:37:33.365412 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:33.455400 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:37:33.458190 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:33.546412 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:37:33.550524 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000003, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.rescue: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/5f3f7abc-978d-4a0e-8ae1-0d813ad77f35/disk.rescue
May 19 04:37:33.552229 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:37:33.553588 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:33.571596 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors.luks [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] opening encrypted volume /dev/dm-0 {{(pid=97981) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 19 04:37:33.573391 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Took 1.39 seconds to destroy the instance on the hypervisor.
May 19 04:37:33.574980 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:37:33.575423 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:37:33.575865 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:37:33.577243 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:33.596776 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:37:33.599599 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=12582MB free_disk=74.58118438720703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:37:33.599760 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:33.601169 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:33.725910 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:34.219366 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:37:34.225452 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:37:34.233815 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:37:34.233815 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:37:34.239159 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:37:34.239159 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:34.246035 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:34.252782 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:34.260828 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:34.260828 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:34.260828 np0000001025 nova-compute[97981]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:34.260828 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:34.260828 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:34.260828 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:34.260828 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:37:34.261138 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:34.261138 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:34.261138 np0000001025 nova-compute[97981]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:34.261138 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:34.261138 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:34.261138 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:34.261138 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:37:34.269570 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:34.269570 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:34.269570 np0000001025 nova-compute[97981]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:34.269570 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:34.269570 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:34.269570 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:34.269570 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:37:34.269875 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:34.269875 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:34.269875 np0000001025 nova-compute[97981]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:34.269875 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:34.269875 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:34.269875 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:34.269875 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:37:34.296578 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b, portal: 192.168.40.100,3260]
May 19 04:37:34.296578 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b, portal: 192.168.40.100,3260] successful.
May 19 04:37:34.296578 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:34.309770 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:34.316505 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b, portal: 192.168.50.100,3260]
May 19 04:37:34.316505 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b, portal: 192.168.50.100,3260] successful.
May 19 04:37:34.316505 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:34.325926 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:34.325926 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:34.325926 np0000001025 nova-compute[97981]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:34.325926 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:34.325926 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:34.325926 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:34.325926 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:37:34.325926 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:37:34.325926 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:37:34.325926 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:34.325926 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:34.325926 np0000001025 nova-compute[97981]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:34.325926 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:34.325926 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:34.325926 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:34.325926 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:37:34.325926 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:37:34.325926 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:37:34.326371 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.136s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:37:34.326487 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:37:34.327292 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:34.327643 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] HCTL ('13', '-', '-', 0) found on session 41 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:37:34.327778 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:37:34.341854 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Searching for a device in session 41 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:37:34.342632 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f628dad-4b63-4812-a34d-a3b52215814b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:37:34.344344 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:34.344344 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:34.344344 np0000001025 nova-compute[97981]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:34.344344 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:34.344344 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:34.344344 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:34.344344 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:37:34.344344 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:37:34.344344 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:37:34.344344 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:34.344344 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:34.344344 np0000001025 nova-compute[97981]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:34.344344 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:34.344344 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:34.344344 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:34.344344 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:37:34.344344 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:37:34.344344 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:37:34.344344 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:37:34.344344 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:37:34.345588 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] HCTL ('14', '-', '-', 0) found on session 42 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:37:34.345795 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:37:34.359788 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Searching for a device in session 42 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:37:34.359788 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2f628dad-4b63-4812-a34d-a3b52215814b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:37:34.468833 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-dd3047ed-7196-48ef-9df2-2a97a413c091 req-e93fac36-40df-4604-acf4-d233dcd6f27e service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received event network-vif-unplugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:34.474010 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-dd3047ed-7196-48ef-9df2-2a97a413c091 req-e93fac36-40df-4604-acf4-d233dcd6f27e service nova] Acquiring lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:34.474010 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-dd3047ed-7196-48ef-9df2-2a97a413c091 req-e93fac36-40df-4604-acf4-d233dcd6f27e service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:34.474010 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-dd3047ed-7196-48ef-9df2-2a97a413c091 req-e93fac36-40df-4604-acf4-d233dcd6f27e service nova] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:34.474010 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-dd3047ed-7196-48ef-9df2-2a97a413c091 req-e93fac36-40df-4604-acf4-d233dcd6f27e service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] No waiting events found dispatching network-vif-unplugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:34.474010 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-dd3047ed-7196-48ef-9df2-2a97a413c091 req-e93fac36-40df-4604-acf4-d233dcd6f27e service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received event network-vif-unplugged-91a50f4f-e3ff-4e6f-80f9-472e706603f0 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:34.474010 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-dd3047ed-7196-48ef-9df2-2a97a413c091 req-e93fac36-40df-4604-acf4-d233dcd6f27e service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Received event network-vif-deleted-91a50f4f-e3ff-4e6f-80f9-472e706603f0 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:34.474010 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-dd3047ed-7196-48ef-9df2-2a97a413c091 req-e93fac36-40df-4604-acf4-d233dcd6f27e service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Neutron deleted interface 91a50f4f-e3ff-4e6f-80f9-472e706603f0; detaching it from the instance and deleting it from the info cache
May 19 04:37:34.474010 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-dd3047ed-7196-48ef-9df2-2a97a413c091 req-e93fac36-40df-4604-acf4-d233dcd6f27e service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:34.524519 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:34.591408 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Acquiring lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:34.592022 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:34.666318 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:37:34.666465 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:37:34.666610 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 5951341b-0ad5-4fb0-82ad-b464c081f37f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:37:34.666751 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 7859dfab-f702-4d0b-a9e9-bb856c5004e6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:37:34.666864 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:37:34.981237 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-dd3047ed-7196-48ef-9df2-2a97a413c091 req-e93fac36-40df-4604-acf4-d233dcd6f27e service nova] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Detach interface failed, port_id=91a50f4f-e3ff-4e6f-80f9-472e706603f0, reason: Instance 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:37:35.027177 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Took 1.45 seconds to deallocate network for instance.
May 19 04:37:35.094029 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:37:35.169594 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance f1a3ef6c-55da-4f79-8b87-720f44891fa4 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 19 04:37:35.169969 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:37:35.170187 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:37:33 up 28 min,  2 users,  load average: 8.69, 5.41, 2.59\n', 'num_instances': '5', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '5', 'num_proj_334b83c8d3714844830f961673658b20': '2', 'io_workload': '2', 'num_vm_rescued': '1', 'num_task_deleting': '1', 'num_proj_336d55ae51114828ba5ad8c0ac87ca9b': '1', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_bc136a1f1fe94373a04ae534d82f8673': '1', 'num_proj_28b3c0fa8f894ed2a7c3bcfac99ce74c': '1'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:37:35.196070 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:37:35.463944 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:37:35.464239 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:37:35.532593 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:35.640860 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:35.890845 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0004340010000305483 future=<Future at 0x721850710b30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:35.891318 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Emitting event <LifecycleEvent: 1779165440.8902988, f66a2b29-93d1-468a-94fc-77679fce8d64 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:35.891449 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] VM Stopped (Lifecycle Event)
May 19 04:37:35.892353 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:35.892449 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=0.9069914359999984 future=<Future at 0x721834470500 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:35.892584 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=0.9068751569998312 future=<Future at 0x721834470500 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:35.966583 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:37:35.983964 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-720936815',display_name='tempest-TestVolumeBootPattern-server-720936815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-720936815',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-4ki1er0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:37:20Z,user_data=None,user_id='5c46088fb3e74b819bb456461716a801',uuid=0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "205c6b38-e8f4-4a6a-8de5-5fc6546c8821", "address": "fa:16:3e:2f:e4:f9", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap205c6b38-e8", "ovs_interfaceid": "205c6b38-e8f4-4a6a-8de5-5fc6546c8821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:37:35.984426 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "205c6b38-e8f4-4a6a-8de5-5fc6546c8821", "address": "fa:16:3e:2f:e4:f9", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap205c6b38-e8", "ovs_interfaceid": "205c6b38-e8f4-4a6a-8de5-5fc6546c8821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:35.984741 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e4:f9,bridge_name='br-int',has_traffic_filtering=True,id=205c6b38-e8f4-4a6a-8de5-5fc6546c8821,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap205c6b38-e8') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:35.985689 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'pci_devices' on Instance uuid 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:37:36.212947 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Found WWN 33000000090b6d19c for multipath device dm-5 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:37:36.213269 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:37:36.213434 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '33000000090b6d19c', 'path': '/dev/dm-5', 'multipath_id': '33000000090b6d19c'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:37:36.213563 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000090b6d19c', 'path': '/dev/dm-5', 'multipath_id': '33000000090b6d19c'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:37:36.393745 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: f66a2b29-93d1-468a-94fc-77679fce8d64] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:36.473733 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:37:36.473921 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.874s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:36.474372 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.942s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:36.475904 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:37:36.489026 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] End _get_guest_xml xml=<domain type="qemu">
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:   <uuid>0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c</uuid>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:   <name>instance-00000014</name>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestVolumeBootPattern-server-720936815</nova:name>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:37:23</nova:creationTime>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:         <nova:properties/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:         <nova:user uuid="5c46088fb3e74b819bb456461716a801">tempest-TestVolumeBootPattern-1071176852-project-member</nova:user>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:         <nova:project uuid="28b3c0fa8f894ed2a7c3bcfac99ce74c">tempest-TestVolumeBootPattern-1071176852</nova:project>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:         <nova:port uuid="205c6b38-e8f4-4a6a-8de5-5fc6546c8821">
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     <system>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <entry name="serial">0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c</entry>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <entry name="uuid">0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c</entry>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     </system>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:   <os>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:   </os>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:   <features>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:   </features>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:   <devices>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c/disk.config"/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     </disk>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <alias name="ua-652c0598-ca18-49bf-ab6d-a836f9af9eb3"/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <serial>652c0598-ca18-49bf-ab6d-a836f9af9eb3</serial>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     </disk>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:2f:e4:f9"/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <target dev="tap205c6b38-e8"/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     </interface>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c/console.log" append="off"/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     </serial>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     <video>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     </video>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     </rng>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:   </devices>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]: </domain>
May 19 04:37:36.489026 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:37:36.490981 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Preparing to wait for external event network-vif-plugged-205c6b38-e8f4-4a6a-8de5-5fc6546c8821 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:37:36.490981 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:36.490981 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:36.490981 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:36.490981 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-720936815',display_name='tempest-TestVolumeBootPattern-server-720936815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-720936815',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-4ki1er0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:37:20Z,user_data=None,user_id='5c46088fb3e74b819bb456461716a801',uuid=0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "205c6b38-e8f4-4a6a-8de5-5fc6546c8821", "address": "fa:16:3e:2f:e4:f9", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap205c6b38-e8", "ovs_interfaceid": "205c6b38-e8f4-4a6a-8de5-5fc6546c8821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:37:36.490981 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "205c6b38-e8f4-4a6a-8de5-5fc6546c8821", "address": "fa:16:3e:2f:e4:f9", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap205c6b38-e8", "ovs_interfaceid": "205c6b38-e8f4-4a6a-8de5-5fc6546c8821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:36.490981 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e4:f9,bridge_name='br-int',has_traffic_filtering=True,id=205c6b38-e8f4-4a6a-8de5-5fc6546c8821,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap205c6b38-e8') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:36.490981 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e4:f9,bridge_name='br-int',has_traffic_filtering=True,id=205c6b38-e8f4-4a6a-8de5-5fc6546c8821,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap205c6b38-e8') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:37:36.491517 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:36.491937 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:36.492343 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:37:36.493124 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:36.493450 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98ef57bb-ce24-5b18-a375-ea66c2fb39fe', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:36.501043 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:36.501159 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:36.501416 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:36.503277 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:36.503404 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap205c6b38-e8, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:36.503700 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap205c6b38-e8, col_values=(('qos', UUID('03b00c89-8435-4dcf-bee1-c6f058154dbc')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:36.504550 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap205c6b38-e8, col_values=(('external_ids', {'iface-id': '205c6b38-e8f4-4a6a-8de5-5fc6546c8821', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:e4:f9', 'vm-uuid': '0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:36.504550 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:36.505973 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:36.510780 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:36.511389 np0000001025 nova-compute[97981]: INFO os_vif [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e4:f9,bridge_name='br-int',has_traffic_filtering=True,id=205c6b38-e8f4-4a6a-8de5-5fc6546c8821,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap205c6b38-e8')
May 19 04:37:36.719198 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508815012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1508815012',id=19,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBocQCc15NItD68QZzkvBuEd0COiZni8hxYbKGZdsTrtlGYMwPFDUxMvKX70mv6NxQ/9uLjET9uEK8V+zM3LQnd+qnoNoRs94oRrVe5QZWgNQNR0jX7RjQBec1JJdtX8Hg==',key_name='tempest-keypair-2133430261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc136a1f1fe94373a04ae534d82f8673',ramdisk_id='',reservation_id='r-iufog8sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-171323133',owner_user_name='tempest-TaggedBootDevicesTest-171323133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dad74db8b9240b1a3e3e145265f8b99',uuid=7859dfab-f702-4d0b-a9e9-bb856c5004e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "address": "fa:16:3e:74:c7:cf", "network": {"id": "274fbf5f-057a-48b4-8049-70f366638ce8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1968961134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d50a64-6a", "ovs_interfaceid": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:37:36.719408 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converting VIF {"id": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "address": "fa:16:3e:74:c7:cf", "network": {"id": "274fbf5f-057a-48b4-8049-70f366638ce8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1968961134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d50a64-6a", "ovs_interfaceid": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:36.719802 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:c7:cf,bridge_name='br-int',has_traffic_filtering=True,id=34d50a64-6aed-47ee-ae9c-851a9fe0161b,network=Network(274fbf5f-057a-48b4-8049-70f366638ce8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d50a64-6a') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:36.720567 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508815012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1508815012',id=19,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBocQCc15NItD68QZzkvBuEd0COiZni8hxYbKGZdsTrtlGYMwPFDUxMvKX70mv6NxQ/9uLjET9uEK8V+zM3LQnd+qnoNoRs94oRrVe5QZWgNQNR0jX7RjQBec1JJdtX8Hg==',key_name='tempest-keypair-2133430261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc136a1f1fe94373a04ae534d82f8673',ramdisk_id='',reservation_id='r-iufog8sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-171323133',owner_user_name='tempest-TaggedBootDevicesTest-171323133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dad74db8b9240b1a3e3e145265f8b99',uuid=7859dfab-f702-4d0b-a9e9-bb856c5004e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "address": "fa:16:3e:ce:a6:b1", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5add6c4e-98", "ovs_interfaceid": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:37:36.720567 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converting VIF {"id": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "address": "fa:16:3e:ce:a6:b1", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5add6c4e-98", "ovs_interfaceid": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:36.720823 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:a6:b1,bridge_name='br-int',has_traffic_filtering=True,id=5add6c4e-9889-49d8-9fa6-2db045c6b4ae,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5add6c4e-98') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:36.722615 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508815012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1508815012',id=19,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBocQCc15NItD68QZzkvBuEd0COiZni8hxYbKGZdsTrtlGYMwPFDUxMvKX70mv6NxQ/9uLjET9uEK8V+zM3LQnd+qnoNoRs94oRrVe5QZWgNQNR0jX7RjQBec1JJdtX8Hg==',key_name='tempest-keypair-2133430261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc136a1f1fe94373a04ae534d82f8673',ramdisk_id='',reservation_id='r-iufog8sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-171323133',owner_user_name='tempest-TaggedBootDevicesTest-171323133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dad74db8b9240b1a3e3e145265f8b99',uuid=7859dfab-f702-4d0b-a9e9-bb856c5004e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "address": "fa:16:3e:9b:1a:bc", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap856804f2-64", "ovs_interfaceid": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:37:36.722615 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converting VIF {"id": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "address": "fa:16:3e:9b:1a:bc", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap856804f2-64", "ovs_interfaceid": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:36.722615 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:1a:bc,bridge_name='br-int',has_traffic_filtering=True,id=856804f2-648b-4cf3-a2d8-a2d4cf97e84f,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap856804f2-64') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:36.722615 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508815012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1508815012',id=19,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBocQCc15NItD68QZzkvBuEd0COiZni8hxYbKGZdsTrtlGYMwPFDUxMvKX70mv6NxQ/9uLjET9uEK8V+zM3LQnd+qnoNoRs94oRrVe5QZWgNQNR0jX7RjQBec1JJdtX8Hg==',key_name='tempest-keypair-2133430261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc136a1f1fe94373a04ae534d82f8673',ramdisk_id='',reservation_id='r-iufog8sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-171323133',owner_user_name='tempest-TaggedBootDevicesTest-171323133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dad74db8b9240b1a3e3e145265f8b99',uuid=7859dfab-f702-4d0b-a9e9-bb856c5004e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "address": "fa:16:3e:12:e9:10", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371fc2a1-78", "ovs_interfaceid": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:37:36.722615 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converting VIF {"id": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "address": "fa:16:3e:12:e9:10", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371fc2a1-78", "ovs_interfaceid": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:36.723003 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:e9:10,bridge_name='br-int',has_traffic_filtering=True,id=371fc2a1-7883-4eef-a3cc-0085db83dfc7,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371fc2a1-78') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:36.723574 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508815012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1508815012',id=19,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBocQCc15NItD68QZzkvBuEd0COiZni8hxYbKGZdsTrtlGYMwPFDUxMvKX70mv6NxQ/9uLjET9uEK8V+zM3LQnd+qnoNoRs94oRrVe5QZWgNQNR0jX7RjQBec1JJdtX8Hg==',key_name='tempest-keypair-2133430261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc136a1f1fe94373a04ae534d82f8673',ramdisk_id='',reservation_id='r-iufog8sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-171323133',owner_user_name='tempest-TaggedBootDevicesTest-171323133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dad74db8b9240b1a3e3e145265f8b99',uuid=7859dfab-f702-4d0b-a9e9-bb856c5004e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "address": "fa:16:3e:97:55:fe", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e688b23-68", "ovs_interfaceid": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:37:36.723574 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converting VIF {"id": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "address": "fa:16:3e:97:55:fe", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e688b23-68", "ovs_interfaceid": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:36.723574 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:55:fe,bridge_name='br-int',has_traffic_filtering=True,id=3e688b23-684d-4dcf-95a1-2f44d8ea1649,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e688b23-68') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:36.724066 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508815012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1508815012',id=19,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBocQCc15NItD68QZzkvBuEd0COiZni8hxYbKGZdsTrtlGYMwPFDUxMvKX70mv6NxQ/9uLjET9uEK8V+zM3LQnd+qnoNoRs94oRrVe5QZWgNQNR0jX7RjQBec1JJdtX8Hg==',key_name='tempest-keypair-2133430261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc136a1f1fe94373a04ae534d82f8673',ramdisk_id='',reservation_id='r-iufog8sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-171323133',owner_user_name='tempest-TaggedBootDevicesTest-171323133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dad74db8b9240b1a3e3e145265f8b99',uuid=7859dfab-f702-4d0b-a9e9-bb856c5004e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea620a14-2efe-4797-9ee1-c004ba488769", "address": "fa:16:3e:2d:30:c5", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea620a14-2e", "ovs_interfaceid": "ea620a14-2efe-4797-9ee1-c004ba488769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:37:36.724258 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converting VIF {"id": "ea620a14-2efe-4797-9ee1-c004ba488769", "address": "fa:16:3e:2d:30:c5", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea620a14-2e", "ovs_interfaceid": "ea620a14-2efe-4797-9ee1-c004ba488769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:36.724563 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:30:c5,bridge_name='br-int',has_traffic_filtering=True,id=ea620a14-2efe-4797-9ee1-c004ba488769,network=Network(eb61abe7-a444-4002-bec1-68ef7e4f36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea620a14-2e') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:36.725064 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508815012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1508815012',id=19,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBocQCc15NItD68QZzkvBuEd0COiZni8hxYbKGZdsTrtlGYMwPFDUxMvKX70mv6NxQ/9uLjET9uEK8V+zM3LQnd+qnoNoRs94oRrVe5QZWgNQNR0jX7RjQBec1JJdtX8Hg==',key_name='tempest-keypair-2133430261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc136a1f1fe94373a04ae534d82f8673',ramdisk_id='',reservation_id='r-iufog8sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-171323133',owner_user_name='tempest-TaggedBootDevicesTest-171323133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dad74db8b9240b1a3e3e145265f8b99',uuid=7859dfab-f702-4d0b-a9e9-bb856c5004e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "address": "fa:16:3e:92:1a:3d", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fdb83aa-cd", "ovs_interfaceid": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:37:36.725185 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converting VIF {"id": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "address": "fa:16:3e:92:1a:3d", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fdb83aa-cd", "ovs_interfaceid": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:36.725483 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:1a:3d,bridge_name='br-int',has_traffic_filtering=True,id=0fdb83aa-cd21-410a-8823-a52276cc6fb1,network=Network(eb61abe7-a444-4002-bec1-68ef7e4f36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fdb83aa-cd') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:36.726032 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lazy-loading 'pci_devices' on Instance uuid 7859dfab-f702-4d0b-a9e9-bb856c5004e6 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:37:36.793123 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:37:36.793322 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:37:36.799867 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.000310178000063388 future=<Future at 0x721834470500 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:36.799867 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:36.800161 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=10.73941190000005 future=<Future at 0x7218344018e0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:36.800841 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Emitting event <LifecycleEvent: 1779165441.7993767, b5f34a29-15f7-4f5e-a8bf-574abebd5c84 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:36.800841 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=10.738764785000058 future=<Future at 0x7218344018e0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:36.800841 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] VM Stopped (Lifecycle Event)
May 19 04:37:37.229519 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] End _get_guest_xml xml=<domain type="qemu">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:   <uuid>7859dfab-f702-4d0b-a9e9-bb856c5004e6</uuid>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:   <name>instance-00000013</name>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <nova:name>tempest-device-tagging-server-1508815012</nova:name>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:37:23</nova:creationTime>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         <nova:user uuid="2dad74db8b9240b1a3e3e145265f8b99">tempest-TaggedBootDevicesTest-171323133-project-member</nova:user>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         <nova:project uuid="bc136a1f1fe94373a04ae534d82f8673">tempest-TaggedBootDevicesTest-171323133</nova:project>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         <nova:port uuid="34d50a64-6aed-47ee-ae9c-851a9fe0161b">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         <nova:port uuid="5add6c4e-9889-49d8-9fa6-2db045c6b4ae">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.1.251" ipVersion="4"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         <nova:port uuid="856804f2-648b-4cf3-a2d8-a2d4cf97e84f">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.1.110" ipVersion="4"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         <nova:port uuid="371fc2a1-7883-4eef-a3cc-0085db83dfc7">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.1.230" ipVersion="4"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         <nova:port uuid="3e688b23-684d-4dcf-95a1-2f44d8ea1649">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.1.84" ipVersion="4"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         <nova:port uuid="ea620a14-2efe-4797-9ee1-c004ba488769">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         <nova:port uuid="0fdb83aa-cd21-410a-8823-a52276cc6fb1">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <system>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <entry name="serial">7859dfab-f702-4d0b-a9e9-bb856c5004e6</entry>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <entry name="uuid">7859dfab-f702-4d0b-a9e9-bb856c5004e6</entry>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     </system>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:   <os>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:   </os>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:   <features>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:   </features>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:   <devices>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/7859dfab-f702-4d0b-a9e9-bb856c5004e6/disk.config"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     </disk>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <alias name="ua-826a781c-5976-4c74-8ca4-447a075fb902"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-1"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <serial>826a781c-5976-4c74-8ca4-447a075fb902</serial>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     </disk>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <alias name="ua-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-4"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <target dev="vdb" bus="virtio"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <serial>5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844</serial>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     </disk>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <alias name="ua-2f628dad-4b63-4812-a34d-a3b52215814b"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-5"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <target dev="vdc" bus="virtio"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <serial>2f628dad-4b63-4812-a34d-a3b52215814b</serial>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     </disk>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:74:c7:cf"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <target dev="tap34d50a64-6a"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     </interface>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:ce:a6:b1"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <target dev="tap5add6c4e-98"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     </interface>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:9b:1a:bc"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <target dev="tap856804f2-64"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     </interface>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:12:e9:10"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <target dev="tap371fc2a1-78"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     </interface>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:97:55:fe"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <target dev="tap3e688b23-68"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     </interface>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:2d:30:c5"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <target dev="tapea620a14-2e"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     </interface>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:92:1a:3d"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <target dev="tap0fdb83aa-cd"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     </interface>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/7859dfab-f702-4d0b-a9e9-bb856c5004e6/console.log" append="off"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     </serial>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <video>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     </video>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     </rng>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:   </devices>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]: </domain>
May 19 04:37:37.229519 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Preparing to wait for external event network-vif-plugged-34d50a64-6aed-47ee-ae9c-851a9fe0161b {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Preparing to wait for external event network-vif-plugged-5add6c4e-9889-49d8-9fa6-2db045c6b4ae {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Preparing to wait for external event network-vif-plugged-856804f2-648b-4cf3-a2d8-a2d4cf97e84f {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Preparing to wait for external event network-vif-plugged-371fc2a1-7883-4eef-a3cc-0085db83dfc7 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Preparing to wait for external event network-vif-plugged-3e688b23-684d-4dcf-95a1-2f44d8ea1649 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Preparing to wait for external event network-vif-plugged-ea620a14-2efe-4797-9ee1-c004ba488769 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Preparing to wait for external event network-vif-plugged-0fdb83aa-cd21-410a-8823-a52276cc6fb1 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:37.235304 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:37.236908 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508815012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1508815012',id=19,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBocQCc15NItD68QZzkvBuEd0COiZni8hxYbKGZdsTrtlGYMwPFDUxMvKX70mv6NxQ/9uLjET9uEK8V+zM3LQnd+qnoNoRs94oRrVe5QZWgNQNR0jX7RjQBec1JJdtX8Hg==',key_name='tempest-keypair-2133430261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc136a1f1fe94373a04ae534d82f8673',ramdisk_id='',reservation_id='r-iufog8sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-171323133',owner_user_name='tempest-TaggedBootDevicesTest-171323133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dad74db8b9240b1a3e3e145265f8b99',uuid=7859dfab-f702-4d0b-a9e9-bb856c5004e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "address": "fa:16:3e:74:c7:cf", "network": {"id": "274fbf5f-057a-48b4-8049-70f366638ce8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1968961134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d50a64-6a", "ovs_interfaceid": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:37:37.236908 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converting VIF {"id": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "address": "fa:16:3e:74:c7:cf", "network": {"id": "274fbf5f-057a-48b4-8049-70f366638ce8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1968961134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d50a64-6a", "ovs_interfaceid": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:37.236908 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:c7:cf,bridge_name='br-int',has_traffic_filtering=True,id=34d50a64-6aed-47ee-ae9c-851a9fe0161b,network=Network(274fbf5f-057a-48b4-8049-70f366638ce8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d50a64-6a') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:37.236908 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c7:cf,bridge_name='br-int',has_traffic_filtering=True,id=34d50a64-6aed-47ee-ae9c-851a9fe0161b,network=Network(274fbf5f-057a-48b4-8049-70f366638ce8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d50a64-6a') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:37:37.236908 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.236908 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.236908 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:37:37.238183 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.238183 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da8c33ca-63d4-58f8-88db-370fc03b6e65', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.238867 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.239686 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:37.295707 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:37:37.303226 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: b5f34a29-15f7-4f5e-a8bf-574abebd5c84] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:37.321095 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.325146 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.327035 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.327035 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34d50a64-6a, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.327035 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap34d50a64-6a, col_values=(('qos', UUID('26a0f6cd-4b3a-4853-8ff7-752b201715be')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.327035 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap34d50a64-6a, col_values=(('external_ids', {'iface-id': '34d50a64-6aed-47ee-ae9c-851a9fe0161b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:c7:cf', 'vm-uuid': '7859dfab-f702-4d0b-a9e9-bb856c5004e6'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.327608 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.328867 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:37.339078 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.339968 np0000001025 nova-compute[97981]: INFO os_vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c7:cf,bridge_name='br-int',has_traffic_filtering=True,id=34d50a64-6aed-47ee-ae9c-851a9fe0161b,network=Network(274fbf5f-057a-48b4-8049-70f366638ce8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d50a64-6a')
May 19 04:37:37.341942 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508815012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1508815012',id=19,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBocQCc15NItD68QZzkvBuEd0COiZni8hxYbKGZdsTrtlGYMwPFDUxMvKX70mv6NxQ/9uLjET9uEK8V+zM3LQnd+qnoNoRs94oRrVe5QZWgNQNR0jX7RjQBec1JJdtX8Hg==',key_name='tempest-keypair-2133430261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc136a1f1fe94373a04ae534d82f8673',ramdisk_id='',reservation_id='r-iufog8sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-171323133',owner_user_name='tempest-TaggedBootDevicesTest-171323133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dad74db8b9240b1a3e3e145265f8b99',uuid=7859dfab-f702-4d0b-a9e9-bb856c5004e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "address": "fa:16:3e:ce:a6:b1", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5add6c4e-98", "ovs_interfaceid": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:37:37.342197 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converting VIF {"id": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "address": "fa:16:3e:ce:a6:b1", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5add6c4e-98", "ovs_interfaceid": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:37.342624 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:a6:b1,bridge_name='br-int',has_traffic_filtering=True,id=5add6c4e-9889-49d8-9fa6-2db045c6b4ae,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5add6c4e-98') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:37.344233 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:a6:b1,bridge_name='br-int',has_traffic_filtering=True,id=5add6c4e-9889-49d8-9fa6-2db045c6b4ae,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5add6c4e-98') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:37:37.344892 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.344892 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.344892 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:37:37.347815 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.347815 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92f42b44-4898-5b3d-9a92-2193d67a6dea', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.349011 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.349011 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:37.358784 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.364673 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.364673 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5add6c4e-98, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.364673 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5add6c4e-98, col_values=(('qos', UUID('492a3b5f-97b2-4f04-9e5e-1efa471142d7')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.364673 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5add6c4e-98, col_values=(('external_ids', {'iface-id': '5add6c4e-9889-49d8-9fa6-2db045c6b4ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:a6:b1', 'vm-uuid': '7859dfab-f702-4d0b-a9e9-bb856c5004e6'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.365094 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.366885 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:37.385293 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.385716 np0000001025 nova-compute[97981]: INFO os_vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:a6:b1,bridge_name='br-int',has_traffic_filtering=True,id=5add6c4e-9889-49d8-9fa6-2db045c6b4ae,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5add6c4e-98')
May 19 04:37:37.386372 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508815012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1508815012',id=19,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBocQCc15NItD68QZzkvBuEd0COiZni8hxYbKGZdsTrtlGYMwPFDUxMvKX70mv6NxQ/9uLjET9uEK8V+zM3LQnd+qnoNoRs94oRrVe5QZWgNQNR0jX7RjQBec1JJdtX8Hg==',key_name='tempest-keypair-2133430261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc136a1f1fe94373a04ae534d82f8673',ramdisk_id='',reservation_id='r-iufog8sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-171323133',owner_user_name='tempest-TaggedBootDevicesTest-171323133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dad74db8b9240b1a3e3e145265f8b99',uuid=7859dfab-f702-4d0b-a9e9-bb856c5004e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "address": "fa:16:3e:9b:1a:bc", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap856804f2-64", "ovs_interfaceid": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:37:37.386518 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converting VIF {"id": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "address": "fa:16:3e:9b:1a:bc", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap856804f2-64", "ovs_interfaceid": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:37.387472 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:1a:bc,bridge_name='br-int',has_traffic_filtering=True,id=856804f2-648b-4cf3-a2d8-a2d4cf97e84f,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap856804f2-64') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:37.387733 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:1a:bc,bridge_name='br-int',has_traffic_filtering=True,id=856804f2-648b-4cf3-a2d8-a2d4cf97e84f,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap856804f2-64') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:37:37.388019 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.388743 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.388743 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:37:37.389705 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.390403 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '474b7629-f372-5d59-ae84-40d8a14db4a1', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.391448 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.391448 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:37.406695 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.409164 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.409164 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap856804f2-64, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.409164 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap856804f2-64, col_values=(('qos', UUID('46bda69c-626f-4539-b75a-be287699a7d7')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.409164 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap856804f2-64, col_values=(('external_ids', {'iface-id': '856804f2-648b-4cf3-a2d8-a2d4cf97e84f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:1a:bc', 'vm-uuid': '7859dfab-f702-4d0b-a9e9-bb856c5004e6'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.410928 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.411139 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:37.429646 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.431901 np0000001025 nova-compute[97981]: INFO os_vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:1a:bc,bridge_name='br-int',has_traffic_filtering=True,id=856804f2-648b-4cf3-a2d8-a2d4cf97e84f,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap856804f2-64')
May 19 04:37:37.434543 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508815012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1508815012',id=19,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBocQCc15NItD68QZzkvBuEd0COiZni8hxYbKGZdsTrtlGYMwPFDUxMvKX70mv6NxQ/9uLjET9uEK8V+zM3LQnd+qnoNoRs94oRrVe5QZWgNQNR0jX7RjQBec1JJdtX8Hg==',key_name='tempest-keypair-2133430261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc136a1f1fe94373a04ae534d82f8673',ramdisk_id='',reservation_id='r-iufog8sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-171323133',owner_user_name='tempest-TaggedBootDevicesTest-171323133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dad74db8b9240b1a3e3e145265f8b99',uuid=7859dfab-f702-4d0b-a9e9-bb856c5004e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "address": "fa:16:3e:12:e9:10", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371fc2a1-78", "ovs_interfaceid": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:37:37.434543 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converting VIF {"id": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "address": "fa:16:3e:12:e9:10", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371fc2a1-78", "ovs_interfaceid": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:37.434543 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:e9:10,bridge_name='br-int',has_traffic_filtering=True,id=371fc2a1-7883-4eef-a3cc-0085db83dfc7,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371fc2a1-78') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:37.434543 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:e9:10,bridge_name='br-int',has_traffic_filtering=True,id=371fc2a1-7883-4eef-a3cc-0085db83dfc7,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371fc2a1-78') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:37:37.435292 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.435292 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.435292 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:37:37.436325 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.436629 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fec0ab33-3689-5597-ba43-5f56953ad58e', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.438920 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.440039 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:37.458816 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.461413 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.461734 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap371fc2a1-78, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.462047 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap371fc2a1-78, col_values=(('qos', UUID('8a9d954c-b932-4660-9487-aa78d597d093')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.462321 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap371fc2a1-78, col_values=(('external_ids', {'iface-id': '371fc2a1-7883-4eef-a3cc-0085db83dfc7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:e9:10', 'vm-uuid': '7859dfab-f702-4d0b-a9e9-bb856c5004e6'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.463176 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.464595 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:37.476072 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:37:37.476072 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:37:37.476529 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.13 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:37:37.491427 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.492678 np0000001025 nova-compute[97981]: INFO os_vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:e9:10,bridge_name='br-int',has_traffic_filtering=True,id=371fc2a1-7883-4eef-a3cc-0085db83dfc7,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371fc2a1-78')
May 19 04:37:37.494444 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508815012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1508815012',id=19,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBocQCc15NItD68QZzkvBuEd0COiZni8hxYbKGZdsTrtlGYMwPFDUxMvKX70mv6NxQ/9uLjET9uEK8V+zM3LQnd+qnoNoRs94oRrVe5QZWgNQNR0jX7RjQBec1JJdtX8Hg==',key_name='tempest-keypair-2133430261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc136a1f1fe94373a04ae534d82f8673',ramdisk_id='',reservation_id='r-iufog8sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-171323133',owner_user_name='tempest-TaggedBootDevicesTest-171323133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dad74db8b9240b1a3e3e145265f8b99',uuid=7859dfab-f702-4d0b-a9e9-bb856c5004e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "address": "fa:16:3e:97:55:fe", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e688b23-68", "ovs_interfaceid": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:37:37.494444 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converting VIF {"id": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "address": "fa:16:3e:97:55:fe", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e688b23-68", "ovs_interfaceid": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:37.494444 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:55:fe,bridge_name='br-int',has_traffic_filtering=True,id=3e688b23-684d-4dcf-95a1-2f44d8ea1649,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e688b23-68') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:37.494444 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:55:fe,bridge_name='br-int',has_traffic_filtering=True,id=3e688b23-684d-4dcf-95a1-2f44d8ea1649,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e688b23-68') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:37:37.496260 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.496260 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.496260 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:37:37.497690 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.497923 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4a218c8-4a13-52ea-9173-14a6808b5dd9', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.498655 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.499576 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:37.539331 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.542954 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.543219 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e688b23-68, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.543597 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e688b23-68, col_values=(('qos', UUID('b5bc7ac8-97b6-43eb-8598-61e11c9979e2')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.544193 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e688b23-68, col_values=(('external_ids', {'iface-id': '3e688b23-684d-4dcf-95a1-2f44d8ea1649', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:55:fe', 'vm-uuid': '7859dfab-f702-4d0b-a9e9-bb856c5004e6'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.544943 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.546460 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:37.574650 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.575860 np0000001025 nova-compute[97981]: INFO os_vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:55:fe,bridge_name='br-int',has_traffic_filtering=True,id=3e688b23-684d-4dcf-95a1-2f44d8ea1649,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e688b23-68')
May 19 04:37:37.577309 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508815012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1508815012',id=19,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBocQCc15NItD68QZzkvBuEd0COiZni8hxYbKGZdsTrtlGYMwPFDUxMvKX70mv6NxQ/9uLjET9uEK8V+zM3LQnd+qnoNoRs94oRrVe5QZWgNQNR0jX7RjQBec1JJdtX8Hg==',key_name='tempest-keypair-2133430261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc136a1f1fe94373a04ae534d82f8673',ramdisk_id='',reservation_id='r-iufog8sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-171323133',owner_user_name='tempest-TaggedBootDevicesTest-171323133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dad74db8b9240b1a3e3e145265f8b99',uuid=7859dfab-f702-4d0b-a9e9-bb856c5004e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea620a14-2efe-4797-9ee1-c004ba488769", "address": "fa:16:3e:2d:30:c5", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea620a14-2e", "ovs_interfaceid": "ea620a14-2efe-4797-9ee1-c004ba488769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:37:37.577309 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converting VIF {"id": "ea620a14-2efe-4797-9ee1-c004ba488769", "address": "fa:16:3e:2d:30:c5", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea620a14-2e", "ovs_interfaceid": "ea620a14-2efe-4797-9ee1-c004ba488769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:37.577309 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:30:c5,bridge_name='br-int',has_traffic_filtering=True,id=ea620a14-2efe-4797-9ee1-c004ba488769,network=Network(eb61abe7-a444-4002-bec1-68ef7e4f36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea620a14-2e') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:37.577309 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:30:c5,bridge_name='br-int',has_traffic_filtering=True,id=ea620a14-2efe-4797-9ee1-c004ba488769,network=Network(eb61abe7-a444-4002-bec1-68ef7e4f36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea620a14-2e') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:37:37.577732 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.577776 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.578207 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:37:37.578652 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.578801 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e79dfa7d-100c-5662-9ffe-8dba37818cab', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.579421 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.579922 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:37.609596 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.612056 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.612298 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea620a14-2e, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.612652 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea620a14-2e, col_values=(('qos', UUID('b7dc82a4-b586-4218-beb3-a0a36eb0ec0b')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.612796 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea620a14-2e, col_values=(('external_ids', {'iface-id': 'ea620a14-2efe-4797-9ee1-c004ba488769', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:30:c5', 'vm-uuid': '7859dfab-f702-4d0b-a9e9-bb856c5004e6'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.613596 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.614769 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:37.653054 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.654077 np0000001025 nova-compute[97981]: INFO os_vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:30:c5,bridge_name='br-int',has_traffic_filtering=True,id=ea620a14-2efe-4797-9ee1-c004ba488769,network=Network(eb61abe7-a444-4002-bec1-68ef7e4f36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea620a14-2e')
May 19 04:37:37.655325 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508815012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1508815012',id=19,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBocQCc15NItD68QZzkvBuEd0COiZni8hxYbKGZdsTrtlGYMwPFDUxMvKX70mv6NxQ/9uLjET9uEK8V+zM3LQnd+qnoNoRs94oRrVe5QZWgNQNR0jX7RjQBec1JJdtX8Hg==',key_name='tempest-keypair-2133430261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc136a1f1fe94373a04ae534d82f8673',ramdisk_id='',reservation_id='r-iufog8sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-171323133',owner_user_name='tempest-TaggedBootDevicesTest-171323133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dad74db8b9240b1a3e3e145265f8b99',uuid=7859dfab-f702-4d0b-a9e9-bb856c5004e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "address": "fa:16:3e:92:1a:3d", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fdb83aa-cd", "ovs_interfaceid": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:37:37.655990 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converting VIF {"id": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "address": "fa:16:3e:92:1a:3d", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fdb83aa-cd", "ovs_interfaceid": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:37.656531 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:1a:3d,bridge_name='br-int',has_traffic_filtering=True,id=0fdb83aa-cd21-410a-8823-a52276cc6fb1,network=Network(eb61abe7-a444-4002-bec1-68ef7e4f36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fdb83aa-cd') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:37.656821 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:1a:3d,bridge_name='br-int',has_traffic_filtering=True,id=0fdb83aa-cd21-410a-8823-a52276cc6fb1,network=Network(eb61abe7-a444-4002-bec1-68ef7e4f36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fdb83aa-cd') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:37:37.658279 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.658608 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.658927 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:37:37.660163 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.660466 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9950335a-5497-569e-bc26-3cef06f565a1', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.661256 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.661960 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:37.692313 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.695443 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.695751 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fdb83aa-cd, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.696239 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0fdb83aa-cd, col_values=(('qos', UUID('f9c98d8d-e750-431f-93e5-e4ff41d01347')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.696440 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0fdb83aa-cd, col_values=(('external_ids', {'iface-id': '0fdb83aa-cd21-410a-8823-a52276cc6fb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:1a:3d', 'vm-uuid': '7859dfab-f702-4d0b-a9e9-bb856c5004e6'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:37.698054 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.703629 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:37.733750 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:37.736264 np0000001025 nova-compute[97981]: INFO os_vif [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:1a:3d,bridge_name='br-int',has_traffic_filtering=True,id=0fdb83aa-cd21-410a-8823-a52276cc6fb1,network=Network(eb61abe7-a444-4002-bec1-68ef7e4f36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fdb83aa-cd')
May 19 04:37:37.801973 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.328s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:37.803757 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.163s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:37.810136 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:37:37.810136 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Claim successful on node np0000001025
May 19 04:37:37.864530 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Deleted allocations for instance 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35
May 19 04:37:38.034835 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:38.037393 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:37:38.037620 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:37:38.037772 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No VIF found with MAC fa:16:3e:2f:e4:f9, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:37:38.038399 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Using config drive
May 19 04:37:38.544094 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:38.728560 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Creating config drive at /opt/stack/data/nova/instances/0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c/disk.config
May 19 04:37:38.733179 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsauo1upt {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:38.777296 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsauo1upt" returned: 0 in 0.044s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:37:38.881446 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-50b4e1f5-3101-4de3-85c5-37fc382cdfb1 tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "5f3f7abc-978d-4a0e-8ae1-0d813ad77f35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.212s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:39.073527 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:39.073693 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:39.073776 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:39.075380 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:39.075380 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:39.076513 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Terminating instance
May 19 04:37:39.150753 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:37:39.151017 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:37:39.258700 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:37:39.259701 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:37:39.259701 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] No VIF found with MAC fa:16:3e:74:c7:cf, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:37:39.259701 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] No VIF found with MAC fa:16:3e:97:55:fe, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:37:39.260178 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Using config drive
May 19 04:37:39.267465 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:39.310142 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:39.331067 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:39.382961 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:39.569275 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ffb6e644-4a1c-40ea-b5db-bb7570f207e0 req-cf5d92e4-b060-4060-bbc6-35c464300525 service nova] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Received event network-vif-plugged-205c6b38-e8f4-4a6a-8de5-5fc6546c8821 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:39.574088 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ffb6e644-4a1c-40ea-b5db-bb7570f207e0 req-cf5d92e4-b060-4060-bbc6-35c464300525 service nova] Acquiring lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:39.574088 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ffb6e644-4a1c-40ea-b5db-bb7570f207e0 req-cf5d92e4-b060-4060-bbc6-35c464300525 service nova] Lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:39.574088 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ffb6e644-4a1c-40ea-b5db-bb7570f207e0 req-cf5d92e4-b060-4060-bbc6-35c464300525 service nova] Lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:39.574088 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ffb6e644-4a1c-40ea-b5db-bb7570f207e0 req-cf5d92e4-b060-4060-bbc6-35c464300525 service nova] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Processing event network-vif-plugged-205c6b38-e8f4-4a6a-8de5-5fc6546c8821 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:37:39.601384 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:37:39.605397 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:39.646626 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:39.654634 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:37:39.661342 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:39.707641 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:39.710670 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:39.761452 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:39.763181 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:39.774817 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:39.862810 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c11c6fff-af37-4e6a-a2d1-594b1823155e req-6e3c38ae-8f80-494e-8789-547222b2fb99 service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received event network-vif-unplugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:39.862810 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c11c6fff-af37-4e6a-a2d1-594b1823155e req-6e3c38ae-8f80-494e-8789-547222b2fb99 service nova] Acquiring lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:39.862810 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c11c6fff-af37-4e6a-a2d1-594b1823155e req-6e3c38ae-8f80-494e-8789-547222b2fb99 service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:39.862810 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c11c6fff-af37-4e6a-a2d1-594b1823155e req-6e3c38ae-8f80-494e-8789-547222b2fb99 service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:39.862810 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c11c6fff-af37-4e6a-a2d1-594b1823155e req-6e3c38ae-8f80-494e-8789-547222b2fb99 service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] No waiting events found dispatching network-vif-unplugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:39.863850 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c11c6fff-af37-4e6a-a2d1-594b1823155e req-6e3c38ae-8f80-494e-8789-547222b2fb99 service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received event network-vif-unplugged-13c0c2a4-ed11-438d-a852-17bc610c6269 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:39.864996 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:39.935695 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:39.956805 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999627508999993 future=<Future at 0x721853c718b0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:39.959561 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Instance destroyed successfully.
May 19 04:37:39.960575 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lazy-loading 'resources' on Instance uuid 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:37:40.028787 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Creating config drive at /opt/stack/data/nova/instances/7859dfab-f702-4d0b-a9e9-bb856c5004e6/disk.config
May 19 04:37:40.035201 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7859dfab-f702-4d0b-a9e9-bb856c5004e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb83mftlr {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:40.083979 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7859dfab-f702-4d0b-a9e9-bb856c5004e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb83mftlr" returned: 0 in 0.049s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:37:40.166072 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.362s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:40.166853 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:37:40.224976 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:37:40.226602 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165460.2251306, 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:40.226771 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] VM Started (Lifecycle Event)
May 19 04:37:40.228548 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:37:40.233870 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Instance spawned successfully.
May 19 04:37:40.233994 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:37:40.462433 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-21819966',display_name='tempest-ServerRescueNegativeTestJSON-server-21819966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverrescuenegativetestjson-server-21819966',id=1,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:35:01Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='334b83c8d3714844830f961673658b20',ramdisk_id='',reservation_id='r-zwug52jp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1305117099',owner_user_name='tempest-ServerRescueNegativeTestJSON-1305117099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:35:09Z,user_data=None,user_id='7cdf106961084f0e941b5b65911c9b76',uuid=4866cabb-0595-4fe5-8be5-ebf4ed9c8f94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13c0c2a4-ed11-438d-a852-17bc610c6269", "address": "fa:16:3e:81:21:90", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c0c2a4-ed", "ovs_interfaceid": "13c0c2a4-ed11-438d-a852-17bc610c6269", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:37:40.462617 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converting VIF {"id": "13c0c2a4-ed11-438d-a852-17bc610c6269", "address": "fa:16:3e:81:21:90", "network": {"id": "245a9a3d-e944-4360-a31e-8c70b7c272ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-405603351-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "334b83c8d3714844830f961673658b20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c0c2a4-ed", "ovs_interfaceid": "13c0c2a4-ed11-438d-a852-17bc610c6269", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:40.463277 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:21:90,bridge_name='br-int',has_traffic_filtering=True,id=13c0c2a4-ed11-438d-a852-17bc610c6269,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c0c2a4-ed') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:40.463598 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:21:90,bridge_name='br-int',has_traffic_filtering=True,id=13c0c2a4-ed11-438d-a852-17bc610c6269,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c0c2a4-ed') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:37:40.464871 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:40.465162 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13c0c2a4-ed, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:40.466346 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:40.467345 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:40.503428 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:40.504864 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:40.504864 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d64fb7df-77f6-47e7-aca1-395026c27446) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:40.506602 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:40.540986 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:40.546210 np0000001025 nova-compute[97981]: INFO os_vif [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:21:90,bridge_name='br-int',has_traffic_filtering=True,id=13c0c2a4-ed11-438d-a852-17bc610c6269,network=Network(245a9a3d-e944-4360-a31e-8c70b7c272ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c0c2a4-ed')
May 19 04:37:40.546210 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Deleting instance files /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94_del
May 19 04:37:40.546917 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Deletion of /opt/stack/data/nova/instances/4866cabb-0595-4fe5-8be5-ebf4ed9c8f94_del complete
May 19 04:37:40.580400 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:40.647093 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:40.677766 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:37:40.677766 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:37:40.677766 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:40.677766 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:40.706920 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:40.731690 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:40.742812 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:37:40.746786 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:40.746977 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:40.747425 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:40.748540 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:40.748540 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:40.748540 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:40.794570 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12a42fd27b7040b3964b46f5455691c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b413d7fd7b148adaa3e2c41bfa30252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:37:40.833030 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:40.869616 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:40.895933 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:40.930282 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:40.949915 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:40.969846 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:40.994271 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:41.015858 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:41.022476 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:41.057826 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Took 1.46 seconds to destroy the instance on the hypervisor.
May 19 04:37:41.058587 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:37:41.059297 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:37:41.059297 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:37:41.059297 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:41.060957 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:41.094345 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:41.099493 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:41.114712 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c59c3691-9015-489a-a128-f4bcda527133 req-5ec1c310-b21b-4a83-a779-938ad7151874 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-plugged-856804f2-648b-4cf3-a2d8-a2d4cf97e84f {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:41.114964 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c59c3691-9015-489a-a128-f4bcda527133 req-5ec1c310-b21b-4a83-a779-938ad7151874 service nova] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:41.116178 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c59c3691-9015-489a-a128-f4bcda527133 req-5ec1c310-b21b-4a83-a779-938ad7151874 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:41.116178 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c59c3691-9015-489a-a128-f4bcda527133 req-5ec1c310-b21b-4a83-a779-938ad7151874 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:41.116178 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c59c3691-9015-489a-a128-f4bcda527133 req-5ec1c310-b21b-4a83-a779-938ad7151874 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Processing event network-vif-plugged-856804f2-648b-4cf3-a2d8-a2d4cf97e84f {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:37:41.174188 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:41.178725 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:37:41.186834 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:41.235351 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:41.245803 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:37:41.246145 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165461.2458866, 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:41.246657 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] VM Paused (Lifecycle Event)
May 19 04:37:41.259129 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Took 18.74 seconds to spawn the instance on the hypervisor.
May 19 04:37:41.259247 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:41.269200 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:41.332470 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:41.356211 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:41.467599 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:41.626839 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:41.660994 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:41.662157 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:41.683720 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:37:41.691979 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e6e3945a-9ba0-4943-a28e-335270176148 req-a8ec0fe1-cbea-4afa-ac24-aed525da5aa4 service nova] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Received event network-vif-plugged-205c6b38-e8f4-4a6a-8de5-5fc6546c8821 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:41.699875 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e6e3945a-9ba0-4943-a28e-335270176148 req-a8ec0fe1-cbea-4afa-ac24-aed525da5aa4 service nova] Acquiring lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:41.699875 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e6e3945a-9ba0-4943-a28e-335270176148 req-a8ec0fe1-cbea-4afa-ac24-aed525da5aa4 service nova] Lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:41.700041 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e6e3945a-9ba0-4943-a28e-335270176148 req-a8ec0fe1-cbea-4afa-ac24-aed525da5aa4 service nova] Lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:41.700246 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e6e3945a-9ba0-4943-a28e-335270176148 req-a8ec0fe1-cbea-4afa-ac24-aed525da5aa4 service nova] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] No waiting events found dispatching network-vif-plugged-205c6b38-e8f4-4a6a-8de5-5fc6546c8821 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:41.700409 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-e6e3945a-9ba0-4943-a28e-335270176148 req-a8ec0fe1-cbea-4afa-ac24-aed525da5aa4 service nova] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Received unexpected event network-vif-plugged-205c6b38-e8f4-4a6a-8de5-5fc6546c8821 for instance with vm_state active and task_state None.
May 19 04:37:41.700409 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e6e3945a-9ba0-4943-a28e-335270176148 req-a8ec0fe1-cbea-4afa-ac24-aed525da5aa4 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-plugged-34d50a64-6aed-47ee-ae9c-851a9fe0161b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:41.700605 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e6e3945a-9ba0-4943-a28e-335270176148 req-a8ec0fe1-cbea-4afa-ac24-aed525da5aa4 service nova] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:41.700715 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e6e3945a-9ba0-4943-a28e-335270176148 req-a8ec0fe1-cbea-4afa-ac24-aed525da5aa4 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:41.700803 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e6e3945a-9ba0-4943-a28e-335270176148 req-a8ec0fe1-cbea-4afa-ac24-aed525da5aa4 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:41.701095 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e6e3945a-9ba0-4943-a28e-335270176148 req-a8ec0fe1-cbea-4afa-ac24-aed525da5aa4 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Processing event network-vif-plugged-34d50a64-6aed-47ee-ae9c-851a9fe0161b {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:37:41.701331 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e6e3945a-9ba0-4943-a28e-335270176148 req-a8ec0fe1-cbea-4afa-ac24-aed525da5aa4 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-plugged-34d50a64-6aed-47ee-ae9c-851a9fe0161b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:41.701449 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e6e3945a-9ba0-4943-a28e-335270176148 req-a8ec0fe1-cbea-4afa-ac24-aed525da5aa4 service nova] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:41.701578 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e6e3945a-9ba0-4943-a28e-335270176148 req-a8ec0fe1-cbea-4afa-ac24-aed525da5aa4 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:41.701667 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e6e3945a-9ba0-4943-a28e-335270176148 req-a8ec0fe1-cbea-4afa-ac24-aed525da5aa4 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:41.701892 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e6e3945a-9ba0-4943-a28e-335270176148 req-a8ec0fe1-cbea-4afa-ac24-aed525da5aa4 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] No event matching network-vif-plugged-34d50a64-6aed-47ee-ae9c-851a9fe0161b in dict_keys([('network-vif-plugged', '5add6c4e-9889-49d8-9fa6-2db045c6b4ae'), ('network-vif-plugged', '371fc2a1-7883-4eef-a3cc-0085db83dfc7'), ('network-vif-plugged', '3e688b23-684d-4dcf-95a1-2f44d8ea1649'), ('network-vif-plugged', 'ea620a14-2efe-4797-9ee1-c004ba488769'), ('network-vif-plugged', '0fdb83aa-cd21-410a-8823-a52276cc6fb1')]) {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 19 04:37:41.702018 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-e6e3945a-9ba0-4943-a28e-335270176148 req-a8ec0fe1-cbea-4afa-ac24-aed525da5aa4 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received unexpected event network-vif-plugged-34d50a64-6aed-47ee-ae9c-851a9fe0161b for instance with vm_state building and task_state spawning.
May 19 04:37:41.702018 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e6e3945a-9ba0-4943-a28e-335270176148 req-a8ec0fe1-cbea-4afa-ac24-aed525da5aa4 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-plugged-5add6c4e-9889-49d8-9fa6-2db045c6b4ae {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:41.702230 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e6e3945a-9ba0-4943-a28e-335270176148 req-a8ec0fe1-cbea-4afa-ac24-aed525da5aa4 service nova] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:41.703525 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e6e3945a-9ba0-4943-a28e-335270176148 req-a8ec0fe1-cbea-4afa-ac24-aed525da5aa4 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:41.703525 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e6e3945a-9ba0-4943-a28e-335270176148 req-a8ec0fe1-cbea-4afa-ac24-aed525da5aa4 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:41.703525 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e6e3945a-9ba0-4943-a28e-335270176148 req-a8ec0fe1-cbea-4afa-ac24-aed525da5aa4 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Processing event network-vif-plugged-5add6c4e-9889-49d8-9fa6-2db045c6b4ae {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:37:41.752841 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:41.760773 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165461.7603028, 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:41.760931 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] VM Resumed (Lifecycle Event)
May 19 04:37:41.776647 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Took 26.30 seconds to build instance.
May 19 04:37:41.933059 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:41.935349 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:41.984976 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Successfully created port: 2a6f5abd-d702-471f-8f6c-8859237af4f9 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:37:42.084875 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:42.126244 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ebd76752-56bd-4858-adfb-38ff5ce60c9e req-d6294cdc-6fa8-40d6-8fae-61e2fac56621 service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received event network-vif-unplugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:42.127689 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:42.130746 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ebd76752-56bd-4858-adfb-38ff5ce60c9e req-d6294cdc-6fa8-40d6-8fae-61e2fac56621 service nova] Acquiring lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:42.131044 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ebd76752-56bd-4858-adfb-38ff5ce60c9e req-d6294cdc-6fa8-40d6-8fae-61e2fac56621 service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:42.131592 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ebd76752-56bd-4858-adfb-38ff5ce60c9e req-d6294cdc-6fa8-40d6-8fae-61e2fac56621 service nova] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:42.131756 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ebd76752-56bd-4858-adfb-38ff5ce60c9e req-d6294cdc-6fa8-40d6-8fae-61e2fac56621 service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] No waiting events found dispatching network-vif-unplugged-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:42.131889 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ebd76752-56bd-4858-adfb-38ff5ce60c9e req-d6294cdc-6fa8-40d6-8fae-61e2fac56621 service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received event network-vif-unplugged-13c0c2a4-ed11-438d-a852-17bc610c6269 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:42.132014 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ebd76752-56bd-4858-adfb-38ff5ce60c9e req-d6294cdc-6fa8-40d6-8fae-61e2fac56621 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-plugged-371fc2a1-7883-4eef-a3cc-0085db83dfc7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:42.132185 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ebd76752-56bd-4858-adfb-38ff5ce60c9e req-d6294cdc-6fa8-40d6-8fae-61e2fac56621 service nova] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:42.132336 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ebd76752-56bd-4858-adfb-38ff5ce60c9e req-d6294cdc-6fa8-40d6-8fae-61e2fac56621 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:42.132439 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ebd76752-56bd-4858-adfb-38ff5ce60c9e req-d6294cdc-6fa8-40d6-8fae-61e2fac56621 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:42.132540 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ebd76752-56bd-4858-adfb-38ff5ce60c9e req-d6294cdc-6fa8-40d6-8fae-61e2fac56621 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Processing event network-vif-plugged-371fc2a1-7883-4eef-a3cc-0085db83dfc7 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:37:42.132678 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ebd76752-56bd-4858-adfb-38ff5ce60c9e req-d6294cdc-6fa8-40d6-8fae-61e2fac56621 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-plugged-371fc2a1-7883-4eef-a3cc-0085db83dfc7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:42.133602 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ebd76752-56bd-4858-adfb-38ff5ce60c9e req-d6294cdc-6fa8-40d6-8fae-61e2fac56621 service nova] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:42.135671 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ebd76752-56bd-4858-adfb-38ff5ce60c9e req-d6294cdc-6fa8-40d6-8fae-61e2fac56621 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:42.135709 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ebd76752-56bd-4858-adfb-38ff5ce60c9e req-d6294cdc-6fa8-40d6-8fae-61e2fac56621 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:42.135834 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ebd76752-56bd-4858-adfb-38ff5ce60c9e req-d6294cdc-6fa8-40d6-8fae-61e2fac56621 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] No event matching network-vif-plugged-371fc2a1-7883-4eef-a3cc-0085db83dfc7 in dict_keys([('network-vif-plugged', '3e688b23-684d-4dcf-95a1-2f44d8ea1649'), ('network-vif-plugged', 'ea620a14-2efe-4797-9ee1-c004ba488769'), ('network-vif-plugged', '0fdb83aa-cd21-410a-8823-a52276cc6fb1')]) {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 19 04:37:42.135946 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-ebd76752-56bd-4858-adfb-38ff5ce60c9e req-d6294cdc-6fa8-40d6-8fae-61e2fac56621 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received unexpected event network-vif-plugged-371fc2a1-7883-4eef-a3cc-0085db83dfc7 for instance with vm_state building and task_state spawning.
May 19 04:37:42.254316 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:42.263753 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:42.267704 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:37:42.278864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.813s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:42.622000 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:42.630524 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:42.637042 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Took 1.58 seconds to deallocate network for instance.
May 19 04:37:42.652088 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:42.720261 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:37:42.721239 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:37:42.721508 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Creating image(s)
May 19 04:37:42.721953 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1a3ef6c-55da-4f79-8b87-720f44891fa4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:42.931359 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "/opt/stack/data/nova/instances/f1a3ef6c-55da-4f79-8b87-720f44891fa4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.209s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:42.931858 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165462.9314156, 7859dfab-f702-4d0b-a9e9-bb856c5004e6 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:42.932551 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] VM Started (Lifecycle Event)
May 19 04:37:42.934042 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:42.939413 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "/opt/stack/data/nova/instances/f1a3ef6c-55da-4f79-8b87-720f44891fa4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:42.940699 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:37:42.945143 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:37:42.947844 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:43.040272 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:43.042150 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:37:43.042615 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:43.043508 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:43.043642 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:37:43.048081 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:37:43.048250 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:43.130769 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Successfully updated port: 2a6f5abd-d702-471f-8f6c-8859237af4f9 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:37:43.141719 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.093s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:37:43.142196 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/f1a3ef6c-55da-4f79-8b87-720f44891fa4/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:43.157154 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:43.157917 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:43.201679 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/f1a3ef6c-55da-4f79-8b87-720f44891fa4/disk 1073741824" returned: 0 in 0.059s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:37:43.202153 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:43.202669 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:43.235251 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e6e26adb-735c-45d4-906a-747835db7827 req-74432658-d5a6-482e-88ca-476bb29d23c9 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-plugged-856804f2-648b-4cf3-a2d8-a2d4cf97e84f {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:43.235862 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e6e26adb-735c-45d4-906a-747835db7827 req-74432658-d5a6-482e-88ca-476bb29d23c9 service nova] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:43.236063 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e6e26adb-735c-45d4-906a-747835db7827 req-74432658-d5a6-482e-88ca-476bb29d23c9 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:43.236389 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e6e26adb-735c-45d4-906a-747835db7827 req-74432658-d5a6-482e-88ca-476bb29d23c9 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:43.236508 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e6e26adb-735c-45d4-906a-747835db7827 req-74432658-d5a6-482e-88ca-476bb29d23c9 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] No event matching network-vif-plugged-856804f2-648b-4cf3-a2d8-a2d4cf97e84f in dict_keys([('network-vif-plugged', '3e688b23-684d-4dcf-95a1-2f44d8ea1649'), ('network-vif-plugged', 'ea620a14-2efe-4797-9ee1-c004ba488769'), ('network-vif-plugged', '0fdb83aa-cd21-410a-8823-a52276cc6fb1')]) {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 19 04:37:43.236972 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-e6e26adb-735c-45d4-906a-747835db7827 req-74432658-d5a6-482e-88ca-476bb29d23c9 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received unexpected event network-vif-plugged-856804f2-648b-4cf3-a2d8-a2d4cf97e84f for instance with vm_state building and task_state spawning.
May 19 04:37:43.236972 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e6e26adb-735c-45d4-906a-747835db7827 req-74432658-d5a6-482e-88ca-476bb29d23c9 service nova] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Received event network-vif-deleted-13c0c2a4-ed11-438d-a852-17bc610c6269 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:43.293959 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.090s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:37:43.293959 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1a3ef6c-55da-4f79-8b87-720f44891fa4/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:37:43.293959 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a3ef6c-55da-4f79-8b87-720f44891fa4/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:43.393996 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1a3ef6c-55da-4f79-8b87-720f44891fa4/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:37:43.397371 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Cannot resize image /opt/stack/data/nova/instances/f1a3ef6c-55da-4f79-8b87-720f44891fa4/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:37:43.398027 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:37:43.398311 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Ensure instance console log exists: /opt/stack/data/nova/instances/f1a3ef6c-55da-4f79-8b87-720f44891fa4/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:37:43.398727 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:43.398997 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:43.399227 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:43.439759 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:43.441916 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165463.4416177, 7859dfab-f702-4d0b-a9e9-bb856c5004e6 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:43.442043 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] VM Paused (Lifecycle Event)
May 19 04:37:43.508059 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:37:43.508721 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:37:43.636976 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Acquiring lock "refresh_cache-f1a3ef6c-55da-4f79-8b87-720f44891fa4" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:37:43.636976 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Acquired lock "refresh_cache-f1a3ef6c-55da-4f79-8b87-720f44891fa4" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:37:43.636976 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:37:43.687864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:43.688394 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:43.688613 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:43.688766 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:43.690282 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:43.693700 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Terminating instance
May 19 04:37:43.783008 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-plugged-5add6c4e-9889-49d8-9fa6-2db045c6b4ae {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:43.785441 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:43.785633 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:43.786238 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:43.786414 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] No event matching network-vif-plugged-5add6c4e-9889-49d8-9fa6-2db045c6b4ae in dict_keys([('network-vif-plugged', '3e688b23-684d-4dcf-95a1-2f44d8ea1649'), ('network-vif-plugged', 'ea620a14-2efe-4797-9ee1-c004ba488769'), ('network-vif-plugged', '0fdb83aa-cd21-410a-8823-a52276cc6fb1')]) {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 19 04:37:43.786552 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received unexpected event network-vif-plugged-5add6c4e-9889-49d8-9fa6-2db045c6b4ae for instance with vm_state building and task_state spawning.
May 19 04:37:43.786695 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-plugged-3e688b23-684d-4dcf-95a1-2f44d8ea1649 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:43.786842 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:43.787000 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:43.787137 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:43.787277 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Processing event network-vif-plugged-3e688b23-684d-4dcf-95a1-2f44d8ea1649 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:37:43.787464 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-plugged-3e688b23-684d-4dcf-95a1-2f44d8ea1649 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:43.787646 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:43.787736 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:43.787859 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:43.787996 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] No event matching network-vif-plugged-3e688b23-684d-4dcf-95a1-2f44d8ea1649 in dict_keys([('network-vif-plugged', 'ea620a14-2efe-4797-9ee1-c004ba488769'), ('network-vif-plugged', '0fdb83aa-cd21-410a-8823-a52276cc6fb1')]) {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 19 04:37:43.788146 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received unexpected event network-vif-plugged-3e688b23-684d-4dcf-95a1-2f44d8ea1649 for instance with vm_state building and task_state spawning.
May 19 04:37:43.788421 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-plugged-ea620a14-2efe-4797-9ee1-c004ba488769 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:43.788560 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:43.788692 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:43.788815 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:43.788938 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Processing event network-vif-plugged-ea620a14-2efe-4797-9ee1-c004ba488769 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:37:43.789085 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Received event network-changed-2a6f5abd-d702-471f-8f6c-8859237af4f9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:43.789274 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Refreshing instance network info cache due to event network-changed-2a6f5abd-d702-471f-8f6c-8859237af4f9. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:37:43.789370 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] Acquiring lock "refresh_cache-f1a3ef6c-55da-4f79-8b87-720f44891fa4" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:37:43.946917 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:43.948419 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:37:44.013542 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:37:44.191476 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b1566317-9f73-424a-bf09-14be0dea9913 req-4307d23e-671b-46c1-8025-b6f8d77bfddb service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-plugged-0fdb83aa-cd21-410a-8823-a52276cc6fb1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:44.196369 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b1566317-9f73-424a-bf09-14be0dea9913 req-4307d23e-671b-46c1-8025-b6f8d77bfddb service nova] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:44.196683 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b1566317-9f73-424a-bf09-14be0dea9913 req-4307d23e-671b-46c1-8025-b6f8d77bfddb service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:44.196890 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b1566317-9f73-424a-bf09-14be0dea9913 req-4307d23e-671b-46c1-8025-b6f8d77bfddb service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:44.196947 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b1566317-9f73-424a-bf09-14be0dea9913 req-4307d23e-671b-46c1-8025-b6f8d77bfddb service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Processing event network-vif-plugged-0fdb83aa-cd21-410a-8823-a52276cc6fb1 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:37:44.197026 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b1566317-9f73-424a-bf09-14be0dea9913 req-4307d23e-671b-46c1-8025-b6f8d77bfddb service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-plugged-0fdb83aa-cd21-410a-8823-a52276cc6fb1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:44.197176 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b1566317-9f73-424a-bf09-14be0dea9913 req-4307d23e-671b-46c1-8025-b6f8d77bfddb service nova] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:44.197316 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b1566317-9f73-424a-bf09-14be0dea9913 req-4307d23e-671b-46c1-8025-b6f8d77bfddb service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:44.197410 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b1566317-9f73-424a-bf09-14be0dea9913 req-4307d23e-671b-46c1-8025-b6f8d77bfddb service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:44.197509 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b1566317-9f73-424a-bf09-14be0dea9913 req-4307d23e-671b-46c1-8025-b6f8d77bfddb service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] No waiting events found dispatching network-vif-plugged-0fdb83aa-cd21-410a-8823-a52276cc6fb1 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:44.197607 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-b1566317-9f73-424a-bf09-14be0dea9913 req-4307d23e-671b-46c1-8025-b6f8d77bfddb service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received unexpected event network-vif-plugged-0fdb83aa-cd21-410a-8823-a52276cc6fb1 for instance with vm_state building and task_state spawning.
May 19 04:37:44.198597 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:37:44.198932 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Instance event wait completed in 1 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:37:44.202361 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:37:44.203994 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Instance spawned successfully.
May 19 04:37:44.204300 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:37:44.226696 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:37:44.233072 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:44.247947 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:44.250572 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:44.277708 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:44.423968 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:44.451249 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:37:44.451571 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165464.4513462, 7859dfab-f702-4d0b-a9e9-bb856c5004e6 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:44.452953 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] VM Resumed (Lifecycle Event)
May 19 04:37:44.521381 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.363s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:44.537677 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Instance destroyed successfully.
May 19 04:37:44.540013 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'resources' on Instance uuid 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:37:44.627195 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Updating instance_info_cache with network_info: [{"id": "2a6f5abd-d702-471f-8f6c-8859237af4f9", "address": "fa:16:3e:93:c3:46", "network": {"id": "fbca82d5-40ca-4591-992b-dd555b5fef8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919658386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b413d7fd7b148adaa3e2c41bfa30252", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a6f5abd-d7", "ovs_interfaceid": "2a6f5abd-d702-471f-8f6c-8859237af4f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:44.636130 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Deleted allocations for instance 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94
May 19 04:37:44.670534 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:44.712597 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:44.712847 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:44.713142 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:44.713489 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:44.714242 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:44.714242 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:44.959671 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:44.965158 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:37:45.048214 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-720936815',display_name='tempest-TestVolumeBootPattern-server-720936815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-720936815',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:37:41Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-4ki1er0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:37:41Z,user_data=None,user_id='5c46088fb3e74b819bb456461716a801',uuid=0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "205c6b38-e8f4-4a6a-8de5-5fc6546c8821", "address": "fa:16:3e:2f:e4:f9", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap205c6b38-e8", "ovs_interfaceid": "205c6b38-e8f4-4a6a-8de5-5fc6546c8821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:37:45.048214 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "205c6b38-e8f4-4a6a-8de5-5fc6546c8821", "address": "fa:16:3e:2f:e4:f9", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap205c6b38-e8", "ovs_interfaceid": "205c6b38-e8f4-4a6a-8de5-5fc6546c8821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:45.048861 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e4:f9,bridge_name='br-int',has_traffic_filtering=True,id=205c6b38-e8f4-4a6a-8de5-5fc6546c8821,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap205c6b38-e8') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:45.049078 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e4:f9,bridge_name='br-int',has_traffic_filtering=True,id=205c6b38-e8f4-4a6a-8de5-5fc6546c8821,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap205c6b38-e8') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:37:45.051285 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:45.051617 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap205c6b38-e8, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:45.053321 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:45.054379 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:45.057703 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:45.058553 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:45.058710 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03b00c89-8435-4dcf-bee1-c6f058154dbc) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:45.059234 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:45.059806 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:45.060202 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:45.066559 np0000001025 nova-compute[97981]: INFO os_vif [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e4:f9,bridge_name='br-int',has_traffic_filtering=True,id=205c6b38-e8f4-4a6a-8de5-5fc6546c8821,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap205c6b38-e8')
May 19 04:37:45.111242 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c', 'attached_at': '', 'detached_at': '', 'volume_id': '652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'serial': '652c0598-ca18-49bf-ab6d-a836f9af9eb3'} {{(pid=97981) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 19 04:37:45.112037 np0000001025 nova-compute[97981]: WARNING stevedore.named [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 19 04:37:45.112453 np0000001025 nova-compute[97981]: WARNING castellan.key_manager [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:37:45.112785 np0000001025 nova-compute[97981]: WARNING nova.keymgr.conf_key_mgr [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:37:45.113704 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x721834324a40>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c', 'attached_at': '', 'detached_at': '', 'volume_id': '652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'serial': '652c0598-ca18-49bf-ab6d-a836f9af9eb3'} {{(pid=97981) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 19 04:37:45.114156 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors.luks [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] closing encrypted volume /dev/dm-6 {{(pid=97981) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 19 04:37:45.133299 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Releasing lock "refresh_cache-f1a3ef6c-55da-4f79-8b87-720f44891fa4" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:37:45.133770 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Instance network_info: |[{"id": "2a6f5abd-d702-471f-8f6c-8859237af4f9", "address": "fa:16:3e:93:c3:46", "network": {"id": "fbca82d5-40ca-4591-992b-dd555b5fef8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919658386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b413d7fd7b148adaa3e2c41bfa30252", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a6f5abd-d7", "ovs_interfaceid": "2a6f5abd-d702-471f-8f6c-8859237af4f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:37:45.134266 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] Acquired lock "refresh_cache-f1a3ef6c-55da-4f79-8b87-720f44891fa4" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:37:45.135663 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Refreshing network info cache for port 2a6f5abd-d702-471f-8f6c-8859237af4f9 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:37:45.138177 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Start _get_guest_xml network_info=[{"id": "2a6f5abd-d702-471f-8f6c-8859237af4f9", "address": "fa:16:3e:93:c3:46", "network": {"id": "fbca82d5-40ca-4591-992b-dd555b5fef8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919658386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b413d7fd7b148adaa3e2c41bfa30252", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a6f5abd-d7", "ovs_interfaceid": "2a6f5abd-d702-471f-8f6c-8859237af4f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:37:45.147682 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:37:45.153253 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:37:45.154519 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-372332817', uuid='f1a3ef6c-55da-4f79-8b87-720f44891fa4'), owner=OwnerMeta(userid='12a42fd27b7040b3964b46f5455691c6', username='tempest-VolumesActionsTest-2133751040-project-member', projectid='9b413d7fd7b148adaa3e2c41bfa30252', projectname='tempest-VolumesActionsTest-2133751040'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2a6f5abd-d702-471f-8f6c-8859237af4f9", "address": "fa:16:3e:93:c3:46", "network": {"id": "fbca82d5-40ca-4591-992b-dd555b5fef8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919658386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b413d7fd7b148adaa3e2c41bfa30252", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a6f5abd-d7", "ovs_interfaceid": "2a6f5abd-d702-471f-8f6c-8859237af4f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165465.15266) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:37:45.154777 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:37:45.155017 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:37:45.155536 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:37:45.156213 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652c0598-ca18-49bf-ab6d-a836f9af9eb3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:37:45.157607 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:37:45.157607 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:37:45.157607 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:37:45.158540 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:37:45.158709 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:37:45.162127 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:37:45.162127 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:37:45.162127 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:37:45.162127 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:37:45.162127 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:37:45.162127 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:37:45.162127 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:37:45.162127 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:37:45.162127 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:37:45.162127 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:37:45.162127 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:37:45.162127 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:37:45.187228 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:37:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-372332817',display_name='tempest-VolumesActionsTest-instance-372332817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesactionstest-instance-372332817',id=21,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b413d7fd7b148adaa3e2c41bfa30252',ramdisk_id='',reservation_id='r-n3uhsnb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2133751040',owner_user_name='tempest-VolumesActionsTest-2133751040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:37:42Z,user_data=None,user_id='12a42fd27b7040b3964b46f5455691c6',uuid=f1a3ef6c-55da-4f79-8b87-720f44891fa4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a6f5abd-d702-471f-8f6c-8859237af4f9", "address": "fa:16:3e:93:c3:46", "network": {"id": "fbca82d5-40ca-4591-992b-dd555b5fef8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919658386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b413d7fd7b148adaa3e2c41bfa30252", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a6f5abd-d7", "ovs_interfaceid": "2a6f5abd-d702-471f-8f6c-8859237af4f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:37:45.187642 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Converting VIF {"id": "2a6f5abd-d702-471f-8f6c-8859237af4f9", "address": "fa:16:3e:93:c3:46", "network": {"id": "fbca82d5-40ca-4591-992b-dd555b5fef8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919658386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b413d7fd7b148adaa3e2c41bfa30252", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a6f5abd-d7", "ovs_interfaceid": "2a6f5abd-d702-471f-8f6c-8859237af4f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:45.188382 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:c3:46,bridge_name='br-int',has_traffic_filtering=True,id=2a6f5abd-d702-471f-8f6c-8859237af4f9,network=Network(fbca82d5-40ca-4591-992b-dd555b5fef8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a6f5abd-d7') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:45.190431 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lazy-loading 'pci_devices' on Instance uuid f1a3ef6c-55da-4f79-8b87-720f44891fa4 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:37:45.207856 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:45.207856 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:45.207856 np0000001025 nova-compute[97981]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:45.207856 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:45.207856 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:45.207856 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:45.207856 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:37:45.207856 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:37:45.207856 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:37:45.208155 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:45.208155 np0000001025 nova-compute[97981]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3 (non-flash)
May 19 04:37:45.208155 np0000001025 nova-compute[97981]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:45.208155 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:37:45.208155 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:45.208155 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:37:45.208155 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:37:45.208155 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:37:45.208155 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:37:45.208155 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b', '42')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:37:45.208434 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', '35')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:37:45.210042 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3', '36')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:37:45.211122 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721834446c00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3'): ({'sdc'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:37:45.211394 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Removing multipathed devices sdc, sdb {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:37:45.211679 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flush multipath device 330000000ce5b9835 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:37:45.222063 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Took 28.51 seconds to spawn the instance on the hypervisor.
May 19 04:37:45.222063 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:45.243031 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:37:45.295311 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:37:45.342819 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:37:45.343039 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:37:45.344204 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:37:45.356546 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:37:45.356785 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:37:45.376805 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:45.417790 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3, portal: 192.168.40.100,3260]
May 19 04:37:45.417790 np0000001025 nova-compute[97981]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3, portal: 192.168.40.100,3260] successful.
May 19 04:37:45.417790 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:45.438504 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:45.452238 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:45.469603 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:37:45.469955 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999822540999958 future=<Future at 0x721834305d00 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:45.482502 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3, portal: 192.168.50.100,3260]
May 19 04:37:45.482502 np0000001025 nova-compute[97981]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-652c0598-ca18-49bf-ab6d-a836f9af9eb3, portal: 192.168.50.100,3260] successful.
May 19 04:37:45.482502 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:45.496422 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:45.504721 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:45.509298 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:37:45.509298 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== disconnect_volume: return (351ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:37:45.509298 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:37:45.509298 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Deleting instance files /opt/stack/data/nova/instances/0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c_del
May 19 04:37:45.509298 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Deletion of /opt/stack/data/nova/instances/0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c_del complete
May 19 04:37:45.641129 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:45.657898 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-750e7a32-ba22-497b-9f20-fbd285ebe29b tempest-ServerRescueNegativeTestJSON-1305117099 tempest-ServerRescueNegativeTestJSON-1305117099-project-member] Lock "4866cabb-0595-4fe5-8be5-ebf4ed9c8f94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.584s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:45.693084 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] End _get_guest_xml xml=<domain type="qemu">
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:   <uuid>f1a3ef6c-55da-4f79-8b87-720f44891fa4</uuid>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:   <name>instance-00000015</name>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <nova:name>tempest-VolumesActionsTest-instance-372332817</nova:name>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:37:45</nova:creationTime>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:         <nova:user uuid="12a42fd27b7040b3964b46f5455691c6">tempest-VolumesActionsTest-2133751040-project-member</nova:user>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:         <nova:project uuid="9b413d7fd7b148adaa3e2c41bfa30252">tempest-VolumesActionsTest-2133751040</nova:project>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:         <nova:port uuid="2a6f5abd-d702-471f-8f6c-8859237af4f9">
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     <system>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <entry name="serial">f1a3ef6c-55da-4f79-8b87-720f44891fa4</entry>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <entry name="uuid">f1a3ef6c-55da-4f79-8b87-720f44891fa4</entry>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     </system>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:   <os>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:   </os>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:   <features>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:   </features>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:   <devices>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/f1a3ef6c-55da-4f79-8b87-720f44891fa4/disk"/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     </disk>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/f1a3ef6c-55da-4f79-8b87-720f44891fa4/disk.config"/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     </disk>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:93:c3:46"/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <target dev="tap2a6f5abd-d7"/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     </interface>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/f1a3ef6c-55da-4f79-8b87-720f44891fa4/console.log" append="off"/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     </serial>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     <video>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     </video>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     </rng>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:   </devices>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]: </domain>
May 19 04:37:45.693084 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:37:45.698132 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Preparing to wait for external event network-vif-plugged-2a6f5abd-d702-471f-8f6c-8859237af4f9 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:37:45.698132 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Acquiring lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:45.698132 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:45.698132 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:45.698132 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:37:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-372332817',display_name='tempest-VolumesActionsTest-instance-372332817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesactionstest-instance-372332817',id=21,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b413d7fd7b148adaa3e2c41bfa30252',ramdisk_id='',reservation_id='r-n3uhsnb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2133751040',owner_user_name='tempest-VolumesActionsTest-2133751040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:37:42Z,user_data=None,user_id='12a42fd27b7040b3964b46f5455691c6',uuid=f1a3ef6c-55da-4f79-8b87-720f44891fa4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a6f5abd-d702-471f-8f6c-8859237af4f9", "address": "fa:16:3e:93:c3:46", "network": {"id": "fbca82d5-40ca-4591-992b-dd555b5fef8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919658386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b413d7fd7b148adaa3e2c41bfa30252", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a6f5abd-d7", "ovs_interfaceid": "2a6f5abd-d702-471f-8f6c-8859237af4f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:37:45.698132 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Converting VIF {"id": "2a6f5abd-d702-471f-8f6c-8859237af4f9", "address": "fa:16:3e:93:c3:46", "network": {"id": "fbca82d5-40ca-4591-992b-dd555b5fef8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919658386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b413d7fd7b148adaa3e2c41bfa30252", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a6f5abd-d7", "ovs_interfaceid": "2a6f5abd-d702-471f-8f6c-8859237af4f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:45.698132 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:c3:46,bridge_name='br-int',has_traffic_filtering=True,id=2a6f5abd-d702-471f-8f6c-8859237af4f9,network=Network(fbca82d5-40ca-4591-992b-dd555b5fef8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a6f5abd-d7') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:45.698132 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:c3:46,bridge_name='br-int',has_traffic_filtering=True,id=2a6f5abd-d702-471f-8f6c-8859237af4f9,network=Network(fbca82d5-40ca-4591-992b-dd555b5fef8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a6f5abd-d7') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:37:45.698132 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:45.698132 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:45.698132 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:37:45.698132 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:45.698132 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45eb6418-c44a-5a79-8e94-39e32f213b98', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:45.698132 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:45.700360 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:45.700360 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:45.702595 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:45.702595 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a6f5abd-d7, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:45.702921 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a6f5abd-d7, col_values=(('qos', UUID('aa30fb9c-5cef-4001-838f-4a6ebe80a5f8')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:45.703060 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a6f5abd-d7, col_values=(('external_ids', {'iface-id': '2a6f5abd-d702-471f-8f6c-8859237af4f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:c3:46', 'vm-uuid': 'f1a3ef6c-55da-4f79-8b87-720f44891fa4'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:45.704204 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:45.705192 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:45.711060 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:45.711880 np0000001025 nova-compute[97981]: INFO os_vif [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:c3:46,bridge_name='br-int',has_traffic_filtering=True,id=2a6f5abd-d702-471f-8f6c-8859237af4f9,network=Network(fbca82d5-40ca-4591-992b-dd555b5fef8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a6f5abd-d7')
May 19 04:37:45.740006 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Took 40.51 seconds to build instance.
May 19 04:37:45.867503 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3167c464-d38b-4adb-a401-7995bc3d58b6 req-a3c73ebe-cd55-48f9-b295-585c4aed90db service nova] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Received event network-vif-unplugged-205c6b38-e8f4-4a6a-8de5-5fc6546c8821 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:45.867742 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3167c464-d38b-4adb-a401-7995bc3d58b6 req-a3c73ebe-cd55-48f9-b295-585c4aed90db service nova] Acquiring lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:45.867871 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3167c464-d38b-4adb-a401-7995bc3d58b6 req-a3c73ebe-cd55-48f9-b295-585c4aed90db service nova] Lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:45.867937 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3167c464-d38b-4adb-a401-7995bc3d58b6 req-a3c73ebe-cd55-48f9-b295-585c4aed90db service nova] Lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:45.868192 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3167c464-d38b-4adb-a401-7995bc3d58b6 req-a3c73ebe-cd55-48f9-b295-585c4aed90db service nova] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] No waiting events found dispatching network-vif-unplugged-205c6b38-e8f4-4a6a-8de5-5fc6546c8821 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:45.868192 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3167c464-d38b-4adb-a401-7995bc3d58b6 req-a3c73ebe-cd55-48f9-b295-585c4aed90db service nova] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Received event network-vif-unplugged-205c6b38-e8f4-4a6a-8de5-5fc6546c8821 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:45.868366 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3167c464-d38b-4adb-a401-7995bc3d58b6 req-a3c73ebe-cd55-48f9-b295-585c4aed90db service nova] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Received event network-vif-unplugged-205c6b38-e8f4-4a6a-8de5-5fc6546c8821 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:45.868366 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3167c464-d38b-4adb-a401-7995bc3d58b6 req-a3c73ebe-cd55-48f9-b295-585c4aed90db service nova] Acquiring lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:45.868569 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3167c464-d38b-4adb-a401-7995bc3d58b6 req-a3c73ebe-cd55-48f9-b295-585c4aed90db service nova] Lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:45.868569 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3167c464-d38b-4adb-a401-7995bc3d58b6 req-a3c73ebe-cd55-48f9-b295-585c4aed90db service nova] Lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:45.868657 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3167c464-d38b-4adb-a401-7995bc3d58b6 req-a3c73ebe-cd55-48f9-b295-585c4aed90db service nova] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] No waiting events found dispatching network-vif-unplugged-205c6b38-e8f4-4a6a-8de5-5fc6546c8821 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:45.870255 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3167c464-d38b-4adb-a401-7995bc3d58b6 req-a3c73ebe-cd55-48f9-b295-585c4aed90db service nova] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Received event network-vif-unplugged-205c6b38-e8f4-4a6a-8de5-5fc6546c8821 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:46.017694 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Took 1.82 seconds to destroy the instance on the hypervisor.
May 19 04:37:46.018147 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:37:46.018589 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:37:46.018790 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:37:46.019035 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:46.243383 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.028s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:46.402033 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:46.974070 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:47.184418 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:47.229519 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:37:47.229662 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:37:47.229811 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] No VIF found with MAC fa:16:3e:93:c3:46, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:37:47.230598 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Using config drive
May 19 04:37:47.355662 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Updated VIF entry in instance network info cache for port 2a6f5abd-d702-471f-8f6c-8859237af4f9. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:37:47.355938 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Updating instance_info_cache with network_info: [{"id": "2a6f5abd-d702-471f-8f6c-8859237af4f9", "address": "fa:16:3e:93:c3:46", "network": {"id": "fbca82d5-40ca-4591-992b-dd555b5fef8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919658386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b413d7fd7b148adaa3e2c41bfa30252", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a6f5abd-d7", "ovs_interfaceid": "2a6f5abd-d702-471f-8f6c-8859237af4f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:47.539834 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0003898130000834499 future=<Future at 0x7218344018e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:47.540809 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] Emitting event <LifecycleEvent: 1779165452.5393531, 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:47.541020 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:47.541327 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] VM Stopped (Lifecycle Event)
May 19 04:37:47.542348 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=7.414097783999978 future=<Future at 0x721853c718b0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:47.542602 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=7.413803133999863 future=<Future at 0x721853c718b0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:47.674450 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:47.738299 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:47.858391 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] Releasing lock "refresh_cache-f1a3ef6c-55da-4f79-8b87-720f44891fa4" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:37:47.859213 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-plugged-ea620a14-2efe-4797-9ee1-c004ba488769 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:47.859213 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:47.859213 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:47.859388 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:47.859453 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] No waiting events found dispatching network-vif-plugged-ea620a14-2efe-4797-9ee1-c004ba488769 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:47.859611 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-5842cb6b-b4f6-495b-9899-425341bf8d63 req-b7601259-e49d-478d-ae4d-f2a11b251db6 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received unexpected event network-vif-plugged-ea620a14-2efe-4797-9ee1-c004ba488769 for instance with vm_state building and task_state spawning.
May 19 04:37:47.945970 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-62d2420a-91a0-4bed-922a-15958c00ba8a req-5eca164b-d038-4c26-81a7-688826639d67 service nova] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Received event network-vif-deleted-205c6b38-e8f4-4a6a-8de5-5fc6546c8821 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:47.970603 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:48.041890 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:48.042337 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Creating config drive at /opt/stack/data/nova/instances/f1a3ef6c-55da-4f79-8b87-720f44891fa4/disk.config
May 19 04:37:48.046789 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4b1ee8a-6aab-4ea9-82e1-ba4169179997 tempest-TestMultiAttachVolumeSwap-626733199 tempest-TestMultiAttachVolumeSwap-626733199-project-member] [instance: 5f3f7abc-978d-4a0e-8ae1-0d813ad77f35] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:48.050890 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f1a3ef6c-55da-4f79-8b87-720f44891fa4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpja74lj0i {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:48.105495 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f1a3ef6c-55da-4f79-8b87-720f44891fa4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpja74lj0i" returned: 0 in 0.054s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:37:48.179211 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Took 2.16 seconds to deallocate network for instance.
May 19 04:37:48.231545 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-184513a4-9802-41a4-88fe-4446c5b614dc req-523dfc4c-1aad-4d15-bf1d-4dcd6acbd6f3 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-changed-34d50a64-6aed-47ee-ae9c-851a9fe0161b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:48.233007 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-184513a4-9802-41a4-88fe-4446c5b614dc req-523dfc4c-1aad-4d15-bf1d-4dcd6acbd6f3 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Refreshing instance network info cache due to event network-changed-34d50a64-6aed-47ee-ae9c-851a9fe0161b. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:37:48.233269 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-184513a4-9802-41a4-88fe-4446c5b614dc req-523dfc4c-1aad-4d15-bf1d-4dcd6acbd6f3 service nova] Acquiring lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:37:48.233392 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-184513a4-9802-41a4-88fe-4446c5b614dc req-523dfc4c-1aad-4d15-bf1d-4dcd6acbd6f3 service nova] Acquired lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:37:48.233552 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-184513a4-9802-41a4-88fe-4446c5b614dc req-523dfc4c-1aad-4d15-bf1d-4dcd6acbd6f3 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Refreshing network info cache for port 34d50a64-6aed-47ee-ae9c-851a9fe0161b {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:37:48.577771 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:48.608300 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:48.702553 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:48.737188 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-184513a4-9802-41a4-88fe-4446c5b614dc req-523dfc4c-1aad-4d15-bf1d-4dcd6acbd6f3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:48.759721 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Took 0.58 seconds to detach 1 volumes for instance.
May 19 04:37:48.938365 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:48.941081 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:48.945886 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:48.973290 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:49.122425 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-184513a4-9802-41a4-88fe-4446c5b614dc req-523dfc4c-1aad-4d15-bf1d-4dcd6acbd6f3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:49.262822 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-184513a4-9802-41a4-88fe-4446c5b614dc req-523dfc4c-1aad-4d15-bf1d-4dcd6acbd6f3 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Updated VIF entry in instance network info cache for port 34d50a64-6aed-47ee-ae9c-851a9fe0161b. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:37:49.262822 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-184513a4-9802-41a4-88fe-4446c5b614dc req-523dfc4c-1aad-4d15-bf1d-4dcd6acbd6f3 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Updating instance_info_cache with network_info: [{"id": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "address": "fa:16:3e:74:c7:cf", "network": {"id": "274fbf5f-057a-48b4-8049-70f366638ce8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1968961134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d50a64-6a", "ovs_interfaceid": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "address": "fa:16:3e:ce:a6:b1", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5add6c4e-98", "ovs_interfaceid": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "address": "fa:16:3e:9b:1a:bc", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap856804f2-64", "ovs_interfaceid": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "address": "fa:16:3e:12:e9:10", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371fc2a1-78", "ovs_interfaceid": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "address": "fa:16:3e:97:55:fe", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e688b23-68", "ovs_interfaceid": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea620a14-2efe-4797-9ee1-c004ba488769", "address": "fa:16:3e:2d:30:c5", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea620a14-2e", "ovs_interfaceid": "ea620a14-2efe-4797-9ee1-c004ba488769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "address": "fa:16:3e:92:1a:3d", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fdb83aa-cd", "ovs_interfaceid": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:49.270726 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:49.270929 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:49.477736 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165469.4764519, f1a3ef6c-55da-4f79-8b87-720f44891fa4 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:49.477736 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] VM Started (Lifecycle Event)
May 19 04:37:49.563585 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:37:49.563958 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:37:49.764167 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-184513a4-9802-41a4-88fe-4446c5b614dc req-523dfc4c-1aad-4d15-bf1d-4dcd6acbd6f3 service nova] Releasing lock "refresh_cache-7859dfab-f702-4d0b-a9e9-bb856c5004e6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:37:49.979884 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:49.982443 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165469.9822383, f1a3ef6c-55da-4f79-8b87-720f44891fa4 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:49.982555 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] VM Paused (Lifecycle Event)
May 19 04:37:50.067338 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:37:50.484697 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:50.486357 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:37:50.573854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.303s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:50.649460 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Deleted allocations for instance 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c
May 19 04:37:50.704635 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:50.864067 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:37:50.988644 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:37:51.660588 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bd30097b-abe4-45fb-bd5d-e221ac86eff4 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.972s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:51.695823 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Acquiring lock "11a634a9-3bdd-4085-abc2-a0ad70710975" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:51.696315 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:51.779914 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:52.198552 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:37:52.747007 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:52.747496 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:52.750084 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:37:52.750245 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Claim successful on node np0000001025
May 19 04:37:52.858326 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2b404c86-a2b9-4a14-96f4-14b9b1955910 req-c07fc832-11f1-44a1-a09a-6a7aba20a0be service nova] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Received event network-vif-plugged-2a6f5abd-d702-471f-8f6c-8859237af4f9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:52.858672 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2b404c86-a2b9-4a14-96f4-14b9b1955910 req-c07fc832-11f1-44a1-a09a-6a7aba20a0be service nova] Acquiring lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:52.858672 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2b404c86-a2b9-4a14-96f4-14b9b1955910 req-c07fc832-11f1-44a1-a09a-6a7aba20a0be service nova] Lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:52.858813 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2b404c86-a2b9-4a14-96f4-14b9b1955910 req-c07fc832-11f1-44a1-a09a-6a7aba20a0be service nova] Lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:52.858877 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2b404c86-a2b9-4a14-96f4-14b9b1955910 req-c07fc832-11f1-44a1-a09a-6a7aba20a0be service nova] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Processing event network-vif-plugged-2a6f5abd-d702-471f-8f6c-8859237af4f9 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:37:52.859331 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:37:52.865690 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165472.8643498, f1a3ef6c-55da-4f79-8b87-720f44891fa4 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:52.865690 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] VM Resumed (Lifecycle Event)
May 19 04:37:52.867002 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:37:52.869124 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Instance spawned successfully.
May 19 04:37:52.869525 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:37:53.042908 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:53.369213 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:53.370633 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:37:53.378847 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:53.378968 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:53.379304 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:53.379582 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:53.379885 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:53.380180 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:37:53.876950 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:37:53.891472 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Took 11.17 seconds to spawn the instance on the hypervisor.
May 19 04:37:53.891610 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:54.020417 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:37:54.020690 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:37:54.406945 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Took 18.81 seconds to build instance.
May 19 04:37:54.513359 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "6cd7138c-f217-4858-8941-89693e62ae6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:54.513616 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "6cd7138c-f217-4858-8941-89693e62ae6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:54.526012 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:37:54.909332 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.317s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:54.956902 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0004592370000864321 future=<Future at 0x721853c718b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:54.957046 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:54.957205 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=5.5125412849999975 future=<Future at 0x721834305d00 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:54.957585 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=5.512157193999883 future=<Future at 0x721834305d00 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:54.960020 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Emitting event <LifecycleEvent: 1779165459.956329, 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:37:54.960020 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] VM Stopped (Lifecycle Event)
May 19 04:37:54.964476 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-60eb76d3-af52-4c9f-9919-b23b7099f90e req-4d3926a0-a7f6-4f59-81d8-abfced23344d service nova] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Received event network-vif-plugged-2a6f5abd-d702-471f-8f6c-8859237af4f9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:54.964638 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-60eb76d3-af52-4c9f-9919-b23b7099f90e req-4d3926a0-a7f6-4f59-81d8-abfced23344d service nova] Acquiring lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:54.964790 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-60eb76d3-af52-4c9f-9919-b23b7099f90e req-4d3926a0-a7f6-4f59-81d8-abfced23344d service nova] Lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:54.964907 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-60eb76d3-af52-4c9f-9919-b23b7099f90e req-4d3926a0-a7f6-4f59-81d8-abfced23344d service nova] Lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:54.965025 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-60eb76d3-af52-4c9f-9919-b23b7099f90e req-4d3926a0-a7f6-4f59-81d8-abfced23344d service nova] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] No waiting events found dispatching network-vif-plugged-2a6f5abd-d702-471f-8f6c-8859237af4f9 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:54.965152 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-60eb76d3-af52-4c9f-9919-b23b7099f90e req-4d3926a0-a7f6-4f59-81d8-abfced23344d service nova] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Received unexpected event network-vif-plugged-2a6f5abd-d702-471f-8f6c-8859237af4f9 for instance with vm_state active and task_state None.
May 19 04:37:55.018784 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:37:55.037960 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.291s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:55.038308 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:37:55.463100 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ff0d9992-1bbb-4026-807e-cc797e634a16 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 4866cabb-0595-4fe5-8be5-ebf4ed9c8f94] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:37:55.519843 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:55.554598 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:37:55.554934 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:37:55.555304 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:55.555644 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:55.589625 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:55.589854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:55.596660 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:37:55.596867 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Claim successful on node np0000001025
May 19 04:37:55.672265 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b98924a893b435ca15d660c63fbf024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2110bc6ddf24455ab91b4ba84e6170a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:37:55.706007 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:56.057005 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:37:56.230172 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Successfully created port: c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:37:56.416610 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Acquiring lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:56.416832 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:56.417034 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Acquiring lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:56.417207 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:56.417345 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:56.421971 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Terminating instance
May 19 04:37:56.560652 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:37:56.878808 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Successfully updated port: c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:37:56.926865 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:37:56.937289 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:37:56.937818 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:37:56.949179 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:56.952557 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:56.955102 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f80eaf70-8a5a-42c2-82d0-a30127aef6bc req-d9783f62-c44b-4532-a6f2-89ab29b8f07d service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Received event network-changed-c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:56.956126 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f80eaf70-8a5a-42c2-82d0-a30127aef6bc req-d9783f62-c44b-4532-a6f2-89ab29b8f07d service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Refreshing instance network info cache due to event network-changed-c20ef5b7-7e77-4061-980b-db836ec71eec. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:37:56.956405 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f80eaf70-8a5a-42c2-82d0-a30127aef6bc req-d9783f62-c44b-4532-a6f2-89ab29b8f07d service nova] Acquiring lock "refresh_cache-11a634a9-3bdd-4085-abc2-a0ad70710975" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:37:56.956572 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f80eaf70-8a5a-42c2-82d0-a30127aef6bc req-d9783f62-c44b-4532-a6f2-89ab29b8f07d service nova] Acquired lock "refresh_cache-11a634a9-3bdd-4085-abc2-a0ad70710975" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:37:56.956739 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-f80eaf70-8a5a-42c2-82d0-a30127aef6bc req-d9783f62-c44b-4532-a6f2-89ab29b8f07d service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Refreshing network info cache for port c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:37:56.974897 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:56.981116 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:57.005187 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:57.009058 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:57.072122 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Booting with volume 2a12d997-15f6-4776-89f7-965ae348fbb1 at /dev/vda
May 19 04:37:57.128609 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:37:57.142319 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:37:57.170882 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:37:57.218878 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:37:57.219068 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:37:57.231300 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5060e7c9-1178-4577-9da7-d6afa4712a4f req-de73747f-00c4-41b8-bd8f-397f4f354c6a service nova] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Received event network-vif-unplugged-2a6f5abd-d702-471f-8f6c-8859237af4f9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:57.232939 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5060e7c9-1178-4577-9da7-d6afa4712a4f req-de73747f-00c4-41b8-bd8f-397f4f354c6a service nova] Acquiring lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:57.233815 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5060e7c9-1178-4577-9da7-d6afa4712a4f req-de73747f-00c4-41b8-bd8f-397f4f354c6a service nova] Lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:57.234010 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5060e7c9-1178-4577-9da7-d6afa4712a4f req-de73747f-00c4-41b8-bd8f-397f4f354c6a service nova] Lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:57.234163 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5060e7c9-1178-4577-9da7-d6afa4712a4f req-de73747f-00c4-41b8-bd8f-397f4f354c6a service nova] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] No waiting events found dispatching network-vif-unplugged-2a6f5abd-d702-471f-8f6c-8859237af4f9 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:57.234307 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5060e7c9-1178-4577-9da7-d6afa4712a4f req-de73747f-00c4-41b8-bd8f-397f4f354c6a service nova] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Received event network-vif-unplugged-2a6f5abd-d702-471f-8f6c-8859237af4f9 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:57.236190 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:37:57.237620 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe74:c7cf', 'fe80::a4bd:88ff:fe8b:8059', 'fe80::fc16:3eff:fece:a6b1', 'fe80::fc16:3eff:fe9b:1abc', 'fe80::fc16:3eff:fe12:e910', 'fe80::fc16:3eff:fe97:55fe', 'fe80::fc16:3eff:fe2d:30c5', 'fe80::fc16:3eff:fe92:1a3d', 'fe80::48e9:e3ff:feb8:fbb', 'fe80::f00a:eeff:fee5:407b'] 
May 19 04:37:57.238015 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:37:57.238248 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:37:57.238592 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:37:57.241312 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Updating existing volume attachment record: b9308172-64da-42b0-9eb6-451f767d5270 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:37:57.260263 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999648968999963 future=<Future at 0x721834335430 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:37:57.261215 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Instance destroyed successfully.
May 19 04:37:57.262063 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lazy-loading 'resources' on Instance uuid f1a3ef6c-55da-4f79-8b87-720f44891fa4 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:37:57.384459 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Acquiring lock "refresh_cache-11a634a9-3bdd-4085-abc2-a0ad70710975" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:37:57.442337 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:37:57.459802 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-f80eaf70-8a5a-42c2-82d0-a30127aef6bc req-d9783f62-c44b-4532-a6f2-89ab29b8f07d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:57.531329 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-f80eaf70-8a5a-42c2-82d0-a30127aef6bc req-d9783f62-c44b-4532-a6f2-89ab29b8f07d service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:37:57.700229 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-f80eaf70-8a5a-42c2-82d0-a30127aef6bc req-d9783f62-c44b-4532-a6f2-89ab29b8f07d service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:57.743686 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:57.743856 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:57.765508 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-372332817',display_name='tempest-VolumesActionsTest-instance-372332817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesactionstest-instance-372332817',id=21,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:37:53Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b413d7fd7b148adaa3e2c41bfa30252',ramdisk_id='',reservation_id='r-n3uhsnb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2133751040',owner_user_name='tempest-VolumesActionsTest-2133751040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:37:54Z,user_data=None,user_id='12a42fd27b7040b3964b46f5455691c6',uuid=f1a3ef6c-55da-4f79-8b87-720f44891fa4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a6f5abd-d702-471f-8f6c-8859237af4f9", "address": "fa:16:3e:93:c3:46", "network": {"id": "fbca82d5-40ca-4591-992b-dd555b5fef8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919658386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b413d7fd7b148adaa3e2c41bfa30252", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a6f5abd-d7", "ovs_interfaceid": "2a6f5abd-d702-471f-8f6c-8859237af4f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:37:57.765769 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Converting VIF {"id": "2a6f5abd-d702-471f-8f6c-8859237af4f9", "address": "fa:16:3e:93:c3:46", "network": {"id": "fbca82d5-40ca-4591-992b-dd555b5fef8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919658386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b413d7fd7b148adaa3e2c41bfa30252", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a6f5abd-d7", "ovs_interfaceid": "2a6f5abd-d702-471f-8f6c-8859237af4f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:37:57.766513 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:c3:46,bridge_name='br-int',has_traffic_filtering=True,id=2a6f5abd-d702-471f-8f6c-8859237af4f9,network=Network(fbca82d5-40ca-4591-992b-dd555b5fef8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a6f5abd-d7') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:37:57.766753 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:c3:46,bridge_name='br-int',has_traffic_filtering=True,id=2a6f5abd-d702-471f-8f6c-8859237af4f9,network=Network(fbca82d5-40ca-4591-992b-dd555b5fef8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a6f5abd-d7') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:37:57.768968 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:57.769368 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a6f5abd-d7, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:57.771607 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:57.773096 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:57.773975 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:57.774202 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa30fb9c-5cef-4001-838f-4a6ebe80a5f8) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:37:57.777611 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:37:57.781724 np0000001025 nova-compute[97981]: INFO os_vif [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:c3:46,bridge_name='br-int',has_traffic_filtering=True,id=2a6f5abd-d702-471f-8f6c-8859237af4f9,network=Network(fbca82d5-40ca-4591-992b-dd555b5fef8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a6f5abd-d7')
May 19 04:37:57.782081 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Deleting instance files /opt/stack/data/nova/instances/f1a3ef6c-55da-4f79-8b87-720f44891fa4_del
May 19 04:37:57.782833 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Deletion of /opt/stack/data/nova/instances/f1a3ef6c-55da-4f79-8b87-720f44891fa4_del complete
May 19 04:37:57.949886 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.360s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:57.950482 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:37:58.045154 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:37:58.202596 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f80eaf70-8a5a-42c2-82d0-a30127aef6bc req-d9783f62-c44b-4532-a6f2-89ab29b8f07d service nova] Releasing lock "refresh_cache-11a634a9-3bdd-4085-abc2-a0ad70710975" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:37:58.203489 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Acquired lock "refresh_cache-11a634a9-3bdd-4085-abc2-a0ad70710975" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:37:58.203489 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:37:58.245375 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:37:58.292657 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Took 1.37 seconds to destroy the instance on the hypervisor.
May 19 04:37:58.293386 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:37:58.293920 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:37:58.294044 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:37:58.294297 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:58.377982 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:58.456797 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:37:58.457516 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:37:58.458579 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:58.458579 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:58.574603 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6374f2e55af946f9abf35d0c8a1cd206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d55ae51114828ba5ad8c0ac87ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:37:58.701971 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-56853f3a-4a03-4f2f-8803-71df8018e396 req-d59fea71-1f69-4dae-afc5-9c0e3e19536e service nova] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Received event network-vif-deleted-2a6f5abd-d702-471f-8f6c-8859237af4f9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:58.702453 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-56853f3a-4a03-4f2f-8803-71df8018e396 req-d59fea71-1f69-4dae-afc5-9c0e3e19536e service nova] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Neutron deleted interface 2a6f5abd-d702-471f-8f6c-8859237af4f9; detaching it from the instance and deleting it from the info cache
May 19 04:37:58.702567 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-56853f3a-4a03-4f2f-8803-71df8018e396 req-d59fea71-1f69-4dae-afc5-9c0e3e19536e service nova] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:58.788131 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:37:58.816991 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:58.817215 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:58.820437 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:37:58.820588 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Claim successful on node np0000001025
May 19 04:37:58.961041 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:37:58.963594 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:37:59.104504 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:59.105596 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:59.122018 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Successfully created port: 919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:37:59.136705 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:59.164878 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Updating instance_info_cache with network_info: [{"id": "c20ef5b7-7e77-4061-980b-db836ec71eec", "address": "fa:16:3e:6d:b2:6e", "network": {"id": "9bde70f2-7770-457c-8b6b-364b5adcf4fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1641494804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2110bc6ddf24455ab91b4ba84e6170a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20ef5b7-7e", "ovs_interfaceid": "c20ef5b7-7e77-4061-980b-db836ec71eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:37:59.205690 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-56853f3a-4a03-4f2f-8803-71df8018e396 req-d59fea71-1f69-4dae-afc5-9c0e3e19536e service nova] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Detach interface failed, port_id=2a6f5abd-d702-471f-8f6c-8859237af4f9, reason: Instance f1a3ef6c-55da-4f79-8b87-720f44891fa4 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:37:59.292152 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6bbcc680-376a-493b-acbb-a780b016066a req-08395c59-775c-414c-bf56-6042ef86e44f service nova] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Received event network-vif-unplugged-2a6f5abd-d702-471f-8f6c-8859237af4f9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:37:59.292334 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6bbcc680-376a-493b-acbb-a780b016066a req-08395c59-775c-414c-bf56-6042ef86e44f service nova] Acquiring lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:59.292518 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6bbcc680-376a-493b-acbb-a780b016066a req-08395c59-775c-414c-bf56-6042ef86e44f service nova] Lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:59.292574 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6bbcc680-376a-493b-acbb-a780b016066a req-08395c59-775c-414c-bf56-6042ef86e44f service nova] Lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:59.292728 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6bbcc680-376a-493b-acbb-a780b016066a req-08395c59-775c-414c-bf56-6042ef86e44f service nova] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] No waiting events found dispatching network-vif-unplugged-2a6f5abd-d702-471f-8f6c-8859237af4f9 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:37:59.292794 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6bbcc680-376a-493b-acbb-a780b016066a req-08395c59-775c-414c-bf56-6042ef86e44f service nova] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Received event network-vif-unplugged-2a6f5abd-d702-471f-8f6c-8859237af4f9 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:37:59.348598 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:37:59.349597 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:37:59.349852 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Creating image(s)
May 19 04:37:59.350227 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:37:59.350374 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Ensure instance console log exists: /opt/stack/data/nova/instances/11a634a9-3bdd-4085-abc2-a0ad70710975/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:37:59.350905 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:37:59.351116 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:37:59.351354 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:37:59.466852 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:37:59.606625 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:37:59.634311 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Successfully updated port: 919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:37:59.641991 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Took 1.35 seconds to deallocate network for instance.
May 19 04:37:59.667685 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Releasing lock "refresh_cache-11a634a9-3bdd-4085-abc2-a0ad70710975" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:37:59.667936 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Instance network_info: |[{"id": "c20ef5b7-7e77-4061-980b-db836ec71eec", "address": "fa:16:3e:6d:b2:6e", "network": {"id": "9bde70f2-7770-457c-8b6b-364b5adcf4fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1641494804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2110bc6ddf24455ab91b4ba84e6170a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20ef5b7-7e", "ovs_interfaceid": "c20ef5b7-7e77-4061-980b-db836ec71eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:37:59.668515 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Start _get_guest_xml network_info=[{"id": "c20ef5b7-7e77-4061-980b-db836ec71eec", "address": "fa:16:3e:6d:b2:6e", "network": {"id": "9bde70f2-7770-457c-8b6b-364b5adcf4fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1641494804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2110bc6ddf24455ab91b4ba84e6170a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20ef5b7-7e", "ovs_interfaceid": "c20ef5b7-7e77-4061-980b-db836ec71eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'b9308172-64da-42b0-9eb6-451f767d5270', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a12d997-15f6-4776-89f7-965ae348fbb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '11a634a9-3bdd-4085-abc2-a0ad70710975', 'attached_at': '', 'detached_at': '', 'volume_id': '2a12d997-15f6-4776-89f7-965ae348fbb1', 'serial': '2a12d997-15f6-4776-89f7-965ae348fbb1'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:37:59.674327 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:37:59.674962 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-261623189', uuid='11a634a9-3bdd-4085-abc2-a0ad70710975'), owner=OwnerMeta(userid='2b98924a893b435ca15d660c63fbf024', username='tempest-ServerActionsV293TestJSON-1582643744-project-member', projectid='e2110bc6ddf24455ab91b4ba84e6170a', projectname='tempest-ServerActionsV293TestJSON-1582643744'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c20ef5b7-7e77-4061-980b-db836ec71eec", "address": "fa:16:3e:6d:b2:6e", "network": {"id": "9bde70f2-7770-457c-8b6b-364b5adcf4fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1641494804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2110bc6ddf24455ab91b4ba84e6170a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20ef5b7-7e", "ovs_interfaceid": "c20ef5b7-7e77-4061-980b-db836ec71eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165479.6742735) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:37:59.676270 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:37:59.676580 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:37:59.677921 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:37:59.677921 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:37:59.678710 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:37:59.678951 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:37:59.679120 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:37:59.679228 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:37:59.679337 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:37:59.679415 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:37:59.679505 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:37:59.679657 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:37:59.679764 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:37:59.679867 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:37:59.679965 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:37:59.680101 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:37:59.695478 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:37:59.695823 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a12d997-15f6-4776-89f7-965ae348fbb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:37:59.696018 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:37:59.696540 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:37:59.696794 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a12d997-15f6-4776-89f7-965ae348fbb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:37:59.712765 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:37:59.713242 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:37:59.713824 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:37:59.714081 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:37:59.714513 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:37:59.714715 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:37:59.727138 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:37:59.727138 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:59.731131 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:37:59.731131 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:59.740457 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1] added
May 19 04:37:59.740457 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:37:59.740457 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:37:59.740457 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:37:59.740457 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:37:59.740457 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:37:59.740457 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:59.740798 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:37:59.740922 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0261(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:37:59.741071 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:37:59.745704 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1] added
May 19 04:37:59.745704 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:37:59.745704 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:37:59.745704 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:37:59.745704 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:37:59.745704 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:37:59.745704 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:37:59.745917 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:37:59.745983 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.032(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:37:59.746124 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:38:00.137027 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "refresh_cache-6cd7138c-f217-4858-8941-89693e62ae6e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:38:00.137207 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquired lock "refresh_cache-6cd7138c-f217-4858-8941-89693e62ae6e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:38:00.137341 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:38:00.153969 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:00.161602 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:00.214101 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:38:00.214449 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:38:00.470215 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00038268900016191765 future=<Future at 0x721834305d00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:38:00.470693 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Emitting event <LifecycleEvent: 1779165465.469682, 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:38:00.470891 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:38:00.471159 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] VM Stopped (Lifecycle Event)
May 19 04:38:00.472291 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=11.787588817999904 future=<Future at 0x721834335430 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:38:00.472401 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=11.787451801000088 future=<Future at 0x721834335430 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:38:00.477691 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:38:00.479867 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:38:00.480164 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Creating image(s)
May 19 04:38:00.481310 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "/opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:00.481523 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "/opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:00.482036 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "/opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:00.482797 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:38:00.491558 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:38:00.492821 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:00.575187 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.082s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:00.575774 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:00.576460 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:00.577836 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:38:00.581878 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:38:00.582099 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:00.663004 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.080s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:00.663557 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:00.716379 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk 1073741824" returned: 0 in 0.052s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:00.718495 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:38:00.724008 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.142s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:00.724554 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:00.742463 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:38:00.748207 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:38:00.754723 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:38:00.760398 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:38:00.760398 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:38:00.773639 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:38:00.773639 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:00.777665 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-82da76dd-286e-41e0-8628-19b2067f88a8 req-3ebcd7b6-5d84-4253-b701-6e3cfb91fccd service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Received event network-changed-919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:00.777665 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-82da76dd-286e-41e0-8628-19b2067f88a8 req-3ebcd7b6-5d84-4253-b701-6e3cfb91fccd service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Refreshing instance network info cache due to event network-changed-919ea210-38da-46cf-9d56-5cbcf6a822a6. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:38:00.777665 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-82da76dd-286e-41e0-8628-19b2067f88a8 req-3ebcd7b6-5d84-4253-b701-6e3cfb91fccd service nova] Acquiring lock "refresh_cache-6cd7138c-f217-4858-8941-89693e62ae6e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:38:00.778403 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:00.795469 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:00.803417 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:00.803417 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:00.803417 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:00.803417 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:00.803417 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:00.803417 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:00.803417 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:38:00.803756 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:00.803756 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:00.803756 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:00.803756 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:00.803756 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:00.803756 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:00.803756 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:38:00.815474 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:00.815474 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:00.815474 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:00.815474 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:00.815474 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:00.815474 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:00.815474 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:38:00.815727 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:00.815727 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:00.815727 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:00.815727 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:00.815727 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:00.815727 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:00.815727 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:38:00.839355 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.114s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:00.839921 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:38:00.839982 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:00.857237 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1, portal: 192.168.50.100,3260]
May 19 04:38:00.857237 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1, portal: 192.168.50.100,3260] successful.
May 19 04:38:00.857237 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:00.863886 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1, portal: 192.168.40.100,3260]
May 19 04:38:00.863886 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1, portal: 192.168.40.100,3260] successful.
May 19 04:38:00.863886 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:00.872706 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:00.881954 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:00.894343 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:00.894343 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:00.894343 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:00.894343 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:00.894343 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:00.894343 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:00.894343 np0000001025 nova-compute[97981]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:00.894343 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:00.894343 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:38:00.894699 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:00.894699 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:00.894699 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:00.894699 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:00.894699 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:00.894699 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:00.894699 np0000001025 nova-compute[97981]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:00.894699 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:00.894699 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:38:00.896931 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:38:00.897066 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:38:00.897978 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] HCTL ('7', '-', '-', 0) found on session 43 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:38:00.898344 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:38:00.903527 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:00.903527 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:00.903527 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:00.903527 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:00.903527 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:00.903527 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:00.903527 np0000001025 nova-compute[97981]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:00.903527 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:00.903527 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:38:00.903864 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:00.903864 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:00.903864 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:00.903864 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:00.903864 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:00.903864 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:00.903864 np0000001025 nova-compute[97981]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:00.903864 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:00.903864 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:38:00.904066 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:38:00.904275 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:38:00.905385 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] HCTL ('8', '-', '-', 0) found on session 44 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:38:00.905511 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:38:00.923737 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Searching for a device in session 43 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:38:00.923737 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2a12d997-15f6-4776-89f7-965ae348fbb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:38:00.928908 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Searching for a device in session 44 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:38:00.928908 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a12d997-15f6-4776-89f7-965ae348fbb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:38:00.929596 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:00.930203 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Cannot resize image /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:38:00.931284 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:38:00.931284 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Ensure instance console log exists: /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:38:00.931284 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:00.931558 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:00.931729 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:00.947361 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:00.974543 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 0bf0fc2b-0f2c-4c99-8c94-1b6aeda9619c] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:01.128733 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Updating instance_info_cache with network_info: [{"id": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "address": "fa:16:3e:8e:26:b9", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ea210-38", "ovs_interfaceid": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:38:01.204599 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-049bf1c9-8f9c-46ec-b40b-0982036b3c48 req-cb258020-7442-434d-b63a-7c215189d901 service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Received event network-vif-unplugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:01.204811 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-049bf1c9-8f9c-46ec-b40b-0982036b3c48 req-cb258020-7442-434d-b63a-7c215189d901 service nova] Acquiring lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:01.204973 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-049bf1c9-8f9c-46ec-b40b-0982036b3c48 req-cb258020-7442-434d-b63a-7c215189d901 service nova] Lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:01.205156 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-049bf1c9-8f9c-46ec-b40b-0982036b3c48 req-cb258020-7442-434d-b63a-7c215189d901 service nova] Lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:01.205391 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-049bf1c9-8f9c-46ec-b40b-0982036b3c48 req-cb258020-7442-434d-b63a-7c215189d901 service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] No waiting events found dispatching network-vif-unplugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:38:01.205532 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-049bf1c9-8f9c-46ec-b40b-0982036b3c48 req-cb258020-7442-434d-b63a-7c215189d901 service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Received unexpected event network-vif-unplugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 for instance with vm_state building and task_state spawning.
May 19 04:38:01.240138 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.423s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:01.240836 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:38:01.243412 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.089s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:01.607969 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:38:01.608233 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:38:01.631581 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Releasing lock "refresh_cache-6cd7138c-f217-4858-8941-89693e62ae6e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:38:01.631853 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Instance network_info: |[{"id": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "address": "fa:16:3e:8e:26:b9", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ea210-38", "ovs_interfaceid": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:38:01.632300 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-82da76dd-286e-41e0-8628-19b2067f88a8 req-3ebcd7b6-5d84-4253-b701-6e3cfb91fccd service nova] Acquired lock "refresh_cache-6cd7138c-f217-4858-8941-89693e62ae6e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:38:01.632424 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-82da76dd-286e-41e0-8628-19b2067f88a8 req-3ebcd7b6-5d84-4253-b701-6e3cfb91fccd service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Refreshing network info cache for port 919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:38:01.634386 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Start _get_guest_xml network_info=[{"id": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "address": "fa:16:3e:8e:26:b9", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ea210-38", "ovs_interfaceid": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:38:01.636281 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:38:01.637400 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-tempest.common.compute-instance-780352072', uuid='6cd7138c-f217-4858-8941-89693e62ae6e'), owner=OwnerMeta(userid='6374f2e55af946f9abf35d0c8a1cd206', username='tempest-ServerActionsTestOtherA-281327203-project-member', projectid='336d55ae51114828ba5ad8c0ac87ca9b', projectname='tempest-ServerActionsTestOtherA-281327203'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "address": "fa:16:3e:8e:26:b9", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ea210-38", "ovs_interfaceid": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165481.6370652) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:38:01.638726 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:38:01.639260 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:38:01.639869 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:38:01.640035 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:38:01.640905 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:38:01.641228 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:38:01.641357 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:38:01.641457 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:38:01.641584 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:38:01.642028 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:38:01.642293 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:38:01.642531 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:38:01.642693 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:38:01.642959 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:38:01.643187 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:38:01.643371 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:38:01.654964 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:37:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-780352072',display_name='tempest-tempest.common.compute-instance-780352072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-tempest-common-compute-instance-780352072',id=23,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWjOIOVsMyvCxHSFbUg/KisSEpUltBBUDn7k40MoaIFEqu0hiq0xGxCl65mWduVoYJ4X6DBai5dMDbW4PlxibjrzT90yPIjDM/NptUDmKdJDlF8xak6SVAX4dfbERZ5hw==',key_name='tempest-keypair-1176894162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='336d55ae51114828ba5ad8c0ac87ca9b',ramdisk_id='',reservation_id='r-roxanvg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-281327203',owner_user_name='tempest-ServerActionsTestOtherA-281327203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:38:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6374f2e55af946f9abf35d0c8a1cd206',uuid=6cd7138c-f217-4858-8941-89693e62ae6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "address": "fa:16:3e:8e:26:b9", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ea210-38", "ovs_interfaceid": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:38:01.655321 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converting VIF {"id": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "address": "fa:16:3e:8e:26:b9", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ea210-38", "ovs_interfaceid": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:38:01.656067 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:26:b9,bridge_name='br-int',has_traffic_filtering=True,id=919ea210-38da-46cf-9d56-5cbcf6a822a6,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919ea210-38') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:38:01.656767 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lazy-loading 'pci_devices' on Instance uuid 6cd7138c-f217-4858-8941-89693e62ae6e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:38:01.714960 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:38:01.746697 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:38:01.747086 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:38:01.747577 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:01.747774 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:01.814933 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c46088fb3e74b819bb456461716a801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b3c0fa8f894ed2a7c3bcfac99ce74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:38:02.110921 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:38:02.136302 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-82da76dd-286e-41e0-8628-19b2067f88a8 req-3ebcd7b6-5d84-4253-b701-6e3cfb91fccd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:02.162295 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] End _get_guest_xml xml=<domain type="qemu">
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:   <uuid>6cd7138c-f217-4858-8941-89693e62ae6e</uuid>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:   <name>instance-00000017</name>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <nova:name>tempest-tempest.common.compute-instance-780352072</nova:name>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:38:01</nova:creationTime>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:         <nova:user uuid="6374f2e55af946f9abf35d0c8a1cd206">tempest-ServerActionsTestOtherA-281327203-project-member</nova:user>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:         <nova:project uuid="336d55ae51114828ba5ad8c0ac87ca9b">tempest-ServerActionsTestOtherA-281327203</nova:project>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:         <nova:port uuid="919ea210-38da-46cf-9d56-5cbcf6a822a6">
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     <system>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <entry name="serial">6cd7138c-f217-4858-8941-89693e62ae6e</entry>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <entry name="uuid">6cd7138c-f217-4858-8941-89693e62ae6e</entry>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     </system>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:   <os>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:   </os>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:   <features>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:   </features>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:   <devices>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk"/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     </disk>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk.config"/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     </disk>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:8e:26:b9"/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <target dev="tap919ea210-38"/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     </interface>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/console.log" append="off"/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     </serial>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     <video>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     </video>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     </rng>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:   </devices>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]: </domain>
May 19 04:38:02.162295 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:38:02.164150 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Preparing to wait for external event network-vif-plugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:38:02.164150 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:02.164150 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:02.164150 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:02.164150 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:37:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-780352072',display_name='tempest-tempest.common.compute-instance-780352072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-tempest-common-compute-instance-780352072',id=23,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWjOIOVsMyvCxHSFbUg/KisSEpUltBBUDn7k40MoaIFEqu0hiq0xGxCl65mWduVoYJ4X6DBai5dMDbW4PlxibjrzT90yPIjDM/NptUDmKdJDlF8xak6SVAX4dfbERZ5hw==',key_name='tempest-keypair-1176894162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='336d55ae51114828ba5ad8c0ac87ca9b',ramdisk_id='',reservation_id='r-roxanvg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-281327203',owner_user_name='tempest-ServerActionsTestOtherA-281327203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:38:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6374f2e55af946f9abf35d0c8a1cd206',uuid=6cd7138c-f217-4858-8941-89693e62ae6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "address": "fa:16:3e:8e:26:b9", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ea210-38", "ovs_interfaceid": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:38:02.168583 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converting VIF {"id": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "address": "fa:16:3e:8e:26:b9", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ea210-38", "ovs_interfaceid": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:38:02.169882 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:26:b9,bridge_name='br-int',has_traffic_filtering=True,id=919ea210-38da-46cf-9d56-5cbcf6a822a6,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919ea210-38') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:38:02.170253 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:26:b9,bridge_name='br-int',has_traffic_filtering=True,id=919ea210-38da-46cf-9d56-5cbcf6a822a6,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919ea210-38') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:38:02.171072 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:02.171373 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:02.171628 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:38:02.175803 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:02.175803 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f46a1fd6-7cae-508c-8a15-eef20b4ca714', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:02.175803 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:02.176228 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:02.179549 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:02.190774 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:02.191004 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap919ea210-38, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:02.191434 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap919ea210-38, col_values=(('qos', UUID('182aeebe-47e9-4c94-bfb7-ed2acb9b2630')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:02.192779 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap919ea210-38, col_values=(('external_ids', {'iface-id': '919ea210-38da-46cf-9d56-5cbcf6a822a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:26:b9', 'vm-uuid': '6cd7138c-f217-4858-8941-89693e62ae6e'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:02.192779 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:02.193643 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:02.198574 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:02.200259 np0000001025 nova-compute[97981]: INFO os_vif [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:26:b9,bridge_name='br-int',has_traffic_filtering=True,id=919ea210-38da-46cf-9d56-5cbcf6a822a6,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919ea210-38')
May 19 04:38:02.251436 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:38:02.463663 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-82da76dd-286e-41e0-8628-19b2067f88a8 req-3ebcd7b6-5d84-4253-b701-6e3cfb91fccd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:02.599820 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-82da76dd-286e-41e0-8628-19b2067f88a8 req-3ebcd7b6-5d84-4253-b701-6e3cfb91fccd service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Updated VIF entry in instance network info cache for port 919ea210-38da-46cf-9d56-5cbcf6a822a6. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:38:02.600209 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-82da76dd-286e-41e0-8628-19b2067f88a8 req-3ebcd7b6-5d84-4253-b701-6e3cfb91fccd service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Updating instance_info_cache with network_info: [{"id": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "address": "fa:16:3e:8e:26:b9", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ea210-38", "ovs_interfaceid": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:38:02.617086 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.374s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:02.620426 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.459s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:02.623899 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:38:02.623899 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Claim successful on node np0000001025
May 19 04:38:02.689246 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Deleted allocations for instance f1a3ef6c-55da-4f79-8b87-720f44891fa4
May 19 04:38:02.736531 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Found WWN 330000000ea42bea5 for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:38:02.736858 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:38:02.737162 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '330000000ea42bea5', 'path': '/dev/dm-0', 'multipath_id': '330000000ea42bea5'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:38:02.737333 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ea42bea5', 'path': '/dev/dm-0', 'multipath_id': '330000000ea42bea5'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:38:02.756829 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:38:02.865137 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Successfully created port: 7a1337f5-a743-48fe-97e4-3ace03005016 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:38:03.047519 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:03.102384 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-82da76dd-286e-41e0-8628-19b2067f88a8 req-3ebcd7b6-5d84-4253-b701-6e3cfb91fccd service nova] Releasing lock "refresh_cache-6cd7138c-f217-4858-8941-89693e62ae6e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:38:03.246449 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-261623189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serveractionsv293testjson-server-261623189',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFEE7MfVouu9pqjSZuefRPAqoz2KwFtdLVyP66SNkY10e8a8acmINjhhjRaCSrP+4JYHVyxJ7DR6qdX1Kgex1JRulJwwAy9kC1zv4B6aG+7K383hOjahrwa67Ca8VXO3A==',key_name='tempest-keypair-1684840035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2110bc6ddf24455ab91b4ba84e6170a',ramdisk_id='',reservation_id='r-6q1ykbfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1582643744',owner_user_name='tempest-ServerActionsV293TestJSON-1582643744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:37:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b98924a893b435ca15d660c63fbf024',uuid=11a634a9-3bdd-4085-abc2-a0ad70710975,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c20ef5b7-7e77-4061-980b-db836ec71eec", "address": "fa:16:3e:6d:b2:6e", "network": {"id": "9bde70f2-7770-457c-8b6b-364b5adcf4fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1641494804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2110bc6ddf24455ab91b4ba84e6170a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20ef5b7-7e", "ovs_interfaceid": "c20ef5b7-7e77-4061-980b-db836ec71eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:38:03.246771 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Converting VIF {"id": "c20ef5b7-7e77-4061-980b-db836ec71eec", "address": "fa:16:3e:6d:b2:6e", "network": {"id": "9bde70f2-7770-457c-8b6b-364b5adcf4fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1641494804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2110bc6ddf24455ab91b4ba84e6170a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20ef5b7-7e", "ovs_interfaceid": "c20ef5b7-7e77-4061-980b-db836ec71eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:38:03.247537 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=c20ef5b7-7e77-4061-980b-db836ec71eec,network=Network(9bde70f2-7770-457c-8b6b-364b5adcf4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20ef5b7-7e') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:38:03.248529 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lazy-loading 'pci_devices' on Instance uuid 11a634a9-3bdd-4085-abc2-a0ad70710975 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:38:03.262374 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Booting with volume df1fb2f1-04f8-4ec6-ba79-00a835271b79 at /dev/vda
May 19 04:38:03.313525 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:38:03.327148 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:38:03.351436 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:03.386733 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:38:03.387159 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:38:03.396135 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:38:03.397593 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe74:c7cf', 'fe80::a4bd:88ff:fe8b:8059', 'fe80::fc16:3eff:fece:a6b1', 'fe80::fc16:3eff:fe9b:1abc', 'fe80::fc16:3eff:fe12:e910', 'fe80::fc16:3eff:fe97:55fe', 'fe80::fc16:3eff:fe2d:30c5', 'fe80::fc16:3eff:fe92:1a3d', 'fe80::48e9:e3ff:feb8:fbb', 'fe80::f00a:eeff:fee5:407b'] 
May 19 04:38:03.397808 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:38:03.398038 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:38:03.398388 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:38:03.398704 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Updating existing volume attachment record: 59d5e2cd-a5c8-40e9-be82-a7d2481f5efb {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:38:03.499077 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Successfully updated port: 7a1337f5-a743-48fe-97e4-3ace03005016 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:38:03.549799 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3e0acb5d-a769-48aa-8087-0cf15fcc541c req-950c1e3e-f1e6-4f8a-8037-6cb8d77d8f07 service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Received event network-changed-7a1337f5-a743-48fe-97e4-3ace03005016 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:03.550021 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3e0acb5d-a769-48aa-8087-0cf15fcc541c req-950c1e3e-f1e6-4f8a-8037-6cb8d77d8f07 service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Refreshing instance network info cache due to event network-changed-7a1337f5-a743-48fe-97e4-3ace03005016. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:38:03.551457 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3e0acb5d-a769-48aa-8087-0cf15fcc541c req-950c1e3e-f1e6-4f8a-8037-6cb8d77d8f07 service nova] Acquiring lock "refresh_cache-346344d1-df0a-4fd8-9396-b5fde8cf53d1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:38:03.551597 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3e0acb5d-a769-48aa-8087-0cf15fcc541c req-950c1e3e-f1e6-4f8a-8037-6cb8d77d8f07 service nova] Acquired lock "refresh_cache-346344d1-df0a-4fd8-9396-b5fde8cf53d1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:38:03.551750 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3e0acb5d-a769-48aa-8087-0cf15fcc541c req-950c1e3e-f1e6-4f8a-8037-6cb8d77d8f07 service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Refreshing network info cache for port 7a1337f5-a743-48fe-97e4-3ace03005016 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:38:03.700609 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c691fd7-3a1b-4429-9b2f-77b62c900123 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "f1a3ef6c-55da-4f79-8b87-720f44891fa4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.284s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:03.721750 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:38:03.721896 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:38:03.722044 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] No VIF found with MAC fa:16:3e:8e:26:b9, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:38:03.722540 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Using config drive
May 19 04:38:03.757891 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] End _get_guest_xml xml=<domain type="qemu">
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:   <uuid>11a634a9-3bdd-4085-abc2-a0ad70710975</uuid>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:   <name>instance-00000016</name>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServerActionsV293TestJSON-server-261623189</nova:name>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:37:59</nova:creationTime>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:         <nova:user uuid="2b98924a893b435ca15d660c63fbf024">tempest-ServerActionsV293TestJSON-1582643744-project-member</nova:user>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:         <nova:project uuid="e2110bc6ddf24455ab91b4ba84e6170a">tempest-ServerActionsV293TestJSON-1582643744</nova:project>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:         <nova:port uuid="c20ef5b7-7e77-4061-980b-db836ec71eec">
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     <system>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <entry name="serial">11a634a9-3bdd-4085-abc2-a0ad70710975</entry>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <entry name="uuid">11a634a9-3bdd-4085-abc2-a0ad70710975</entry>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     </system>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:   <os>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:   </os>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:   <features>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:   </features>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:   <devices>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/11a634a9-3bdd-4085-abc2-a0ad70710975/disk.config"/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     </disk>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <alias name="ua-2a12d997-15f6-4776-89f7-965ae348fbb1"/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-0"/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <serial>2a12d997-15f6-4776-89f7-965ae348fbb1</serial>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     </disk>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:6d:b2:6e"/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <target dev="tapc20ef5b7-7e"/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     </interface>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/11a634a9-3bdd-4085-abc2-a0ad70710975/console.log" append="off"/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     </serial>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     <video>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     </video>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     </rng>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:   </devices>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]: </domain>
May 19 04:38:03.757891 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:38:03.759984 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Preparing to wait for external event network-vif-plugged-c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:38:03.759984 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Acquiring lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:03.759984 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:03.759984 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:03.761722 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-261623189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serveractionsv293testjson-server-261623189',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFEE7MfVouu9pqjSZuefRPAqoz2KwFtdLVyP66SNkY10e8a8acmINjhhjRaCSrP+4JYHVyxJ7DR6qdX1Kgex1JRulJwwAy9kC1zv4B6aG+7K383hOjahrwa67Ca8VXO3A==',key_name='tempest-keypair-1684840035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2110bc6ddf24455ab91b4ba84e6170a',ramdisk_id='',reservation_id='r-6q1ykbfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1582643744',owner_user_name='tempest-ServerActionsV293TestJSON-1582643744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:37:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b98924a893b435ca15d660c63fbf024',uuid=11a634a9-3bdd-4085-abc2-a0ad70710975,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c20ef5b7-7e77-4061-980b-db836ec71eec", "address": "fa:16:3e:6d:b2:6e", "network": {"id": "9bde70f2-7770-457c-8b6b-364b5adcf4fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1641494804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2110bc6ddf24455ab91b4ba84e6170a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20ef5b7-7e", "ovs_interfaceid": "c20ef5b7-7e77-4061-980b-db836ec71eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:38:03.761957 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Converting VIF {"id": "c20ef5b7-7e77-4061-980b-db836ec71eec", "address": "fa:16:3e:6d:b2:6e", "network": {"id": "9bde70f2-7770-457c-8b6b-364b5adcf4fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1641494804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2110bc6ddf24455ab91b4ba84e6170a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20ef5b7-7e", "ovs_interfaceid": "c20ef5b7-7e77-4061-980b-db836ec71eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:38:03.762534 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=c20ef5b7-7e77-4061-980b-db836ec71eec,network=Network(9bde70f2-7770-457c-8b6b-364b5adcf4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20ef5b7-7e') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:38:03.762786 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=c20ef5b7-7e77-4061-980b-db836ec71eec,network=Network(9bde70f2-7770-457c-8b6b-364b5adcf4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20ef5b7-7e') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:38:03.763274 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:03.763722 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:03.764020 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:38:03.764963 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:03.765182 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f1affce-4bbc-5e25-bf3f-b9d6b8adbf1f', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:03.774655 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:03.775590 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:03.780353 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:03.785071 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:03.785273 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc20ef5b7-7e, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:03.785606 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc20ef5b7-7e, col_values=(('qos', UUID('f3d52624-a6f2-4ca7-84e2-758f31d90978')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:03.785785 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc20ef5b7-7e, col_values=(('external_ids', {'iface-id': 'c20ef5b7-7e77-4061-980b-db836ec71eec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:b2:6e', 'vm-uuid': '11a634a9-3bdd-4085-abc2-a0ad70710975'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:03.786703 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:03.787801 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:03.799291 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:03.800496 np0000001025 nova-compute[97981]: INFO os_vif [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=c20ef5b7-7e77-4061-980b-db836ec71eec,network=Network(9bde70f2-7770-457c-8b6b-364b5adcf4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20ef5b7-7e')
May 19 04:38:03.970218 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:38:03.970310 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:38:04.001424 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "refresh_cache-346344d1-df0a-4fd8-9396-b5fde8cf53d1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:38:04.053571 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-3e0acb5d-a769-48aa-8087-0cf15fcc541c req-950c1e3e-f1e6-4f8a-8037-6cb8d77d8f07 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:04.120609 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3e0acb5d-a769-48aa-8087-0cf15fcc541c req-950c1e3e-f1e6-4f8a-8037-6cb8d77d8f07 service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:38:04.230665 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:04.290215 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3e0acb5d-a769-48aa-8087-0cf15fcc541c req-950c1e3e-f1e6-4f8a-8037-6cb8d77d8f07 service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:38:04.373360 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Creating config drive at /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk.config
May 19 04:38:04.377641 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbflj645e {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:04.429546 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbflj645e" returned: 0 in 0.052s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:04.473086 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:38:04.792751 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3e0acb5d-a769-48aa-8087-0cf15fcc541c req-950c1e3e-f1e6-4f8a-8037-6cb8d77d8f07 service nova] Releasing lock "refresh_cache-346344d1-df0a-4fd8-9396-b5fde8cf53d1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:38:04.793375 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquired lock "refresh_cache-346344d1-df0a-4fd8-9396-b5fde8cf53d1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:38:04.793544 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:38:04.874147 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:04.904217 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:04.982797 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.362s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:04.982797 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:38:04.987692 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:05.003690 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:05.009616 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:05.326069 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:38:05.326515 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:38:05.326515 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] No VIF found with MAC fa:16:3e:6d:b2:6e, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:38:05.327478 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Using config drive
May 19 04:38:05.378874 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:38:05.468678 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Acquiring lock "3d008249-1262-4ec8-a8c1-d7845472b4c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:05.468943 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "3d008249-1262-4ec8-a8c1-d7845472b4c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:05.488889 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:38:05.489129 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:38:05.489500 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:05.489905 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:05.511552 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:38:05.513310 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:38:05.513771 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Creating image(s)
May 19 04:38:05.514266 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:38:05.514425 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Ensure instance console log exists: /opt/stack/data/nova/instances/346344d1-df0a-4fd8-9396-b5fde8cf53d1/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:38:05.514810 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:05.515033 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:05.515545 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:05.587713 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7955853f574d42e58ba89f18ed109760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dfff83ce24e619f87507f951f6c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:38:05.598415 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:05.632437 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-619d0e75-1661-439a-aa4b-a6fcae95d374 req-44f07fd2-515b-42a6-ae92-8a32be2cbc4e service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Received event network-vif-plugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:05.632960 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-619d0e75-1661-439a-aa4b-a6fcae95d374 req-44f07fd2-515b-42a6-ae92-8a32be2cbc4e service nova] Acquiring lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:05.633136 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-619d0e75-1661-439a-aa4b-a6fcae95d374 req-44f07fd2-515b-42a6-ae92-8a32be2cbc4e service nova] Lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:05.633365 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-619d0e75-1661-439a-aa4b-a6fcae95d374 req-44f07fd2-515b-42a6-ae92-8a32be2cbc4e service nova] Lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:05.633441 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-619d0e75-1661-439a-aa4b-a6fcae95d374 req-44f07fd2-515b-42a6-ae92-8a32be2cbc4e service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Processing event network-vif-plugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:38:05.633565 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-619d0e75-1661-439a-aa4b-a6fcae95d374 req-44f07fd2-515b-42a6-ae92-8a32be2cbc4e service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Received event network-vif-plugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:05.633676 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-619d0e75-1661-439a-aa4b-a6fcae95d374 req-44f07fd2-515b-42a6-ae92-8a32be2cbc4e service nova] Acquiring lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:05.633792 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-619d0e75-1661-439a-aa4b-a6fcae95d374 req-44f07fd2-515b-42a6-ae92-8a32be2cbc4e service nova] Lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:05.633907 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-619d0e75-1661-439a-aa4b-a6fcae95d374 req-44f07fd2-515b-42a6-ae92-8a32be2cbc4e service nova] Lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:05.633998 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-619d0e75-1661-439a-aa4b-a6fcae95d374 req-44f07fd2-515b-42a6-ae92-8a32be2cbc4e service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] No waiting events found dispatching network-vif-plugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:38:05.634122 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-619d0e75-1661-439a-aa4b-a6fcae95d374 req-44f07fd2-515b-42a6-ae92-8a32be2cbc4e service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Received unexpected event network-vif-plugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 for instance with vm_state building and task_state spawning.
May 19 04:38:05.702035 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165485.7016091, 6cd7138c-f217-4858-8941-89693e62ae6e => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:38:05.708207 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:38:05.708207 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] VM Started (Lifecycle Event)
May 19 04:38:05.710961 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:38:05.713868 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Instance spawned successfully.
May 19 04:38:05.714435 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:38:05.763863 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Updating instance_info_cache with network_info: [{"id": "7a1337f5-a743-48fe-97e4-3ace03005016", "address": "fa:16:3e:ee:13:2d", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1337f5-a7", "ovs_interfaceid": "7a1337f5-a743-48fe-97e4-3ace03005016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:38:05.836646 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:05.969899 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Creating config drive at /opt/stack/data/nova/instances/11a634a9-3bdd-4085-abc2-a0ad70710975/disk.config
May 19 04:38:05.975783 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:38:05.976351 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/11a634a9-3bdd-4085-abc2-a0ad70710975/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7heuwcrb {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:05.997168 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:38:06.040903 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/11a634a9-3bdd-4085-abc2-a0ad70710975/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7heuwcrb" returned: 0 in 0.063s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:06.147024 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Successfully created port: 5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:38:06.212918 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:06.215313 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:38:06.223529 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:06.223680 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:06.224055 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:06.224310 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:06.224601 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:06.224853 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:06.268943 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Releasing lock "refresh_cache-346344d1-df0a-4fd8-9396-b5fde8cf53d1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:38:06.269294 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Instance network_info: |[{"id": "7a1337f5-a743-48fe-97e4-3ace03005016", "address": "fa:16:3e:ee:13:2d", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1337f5-a7", "ovs_interfaceid": "7a1337f5-a743-48fe-97e4-3ace03005016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:38:06.271272 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Start _get_guest_xml network_info=[{"id": "7a1337f5-a743-48fe-97e4-3ace03005016", "address": "fa:16:3e:ee:13:2d", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1337f5-a7", "ovs_interfaceid": "7a1337f5-a743-48fe-97e4-3ace03005016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '59d5e2cd-a5c8-40e9-be82-a7d2481f5efb', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df1fb2f1-04f8-4ec6-ba79-00a835271b79', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '346344d1-df0a-4fd8-9396-b5fde8cf53d1', 'attached_at': '', 'detached_at': '', 'volume_id': 'df1fb2f1-04f8-4ec6-ba79-00a835271b79', 'serial': 'df1fb2f1-04f8-4ec6-ba79-00a835271b79'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:38:06.274785 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:38:06.277023 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-163161666', uuid='346344d1-df0a-4fd8-9396-b5fde8cf53d1'), owner=OwnerMeta(userid='5c46088fb3e74b819bb456461716a801', username='tempest-TestVolumeBootPattern-1071176852-project-member', projectid='28b3c0fa8f894ed2a7c3bcfac99ce74c', projectname='tempest-TestVolumeBootPattern-1071176852'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7a1337f5-a743-48fe-97e4-3ace03005016", "address": "fa:16:3e:ee:13:2d", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1337f5-a7", "ovs_interfaceid": "7a1337f5-a743-48fe-97e4-3ace03005016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165486.276338) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:38:06.278374 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:38:06.278865 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:38:06.279680 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:38:06.280365 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:38:06.281764 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:38:06.282659 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:38:06.282815 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:38:06.283016 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:38:06.283249 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:38:06.283345 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:38:06.283608 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:38:06.283827 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:38:06.283914 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:38:06.284028 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:38:06.284254 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:38:06.284647 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:38:06.306097 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:38:06.306357 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df1fb2f1-04f8-4ec6-ba79-00a835271b79', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:38:06.306956 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:38:06.306956 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:38:06.307223 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df1fb2f1-04f8-4ec6-ba79-00a835271b79', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:38:06.322727 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:38:06.323515 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:38:06.324045 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:38:06.324379 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:38:06.324772 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:38:06.325019 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:38:06.337279 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:38:06.337279 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:06.338883 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:38:06.338883 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:06.348592 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79] added
May 19 04:38:06.348592 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:38:06.348592 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:38:06.348592 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:38:06.348592 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:38:06.348592 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:38:06.348592 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:06.348862 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:38:06.351038 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.024(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:38:06.351038 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:38:06.352915 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79] added
May 19 04:38:06.352915 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:38:06.352915 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:38:06.352915 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:38:06.352915 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:38:06.352915 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:38:06.352915 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:06.353267 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:38:06.353494 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:38:06.353708 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:38:06.503198 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:38:06.508751 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:06.540096 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:06.573515 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:06.573825 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:06.580715 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:38:06.581193 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Claim successful on node np0000001025
May 19 04:38:06.645949 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:06.717691 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:38:06.718050 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165486.7178476, 6cd7138c-f217-4858-8941-89693e62ae6e => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:38:06.718224 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] VM Paused (Lifecycle Event)
May 19 04:38:06.729866 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Took 6.25 seconds to spawn the instance on the hypervisor.
May 19 04:38:06.730196 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:06.819771 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4d8b30d0-94a1-4de4-b777-0bce28d27253 req-5320652c-1c7c-4a48-ba78-a89d2946f2a8 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Received event network-vif-plugged-c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:06.823350 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4d8b30d0-94a1-4de4-b777-0bce28d27253 req-5320652c-1c7c-4a48-ba78-a89d2946f2a8 service nova] Acquiring lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:06.823559 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4d8b30d0-94a1-4de4-b777-0bce28d27253 req-5320652c-1c7c-4a48-ba78-a89d2946f2a8 service nova] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:06.823709 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4d8b30d0-94a1-4de4-b777-0bce28d27253 req-5320652c-1c7c-4a48-ba78-a89d2946f2a8 service nova] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:06.823882 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4d8b30d0-94a1-4de4-b777-0bce28d27253 req-5320652c-1c7c-4a48-ba78-a89d2946f2a8 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Processing event network-vif-plugged-c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:38:06.841484 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:06.845048 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:06.848535 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:06.875485 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:07.076815 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Successfully updated port: 5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:38:07.221617 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:07.224139 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165487.2230375, 6cd7138c-f217-4858-8941-89693e62ae6e => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:38:07.224139 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] VM Resumed (Lifecycle Event)
May 19 04:38:07.239754 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Took 11.72 seconds to build instance.
May 19 04:38:07.351479 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:38:07.354007 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:38:07.368658 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:38:07.368658 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:38:07.370815 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:38:07.370815 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:07.382865 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:07.387627 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:07.399923 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:07.399923 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:07.399923 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:07.399923 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:07.399923 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:07.399923 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:07.399923 np0000001025 nova-compute[97981]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:07.399923 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:07.399923 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:38:07.400373 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:07.400373 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:07.400373 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:07.400373 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:07.400373 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:07.400373 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:07.400373 np0000001025 nova-compute[97981]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:07.400373 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:07.400373 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:38:07.411903 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:07.411903 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:07.411903 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:07.411903 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:07.411903 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:07.411903 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:07.411903 np0000001025 nova-compute[97981]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:07.411903 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:07.411903 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:38:07.412346 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:07.412346 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:07.412346 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:07.412346 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:07.412346 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:07.412346 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:07.412346 np0000001025 nova-compute[97981]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:07.412346 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:07.412346 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:38:07.446183 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79, portal: 192.168.50.100,3260]
May 19 04:38:07.446183 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79, portal: 192.168.50.100,3260] successful.
May 19 04:38:07.446183 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:07.448138 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:38:07.452712 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:38:07.455517 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Instance spawned successfully.
May 19 04:38:07.455955 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:38:07.462334 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:07.469480 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79, portal: 192.168.40.100,3260]
May 19 04:38:07.469480 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79, portal: 192.168.40.100,3260] successful.
May 19 04:38:07.469480 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:07.482600 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:07.487827 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:07.487827 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:07.487827 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:07.487827 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:07.487827 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:07.487827 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:07.487827 np0000001025 nova-compute[97981]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:07.487827 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:07.487827 np0000001025 nova-compute[97981]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:07.487827 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:07.487827 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:38:07.487827 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:07.487827 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:07.487827 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:07.487827 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:07.487827 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:07.487827 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:07.487827 np0000001025 nova-compute[97981]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:07.487827 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:07.487827 np0000001025 nova-compute[97981]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:07.487827 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:07.487827 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:38:07.487827 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:38:07.487827 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:38:07.489185 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] HCTL ('15', '-', '-', 0) found on session 45 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:38:07.489339 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:38:07.503599 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:07.503599 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:07.503599 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:07.503599 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:07.503599 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:07.503599 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:07.503599 np0000001025 nova-compute[97981]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:07.503599 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:07.503599 np0000001025 nova-compute[97981]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:07.503599 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:07.503599 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:38:07.503972 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:07.503972 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:07.503972 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:07.503972 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:07.503972 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:07.503972 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:07.503972 np0000001025 nova-compute[97981]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:07.503972 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:07.503972 np0000001025 nova-compute[97981]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:07.503972 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:07.503972 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:38:07.504364 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:38:07.504364 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:38:07.505551 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] HCTL ('16', '-', '-', 0) found on session 46 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:38:07.505551 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:38:07.514359 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching for a device in session 45 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:38:07.514359 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'df1fb2f1-04f8-4ec6-ba79-00a835271b79', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:38:07.517925 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:38:07.518787 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:38:07.518858 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Creating image(s)
May 19 04:38:07.525284 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "/opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:07.525284 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "/opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:07.525284 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "/opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:07.525284 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:38:07.525284 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:38:07.526642 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:07.527133 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching for a device in session 46 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:38:07.527360 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df1fb2f1-04f8-4ec6-ba79-00a835271b79', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:38:07.583435 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "refresh_cache-e415a06a-1c69-49b7-9bd3-f68ce343b0b7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:38:07.583991 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquired lock "refresh_cache-e415a06a-1c69-49b7-9bd3-f68ce343b0b7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:38:07.584690 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:38:07.685225 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.158s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:07.685225 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:07.685628 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:07.686810 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:38:07.692224 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:38:07.693364 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:07.756235 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f9f08195-6aab-4cf8-8f56-a5611bef4518 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "6cd7138c-f217-4858-8941-89693e62ae6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.242s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:07.760484 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:07.769205 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:38:07.810829 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.117s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:07.812154 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:07.886752 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk 1073741824" returned: 0 in 0.074s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:07.887001 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:07.887415 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:07.972394 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:07.972540 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:07.972851 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:07.973069 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:07.973319 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:07.973539 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:07.994446 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.107s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:07.994956 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:38:07.995269 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:08.052759 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:08.097724 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:08.098616 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Cannot resize image /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:38:08.098616 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:38:08.098616 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Ensure instance console log exists: /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:38:08.098793 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:08.098993 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:08.099101 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:08.164199 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:38:08.188816 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-28e2a153-9d4a-4d6b-98b2-c30d3c9a2ff6 req-a27e081c-84fd-417e-90b3-e5370681f633 service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Received event network-changed-919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:08.189038 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-28e2a153-9d4a-4d6b-98b2-c30d3c9a2ff6 req-a27e081c-84fd-417e-90b3-e5370681f633 service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Refreshing instance network info cache due to event network-changed-919ea210-38da-46cf-9d56-5cbcf6a822a6. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:38:08.189323 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-28e2a153-9d4a-4d6b-98b2-c30d3c9a2ff6 req-a27e081c-84fd-417e-90b3-e5370681f633 service nova] Acquiring lock "refresh_cache-6cd7138c-f217-4858-8941-89693e62ae6e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:38:08.190020 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-28e2a153-9d4a-4d6b-98b2-c30d3c9a2ff6 req-a27e081c-84fd-417e-90b3-e5370681f633 service nova] Acquired lock "refresh_cache-6cd7138c-f217-4858-8941-89693e62ae6e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:38:08.190274 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-28e2a153-9d4a-4d6b-98b2-c30d3c9a2ff6 req-a27e081c-84fd-417e-90b3-e5370681f633 service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Refreshing network info cache for port 919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:38:08.225468 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:38:08.225744 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:38:08.277597 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165488.277139, 11a634a9-3bdd-4085-abc2-a0ad70710975 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:38:08.277796 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] VM Started (Lifecycle Event)
May 19 04:38:08.325250 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:38:08.359838 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:08.480244 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Took 9.13 seconds to spawn the instance on the hypervisor.
May 19 04:38:08.480244 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:08.524509 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Updating instance_info_cache with network_info: [{"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:38:08.693509 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-28e2a153-9d4a-4d6b-98b2-c30d3c9a2ff6 req-a27e081c-84fd-417e-90b3-e5370681f633 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:08.728685 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:38:08.781856 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:08.782527 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:38:08.788812 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:08.888476 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2f2f65f3-148f-4ae7-8f04-f73d9d8d5984 req-c9816b66-3a30-4b95-940d-65d2c07beda0 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Received event network-vif-plugged-c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:08.888699 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2f2f65f3-148f-4ae7-8f04-f73d9d8d5984 req-c9816b66-3a30-4b95-940d-65d2c07beda0 service nova] Acquiring lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:08.888848 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2f2f65f3-148f-4ae7-8f04-f73d9d8d5984 req-c9816b66-3a30-4b95-940d-65d2c07beda0 service nova] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:08.888992 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2f2f65f3-148f-4ae7-8f04-f73d9d8d5984 req-c9816b66-3a30-4b95-940d-65d2c07beda0 service nova] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:08.889140 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2f2f65f3-148f-4ae7-8f04-f73d9d8d5984 req-c9816b66-3a30-4b95-940d-65d2c07beda0 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] No waiting events found dispatching network-vif-plugged-c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:38:08.889258 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-2f2f65f3-148f-4ae7-8f04-f73d9d8d5984 req-c9816b66-3a30-4b95-940d-65d2c07beda0 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Received unexpected event network-vif-plugged-c20ef5b7-7e77-4061-980b-db836ec71eec for instance with vm_state active and task_state None.
May 19 04:38:08.889363 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2f2f65f3-148f-4ae7-8f04-f73d9d8d5984 req-c9816b66-3a30-4b95-940d-65d2c07beda0 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Received event network-changed-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:08.890103 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2f2f65f3-148f-4ae7-8f04-f73d9d8d5984 req-c9816b66-3a30-4b95-940d-65d2c07beda0 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Refreshing instance network info cache due to event network-changed-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:38:08.890298 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2f2f65f3-148f-4ae7-8f04-f73d9d8d5984 req-c9816b66-3a30-4b95-940d-65d2c07beda0 service nova] Acquiring lock "refresh_cache-e415a06a-1c69-49b7-9bd3-f68ce343b0b7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:38:08.989097 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Took 16.29 seconds to build instance.
May 19 04:38:09.016035 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-28e2a153-9d4a-4d6b-98b2-c30d3c9a2ff6 req-a27e081c-84fd-417e-90b3-e5370681f633 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:09.026742 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Releasing lock "refresh_cache-e415a06a-1c69-49b7-9bd3-f68ce343b0b7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:38:09.027044 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Instance network_info: |[{"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:38:09.027566 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2f2f65f3-148f-4ae7-8f04-f73d9d8d5984 req-c9816b66-3a30-4b95-940d-65d2c07beda0 service nova] Acquired lock "refresh_cache-e415a06a-1c69-49b7-9bd3-f68ce343b0b7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:38:09.027738 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2f2f65f3-148f-4ae7-8f04-f73d9d8d5984 req-c9816b66-3a30-4b95-940d-65d2c07beda0 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Refreshing network info cache for port 5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:38:09.030237 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Start _get_guest_xml network_info=[{"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:38:09.032893 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:38:09.034679 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1460978051', uuid='e415a06a-1c69-49b7-9bd3-f68ce343b0b7'), owner=OwnerMeta(userid='7955853f574d42e58ba89f18ed109760', username='tempest-AttachVolumeShelveTestJSON-51274594-project-member', projectid='8a3dfff83ce24e619f87507f951f6c69', projectname='tempest-AttachVolumeShelveTestJSON-51274594'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165489.0340796) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:38:09.035526 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:38:09.036009 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:38:09.036819 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:38:09.036996 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:38:09.038123 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:38:09.041187 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:38:09.041187 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:38:09.041187 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:38:09.041187 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:38:09.041187 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:38:09.041187 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:38:09.041187 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:38:09.041187 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:38:09.041187 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:38:09.041187 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:38:09.041187 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:38:09.059432 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1460978051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumeshelvetestjson-server-1460978051',id=25,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuu3onWzOWOhTwLe3vZlOngY/CNVOE694TNfiS2EbzzOJkaGAyIrxidDf/5+IdWjmIe9CYb9T+M3VPE0CkhNbotNWs4WbsLT86SQsfo4cFhFoJ7Md7HRdavMADvBfS/PA==',key_name='tempest-keypair-1653098683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a3dfff83ce24e619f87507f951f6c69',ramdisk_id='',reservation_id='r-a8neifui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-51274594',owner_user_name='tempest-AttachVolumeShelveTestJSON-51274594-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:38:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7955853f574d42e58ba89f18ed109760',uuid=e415a06a-1c69-49b7-9bd3-f68ce343b0b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:38:09.059432 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converting VIF {"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:38:09.060081 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:10:d8,bridge_name='br-int',has_traffic_filtering=True,id=5b2a0762-a1d4-4a8c-a81b-de0fef92e15c,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2a0762-a1') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:38:09.060677 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'pci_devices' on Instance uuid e415a06a-1c69-49b7-9bd3-f68ce343b0b7 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:38:09.174457 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-28e2a153-9d4a-4d6b-98b2-c30d3c9a2ff6 req-a27e081c-84fd-417e-90b3-e5370681f633 service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Updated VIF entry in instance network info cache for port 919ea210-38da-46cf-9d56-5cbcf6a822a6. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:38:09.174933 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-28e2a153-9d4a-4d6b-98b2-c30d3c9a2ff6 req-a27e081c-84fd-417e-90b3-e5370681f633 service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Updating instance_info_cache with network_info: [{"id": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "address": "fa:16:3e:8e:26:b9", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ea210-38", "ovs_interfaceid": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:38:09.238130 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.664s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:09.238847 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:38:09.285052 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165489.28476, 11a634a9-3bdd-4085-abc2-a0ad70710975 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:38:09.285209 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] VM Paused (Lifecycle Event)
May 19 04:38:09.343155 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Found WWN 3300000003d5fd3e3 for multipath device dm-8 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:38:09.343768 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:38:09.343987 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000003d5fd3e3', 'path': '/dev/dm-8', 'multipath_id': '3300000003d5fd3e3'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:38:09.344169 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003d5fd3e3', 'path': '/dev/dm-8', 'multipath_id': '3300000003d5fd3e3'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:38:09.491620 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a5c505c0-f9ec-4513-a73c-3e452a2dee04 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.795s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:09.531245 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-2f2f65f3-148f-4ae7-8f04-f73d9d8d5984 req-c9816b66-3a30-4b95-940d-65d2c07beda0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:09.563558 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] End _get_guest_xml xml=<domain type="qemu">
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:   <uuid>e415a06a-1c69-49b7-9bd3-f68ce343b0b7</uuid>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:   <name>instance-00000019</name>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1460978051</nova:name>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:38:09</nova:creationTime>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:         <nova:user uuid="7955853f574d42e58ba89f18ed109760">tempest-AttachVolumeShelveTestJSON-51274594-project-member</nova:user>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:         <nova:project uuid="8a3dfff83ce24e619f87507f951f6c69">tempest-AttachVolumeShelveTestJSON-51274594</nova:project>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:         <nova:port uuid="5b2a0762-a1d4-4a8c-a81b-de0fef92e15c">
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     <system>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <entry name="serial">e415a06a-1c69-49b7-9bd3-f68ce343b0b7</entry>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <entry name="uuid">e415a06a-1c69-49b7-9bd3-f68ce343b0b7</entry>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     </system>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:   <os>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:   </os>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:   <features>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:   </features>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:   <devices>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk"/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     </disk>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk.config"/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     </disk>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:75:10:d8"/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <target dev="tap5b2a0762-a1"/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     </interface>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/console.log" append="off"/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     </serial>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     <video>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     </video>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     </rng>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:   </devices>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]: </domain>
May 19 04:38:09.563558 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:38:09.565496 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Preparing to wait for external event network-vif-plugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:38:09.565496 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:09.565496 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:09.565496 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:09.565496 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1460978051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumeshelvetestjson-server-1460978051',id=25,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuu3onWzOWOhTwLe3vZlOngY/CNVOE694TNfiS2EbzzOJkaGAyIrxidDf/5+IdWjmIe9CYb9T+M3VPE0CkhNbotNWs4WbsLT86SQsfo4cFhFoJ7Md7HRdavMADvBfS/PA==',key_name='tempest-keypair-1653098683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a3dfff83ce24e619f87507f951f6c69',ramdisk_id='',reservation_id='r-a8neifui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-51274594',owner_user_name='tempest-AttachVolumeShelveTestJSON-51274594-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:38:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7955853f574d42e58ba89f18ed109760',uuid=e415a06a-1c69-49b7-9bd3-f68ce343b0b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:38:09.565496 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converting VIF {"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:38:09.565878 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:10:d8,bridge_name='br-int',has_traffic_filtering=True,id=5b2a0762-a1d4-4a8c-a81b-de0fef92e15c,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2a0762-a1') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:38:09.565983 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:10:d8,bridge_name='br-int',has_traffic_filtering=True,id=5b2a0762-a1d4-4a8c-a81b-de0fef92e15c,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2a0762-a1') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:38:09.566279 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:09.566519 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:09.566801 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:38:09.567871 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:09.568057 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '487b9ef3-411d-5e63-b4f8-f27a64c9aa5a', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:09.569566 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:09.570420 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:09.571445 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:09.573553 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:09.573753 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b2a0762-a1, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:09.574160 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b2a0762-a1, col_values=(('qos', UUID('18594b8c-584a-4acc-80bc-9017cf771b08')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:09.574340 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b2a0762-a1, col_values=(('external_ids', {'iface-id': '5b2a0762-a1d4-4a8c-a81b-de0fef92e15c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:10:d8', 'vm-uuid': 'e415a06a-1c69-49b7-9bd3-f68ce343b0b7'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:09.575206 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:09.576459 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:09.581155 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:09.582345 np0000001025 nova-compute[97981]: INFO os_vif [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:10:d8,bridge_name='br-int',has_traffic_filtering=True,id=5b2a0762-a1d4-4a8c-a81b-de0fef92e15c,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2a0762-a1')
May 19 04:38:09.677782 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-28e2a153-9d4a-4d6b-98b2-c30d3c9a2ff6 req-a27e081c-84fd-417e-90b3-e5370681f633 service nova] Releasing lock "refresh_cache-6cd7138c-f217-4858-8941-89693e62ae6e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:38:09.744775 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:38:09.745797 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:38:09.745944 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:09.746249 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:09.787551 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:09.789537 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165489.7892065, 11a634a9-3bdd-4085-abc2-a0ad70710975 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:38:09.789735 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] VM Resumed (Lifecycle Event)
May 19 04:38:09.826065 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12a42fd27b7040b3964b46f5455691c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b413d7fd7b148adaa3e2c41bfa30252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:38:09.849708 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-163161666',display_name='tempest-TestVolumeBootPattern-server-163161666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-163161666',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuhilx0tRF3WlGuiMFtVh9wNHP60rfodDvgDjikOW6n/GDk2wQf/EIHZEMv8fxrhWlZUDYtJXkQ3L6iNm1XDZzZAGzLcp+gX7pll6FIzgta7AklQ/uWj1eFkrn6Nrm6Tw==',key_name='tempest-keypair-685402957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-1yosq7sn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:38:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c46088fb3e74b819bb456461716a801',uuid=346344d1-df0a-4fd8-9396-b5fde8cf53d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a1337f5-a743-48fe-97e4-3ace03005016", "address": "fa:16:3e:ee:13:2d", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1337f5-a7", "ovs_interfaceid": "7a1337f5-a743-48fe-97e4-3ace03005016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:38:09.850072 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "7a1337f5-a743-48fe-97e4-3ace03005016", "address": "fa:16:3e:ee:13:2d", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1337f5-a7", "ovs_interfaceid": "7a1337f5-a743-48fe-97e4-3ace03005016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:38:09.850831 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:13:2d,bridge_name='br-int',has_traffic_filtering=True,id=7a1337f5-a743-48fe-97e4-3ace03005016,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1337f5-a7') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:38:09.851682 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'pci_devices' on Instance uuid 346344d1-df0a-4fd8-9396-b5fde8cf53d1 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:38:09.902217 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-2f2f65f3-148f-4ae7-8f04-f73d9d8d5984 req-c9816b66-3a30-4b95-940d-65d2c07beda0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:10.053402 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2f2f65f3-148f-4ae7-8f04-f73d9d8d5984 req-c9816b66-3a30-4b95-940d-65d2c07beda0 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Updated VIF entry in instance network info cache for port 5b2a0762-a1d4-4a8c-a81b-de0fef92e15c. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:38:10.053402 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2f2f65f3-148f-4ae7-8f04-f73d9d8d5984 req-c9816b66-3a30-4b95-940d-65d2c07beda0 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Updating instance_info_cache with network_info: [{"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:38:10.248234 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:38:10.256760 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-88358a81-901e-4261-b2a3-35bb74ae595f req-baef22e5-609e-4352-a00e-72b07dafba23 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Received event network-changed-c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:10.256990 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-88358a81-901e-4261-b2a3-35bb74ae595f req-baef22e5-609e-4352-a00e-72b07dafba23 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Refreshing instance network info cache due to event network-changed-c20ef5b7-7e77-4061-980b-db836ec71eec. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:38:10.257230 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-88358a81-901e-4261-b2a3-35bb74ae595f req-baef22e5-609e-4352-a00e-72b07dafba23 service nova] Acquiring lock "refresh_cache-11a634a9-3bdd-4085-abc2-a0ad70710975" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:38:10.257373 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-88358a81-901e-4261-b2a3-35bb74ae595f req-baef22e5-609e-4352-a00e-72b07dafba23 service nova] Acquired lock "refresh_cache-11a634a9-3bdd-4085-abc2-a0ad70710975" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:38:10.257859 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-88358a81-901e-4261-b2a3-35bb74ae595f req-baef22e5-609e-4352-a00e-72b07dafba23 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Refreshing network info cache for port c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:38:10.292283 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:10.294437 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:38:10.332306 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Successfully created port: c3a5868f-a20d-451d-a1a4-3869552637a9 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:38:10.355156 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] End _get_guest_xml xml=<domain type="qemu">
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:   <uuid>346344d1-df0a-4fd8-9396-b5fde8cf53d1</uuid>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:   <name>instance-00000018</name>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestVolumeBootPattern-server-163161666</nova:name>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:38:06</nova:creationTime>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:         <nova:user uuid="5c46088fb3e74b819bb456461716a801">tempest-TestVolumeBootPattern-1071176852-project-member</nova:user>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:         <nova:project uuid="28b3c0fa8f894ed2a7c3bcfac99ce74c">tempest-TestVolumeBootPattern-1071176852</nova:project>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:         <nova:port uuid="7a1337f5-a743-48fe-97e4-3ace03005016">
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     <system>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <entry name="serial">346344d1-df0a-4fd8-9396-b5fde8cf53d1</entry>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <entry name="uuid">346344d1-df0a-4fd8-9396-b5fde8cf53d1</entry>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     </system>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:   <os>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:   </os>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:   <features>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:   </features>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:   <devices>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/346344d1-df0a-4fd8-9396-b5fde8cf53d1/disk.config"/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     </disk>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <alias name="ua-df1fb2f1-04f8-4ec6-ba79-00a835271b79"/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-8"/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <serial>df1fb2f1-04f8-4ec6-ba79-00a835271b79</serial>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     </disk>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:ee:13:2d"/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <target dev="tap7a1337f5-a7"/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     </interface>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/346344d1-df0a-4fd8-9396-b5fde8cf53d1/console.log" append="off"/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     </serial>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     <video>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     </video>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     </rng>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:   </devices>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]: </domain>
May 19 04:38:10.355156 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:38:10.357176 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Preparing to wait for external event network-vif-plugged-7a1337f5-a743-48fe-97e4-3ace03005016 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:38:10.357176 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:10.357176 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:10.357176 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:10.357176 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-163161666',display_name='tempest-TestVolumeBootPattern-server-163161666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-163161666',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuhilx0tRF3WlGuiMFtVh9wNHP60rfodDvgDjikOW6n/GDk2wQf/EIHZEMv8fxrhWlZUDYtJXkQ3L6iNm1XDZzZAGzLcp+gX7pll6FIzgta7AklQ/uWj1eFkrn6Nrm6Tw==',key_name='tempest-keypair-685402957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-1yosq7sn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:38:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c46088fb3e74b819bb456461716a801',uuid=346344d1-df0a-4fd8-9396-b5fde8cf53d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a1337f5-a743-48fe-97e4-3ace03005016", "address": "fa:16:3e:ee:13:2d", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1337f5-a7", "ovs_interfaceid": "7a1337f5-a743-48fe-97e4-3ace03005016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:38:10.358738 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "7a1337f5-a743-48fe-97e4-3ace03005016", "address": "fa:16:3e:ee:13:2d", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1337f5-a7", "ovs_interfaceid": "7a1337f5-a743-48fe-97e4-3ace03005016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:38:10.362456 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:13:2d,bridge_name='br-int',has_traffic_filtering=True,id=7a1337f5-a743-48fe-97e4-3ace03005016,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1337f5-a7') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:38:10.362830 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:13:2d,bridge_name='br-int',has_traffic_filtering=True,id=7a1337f5-a743-48fe-97e4-3ace03005016,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1337f5-a7') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:38:10.366366 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:10.366366 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:10.366366 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:38:10.366366 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:10.367395 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dff159bd-f655-5540-8e6f-5b44ff44adf0', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:10.368204 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:10.368566 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:10.375212 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:10.378351 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:10.378659 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a1337f5-a7, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:10.379554 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a1337f5-a7, col_values=(('qos', UUID('839b804b-a0f0-4d70-b0c7-3f47c4a50c33')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:10.380677 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a1337f5-a7, col_values=(('external_ids', {'iface-id': '7a1337f5-a743-48fe-97e4-3ace03005016', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:13:2d', 'vm-uuid': '346344d1-df0a-4fd8-9396-b5fde8cf53d1'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:10.383477 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:10.383477 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:10.394247 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:10.395008 np0000001025 nova-compute[97981]: INFO os_vif [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:13:2d,bridge_name='br-int',has_traffic_filtering=True,id=7a1337f5-a743-48fe-97e4-3ace03005016,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1337f5-a7')
May 19 04:38:10.554826 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2f2f65f3-148f-4ae7-8f04-f73d9d8d5984 req-c9816b66-3a30-4b95-940d-65d2c07beda0 service nova] Releasing lock "refresh_cache-e415a06a-1c69-49b7-9bd3-f68ce343b0b7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:38:10.754927 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:38:10.761897 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-88358a81-901e-4261-b2a3-35bb74ae595f req-baef22e5-609e-4352-a00e-72b07dafba23 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:10.814579 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Successfully updated port: c3a5868f-a20d-451d-a1a4-3869552637a9 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:38:10.962258 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-08377e69-481d-43e8-a53f-29fbd23eaec1 req-9c1e25e5-9f15-41ef-b876-605f365280e8 service nova] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Received event network-changed-c3a5868f-a20d-451d-a1a4-3869552637a9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:10.962258 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-08377e69-481d-43e8-a53f-29fbd23eaec1 req-9c1e25e5-9f15-41ef-b876-605f365280e8 service nova] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Refreshing instance network info cache due to event network-changed-c3a5868f-a20d-451d-a1a4-3869552637a9. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:38:10.962426 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-08377e69-481d-43e8-a53f-29fbd23eaec1 req-9c1e25e5-9f15-41ef-b876-605f365280e8 service nova] Acquiring lock "refresh_cache-3d008249-1262-4ec8-a8c1-d7845472b4c1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:38:10.962426 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-08377e69-481d-43e8-a53f-29fbd23eaec1 req-9c1e25e5-9f15-41ef-b876-605f365280e8 service nova] Acquired lock "refresh_cache-3d008249-1262-4ec8-a8c1-d7845472b4c1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:38:10.962587 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-08377e69-481d-43e8-a53f-29fbd23eaec1 req-9c1e25e5-9f15-41ef-b876-605f365280e8 service nova] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Refreshing network info cache for port c3a5868f-a20d-451d-a1a4-3869552637a9 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:38:11.094200 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-88358a81-901e-4261-b2a3-35bb74ae595f req-baef22e5-609e-4352-a00e-72b07dafba23 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:11.103580 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:38:11.103750 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:38:11.103888 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] No VIF found with MAC fa:16:3e:75:10:d8, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:38:11.104387 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Using config drive
May 19 04:38:11.242944 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-88358a81-901e-4261-b2a3-35bb74ae595f req-baef22e5-609e-4352-a00e-72b07dafba23 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Updated VIF entry in instance network info cache for port c20ef5b7-7e77-4061-980b-db836ec71eec. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:38:11.243668 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-88358a81-901e-4261-b2a3-35bb74ae595f req-baef22e5-609e-4352-a00e-72b07dafba23 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Updating instance_info_cache with network_info: [{"id": "c20ef5b7-7e77-4061-980b-db836ec71eec", "address": "fa:16:3e:6d:b2:6e", "network": {"id": "9bde70f2-7770-457c-8b6b-364b5adcf4fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1641494804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2110bc6ddf24455ab91b4ba84e6170a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20ef5b7-7e", "ovs_interfaceid": "c20ef5b7-7e77-4061-980b-db836ec71eec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:38:11.322829 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Acquiring lock "refresh_cache-3d008249-1262-4ec8-a8c1-d7845472b4c1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:38:11.465291 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-08377e69-481d-43e8-a53f-29fbd23eaec1 req-9c1e25e5-9f15-41ef-b876-605f365280e8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:11.538508 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-08377e69-481d-43e8-a53f-29fbd23eaec1 req-9c1e25e5-9f15-41ef-b876-605f365280e8 service nova] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:38:11.609993 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:11.711301 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-08377e69-481d-43e8-a53f-29fbd23eaec1 req-9c1e25e5-9f15-41ef-b876-605f365280e8 service nova] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:38:11.744819 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Creating config drive at /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk.config
May 19 04:38:11.745800 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-88358a81-901e-4261-b2a3-35bb74ae595f req-baef22e5-609e-4352-a00e-72b07dafba23 service nova] Releasing lock "refresh_cache-11a634a9-3bdd-4085-abc2-a0ad70710975" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:38:11.749740 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpie2jv_n5 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:11.768646 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:38:11.770378 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:38:11.770671 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Creating image(s)
May 19 04:38:11.771401 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d008249-1262-4ec8-a8c1-d7845472b4c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:11.771695 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "/opt/stack/data/nova/instances/3d008249-1262-4ec8-a8c1-d7845472b4c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:11.772337 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "/opt/stack/data/nova/instances/3d008249-1262-4ec8-a8c1-d7845472b4c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:11.773150 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:38:11.776160 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:38:11.777276 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:11.795927 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpie2jv_n5" returned: 0 in 0.045s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:11.864403 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.087s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:11.864871 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:11.865361 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:11.865845 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:38:11.868692 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:38:11.869038 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:11.915608 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:38:11.915821 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:38:11.916009 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No VIF found with MAC fa:16:3e:ee:13:2d, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:38:11.916631 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Using config drive
May 19 04:38:11.977390 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.108s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:11.977837 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/3d008249-1262-4ec8-a8c1-d7845472b4c1/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:12.023734 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/3d008249-1262-4ec8-a8c1-d7845472b4c1/disk 1073741824" returned: 0 in 0.046s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:12.024170 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:12.024484 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:12.106673 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.082s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:12.107116 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d008249-1262-4ec8-a8c1-d7845472b4c1/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:38:12.107394 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d008249-1262-4ec8-a8c1-d7845472b4c1/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:12.201851 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d008249-1262-4ec8-a8c1-d7845472b4c1/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:12.206123 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Cannot resize image /opt/stack/data/nova/instances/3d008249-1262-4ec8-a8c1-d7845472b4c1/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:38:12.206123 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:38:12.206123 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Ensure instance console log exists: /opt/stack/data/nova/instances/3d008249-1262-4ec8-a8c1-d7845472b4c1/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:38:12.206123 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:12.206123 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:12.206123 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:12.210558 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:12.215203 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-08377e69-481d-43e8-a53f-29fbd23eaec1 req-9c1e25e5-9f15-41ef-b876-605f365280e8 service nova] Releasing lock "refresh_cache-3d008249-1262-4ec8-a8c1-d7845472b4c1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:38:12.215203 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Acquired lock "refresh_cache-3d008249-1262-4ec8-a8c1-d7845472b4c1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:38:12.215203 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:38:12.241380 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:12.245180 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:12.260716 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0005449610000596294 future=<Future at 0x721834335430 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:38:12.261094 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Emitting event <LifecycleEvent: 1779165477.2597785, f1a3ef6c-55da-4f79-8b87-720f44891fa4 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:38:12.261382 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:38:12.262180 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] VM Stopped (Lifecycle Event)
May 19 04:38:12.330809 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:12.430495 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:12.527329 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:12.538052 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:12.570605 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:12.578580 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:12.604847 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Creating config drive at /opt/stack/data/nova/instances/346344d1-df0a-4fd8-9396-b5fde8cf53d1/disk.config
May 19 04:38:12.610099 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/346344d1-df0a-4fd8-9396-b5fde8cf53d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnsgva4iz {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:12.684641 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/346344d1-df0a-4fd8-9396-b5fde8cf53d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnsgva4iz" returned: 0 in 0.074s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:12.764979 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1a3ef6c-55da-4f79-8b87-720f44891fa4] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:12.796122 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:38:12.962963 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:13.051295 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:13.070981 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-be07fe07-e90b-4adf-afd3-0fca87a386cc req-d19cbf80-044e-4f25-bbde-b3b6693fefa3 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Received event network-vif-plugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:13.070981 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-be07fe07-e90b-4adf-afd3-0fca87a386cc req-d19cbf80-044e-4f25-bbde-b3b6693fefa3 service nova] Acquiring lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:13.070981 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-be07fe07-e90b-4adf-afd3-0fca87a386cc req-d19cbf80-044e-4f25-bbde-b3b6693fefa3 service nova] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:13.070981 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-be07fe07-e90b-4adf-afd3-0fca87a386cc req-d19cbf80-044e-4f25-bbde-b3b6693fefa3 service nova] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:13.070981 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-be07fe07-e90b-4adf-afd3-0fca87a386cc req-d19cbf80-044e-4f25-bbde-b3b6693fefa3 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Processing event network-vif-plugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:38:13.070981 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-be07fe07-e90b-4adf-afd3-0fca87a386cc req-d19cbf80-044e-4f25-bbde-b3b6693fefa3 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Received event network-vif-plugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:13.072205 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-be07fe07-e90b-4adf-afd3-0fca87a386cc req-d19cbf80-044e-4f25-bbde-b3b6693fefa3 service nova] Acquiring lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:13.072737 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-be07fe07-e90b-4adf-afd3-0fca87a386cc req-d19cbf80-044e-4f25-bbde-b3b6693fefa3 service nova] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:13.072970 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-be07fe07-e90b-4adf-afd3-0fca87a386cc req-d19cbf80-044e-4f25-bbde-b3b6693fefa3 service nova] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:13.073228 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-be07fe07-e90b-4adf-afd3-0fca87a386cc req-d19cbf80-044e-4f25-bbde-b3b6693fefa3 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] No waiting events found dispatching network-vif-plugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:38:13.073562 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-be07fe07-e90b-4adf-afd3-0fca87a386cc req-d19cbf80-044e-4f25-bbde-b3b6693fefa3 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Received unexpected event network-vif-plugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c for instance with vm_state building and task_state spawning.
May 19 04:38:13.113943 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Updating instance_info_cache with network_info: [{"id": "c3a5868f-a20d-451d-a1a4-3869552637a9", "address": "fa:16:3e:8d:df:62", "network": {"id": "fbca82d5-40ca-4591-992b-dd555b5fef8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919658386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b413d7fd7b148adaa3e2c41bfa30252", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a5868f-a2", "ovs_interfaceid": "c3a5868f-a20d-451d-a1a4-3869552637a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:38:13.162132 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165493.1616354, e415a06a-1c69-49b7-9bd3-f68ce343b0b7 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:38:13.162554 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] VM Started (Lifecycle Event)
May 19 04:38:13.164252 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:38:13.170177 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:13.177833 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:38:13.185466 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Instance spawned successfully.
May 19 04:38:13.186480 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:38:13.207837 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:13.285455 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:13.465130 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-72069337-3c9d-40c3-8264-84fb580662d8 req-7e87b58c-bcd9-4068-8391-4704f11a6ede service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Received event network-vif-plugged-7a1337f5-a743-48fe-97e4-3ace03005016 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:13.465475 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72069337-3c9d-40c3-8264-84fb580662d8 req-7e87b58c-bcd9-4068-8391-4704f11a6ede service nova] Acquiring lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:13.465475 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72069337-3c9d-40c3-8264-84fb580662d8 req-7e87b58c-bcd9-4068-8391-4704f11a6ede service nova] Lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:13.465652 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-72069337-3c9d-40c3-8264-84fb580662d8 req-7e87b58c-bcd9-4068-8391-4704f11a6ede service nova] Lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:13.465652 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-72069337-3c9d-40c3-8264-84fb580662d8 req-7e87b58c-bcd9-4068-8391-4704f11a6ede service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Processing event network-vif-plugged-7a1337f5-a743-48fe-97e4-3ace03005016 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:38:13.500854 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:13.502667 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:13.507224 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:13.533724 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:13.617407 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Releasing lock "refresh_cache-3d008249-1262-4ec8-a8c1-d7845472b4c1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:38:13.617833 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Instance network_info: |[{"id": "c3a5868f-a20d-451d-a1a4-3869552637a9", "address": "fa:16:3e:8d:df:62", "network": {"id": "fbca82d5-40ca-4591-992b-dd555b5fef8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919658386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b413d7fd7b148adaa3e2c41bfa30252", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a5868f-a2", "ovs_interfaceid": "c3a5868f-a20d-451d-a1a4-3869552637a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:38:13.620126 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Start _get_guest_xml network_info=[{"id": "c3a5868f-a20d-451d-a1a4-3869552637a9", "address": "fa:16:3e:8d:df:62", "network": {"id": "fbca82d5-40ca-4591-992b-dd555b5fef8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919658386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b413d7fd7b148adaa3e2c41bfa30252", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a5868f-a2", "ovs_interfaceid": "c3a5868f-a20d-451d-a1a4-3869552637a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:38:13.623800 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:38:13.625865 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-1063904648', uuid='3d008249-1262-4ec8-a8c1-d7845472b4c1'), owner=OwnerMeta(userid='12a42fd27b7040b3964b46f5455691c6', username='tempest-VolumesActionsTest-2133751040-project-member', projectid='9b413d7fd7b148adaa3e2c41bfa30252', projectname='tempest-VolumesActionsTest-2133751040'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c3a5868f-a20d-451d-a1a4-3869552637a9", "address": "fa:16:3e:8d:df:62", "network": {"id": "fbca82d5-40ca-4591-992b-dd555b5fef8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919658386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b413d7fd7b148adaa3e2c41bfa30252", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a5868f-a2", "ovs_interfaceid": "c3a5868f-a20d-451d-a1a4-3869552637a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165493.6247196) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:38:13.628603 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:38:13.628966 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:38:13.630731 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:38:13.631662 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:38:13.631927 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:38:13.632552 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:38:13.632552 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:38:13.632552 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:38:13.632706 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:38:13.632734 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:38:13.632849 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:38:13.632999 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:38:13.633101 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:38:13.633708 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:38:13.633708 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:38:13.634312 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:38:13.649840 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:38:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1063904648',display_name='tempest-VolumesActionsTest-instance-1063904648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesactionstest-instance-1063904648',id=26,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b413d7fd7b148adaa3e2c41bfa30252',ramdisk_id='',reservation_id='r-gh3m7roe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2133751040',owner_user_name='tempest-VolumesActionsTest-2133751040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:38:11Z,user_data=None,user_id='12a42fd27b7040b3964b46f5455691c6',uuid=3d008249-1262-4ec8-a8c1-d7845472b4c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3a5868f-a20d-451d-a1a4-3869552637a9", "address": "fa:16:3e:8d:df:62", "network": {"id": "fbca82d5-40ca-4591-992b-dd555b5fef8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919658386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b413d7fd7b148adaa3e2c41bfa30252", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a5868f-a2", "ovs_interfaceid": "c3a5868f-a20d-451d-a1a4-3869552637a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:38:13.650028 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Converting VIF {"id": "c3a5868f-a20d-451d-a1a4-3869552637a9", "address": "fa:16:3e:8d:df:62", "network": {"id": "fbca82d5-40ca-4591-992b-dd555b5fef8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919658386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b413d7fd7b148adaa3e2c41bfa30252", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a5868f-a2", "ovs_interfaceid": "c3a5868f-a20d-451d-a1a4-3869552637a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:38:13.651746 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:df:62,bridge_name='br-int',has_traffic_filtering=True,id=c3a5868f-a20d-451d-a1a4-3869552637a9,network=Network(fbca82d5-40ca-4591-992b-dd555b5fef8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a5868f-a2') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:38:13.652317 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d008249-1262-4ec8-a8c1-d7845472b4c1 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:38:13.668017 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:13.672858 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:38:13.695193 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:13.695363 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:13.695629 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:13.695829 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:13.696045 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:13.696393 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:14.081146 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:38:14.083418 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:38:14.088301 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Instance spawned successfully.
May 19 04:38:14.088301 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:38:14.155076 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] End _get_guest_xml xml=<domain type="qemu">
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:   <uuid>3d008249-1262-4ec8-a8c1-d7845472b4c1</uuid>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:   <name>instance-0000001a</name>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <nova:name>tempest-VolumesActionsTest-instance-1063904648</nova:name>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:38:13</nova:creationTime>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:         <nova:user uuid="12a42fd27b7040b3964b46f5455691c6">tempest-VolumesActionsTest-2133751040-project-member</nova:user>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:         <nova:project uuid="9b413d7fd7b148adaa3e2c41bfa30252">tempest-VolumesActionsTest-2133751040</nova:project>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:         <nova:port uuid="c3a5868f-a20d-451d-a1a4-3869552637a9">
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     <system>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <entry name="serial">3d008249-1262-4ec8-a8c1-d7845472b4c1</entry>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <entry name="uuid">3d008249-1262-4ec8-a8c1-d7845472b4c1</entry>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     </system>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:   <os>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:   </os>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:   <features>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:   </features>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:   <devices>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/3d008249-1262-4ec8-a8c1-d7845472b4c1/disk"/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     </disk>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/3d008249-1262-4ec8-a8c1-d7845472b4c1/disk.config"/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     </disk>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:8d:df:62"/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <target dev="tapc3a5868f-a2"/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     </interface>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/3d008249-1262-4ec8-a8c1-d7845472b4c1/console.log" append="off"/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     </serial>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     <video>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     </video>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     </rng>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:   </devices>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]: </domain>
May 19 04:38:14.155076 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:38:14.156870 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Preparing to wait for external event network-vif-plugged-c3a5868f-a20d-451d-a1a4-3869552637a9 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:38:14.156870 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Acquiring lock "3d008249-1262-4ec8-a8c1-d7845472b4c1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:14.156870 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "3d008249-1262-4ec8-a8c1-d7845472b4c1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:14.156870 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "3d008249-1262-4ec8-a8c1-d7845472b4c1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:14.157793 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:38:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1063904648',display_name='tempest-VolumesActionsTest-instance-1063904648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesactionstest-instance-1063904648',id=26,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b413d7fd7b148adaa3e2c41bfa30252',ramdisk_id='',reservation_id='r-gh3m7roe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2133751040',owner_user_name='tempest-VolumesActionsTest-2133751040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:38:11Z,user_data=None,user_id='12a42fd27b7040b3964b46f5455691c6',uuid=3d008249-1262-4ec8-a8c1-d7845472b4c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3a5868f-a20d-451d-a1a4-3869552637a9", "address": "fa:16:3e:8d:df:62", "network": {"id": "fbca82d5-40ca-4591-992b-dd555b5fef8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919658386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b413d7fd7b148adaa3e2c41bfa30252", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a5868f-a2", "ovs_interfaceid": "c3a5868f-a20d-451d-a1a4-3869552637a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:38:14.158117 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Converting VIF {"id": "c3a5868f-a20d-451d-a1a4-3869552637a9", "address": "fa:16:3e:8d:df:62", "network": {"id": "fbca82d5-40ca-4591-992b-dd555b5fef8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919658386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b413d7fd7b148adaa3e2c41bfa30252", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a5868f-a2", "ovs_interfaceid": "c3a5868f-a20d-451d-a1a4-3869552637a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:38:14.158787 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:df:62,bridge_name='br-int',has_traffic_filtering=True,id=c3a5868f-a20d-451d-a1a4-3869552637a9,network=Network(fbca82d5-40ca-4591-992b-dd555b5fef8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a5868f-a2') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:38:14.159324 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:df:62,bridge_name='br-int',has_traffic_filtering=True,id=c3a5868f-a20d-451d-a1a4-3869552637a9,network=Network(fbca82d5-40ca-4591-992b-dd555b5fef8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a5868f-a2') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:38:14.159657 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:14.159887 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:14.160084 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:38:14.161282 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:14.161443 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '222cb214-1255-5d66-889e-7007c76b9810', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:14.162060 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:14.162667 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:14.163610 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:14.165576 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:14.165738 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3a5868f-a2, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:14.166030 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3a5868f-a2, col_values=(('qos', UUID('374c842e-b22e-4fc2-8323-a9f25ebe6f0c')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:14.166217 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3a5868f-a2, col_values=(('external_ids', {'iface-id': 'c3a5868f-a20d-451d-a1a4-3869552637a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:df:62', 'vm-uuid': '3d008249-1262-4ec8-a8c1-d7845472b4c1'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:14.166962 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:14.168030 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:14.174529 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:14.175493 np0000001025 nova-compute[97981]: INFO os_vif [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:df:62,bridge_name='br-int',has_traffic_filtering=True,id=c3a5868f-a20d-451d-a1a4-3869552637a9,network=Network(fbca82d5-40ca-4591-992b-dd555b5fef8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a5868f-a2')
May 19 04:38:14.176971 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:38:14.176971 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165494.176351, e415a06a-1c69-49b7-9bd3-f68ce343b0b7 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:38:14.176971 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] VM Paused (Lifecycle Event)
May 19 04:38:14.203796 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Took 6.68 seconds to spawn the instance on the hypervisor.
May 19 04:38:14.203796 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:14.593997 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:14.594167 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:14.594492 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:14.594741 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:14.595176 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:14.595437 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:14.679481 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:14.683612 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165494.6824286, e415a06a-1c69-49b7-9bd3-f68ce343b0b7 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:38:14.683612 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] VM Resumed (Lifecycle Event)
May 19 04:38:14.710842 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Took 14.60 seconds to build instance.
May 19 04:38:15.100665 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Took 9.59 seconds to spawn the instance on the hypervisor.
May 19 04:38:15.100798 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:15.186283 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:15.192562 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:38:15.213165 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d4dd3147-da63-4b3b-bf99-bbf0f5a49d4b tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.108s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:15.550143 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d249c115-31d9-4b3f-833a-f7244ed008c0 req-28c31bd5-8ba9-459d-967f-a2f99a0dd2a4 service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Received event network-vif-plugged-7a1337f5-a743-48fe-97e4-3ace03005016 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:15.550374 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d249c115-31d9-4b3f-833a-f7244ed008c0 req-28c31bd5-8ba9-459d-967f-a2f99a0dd2a4 service nova] Acquiring lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:15.550541 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d249c115-31d9-4b3f-833a-f7244ed008c0 req-28c31bd5-8ba9-459d-967f-a2f99a0dd2a4 service nova] Lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:15.550653 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d249c115-31d9-4b3f-833a-f7244ed008c0 req-28c31bd5-8ba9-459d-967f-a2f99a0dd2a4 service nova] Lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:15.550768 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d249c115-31d9-4b3f-833a-f7244ed008c0 req-28c31bd5-8ba9-459d-967f-a2f99a0dd2a4 service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] No waiting events found dispatching network-vif-plugged-7a1337f5-a743-48fe-97e4-3ace03005016 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:38:15.550877 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-d249c115-31d9-4b3f-833a-f7244ed008c0 req-28c31bd5-8ba9-459d-967f-a2f99a0dd2a4 service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Received unexpected event network-vif-plugged-7a1337f5-a743-48fe-97e4-3ace03005016 for instance with vm_state active and task_state None.
May 19 04:38:15.619820 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Took 16.87 seconds to build instance.
May 19 04:38:15.697232 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165495.6965408, 346344d1-df0a-4fd8-9396-b5fde8cf53d1 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:38:15.698094 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] VM Started (Lifecycle Event)
May 19 04:38:15.705338 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:38:15.705338 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:38:15.705338 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] No VIF found with MAC fa:16:3e:8d:df:62, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:38:15.705338 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Using config drive
May 19 04:38:16.122419 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.378s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:16.203865 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:16.217442 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:16.220517 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:38:16.336129 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1809a6b1-d3b8-418a-a1c0-cdee0d2c0708 req-08d076ab-8f32-4a38-aa1d-b9ddc200d46c service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Received event network-changed-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:16.336129 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1809a6b1-d3b8-418a-a1c0-cdee0d2c0708 req-08d076ab-8f32-4a38-aa1d-b9ddc200d46c service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Refreshing instance network info cache due to event network-changed-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:38:16.336129 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1809a6b1-d3b8-418a-a1c0-cdee0d2c0708 req-08d076ab-8f32-4a38-aa1d-b9ddc200d46c service nova] Acquiring lock "refresh_cache-e415a06a-1c69-49b7-9bd3-f68ce343b0b7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:38:16.336129 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1809a6b1-d3b8-418a-a1c0-cdee0d2c0708 req-08d076ab-8f32-4a38-aa1d-b9ddc200d46c service nova] Acquired lock "refresh_cache-e415a06a-1c69-49b7-9bd3-f68ce343b0b7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:38:16.336129 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1809a6b1-d3b8-418a-a1c0-cdee0d2c0708 req-08d076ab-8f32-4a38-aa1d-b9ddc200d46c service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Refreshing network info cache for port 5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:38:16.378864 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Creating config drive at /opt/stack/data/nova/instances/3d008249-1262-4ec8-a8c1-d7845472b4c1/disk.config
May 19 04:38:16.383887 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3d008249-1262-4ec8-a8c1-d7845472b4c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5sg0a3lm {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:16.445496 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3d008249-1262-4ec8-a8c1-d7845472b4c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5sg0a3lm" returned: 0 in 0.061s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:16.725849 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165496.7255173, 346344d1-df0a-4fd8-9396-b5fde8cf53d1 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:38:16.726342 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] VM Paused (Lifecycle Event)
May 19 04:38:16.839721 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-1809a6b1-d3b8-418a-a1c0-cdee0d2c0708 req-08d076ab-8f32-4a38-aa1d-b9ddc200d46c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:16.946706 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:16.981663 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:16.985423 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:17.078141 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:17.229189 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:17.242970 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165497.242597, 346344d1-df0a-4fd8-9396-b5fde8cf53d1 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:38:17.244749 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] VM Resumed (Lifecycle Event)
May 19 04:38:17.298548 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-1809a6b1-d3b8-418a-a1c0-cdee0d2c0708 req-08d076ab-8f32-4a38-aa1d-b9ddc200d46c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:17.334820 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:17.370185 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:17.511860 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1809a6b1-d3b8-418a-a1c0-cdee0d2c0708 req-08d076ab-8f32-4a38-aa1d-b9ddc200d46c service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Updated VIF entry in instance network info cache for port 5b2a0762-a1d4-4a8c-a81b-de0fef92e15c. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:38:17.512352 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1809a6b1-d3b8-418a-a1c0-cdee0d2c0708 req-08d076ab-8f32-4a38-aa1d-b9ddc200d46c service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Updating instance_info_cache with network_info: [{"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:38:17.645583 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c9768cc1-8fa2-47ea-9579-97a8040dc919 req-a6f6f8af-dee4-47ab-8197-c8300e0b4743 service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Received event network-changed-7a1337f5-a743-48fe-97e4-3ace03005016 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:17.645583 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c9768cc1-8fa2-47ea-9579-97a8040dc919 req-a6f6f8af-dee4-47ab-8197-c8300e0b4743 service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Refreshing instance network info cache due to event network-changed-7a1337f5-a743-48fe-97e4-3ace03005016. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:38:17.645583 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c9768cc1-8fa2-47ea-9579-97a8040dc919 req-a6f6f8af-dee4-47ab-8197-c8300e0b4743 service nova] Acquiring lock "refresh_cache-346344d1-df0a-4fd8-9396-b5fde8cf53d1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:38:17.645583 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c9768cc1-8fa2-47ea-9579-97a8040dc919 req-a6f6f8af-dee4-47ab-8197-c8300e0b4743 service nova] Acquired lock "refresh_cache-346344d1-df0a-4fd8-9396-b5fde8cf53d1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:38:17.645583 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c9768cc1-8fa2-47ea-9579-97a8040dc919 req-a6f6f8af-dee4-47ab-8197-c8300e0b4743 service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Refreshing network info cache for port 7a1337f5-a743-48fe-97e4-3ace03005016 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:38:17.746253 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:17.748305 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:38:18.014588 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1809a6b1-d3b8-418a-a1c0-cdee0d2c0708 req-08d076ab-8f32-4a38-aa1d-b9ddc200d46c service nova] Releasing lock "refresh_cache-e415a06a-1c69-49b7-9bd3-f68ce343b0b7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:38:18.054171 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:18.147267 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-c9768cc1-8fa2-47ea-9579-97a8040dc919 req-a6f6f8af-dee4-47ab-8197-c8300e0b4743 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:18.251574 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165498.2511482, 3d008249-1262-4ec8-a8c1-d7845472b4c1 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:38:18.251766 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] VM Started (Lifecycle Event)
May 19 04:38:18.396248 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3b2fb16c-c6f2-4b83-a60f-ac97924fb9ef req-11b94286-7533-4f3e-82da-d4268850c343 service nova] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Received event network-vif-plugged-c3a5868f-a20d-451d-a1a4-3869552637a9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:18.396728 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3b2fb16c-c6f2-4b83-a60f-ac97924fb9ef req-11b94286-7533-4f3e-82da-d4268850c343 service nova] Acquiring lock "3d008249-1262-4ec8-a8c1-d7845472b4c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:18.397390 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3b2fb16c-c6f2-4b83-a60f-ac97924fb9ef req-11b94286-7533-4f3e-82da-d4268850c343 service nova] Lock "3d008249-1262-4ec8-a8c1-d7845472b4c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:18.397709 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3b2fb16c-c6f2-4b83-a60f-ac97924fb9ef req-11b94286-7533-4f3e-82da-d4268850c343 service nova] Lock "3d008249-1262-4ec8-a8c1-d7845472b4c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:18.397999 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3b2fb16c-c6f2-4b83-a60f-ac97924fb9ef req-11b94286-7533-4f3e-82da-d4268850c343 service nova] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Processing event network-vif-plugged-c3a5868f-a20d-451d-a1a4-3869552637a9 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:38:18.399295 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3b2fb16c-c6f2-4b83-a60f-ac97924fb9ef req-11b94286-7533-4f3e-82da-d4268850c343 service nova] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Received event network-vif-plugged-c3a5868f-a20d-451d-a1a4-3869552637a9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:18.399295 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3b2fb16c-c6f2-4b83-a60f-ac97924fb9ef req-11b94286-7533-4f3e-82da-d4268850c343 service nova] Acquiring lock "3d008249-1262-4ec8-a8c1-d7845472b4c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:18.399295 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3b2fb16c-c6f2-4b83-a60f-ac97924fb9ef req-11b94286-7533-4f3e-82da-d4268850c343 service nova] Lock "3d008249-1262-4ec8-a8c1-d7845472b4c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:18.399295 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3b2fb16c-c6f2-4b83-a60f-ac97924fb9ef req-11b94286-7533-4f3e-82da-d4268850c343 service nova] Lock "3d008249-1262-4ec8-a8c1-d7845472b4c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:18.399295 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3b2fb16c-c6f2-4b83-a60f-ac97924fb9ef req-11b94286-7533-4f3e-82da-d4268850c343 service nova] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] No waiting events found dispatching network-vif-plugged-c3a5868f-a20d-451d-a1a4-3869552637a9 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:38:18.399295 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-3b2fb16c-c6f2-4b83-a60f-ac97924fb9ef req-11b94286-7533-4f3e-82da-d4268850c343 service nova] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Received unexpected event network-vif-plugged-c3a5868f-a20d-451d-a1a4-3869552637a9 for instance with vm_state building and task_state spawning.
May 19 04:38:18.400543 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:38:18.405417 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:38:18.407493 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Instance spawned successfully.
May 19 04:38:18.409033 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:38:18.487730 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-c9768cc1-8fa2-47ea-9579-97a8040dc919 req-a6f6f8af-dee4-47ab-8197-c8300e0b4743 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:18.633277 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c9768cc1-8fa2-47ea-9579-97a8040dc919 req-a6f6f8af-dee4-47ab-8197-c8300e0b4743 service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Updated VIF entry in instance network info cache for port 7a1337f5-a743-48fe-97e4-3ace03005016. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:38:18.633645 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c9768cc1-8fa2-47ea-9579-97a8040dc919 req-a6f6f8af-dee4-47ab-8197-c8300e0b4743 service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Updating instance_info_cache with network_info: [{"id": "7a1337f5-a743-48fe-97e4-3ace03005016", "address": "fa:16:3e:ee:13:2d", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1337f5-a7", "ovs_interfaceid": "7a1337f5-a743-48fe-97e4-3ace03005016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:38:18.756652 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:18.758605 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:38:18.919175 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:18.919175 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:18.919175 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:18.919175 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:18.919175 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:18.919175 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:38:19.135805 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c9768cc1-8fa2-47ea-9579-97a8040dc919 req-a6f6f8af-dee4-47ab-8197-c8300e0b4743 service nova] Releasing lock "refresh_cache-346344d1-df0a-4fd8-9396-b5fde8cf53d1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:38:19.181209 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:19.264211 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:38:19.264211 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165499.2617245, 3d008249-1262-4ec8-a8c1-d7845472b4c1 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:38:19.264211 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] VM Paused (Lifecycle Event)
May 19 04:38:19.423685 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Took 7.65 seconds to spawn the instance on the hypervisor.
May 19 04:38:19.423824 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:19.764613 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:19.766434 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165499.766213, 3d008249-1262-4ec8-a8c1-d7845472b4c1 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:38:19.766550 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] VM Resumed (Lifecycle Event)
May 19 04:38:19.938730 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Took 13.44 seconds to build instance.
May 19 04:38:20.269329 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:20.272958 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:38:20.440409 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "3d008249-1262-4ec8-a8c1-d7845472b4c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.971s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:22.552366 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Acquiring lock "3d008249-1262-4ec8-a8c1-d7845472b4c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:22.552366 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "3d008249-1262-4ec8-a8c1-d7845472b4c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:22.552366 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Acquiring lock "3d008249-1262-4ec8-a8c1-d7845472b4c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:22.552366 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "3d008249-1262-4ec8-a8c1-d7845472b4c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:22.552366 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "3d008249-1262-4ec8-a8c1-d7845472b4c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:22.554067 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Terminating instance
May 19 04:38:23.056517 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:23.061250 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:38:23.083271 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:23.089447 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:23.114448 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:23.122389 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:23.148430 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:23.151157 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:23.366326 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:23.375912 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:23.401249 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Instance destroyed successfully.
May 19 04:38:23.402827 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lazy-loading 'resources' on Instance uuid 3d008249-1262-4ec8-a8c1-d7845472b4c1 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:38:23.403637 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999638270000105 future=<Future at 0x721850655790 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:38:23.404042 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999196684000026 future=<Future at 0x721850655790 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:38:23.405261 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.997963084000048 future=<Future at 0x721850655790 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:38:23.428302 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f5f4fddb-b23c-4f2c-b180-7cd1000b4251 req-710f9ffe-93f3-4e8e-bdac-f005f60a4d54 service nova] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Received event network-vif-unplugged-c3a5868f-a20d-451d-a1a4-3869552637a9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:23.428469 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f5f4fddb-b23c-4f2c-b180-7cd1000b4251 req-710f9ffe-93f3-4e8e-bdac-f005f60a4d54 service nova] Acquiring lock "3d008249-1262-4ec8-a8c1-d7845472b4c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:23.428928 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f5f4fddb-b23c-4f2c-b180-7cd1000b4251 req-710f9ffe-93f3-4e8e-bdac-f005f60a4d54 service nova] Lock "3d008249-1262-4ec8-a8c1-d7845472b4c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:23.428928 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f5f4fddb-b23c-4f2c-b180-7cd1000b4251 req-710f9ffe-93f3-4e8e-bdac-f005f60a4d54 service nova] Lock "3d008249-1262-4ec8-a8c1-d7845472b4c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:23.428928 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f5f4fddb-b23c-4f2c-b180-7cd1000b4251 req-710f9ffe-93f3-4e8e-bdac-f005f60a4d54 service nova] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] No waiting events found dispatching network-vif-unplugged-c3a5868f-a20d-451d-a1a4-3869552637a9 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:38:23.428928 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f5f4fddb-b23c-4f2c-b180-7cd1000b4251 req-710f9ffe-93f3-4e8e-bdac-f005f60a4d54 service nova] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Received event network-vif-unplugged-c3a5868f-a20d-451d-a1a4-3869552637a9 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:38:23.591590 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:23.906323 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:38:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1063904648',display_name='tempest-VolumesActionsTest-instance-1063904648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesactionstest-instance-1063904648',id=26,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:38:19Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b413d7fd7b148adaa3e2c41bfa30252',ramdisk_id='',reservation_id='r-gh3m7roe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2133751040',owner_user_name='tempest-VolumesActionsTest-2133751040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:38:19Z,user_data=None,user_id='12a42fd27b7040b3964b46f5455691c6',uuid=3d008249-1262-4ec8-a8c1-d7845472b4c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3a5868f-a20d-451d-a1a4-3869552637a9", "address": "fa:16:3e:8d:df:62", "network": {"id": "fbca82d5-40ca-4591-992b-dd555b5fef8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919658386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b413d7fd7b148adaa3e2c41bfa30252", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a5868f-a2", "ovs_interfaceid": "c3a5868f-a20d-451d-a1a4-3869552637a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:38:23.906626 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Converting VIF {"id": "c3a5868f-a20d-451d-a1a4-3869552637a9", "address": "fa:16:3e:8d:df:62", "network": {"id": "fbca82d5-40ca-4591-992b-dd555b5fef8e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919658386-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b413d7fd7b148adaa3e2c41bfa30252", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a5868f-a2", "ovs_interfaceid": "c3a5868f-a20d-451d-a1a4-3869552637a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:38:23.907448 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:df:62,bridge_name='br-int',has_traffic_filtering=True,id=c3a5868f-a20d-451d-a1a4-3869552637a9,network=Network(fbca82d5-40ca-4591-992b-dd555b5fef8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a5868f-a2') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:38:23.907972 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:df:62,bridge_name='br-int',has_traffic_filtering=True,id=c3a5868f-a20d-451d-a1a4-3869552637a9,network=Network(fbca82d5-40ca-4591-992b-dd555b5fef8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a5868f-a2') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:38:23.911634 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:23.912009 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3a5868f-a2, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:23.913534 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:23.915244 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:23.918159 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:23.921210 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:23.921210 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=374c842e-b22e-4fc2-8323-a9f25ebe6f0c) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:23.922990 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:23.922990 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:23.924195 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:23.928178 np0000001025 nova-compute[97981]: INFO os_vif [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:df:62,bridge_name='br-int',has_traffic_filtering=True,id=c3a5868f-a20d-451d-a1a4-3869552637a9,network=Network(fbca82d5-40ca-4591-992b-dd555b5fef8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a5868f-a2')
May 19 04:38:23.932164 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Deleting instance files /opt/stack/data/nova/instances/3d008249-1262-4ec8-a8c1-d7845472b4c1_del
May 19 04:38:23.943071 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Deletion of /opt/stack/data/nova/instances/3d008249-1262-4ec8-a8c1-d7845472b4c1_del complete
May 19 04:38:24.450762 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Took 1.39 seconds to destroy the instance on the hypervisor.
May 19 04:38:24.451359 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:38:24.451682 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:38:24.451791 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:38:24.452019 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:24.524303 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:25.294756 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:38:25.520430 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-59eea6a4-bf0e-4af8-b506-3af15bb07dfa req-9f133b93-e7eb-4fce-a0bd-885db98f4071 service nova] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Received event network-vif-unplugged-c3a5868f-a20d-451d-a1a4-3869552637a9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:25.522642 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-59eea6a4-bf0e-4af8-b506-3af15bb07dfa req-9f133b93-e7eb-4fce-a0bd-885db98f4071 service nova] Acquiring lock "3d008249-1262-4ec8-a8c1-d7845472b4c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:25.522938 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-59eea6a4-bf0e-4af8-b506-3af15bb07dfa req-9f133b93-e7eb-4fce-a0bd-885db98f4071 service nova] Lock "3d008249-1262-4ec8-a8c1-d7845472b4c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:25.523125 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-59eea6a4-bf0e-4af8-b506-3af15bb07dfa req-9f133b93-e7eb-4fce-a0bd-885db98f4071 service nova] Lock "3d008249-1262-4ec8-a8c1-d7845472b4c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:25.523304 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-59eea6a4-bf0e-4af8-b506-3af15bb07dfa req-9f133b93-e7eb-4fce-a0bd-885db98f4071 service nova] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] No waiting events found dispatching network-vif-unplugged-c3a5868f-a20d-451d-a1a4-3869552637a9 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:38:25.523479 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-59eea6a4-bf0e-4af8-b506-3af15bb07dfa req-9f133b93-e7eb-4fce-a0bd-885db98f4071 service nova] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Received event network-vif-unplugged-c3a5868f-a20d-451d-a1a4-3869552637a9 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:38:25.523651 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-59eea6a4-bf0e-4af8-b506-3af15bb07dfa req-9f133b93-e7eb-4fce-a0bd-885db98f4071 service nova] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Received event network-vif-deleted-c3a5868f-a20d-451d-a1a4-3869552637a9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:25.796377 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Took 1.34 seconds to deallocate network for instance.
May 19 04:38:26.135641 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:26.310534 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:26.311010 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:26.777045 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:38:26.777359 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:38:27.282046 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:38:27.792820 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.482s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:27.843230 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Deleted allocations for instance 3d008249-1262-4ec8-a8c1-d7845472b4c1
May 19 04:38:28.060007 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:28.611609 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:38:28.612163 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:38:28.615061 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:38:28.615451 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:38:28.855327 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee875b33-8243-4b37-8877-417c7b7f9924 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Lock "3d008249-1262-4ec8-a8c1-d7845472b4c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.303s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:28.923208 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:29.078068 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:29.615503 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:38:29.619613 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:38:30.615011 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:38:30.615680 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:38:30.615840 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:38:31.029735 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:32.058399 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:32.059029 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:32.059029 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:32.059272 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:32.059458 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:32.067669 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Terminating instance
May 19 04:38:32.575665 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:38:32.612641 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:32.614999 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:38:32.617264 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:32.645375 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:32.664137 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:32.687611 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:32.715802 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:32.834145 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:32.840952 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:32.877980 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:32.939987 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:32.941696 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:32.957150 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ac52c00d-1bb3-4d00-8bf5-5daf16f84399 req-9d3dd0b1-b055-4b7c-b854-8aaa3eef86a2 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-unplugged-856804f2-648b-4cf3-a2d8-a2d4cf97e84f {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:32.957150 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ac52c00d-1bb3-4d00-8bf5-5daf16f84399 req-9d3dd0b1-b055-4b7c-b854-8aaa3eef86a2 service nova] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:32.957504 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ac52c00d-1bb3-4d00-8bf5-5daf16f84399 req-9d3dd0b1-b055-4b7c-b854-8aaa3eef86a2 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:32.957835 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ac52c00d-1bb3-4d00-8bf5-5daf16f84399 req-9d3dd0b1-b055-4b7c-b854-8aaa3eef86a2 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:32.958102 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ac52c00d-1bb3-4d00-8bf5-5daf16f84399 req-9d3dd0b1-b055-4b7c-b854-8aaa3eef86a2 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] No waiting events found dispatching network-vif-unplugged-856804f2-648b-4cf3-a2d8-a2d4cf97e84f {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:38:32.958330 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ac52c00d-1bb3-4d00-8bf5-5daf16f84399 req-9d3dd0b1-b055-4b7c-b854-8aaa3eef86a2 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-unplugged-856804f2-648b-4cf3-a2d8-a2d4cf97e84f for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:38:32.981388 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:33.008966 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:33.072678 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:33.129258 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:33.129566 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:33.129776 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:33.130010 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:38:33.151531 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4afe05c7-628b-4e5b-b842-b4c2047422f3 req-ced55450-807b-4dfc-b55d-3160cf3e7bb9 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-unplugged-371fc2a1-7883-4eef-a3cc-0085db83dfc7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:33.154629 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4afe05c7-628b-4e5b-b842-b4c2047422f3 req-ced55450-807b-4dfc-b55d-3160cf3e7bb9 service nova] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:33.154629 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4afe05c7-628b-4e5b-b842-b4c2047422f3 req-ced55450-807b-4dfc-b55d-3160cf3e7bb9 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:33.154629 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4afe05c7-628b-4e5b-b842-b4c2047422f3 req-ced55450-807b-4dfc-b55d-3160cf3e7bb9 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:33.154629 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4afe05c7-628b-4e5b-b842-b4c2047422f3 req-ced55450-807b-4dfc-b55d-3160cf3e7bb9 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] No waiting events found dispatching network-vif-unplugged-371fc2a1-7883-4eef-a3cc-0085db83dfc7 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:38:33.154629 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4afe05c7-628b-4e5b-b842-b4c2047422f3 req-ced55450-807b-4dfc-b55d-3160cf3e7bb9 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-unplugged-371fc2a1-7883-4eef-a3cc-0085db83dfc7 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:38:33.185793 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:33.233965 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:33.258258 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999678842000094 future=<Future at 0x7218342117c0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:38:33.268912 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Instance destroyed successfully.
May 19 04:38:33.269517 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lazy-loading 'resources' on Instance uuid 7859dfab-f702-4d0b-a9e9-bb856c5004e6 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:38:33.283086 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:33.774992 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508815012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1508815012',id=19,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBocQCc15NItD68QZzkvBuEd0COiZni8hxYbKGZdsTrtlGYMwPFDUxMvKX70mv6NxQ/9uLjET9uEK8V+zM3LQnd+qnoNoRs94oRrVe5QZWgNQNR0jX7RjQBec1JJdtX8Hg==',key_name='tempest-keypair-2133430261',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:37:45Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc136a1f1fe94373a04ae534d82f8673',ramdisk_id='',reservation_id='r-iufog8sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-171323133',owner_user_name='tempest-TaggedBootDevicesTest-171323133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:37:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dad74db8b9240b1a3e3e145265f8b99',uuid=7859dfab-f702-4d0b-a9e9-bb856c5004e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "address": "fa:16:3e:74:c7:cf", "network": {"id": "274fbf5f-057a-48b4-8049-70f366638ce8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1968961134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d50a64-6a", "ovs_interfaceid": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:38:33.775517 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converting VIF {"id": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "address": "fa:16:3e:74:c7:cf", "network": {"id": "274fbf5f-057a-48b4-8049-70f366638ce8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1968961134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d50a64-6a", "ovs_interfaceid": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:38:33.778414 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:c7:cf,bridge_name='br-int',has_traffic_filtering=True,id=34d50a64-6aed-47ee-ae9c-851a9fe0161b,network=Network(274fbf5f-057a-48b4-8049-70f366638ce8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d50a64-6a') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:38:33.778702 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:c7:cf,bridge_name='br-int',has_traffic_filtering=True,id=34d50a64-6aed-47ee-ae9c-851a9fe0161b,network=Network(274fbf5f-057a-48b4-8049-70f366638ce8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d50a64-6a') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:38:33.781467 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:33.784203 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34d50a64-6a, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:33.784203 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:33.784772 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:33.818256 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:33.820179 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:33.821315 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=26a0f6cd-4b3a-4853-8ff7-752b201715be) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:33.822769 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:33.824047 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:33.858763 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:33.863865 np0000001025 nova-compute[97981]: INFO os_vif [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:c7:cf,bridge_name='br-int',has_traffic_filtering=True,id=34d50a64-6aed-47ee-ae9c-851a9fe0161b,network=Network(274fbf5f-057a-48b4-8049-70f366638ce8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d50a64-6a')
May 19 04:38:33.864693 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508815012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1508815012',id=19,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBocQCc15NItD68QZzkvBuEd0COiZni8hxYbKGZdsTrtlGYMwPFDUxMvKX70mv6NxQ/9uLjET9uEK8V+zM3LQnd+qnoNoRs94oRrVe5QZWgNQNR0jX7RjQBec1JJdtX8Hg==',key_name='tempest-keypair-2133430261',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:37:45Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc136a1f1fe94373a04ae534d82f8673',ramdisk_id='',reservation_id='r-iufog8sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-171323133',owner_user_name='tempest-TaggedBootDevicesTest-171323133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:37:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dad74db8b9240b1a3e3e145265f8b99',uuid=7859dfab-f702-4d0b-a9e9-bb856c5004e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "address": "fa:16:3e:ce:a6:b1", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5add6c4e-98", "ovs_interfaceid": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:38:33.865063 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converting VIF {"id": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "address": "fa:16:3e:ce:a6:b1", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5add6c4e-98", "ovs_interfaceid": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:38:33.866843 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:a6:b1,bridge_name='br-int',has_traffic_filtering=True,id=5add6c4e-9889-49d8-9fa6-2db045c6b4ae,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5add6c4e-98') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:38:33.866843 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:a6:b1,bridge_name='br-int',has_traffic_filtering=True,id=5add6c4e-9889-49d8-9fa6-2db045c6b4ae,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5add6c4e-98') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:38:33.867498 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:33.867736 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5add6c4e-98, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:33.868973 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:33.871524 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:33.899702 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:33.903322 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:33.903641 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=492a3b5f-97b2-4f04-9e5e-1efa471142d7) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:33.905226 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:33.905943 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:33.932335 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:33.936430 np0000001025 nova-compute[97981]: INFO os_vif [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:a6:b1,bridge_name='br-int',has_traffic_filtering=True,id=5add6c4e-9889-49d8-9fa6-2db045c6b4ae,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5add6c4e-98')
May 19 04:38:33.937340 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508815012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1508815012',id=19,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBocQCc15NItD68QZzkvBuEd0COiZni8hxYbKGZdsTrtlGYMwPFDUxMvKX70mv6NxQ/9uLjET9uEK8V+zM3LQnd+qnoNoRs94oRrVe5QZWgNQNR0jX7RjQBec1JJdtX8Hg==',key_name='tempest-keypair-2133430261',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:37:45Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc136a1f1fe94373a04ae534d82f8673',ramdisk_id='',reservation_id='r-iufog8sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-171323133',owner_user_name='tempest-TaggedBootDevicesTest-171323133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:37:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dad74db8b9240b1a3e3e145265f8b99',uuid=7859dfab-f702-4d0b-a9e9-bb856c5004e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "address": "fa:16:3e:9b:1a:bc", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap856804f2-64", "ovs_interfaceid": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:38:33.937503 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converting VIF {"id": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "address": "fa:16:3e:9b:1a:bc", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap856804f2-64", "ovs_interfaceid": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:38:33.938802 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:1a:bc,bridge_name='br-int',has_traffic_filtering=True,id=856804f2-648b-4cf3-a2d8-a2d4cf97e84f,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap856804f2-64') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:38:33.938802 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:1a:bc,bridge_name='br-int',has_traffic_filtering=True,id=856804f2-648b-4cf3-a2d8-a2d4cf97e84f,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap856804f2-64') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:38:33.939366 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:33.939570 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap856804f2-64, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:33.940634 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:33.941474 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:33.968242 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:33.972229 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:33.972229 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46bda69c-626f-4539-b75a-be287699a7d7) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:33.972229 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:33.972229 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:33.995720 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.002531 np0000001025 nova-compute[97981]: INFO os_vif [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:1a:bc,bridge_name='br-int',has_traffic_filtering=True,id=856804f2-648b-4cf3-a2d8-a2d4cf97e84f,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap856804f2-64')
May 19 04:38:34.004447 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508815012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1508815012',id=19,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBocQCc15NItD68QZzkvBuEd0COiZni8hxYbKGZdsTrtlGYMwPFDUxMvKX70mv6NxQ/9uLjET9uEK8V+zM3LQnd+qnoNoRs94oRrVe5QZWgNQNR0jX7RjQBec1JJdtX8Hg==',key_name='tempest-keypair-2133430261',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:37:45Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc136a1f1fe94373a04ae534d82f8673',ramdisk_id='',reservation_id='r-iufog8sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-171323133',owner_user_name='tempest-TaggedBootDevicesTest-171323133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:37:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dad74db8b9240b1a3e3e145265f8b99',uuid=7859dfab-f702-4d0b-a9e9-bb856c5004e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "address": "fa:16:3e:12:e9:10", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371fc2a1-78", "ovs_interfaceid": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:38:34.004655 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converting VIF {"id": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "address": "fa:16:3e:12:e9:10", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371fc2a1-78", "ovs_interfaceid": "371fc2a1-7883-4eef-a3cc-0085db83dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:38:34.005182 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:e9:10,bridge_name='br-int',has_traffic_filtering=True,id=371fc2a1-7883-4eef-a3cc-0085db83dfc7,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371fc2a1-78') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:38:34.005402 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:e9:10,bridge_name='br-int',has_traffic_filtering=True,id=371fc2a1-7883-4eef-a3cc-0085db83dfc7,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371fc2a1-78') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:38:34.006138 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.007681 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap371fc2a1-78, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:34.008823 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.009840 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:34.025344 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.026472 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.027172 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a9d954c-b932-4660-9487-aa78d597d093) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:34.027680 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.028845 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:34.051343 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.057305 np0000001025 nova-compute[97981]: INFO os_vif [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:e9:10,bridge_name='br-int',has_traffic_filtering=True,id=371fc2a1-7883-4eef-a3cc-0085db83dfc7,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371fc2a1-78')
May 19 04:38:34.058316 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508815012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1508815012',id=19,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBocQCc15NItD68QZzkvBuEd0COiZni8hxYbKGZdsTrtlGYMwPFDUxMvKX70mv6NxQ/9uLjET9uEK8V+zM3LQnd+qnoNoRs94oRrVe5QZWgNQNR0jX7RjQBec1JJdtX8Hg==',key_name='tempest-keypair-2133430261',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:37:45Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc136a1f1fe94373a04ae534d82f8673',ramdisk_id='',reservation_id='r-iufog8sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-171323133',owner_user_name='tempest-TaggedBootDevicesTest-171323133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:37:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dad74db8b9240b1a3e3e145265f8b99',uuid=7859dfab-f702-4d0b-a9e9-bb856c5004e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "address": "fa:16:3e:97:55:fe", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e688b23-68", "ovs_interfaceid": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:38:34.060305 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converting VIF {"id": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "address": "fa:16:3e:97:55:fe", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e688b23-68", "ovs_interfaceid": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:38:34.060305 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:55:fe,bridge_name='br-int',has_traffic_filtering=True,id=3e688b23-684d-4dcf-95a1-2f44d8ea1649,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e688b23-68') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:38:34.060651 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:55:fe,bridge_name='br-int',has_traffic_filtering=True,id=3e688b23-684d-4dcf-95a1-2f44d8ea1649,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e688b23-68') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:38:34.061509 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.061861 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e688b23-68, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:34.062939 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.069336 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:34.079183 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.079651 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.079872 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5bc7ac8-97b6-43eb-8598-61e11c9979e2) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:34.080707 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.081183 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:34.096230 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.098092 np0000001025 nova-compute[97981]: INFO os_vif [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:55:fe,bridge_name='br-int',has_traffic_filtering=True,id=3e688b23-684d-4dcf-95a1-2f44d8ea1649,network=Network(04e817d9-6038-46d0-a6c3-a339127acee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e688b23-68')
May 19 04:38:34.098760 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508815012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1508815012',id=19,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBocQCc15NItD68QZzkvBuEd0COiZni8hxYbKGZdsTrtlGYMwPFDUxMvKX70mv6NxQ/9uLjET9uEK8V+zM3LQnd+qnoNoRs94oRrVe5QZWgNQNR0jX7RjQBec1JJdtX8Hg==',key_name='tempest-keypair-2133430261',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:37:45Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc136a1f1fe94373a04ae534d82f8673',ramdisk_id='',reservation_id='r-iufog8sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-171323133',owner_user_name='tempest-TaggedBootDevicesTest-171323133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:37:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dad74db8b9240b1a3e3e145265f8b99',uuid=7859dfab-f702-4d0b-a9e9-bb856c5004e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea620a14-2efe-4797-9ee1-c004ba488769", "address": "fa:16:3e:2d:30:c5", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea620a14-2e", "ovs_interfaceid": "ea620a14-2efe-4797-9ee1-c004ba488769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:38:34.099171 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converting VIF {"id": "ea620a14-2efe-4797-9ee1-c004ba488769", "address": "fa:16:3e:2d:30:c5", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea620a14-2e", "ovs_interfaceid": "ea620a14-2efe-4797-9ee1-c004ba488769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:38:34.099521 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:30:c5,bridge_name='br-int',has_traffic_filtering=True,id=ea620a14-2efe-4797-9ee1-c004ba488769,network=Network(eb61abe7-a444-4002-bec1-68ef7e4f36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea620a14-2e') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:38:34.099789 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:30:c5,bridge_name='br-int',has_traffic_filtering=True,id=ea620a14-2efe-4797-9ee1-c004ba488769,network=Network(eb61abe7-a444-4002-bec1-68ef7e4f36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea620a14-2e') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:38:34.100469 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.100628 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea620a14-2e, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:34.101954 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.102761 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:34.111234 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.112604 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.112723 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7dc82a4-b586-4218-beb3-a0a36eb0ec0b) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:34.113588 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.113729 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:34.120216 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.122419 np0000001025 nova-compute[97981]: INFO os_vif [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:30:c5,bridge_name='br-int',has_traffic_filtering=True,id=ea620a14-2efe-4797-9ee1-c004ba488769,network=Network(eb61abe7-a444-4002-bec1-68ef7e4f36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea620a14-2e')
May 19 04:38:34.123055 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508815012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-device-tagging-server-1508815012',id=19,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBocQCc15NItD68QZzkvBuEd0COiZni8hxYbKGZdsTrtlGYMwPFDUxMvKX70mv6NxQ/9uLjET9uEK8V+zM3LQnd+qnoNoRs94oRrVe5QZWgNQNR0jX7RjQBec1JJdtX8Hg==',key_name='tempest-keypair-2133430261',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:37:45Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc136a1f1fe94373a04ae534d82f8673',ramdisk_id='',reservation_id='r-iufog8sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-171323133',owner_user_name='tempest-TaggedBootDevicesTest-171323133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:37:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dad74db8b9240b1a3e3e145265f8b99',uuid=7859dfab-f702-4d0b-a9e9-bb856c5004e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "address": "fa:16:3e:92:1a:3d", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fdb83aa-cd", "ovs_interfaceid": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:38:34.123703 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converting VIF {"id": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "address": "fa:16:3e:92:1a:3d", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fdb83aa-cd", "ovs_interfaceid": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:38:34.123703 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:1a:3d,bridge_name='br-int',has_traffic_filtering=True,id=0fdb83aa-cd21-410a-8823-a52276cc6fb1,network=Network(eb61abe7-a444-4002-bec1-68ef7e4f36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fdb83aa-cd') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:38:34.123974 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:1a:3d,bridge_name='br-int',has_traffic_filtering=True,id=0fdb83aa-cd21-410a-8823-a52276cc6fb1,network=Network(eb61abe7-a444-4002-bec1-68ef7e4f36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fdb83aa-cd') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:38:34.124868 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.125204 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fdb83aa-cd, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:34.128607 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.128607 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:34.129365 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.129365 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9c98d8d-e750-431f-93e5-e4ff41d01347) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:34.130782 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.130782 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:34.131294 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:34.132982 np0000001025 nova-compute[97981]: INFO os_vif [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:1a:3d,bridge_name='br-int',has_traffic_filtering=True,id=0fdb83aa-cd21-410a-8823-a52276cc6fb1,network=Network(eb61abe7-a444-4002-bec1-68ef7e4f36fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fdb83aa-cd')
May 19 04:38:34.136905 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:38:34.137299 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b', 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f628dad-4b63-4812-a34d-a3b52215814b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:38:34.137458 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:38:34.137878 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:38:34.138270 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b', 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f628dad-4b63-4812-a34d-a3b52215814b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:38:34.138534 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:38:34.177103 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:34.177103 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:34.177103 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:34.177103 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:34.177103 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:34.177103 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:34.177103 np0000001025 nova-compute[97981]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:34.177103 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:34.177103 np0000001025 nova-compute[97981]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:34.177103 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:34.177103 np0000001025 nova-compute[97981]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:34.177103 np0000001025 nova-compute[97981]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:34.177103 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:38:34.177392 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:34.177392 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:34.177392 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:34.177392 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:34.177392 np0000001025 nova-compute[97981]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:34.177392 np0000001025 nova-compute[97981]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b (non-flash)
May 19 04:38:34.177392 np0000001025 nova-compute[97981]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:34.177392 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:34.177392 np0000001025 nova-compute[97981]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:34.177392 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:34.177392 np0000001025 nova-compute[97981]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:34.177392 np0000001025 nova-compute[97981]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:34.177392 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:38:34.177809 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3', '48')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:38:34.177809 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b', '41')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:38:34.179219 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b', '42')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:38:34.180908 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721834487b00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b'): ({'sdi'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:38:34.180908 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Removing multipathed devices sdh, sdi {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:38:34.181209 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Flush multipath device 33000000090b6d19c {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:38:34.217911 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:38:34.258394 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:38:34.291612 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:38:34.291808 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:38:34.293148 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:38:34.304494 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:38:34.304729 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:38:34.316262 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:34.332986 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:34.381246 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b, portal: 192.168.40.100,3260]
May 19 04:38:34.381246 np0000001025 nova-compute[97981]: Logout of [sid: 41, target: iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b, portal: 192.168.40.100,3260] successful.
May 19 04:38:34.381246 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:34.405847 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:34.413975 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:34.414353 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:34.429492 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:34.476998 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b, portal: 192.168.50.100,3260]
May 19 04:38:34.476998 np0000001025 nova-compute[97981]: Logout of [sid: 42, target: iqn.2023-03.storpool.com:os--volume-2f628dad-4b63-4812-a34d-a3b52215814b, portal: 192.168.50.100,3260] successful.
May 19 04:38:34.476998 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:34.496020 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:34.496557 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:38:34.496726 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] <== disconnect_volume: return (359ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:38:34.496923 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:38:34.498808 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:38:34.500067 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:38:34.500067 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:38:34.500067 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:38:34.500333 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:38:34.500528 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:38:34.506987 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:34.510284 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:38:34.510643 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:38:34.510643 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-5 (vdc) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:38:34.512264 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:38:34.513451 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:34.530223 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:34.530223 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:34.530223 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:34.530223 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:34.530223 np0000001025 nova-compute[97981]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:34.530223 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:34.530223 np0000001025 nova-compute[97981]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:34.530223 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:34.530223 np0000001025 nova-compute[97981]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:34.530223 np0000001025 nova-compute[97981]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:34.530223 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:38:34.530495 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:34.530495 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:34.530495 np0000001025 nova-compute[97981]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:34.530495 np0000001025 nova-compute[97981]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844 (non-flash)
May 19 04:38:34.530495 np0000001025 nova-compute[97981]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:34.530495 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:34.530495 np0000001025 nova-compute[97981]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:34.530495 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:34.530495 np0000001025 nova-compute[97981]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:34.530495 np0000001025 nova-compute[97981]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:34.530495 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:38:34.531948 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3', '48')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:38:34.531948 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', '39')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:38:34.532706 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844', '40')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:38:34.533644 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185041c2c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844'): ({'sdg'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:38:34.534295 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Removing multipathed devices sdf, sdg {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:38:34.535002 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Flush multipath device 33000000088024718 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:38:34.576560 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:38:34.596240 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:34.596370 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:34.629041 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:38:34.678353 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:34.683509 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:34.695238 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:38:34.695534 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:38:34.698800 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:38:34.718420 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:38:34.718823 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:38:34.732789 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:34.773332 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844, portal: 192.168.40.100,3260]
May 19 04:38:34.773332 np0000001025 nova-compute[97981]: Logout of [sid: 39, target: iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844, portal: 192.168.40.100,3260] successful.
May 19 04:38:34.773332 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:34.798314 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:34.802933 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:34.803448 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:34.821561 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:34.868067 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844, portal: 192.168.50.100,3260]
May 19 04:38:34.868067 np0000001025 nova-compute[97981]: Logout of [sid: 40, target: iqn.2023-03.storpool.com:os--volume-5be8ea8b-fcf2-4a71-8f06-2ee2b82a5844, portal: 192.168.50.100,3260] successful.
May 19 04:38:34.868067 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:34.885680 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:34.886281 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:38:34.886281 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] <== disconnect_volume: return (386ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:38:34.886464 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:38:34.888860 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:38:34.889467 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '826a781c-5976-4c74-8ca4-447a075fb902', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:38:34.889684 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:38:34.890235 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:38:34.890550 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '826a781c-5976-4c74-8ca4-447a075fb902', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:38:34.890725 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:38:34.897233 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:34.902760 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-8 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:38:34.902760 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:38:34.904194 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:34.928065 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:34.928065 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:34.928065 np0000001025 nova-compute[97981]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:34.928065 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:34.928065 np0000001025 nova-compute[97981]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:34.928065 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:34.928065 np0000001025 nova-compute[97981]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:34.928065 np0000001025 nova-compute[97981]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:34.928065 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:38:34.928065 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:34.928065 np0000001025 nova-compute[97981]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902 (non-flash)
May 19 04:38:34.928065 np0000001025 nova-compute[97981]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:34.928065 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:34.928065 np0000001025 nova-compute[97981]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:34.928065 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:34.928065 np0000001025 nova-compute[97981]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:34.928065 np0000001025 nova-compute[97981]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:34.928065 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:38:34.928761 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3', '48')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:38:34.928761 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', '38')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:38:34.930813 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902', '37')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:38:34.932126 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185041c5e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902'): ({'sdd'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:38:34.932516 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Removing multipathed devices sdd, sde {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:38:34.932852 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Flush multipath device 330000000d5af5e45 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:38:34.949553 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:34.950343 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=12754MB free_disk=74.51826095581055GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:38:34.950607 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:34.950852 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:34.995881 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:38:35.027449 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-44e44660-310b-48ea-a3bc-d41678d02f33 req-8ab02490-e350-46bc-9e1d-6abb80043b52 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-unplugged-856804f2-648b-4cf3-a2d8-a2d4cf97e84f {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:35.027449 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-44e44660-310b-48ea-a3bc-d41678d02f33 req-8ab02490-e350-46bc-9e1d-6abb80043b52 service nova] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:35.027605 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-44e44660-310b-48ea-a3bc-d41678d02f33 req-8ab02490-e350-46bc-9e1d-6abb80043b52 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:35.027791 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-44e44660-310b-48ea-a3bc-d41678d02f33 req-8ab02490-e350-46bc-9e1d-6abb80043b52 service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:35.029530 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-44e44660-310b-48ea-a3bc-d41678d02f33 req-8ab02490-e350-46bc-9e1d-6abb80043b52 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] No waiting events found dispatching network-vif-unplugged-856804f2-648b-4cf3-a2d8-a2d4cf97e84f {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:38:35.030432 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-44e44660-310b-48ea-a3bc-d41678d02f33 req-8ab02490-e350-46bc-9e1d-6abb80043b52 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-unplugged-856804f2-648b-4cf3-a2d8-a2d4cf97e84f for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:38:35.035746 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:38:35.090058 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:38:35.090385 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] SCSI volumes sdd, sde have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:38:35.091865 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:38:35.104876 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:38:35.105142 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:38:35.121988 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:35.162063 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902, portal: 192.168.40.100,3260]
May 19 04:38:35.162063 np0000001025 nova-compute[97981]: Logout of [sid: 38, target: iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902, portal: 192.168.40.100,3260] successful.
May 19 04:38:35.162063 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:35.188670 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:35.204339 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:35.237905 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902, portal: 192.168.50.100,3260]
May 19 04:38:35.237905 np0000001025 nova-compute[97981]: Logout of [sid: 37, target: iqn.2023-03.storpool.com:os--volume-826a781c-5976-4c74-8ca4-447a075fb902, portal: 192.168.50.100,3260] successful.
May 19 04:38:35.237905 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:35.250676 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3c2ad8cb-e9d6-46b5-934c-a2ca12198c4b req-b7890518-848a-4919-a1b9-e5f8a49de75f service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-unplugged-371fc2a1-7883-4eef-a3cc-0085db83dfc7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:35.254249 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3c2ad8cb-e9d6-46b5-934c-a2ca12198c4b req-b7890518-848a-4919-a1b9-e5f8a49de75f service nova] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:35.254249 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3c2ad8cb-e9d6-46b5-934c-a2ca12198c4b req-b7890518-848a-4919-a1b9-e5f8a49de75f service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:35.254249 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3c2ad8cb-e9d6-46b5-934c-a2ca12198c4b req-b7890518-848a-4919-a1b9-e5f8a49de75f service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:35.254249 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3c2ad8cb-e9d6-46b5-934c-a2ca12198c4b req-b7890518-848a-4919-a1b9-e5f8a49de75f service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] No waiting events found dispatching network-vif-unplugged-371fc2a1-7883-4eef-a3cc-0085db83dfc7 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:38:35.254249 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3c2ad8cb-e9d6-46b5-934c-a2ca12198c4b req-b7890518-848a-4919-a1b9-e5f8a49de75f service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-unplugged-371fc2a1-7883-4eef-a3cc-0085db83dfc7 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:38:35.254653 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3c2ad8cb-e9d6-46b5-934c-a2ca12198c4b req-b7890518-848a-4919-a1b9-e5f8a49de75f service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-unplugged-0fdb83aa-cd21-410a-8823-a52276cc6fb1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:35.254653 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3c2ad8cb-e9d6-46b5-934c-a2ca12198c4b req-b7890518-848a-4919-a1b9-e5f8a49de75f service nova] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:35.254776 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3c2ad8cb-e9d6-46b5-934c-a2ca12198c4b req-b7890518-848a-4919-a1b9-e5f8a49de75f service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:35.254962 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3c2ad8cb-e9d6-46b5-934c-a2ca12198c4b req-b7890518-848a-4919-a1b9-e5f8a49de75f service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:35.255098 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3c2ad8cb-e9d6-46b5-934c-a2ca12198c4b req-b7890518-848a-4919-a1b9-e5f8a49de75f service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] No waiting events found dispatching network-vif-unplugged-0fdb83aa-cd21-410a-8823-a52276cc6fb1 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:38:35.255291 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3c2ad8cb-e9d6-46b5-934c-a2ca12198c4b req-b7890518-848a-4919-a1b9-e5f8a49de75f service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-unplugged-0fdb83aa-cd21-410a-8823-a52276cc6fb1 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:38:35.255401 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3c2ad8cb-e9d6-46b5-934c-a2ca12198c4b req-b7890518-848a-4919-a1b9-e5f8a49de75f service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-unplugged-0fdb83aa-cd21-410a-8823-a52276cc6fb1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:35.255554 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3c2ad8cb-e9d6-46b5-934c-a2ca12198c4b req-b7890518-848a-4919-a1b9-e5f8a49de75f service nova] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:35.255710 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3c2ad8cb-e9d6-46b5-934c-a2ca12198c4b req-b7890518-848a-4919-a1b9-e5f8a49de75f service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:35.255869 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3c2ad8cb-e9d6-46b5-934c-a2ca12198c4b req-b7890518-848a-4919-a1b9-e5f8a49de75f service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:35.256035 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3c2ad8cb-e9d6-46b5-934c-a2ca12198c4b req-b7890518-848a-4919-a1b9-e5f8a49de75f service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] No waiting events found dispatching network-vif-unplugged-0fdb83aa-cd21-410a-8823-a52276cc6fb1 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:38:35.259524 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3c2ad8cb-e9d6-46b5-934c-a2ca12198c4b req-b7890518-848a-4919-a1b9-e5f8a49de75f service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-unplugged-0fdb83aa-cd21-410a-8823-a52276cc6fb1 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:38:35.261987 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:35.262723 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:38:35.262888 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] <== disconnect_volume: return (373ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:38:35.263903 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:38:35.263903 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Deleting instance files /opt/stack/data/nova/instances/7859dfab-f702-4d0b-a9e9-bb856c5004e6_del
May 19 04:38:35.264061 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Deletion of /opt/stack/data/nova/instances/7859dfab-f702-4d0b-a9e9-bb856c5004e6_del complete
May 19 04:38:35.775214 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Took 3.20 seconds to destroy the instance on the hypervisor.
May 19 04:38:35.775870 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:38:35.776266 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:38:35.776435 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:38:35.776803 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:35.892344 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:36.046330 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 5951341b-0ad5-4fb0-82ad-b464c081f37f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:38:36.046486 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 7859dfab-f702-4d0b-a9e9-bb856c5004e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:38:36.046592 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 11a634a9-3bdd-4085-abc2-a0ad70710975 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:38:36.046592 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 6cd7138c-f217-4858-8941-89693e62ae6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:38:36.046746 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 346344d1-df0a-4fd8-9396-b5fde8cf53d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:38:36.046746 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance e415a06a-1c69-49b7-9bd3-f68ce343b0b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:38:36.046910 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:38:36.047061 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:38:34 up 29 min,  2 users,  load average: 8.71, 6.04, 2.99\n', 'num_instances': '6', 'num_vm_active': '6', 'num_task_None': '5', 'num_os_type_None': '6', 'num_proj_336d55ae51114828ba5ad8c0ac87ca9b': '2', 'io_workload': '0', 'num_task_deleting': '1', 'num_proj_bc136a1f1fe94373a04ae534d82f8673': '1', 'num_proj_e2110bc6ddf24455ab91b4ba84e6170a': '1', 'num_proj_28b3c0fa8f894ed2a7c3bcfac99ce74c': '1', 'num_proj_8a3dfff83ce24e619f87507f951f6c69': '1'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:38:36.235384 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:36.519585 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:38:36.520212 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:38:37.027121 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:38:37.542532 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:38:37.542994 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.592s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:37.543838 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:38:37.546221 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1f68b007-f29d-4264-ae1b-d30b2d8f7243 req-812c53da-6f41-42ee-b91e-d587411829e3 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-deleted-371fc2a1-7883-4eef-a3cc-0085db83dfc7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:37.546685 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-1f68b007-f29d-4264-ae1b-d30b2d8f7243 req-812c53da-6f41-42ee-b91e-d587411829e3 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Neutron deleted interface 371fc2a1-7883-4eef-a3cc-0085db83dfc7; detaching it from the instance and deleting it from the info cache
May 19 04:38:37.547138 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1f68b007-f29d-4264-ae1b-d30b2d8f7243 req-812c53da-6f41-42ee-b91e-d587411829e3 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Updating instance_info_cache with network_info: [{"id": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "address": "fa:16:3e:74:c7:cf", "network": {"id": "274fbf5f-057a-48b4-8049-70f366638ce8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1968961134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d50a64-6a", "ovs_interfaceid": "34d50a64-6aed-47ee-ae9c-851a9fe0161b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "address": "fa:16:3e:ce:a6:b1", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5add6c4e-98", "ovs_interfaceid": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "address": "fa:16:3e:9b:1a:bc", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap856804f2-64", "ovs_interfaceid": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "address": "fa:16:3e:97:55:fe", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e688b23-68", "ovs_interfaceid": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea620a14-2efe-4797-9ee1-c004ba488769", "address": "fa:16:3e:2d:30:c5", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea620a14-2e", "ovs_interfaceid": "ea620a14-2efe-4797-9ee1-c004ba488769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "address": "fa:16:3e:92:1a:3d", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fdb83aa-cd", "ovs_interfaceid": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:38:38.027716 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0a9bd3cd-b8b7-46f9-9ced-72b54d2a3cff req-cd7a6652-02af-4484-88c5-a3b9e36ff3ec service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-unplugged-34d50a64-6aed-47ee-ae9c-851a9fe0161b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:38.028167 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0a9bd3cd-b8b7-46f9-9ced-72b54d2a3cff req-cd7a6652-02af-4484-88c5-a3b9e36ff3ec service nova] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:38.028303 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0a9bd3cd-b8b7-46f9-9ced-72b54d2a3cff req-cd7a6652-02af-4484-88c5-a3b9e36ff3ec service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:38.028432 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0a9bd3cd-b8b7-46f9-9ced-72b54d2a3cff req-cd7a6652-02af-4484-88c5-a3b9e36ff3ec service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:38.028543 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0a9bd3cd-b8b7-46f9-9ced-72b54d2a3cff req-cd7a6652-02af-4484-88c5-a3b9e36ff3ec service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] No waiting events found dispatching network-vif-unplugged-34d50a64-6aed-47ee-ae9c-851a9fe0161b {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:38:38.028779 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0a9bd3cd-b8b7-46f9-9ced-72b54d2a3cff req-cd7a6652-02af-4484-88c5-a3b9e36ff3ec service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-unplugged-34d50a64-6aed-47ee-ae9c-851a9fe0161b for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:38:38.051343 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1f68b007-f29d-4264-ae1b-d30b2d8f7243 req-812c53da-6f41-42ee-b91e-d587411829e3 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Detach interface failed, port_id=371fc2a1-7883-4eef-a3cc-0085db83dfc7, reason: Instance 7859dfab-f702-4d0b-a9e9-bb856c5004e6 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:38:38.111788 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:38.314280 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f97aa391-ca7c-4928-8ff8-7fc414104ac1 req-b0d58015-b6fa-4c4d-8654-9d0d5dbc15e2 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-deleted-34d50a64-6aed-47ee-ae9c-851a9fe0161b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:38.314462 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-f97aa391-ca7c-4928-8ff8-7fc414104ac1 req-b0d58015-b6fa-4c4d-8654-9d0d5dbc15e2 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Neutron deleted interface 34d50a64-6aed-47ee-ae9c-851a9fe0161b; detaching it from the instance and deleting it from the info cache
May 19 04:38:38.314881 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-f97aa391-ca7c-4928-8ff8-7fc414104ac1 req-b0d58015-b6fa-4c4d-8654-9d0d5dbc15e2 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Updating instance_info_cache with network_info: [{"id": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "address": "fa:16:3e:ce:a6:b1", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5add6c4e-98", "ovs_interfaceid": "5add6c4e-9889-49d8-9fa6-2db045c6b4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "address": "fa:16:3e:9b:1a:bc", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap856804f2-64", "ovs_interfaceid": "856804f2-648b-4cf3-a2d8-a2d4cf97e84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "address": "fa:16:3e:97:55:fe", "network": {"id": "04e817d9-6038-46d0-a6c3-a339127acee6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658169575", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e688b23-68", "ovs_interfaceid": "3e688b23-684d-4dcf-95a1-2f44d8ea1649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea620a14-2efe-4797-9ee1-c004ba488769", "address": "fa:16:3e:2d:30:c5", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea620a14-2e", "ovs_interfaceid": "ea620a14-2efe-4797-9ee1-c004ba488769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "address": "fa:16:3e:92:1a:3d", "network": {"id": "eb61abe7-a444-4002-bec1-68ef7e4f36fa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1639315783", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bc136a1f1fe94373a04ae534d82f8673", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fdb83aa-cd", "ovs_interfaceid": "0fdb83aa-cd21-410a-8823-a52276cc6fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:38:38.403843 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0005527159999019204 future=<Future at 0x721850655790 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:38:38.404035 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:38:38.404159 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=9.85384706700006 future=<Future at 0x7218342117c0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:38:38.404228 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=9.853722263000009 future=<Future at 0x7218342117c0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:38:38.404679 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] Emitting event <LifecycleEvent: 1779165503.40315, 3d008249-1262-4ec8-a8c1-d7845472b4c1 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:38:38.404889 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] VM Stopped (Lifecycle Event)
May 19 04:38:38.543912 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:38:38.547744 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:38:38.547897 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:38:38.548153 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.07 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:38:38.822086 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f97aa391-ca7c-4928-8ff8-7fc414104ac1 req-b0d58015-b6fa-4c4d-8654-9d0d5dbc15e2 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Detach interface failed, port_id=34d50a64-6aed-47ee-ae9c-851a9fe0161b, reason: Instance 7859dfab-f702-4d0b-a9e9-bb856c5004e6 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:38:38.907974 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-88ee08b4-5a4a-449d-8ad5-95ae1fb11e4a tempest-VolumesNegativeTest-204685150 tempest-VolumesNegativeTest-204685150-project-member] [instance: 3d008249-1262-4ec8-a8c1-d7845472b4c1] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:39.131026 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:39.327339 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:38:39.643089 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-064ece44-d5af-44ec-9a09-0c665e26ad22 req-e5324982-63f7-47c9-9d25-89df7c3c4af5 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-deleted-0fdb83aa-cd21-410a-8823-a52276cc6fb1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:39.643089 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-064ece44-d5af-44ec-9a09-0c665e26ad22 req-e5324982-63f7-47c9-9d25-89df7c3c4af5 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-deleted-ea620a14-2efe-4797-9ee1-c004ba488769 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:39.834433 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Took 4.06 seconds to deallocate network for instance.
May 19 04:38:40.128866 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-05170d92-d50e-4fe5-85ae-d39dcf3ac196 req-058e2672-31a0-4c4e-b499-150bb1b47c0d service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-unplugged-34d50a64-6aed-47ee-ae9c-851a9fe0161b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:40.129394 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-05170d92-d50e-4fe5-85ae-d39dcf3ac196 req-058e2672-31a0-4c4e-b499-150bb1b47c0d service nova] Acquiring lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:40.129579 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-05170d92-d50e-4fe5-85ae-d39dcf3ac196 req-058e2672-31a0-4c4e-b499-150bb1b47c0d service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:40.129720 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-05170d92-d50e-4fe5-85ae-d39dcf3ac196 req-058e2672-31a0-4c4e-b499-150bb1b47c0d service nova] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:40.129846 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-05170d92-d50e-4fe5-85ae-d39dcf3ac196 req-058e2672-31a0-4c4e-b499-150bb1b47c0d service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] No waiting events found dispatching network-vif-unplugged-34d50a64-6aed-47ee-ae9c-851a9fe0161b {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:38:40.131134 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-05170d92-d50e-4fe5-85ae-d39dcf3ac196 req-058e2672-31a0-4c4e-b499-150bb1b47c0d service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-unplugged-34d50a64-6aed-47ee-ae9c-851a9fe0161b for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:38:40.434075 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5d707700-f3e8-440f-9fa2-09cf65e8b3e4 req-94b26dd5-267f-4254-a0f5-94fabcf75ce2 service nova] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Received event network-vif-deleted-3e688b23-684d-4dcf-95a1-2f44d8ea1649 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:41.556801 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:41.638258 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Took 1.80 seconds to detach 3 volumes for instance.
May 19 04:38:42.146427 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:42.146678 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:42.603216 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:38:42.603216 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:38:43.106592 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:38:43.117461 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:43.620464 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.473s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:43.719797 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Deleted allocations for instance 7859dfab-f702-4d0b-a9e9-bb856c5004e6
May 19 04:38:44.133168 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:44.740362 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-34a4403f-a6ce-431d-8104-297a82cc83dc tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Lock "7859dfab-f702-4d0b-a9e9-bb856c5004e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.681s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:45.078196 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "6cd7138c-f217-4858-8941-89693e62ae6e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:45.084423 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "6cd7138c-f217-4858-8941-89693e62ae6e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.006s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:45.591438 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lazy-loading 'flavor' on Instance uuid 6cd7138c-f217-4858-8941-89693e62ae6e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:38:45.643699 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:46.304097 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:46.598199 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "6cd7138c-f217-4858-8941-89693e62ae6e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:46.999057 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "87e8e02e-e385-418c-be0c-bb25a377d081" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:46.999057 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "87e8e02e-e385-418c-be0c-bb25a377d081" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:47.301394 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:47.487625 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:47.502691 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:38:47.694229 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "6cd7138c-f217-4858-8941-89693e62ae6e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:47.694229 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "6cd7138c-f217-4858-8941-89693e62ae6e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:47.694229 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Attaching volume de39af6d-0810-4cc6-af4b-fd4602ea4ea2 to /dev/vdb
May 19 04:38:47.740375 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:38:47.758855 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:38:47.793790 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:47.827365 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:38:47.828298 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:38:47.836194 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:38:47.839127 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe8e:26b9', 'fe80::fc16:3eff:fe6d:b26e', 'fe80::30c3:b4ff:fe77:721a', 'fe80::fc16:3eff:fe75:10d8', 'fe80::946f:41ff:fe06:ab72', 'fe80::fc16:3eff:feee:132d', 'fe80::bc20:d2ff:fef5:7278'] 
May 19 04:38:47.839127 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:38:47.839127 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:38:47.839127 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:38:47.839127 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Updating existing volume attachment record: cff22f46-92a3-4576-a81e-b5f1e2e4a6f9 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:38:48.069597 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:48.069597 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:48.073963 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:38:48.074242 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Claim successful on node np0000001025
May 19 04:38:48.119508 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:48.258462 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0005165909999504947 future=<Future at 0x7218342117c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:38:48.259229 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Emitting event <LifecycleEvent: 1779165513.2578452, 7859dfab-f702-4d0b-a9e9-bb856c5004e6 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:38:48.259399 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] VM Stopped (Lifecycle Event)
May 19 04:38:48.260519 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:38:48.397756 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:38:48.397756 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:38:48.397756 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:38:48.400077 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:38:48.400077 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:38:48.416397 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:38:48.417751 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:38:48.418259 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:38:48.418443 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:38:48.420975 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:38:48.421246 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:38:48.431842 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:38:48.431842 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:48.440600 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:38:48.440600 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:48.446584 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2] added
May 19 04:38:48.446584 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:38:48.446584 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:38:48.446584 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:38:48.446584 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:38:48.446584 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:38:48.446584 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:48.447361 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:38:48.447361 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0285(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:38:48.447361 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:38:48.451959 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2] added
May 19 04:38:48.451959 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:38:48.451959 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:38:48.451959 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:38:48.451959 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:38:48.451959 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:38:48.451959 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:48.452253 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:38:48.452299 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0311(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:38:48.452426 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:38:48.593459 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Rebuilding instance
May 19 04:38:48.744081 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:48.761987 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 7859dfab-f702-4d0b-a9e9-bb856c5004e6] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:49.137368 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:49.398321 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:38:49.398581 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:38:49.447466 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:38:49.453584 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:38:49.459316 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:38:49.459316 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:38:49.464840 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:38:49.464840 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:49.470034 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:49.474375 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:49.481374 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:49.481374 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:49.481374 np0000001025 nova-compute[97981]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:49.481374 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:49.481374 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:38:49.481539 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsi session list stdout=tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:49.481539 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:49.481539 np0000001025 nova-compute[97981]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:49.481539 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:49.481539 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:38:49.485797 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:49.485797 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:49.485797 np0000001025 nova-compute[97981]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:49.485797 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:49.485797 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:38:49.485952 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsi session list stdout=tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:49.485952 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:49.485952 np0000001025 nova-compute[97981]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:49.485952 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:49.485952 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:38:49.519194 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2, portal: 192.168.40.100,3260]
May 19 04:38:49.519194 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2, portal: 192.168.40.100,3260] successful.
May 19 04:38:49.519194 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:49.524633 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2, portal: 192.168.50.100,3260]
May 19 04:38:49.524633 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2, portal: 192.168.50.100,3260] successful.
May 19 04:38:49.524633 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:49.529371 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:49.534167 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:49.542666 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:49.542666 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:49.542666 np0000001025 nova-compute[97981]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:49.542666 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:49.542666 np0000001025 nova-compute[97981]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:49.542666 np0000001025 nova-compute[97981]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:49.542666 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:38:49.542907 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsi session list stdout=tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:49.542907 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:49.542907 np0000001025 nova-compute[97981]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:49.542907 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:49.542907 np0000001025 nova-compute[97981]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:49.542907 np0000001025 nova-compute[97981]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:49.542907 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:38:49.543222 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.125s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:38:49.543340 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:38:49.544163 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] HCTL ('9', '-', '-', 0) found on session 51 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:38:49.544276 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:38:49.548056 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:49.548056 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:49.548056 np0000001025 nova-compute[97981]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:49.548056 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:49.548056 np0000001025 nova-compute[97981]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:49.548056 np0000001025 nova-compute[97981]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:49.548056 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:38:49.548314 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsi session list stdout=tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:49.548314 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:49.548314 np0000001025 nova-compute[97981]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:49.548314 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:49.548314 np0000001025 nova-compute[97981]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:49.548314 np0000001025 nova-compute[97981]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:49.548314 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:38:49.548499 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.130s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:38:49.548606 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:38:49.549343 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] HCTL ('10', '-', '-', 0) found on session 52 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:38:49.549446 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:38:49.556448 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Searching for a device in session 51 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:38:49.556644 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:38:49.565030 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Searching for a device in session 52 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:38:49.565030 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:38:49.769188 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:49.771636 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:49.788378 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:49.796813 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:49.819957 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:49.824842 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:49.889851 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ca955d7e-0286-4c0e-91d1-d1e89d518e2f req-545a606a-ab51-4764-b3d1-2f819fba6adc service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Received event network-vif-unplugged-c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:49.889923 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ca955d7e-0286-4c0e-91d1-d1e89d518e2f req-545a606a-ab51-4764-b3d1-2f819fba6adc service nova] Acquiring lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:49.890067 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ca955d7e-0286-4c0e-91d1-d1e89d518e2f req-545a606a-ab51-4764-b3d1-2f819fba6adc service nova] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:49.890266 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ca955d7e-0286-4c0e-91d1-d1e89d518e2f req-545a606a-ab51-4764-b3d1-2f819fba6adc service nova] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:49.890428 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ca955d7e-0286-4c0e-91d1-d1e89d518e2f req-545a606a-ab51-4764-b3d1-2f819fba6adc service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] No waiting events found dispatching network-vif-unplugged-c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:38:49.890595 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-ca955d7e-0286-4c0e-91d1-d1e89d518e2f req-545a606a-ab51-4764-b3d1-2f819fba6adc service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Received unexpected event network-vif-unplugged-c20ef5b7-7e77-4061-980b-db836ec71eec for instance with vm_state active and task_state rebuilding.
May 19 04:38:49.902071 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:38:50.080760 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999637876999941 future=<Future at 0x7218506009e0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:38:50.081571 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.998916769000061 future=<Future at 0x7218506009e0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:38:50.081635 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.99875530899999 future=<Future at 0x7218506009e0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:38:50.082764 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Instance destroyed successfully.
May 19 04:38:50.086121 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Instance destroyed successfully.
May 19 04:38:50.087306 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1399018170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serveractionsv293testjson-server-261623189',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFEE7MfVouu9pqjSZuefRPAqoz2KwFtdLVyP66SNkY10e8a8acmINjhhjRaCSrP+4JYHVyxJ7DR6qdX1Kgex1JRulJwwAy9kC1zv4B6aG+7K383hOjahrwa67Ca8VXO3A==',key_name='tempest-keypair-1684840035',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:38:08Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e2110bc6ddf24455ab91b4ba84e6170a',ramdisk_id='',reservation_id='r-6q1ykbfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77cbe94e-3270-472e-a2a4-99ad3be8837f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1582643744',owner_user_name='tempest-ServerActionsV293TestJSON-1582643744-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:38:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b98924a893b435ca15d660c63fbf024',uuid=11a634a9-3bdd-4085-abc2-a0ad70710975,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c20ef5b7-7e77-4061-980b-db836ec71eec", "address": "fa:16:3e:6d:b2:6e", "network": {"id": "9bde70f2-7770-457c-8b6b-364b5adcf4fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1641494804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2110bc6ddf24455ab91b4ba84e6170a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20ef5b7-7e", "ovs_interfaceid": "c20ef5b7-7e77-4061-980b-db836ec71eec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:38:50.087563 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Converting VIF {"id": "c20ef5b7-7e77-4061-980b-db836ec71eec", "address": "fa:16:3e:6d:b2:6e", "network": {"id": "9bde70f2-7770-457c-8b6b-364b5adcf4fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1641494804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2110bc6ddf24455ab91b4ba84e6170a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20ef5b7-7e", "ovs_interfaceid": "c20ef5b7-7e77-4061-980b-db836ec71eec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:38:50.088613 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=c20ef5b7-7e77-4061-980b-db836ec71eec,network=Network(9bde70f2-7770-457c-8b6b-364b5adcf4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20ef5b7-7e') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:38:50.088613 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=c20ef5b7-7e77-4061-980b-db836ec71eec,network=Network(9bde70f2-7770-457c-8b6b-364b5adcf4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20ef5b7-7e') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:38:50.090123 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:50.090368 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc20ef5b7-7e, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:50.098799 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:50.100126 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:50.100696 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:50.100867 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3d52624-a6f2-4ca7-84e2-758f31d90978) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:50.101939 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:50.102611 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:50.103300 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:50.105375 np0000001025 nova-compute[97981]: INFO os_vif [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=c20ef5b7-7e77-4061-980b-db836ec71eec,network=Network(9bde70f2-7770-457c-8b6b-364b5adcf4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20ef5b7-7e')
May 19 04:38:50.106328 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:38:50.106454 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a12d997-15f6-4776-89f7-965ae348fbb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:38:50.106569 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:38:50.411368 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.342s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:50.411661 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:38:50.419500 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:38:50.916583 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:38:50.916994 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:38:50.917081 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:50.917295 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:50.973277 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85bb755af78441a09efcb1f00474515e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49561da7541f44898968cb455fb3e6bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:38:51.055854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:51.056114 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:51.333283 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Successfully created port: 3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:38:51.419662 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:38:51.436453 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Found WWN 330000000d2175c04 for multipath device dm-1 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:38:51.436748 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:38:51.437193 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000d2175c04', 'path': '/dev/dm-1', 'multipath_id': '330000000d2175c04'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:38:51.437350 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d2175c04', 'path': '/dev/dm-1', 'multipath_id': '330000000d2175c04'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:38:51.437747 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.331s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:38:51.438134 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a12d997-15f6-4776-89f7-965ae348fbb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:38:51.438317 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:38:51.442912 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lazy-loading 'flavor' on Instance uuid 6cd7138c-f217-4858-8941-89693e62ae6e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:38:51.465189 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:51.465189 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:51.465189 np0000001025 nova-compute[97981]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:51.465189 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:51.465189 np0000001025 nova-compute[97981]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:51.465189 np0000001025 nova-compute[97981]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:51.465189 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:38:51.465448 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsi session list stdout=tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:51.465448 np0000001025 nova-compute[97981]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:38:51.465448 np0000001025 nova-compute[97981]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:51.465448 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:51.465448 np0000001025 nova-compute[97981]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:51.465448 np0000001025 nova-compute[97981]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:51.465448 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:38:51.465739 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', '51'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', '52')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:38:51.466159 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', '44')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:38:51.467428 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', '43')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:38:51.468179 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721853cd18a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1'): ({'sdb'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:38:51.468363 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Removing multipathed devices sdc, sdb {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:38:51.468605 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Flush multipath device 330000000ea42bea5 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:38:51.525975 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:38:51.558498 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:38:51.580989 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:38:51.639288 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:38:51.639288 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:38:51.639288 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:38:51.650800 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:38:51.651349 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:38:51.663834 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:51.690601 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1, portal: 192.168.40.100,3260]
May 19 04:38:51.690601 np0000001025 nova-compute[97981]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1, portal: 192.168.40.100,3260] successful.
May 19 04:38:51.690601 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:51.706850 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:51.718273 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:51.749897 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1, portal: 192.168.50.100,3260]
May 19 04:38:51.749897 np0000001025 nova-compute[97981]: Logout of [sid: 43, target: iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1, portal: 192.168.50.100,3260] successful.
May 19 04:38:51.749897 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:51.764453 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:51.764726 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:38:51.764892 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] <== disconnect_volume: return (1658ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:38:51.765080 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:38:51.765455 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Deleting instance files /opt/stack/data/nova/instances/11a634a9-3bdd-4085-abc2-a0ad70710975_del
May 19 04:38:51.766096 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Deletion of /opt/stack/data/nova/instances/11a634a9-3bdd-4085-abc2-a0ad70710975_del complete
May 19 04:38:51.842328 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Successfully updated port: 3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:38:51.893961 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0483ec63-0c26-4479-b1a9-74a7adaac022 req-ce91903a-8558-4c54-b86e-f4e8e42263fd service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Received event network-changed-3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:51.895132 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0483ec63-0c26-4479-b1a9-74a7adaac022 req-ce91903a-8558-4c54-b86e-f4e8e42263fd service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Refreshing instance network info cache due to event network-changed-3587c521-ddbe-4301-84ca-17721980c57a. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:38:51.895325 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0483ec63-0c26-4479-b1a9-74a7adaac022 req-ce91903a-8558-4c54-b86e-f4e8e42263fd service nova] Acquiring lock "refresh_cache-87e8e02e-e385-418c-be0c-bb25a377d081" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:38:51.895429 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0483ec63-0c26-4479-b1a9-74a7adaac022 req-ce91903a-8558-4c54-b86e-f4e8e42263fd service nova] Acquired lock "refresh_cache-87e8e02e-e385-418c-be0c-bb25a377d081" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:38:51.895591 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-0483ec63-0c26-4479-b1a9-74a7adaac022 req-ce91903a-8558-4c54-b86e-f4e8e42263fd service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Refreshing network info cache for port 3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:38:51.925146 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:38:51.945598 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Attempting to attach volume de39af6d-0810-4cc6-af4b-fd4602ea4ea2 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:38:51.946808 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:38:51.946808 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:38:51.946808 np0000001025 nova-compute[97981]:   <alias name="ua-de39af6d-0810-4cc6-af4b-fd4602ea4ea2"/>
May 19 04:38:51.946808 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-1"/>
May 19 04:38:51.946808 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:38:51.946808 np0000001025 nova-compute[97981]:   <serial>de39af6d-0810-4cc6-af4b-fd4602ea4ea2</serial>
May 19 04:38:51.946808 np0000001025 nova-compute[97981]: </disk>
May 19 04:38:51.946808 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:38:51.959055 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ca9ecfa3-d066-4ee8-8917-2eb9b586b440 req-8eaab4eb-1842-45de-a700-8c097a81c17d service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Received event network-vif-unplugged-c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:51.959351 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ca9ecfa3-d066-4ee8-8917-2eb9b586b440 req-8eaab4eb-1842-45de-a700-8c097a81c17d service nova] Acquiring lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:51.959816 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ca9ecfa3-d066-4ee8-8917-2eb9b586b440 req-8eaab4eb-1842-45de-a700-8c097a81c17d service nova] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:51.959930 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ca9ecfa3-d066-4ee8-8917-2eb9b586b440 req-8eaab4eb-1842-45de-a700-8c097a81c17d service nova] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:51.960094 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ca9ecfa3-d066-4ee8-8917-2eb9b586b440 req-8eaab4eb-1842-45de-a700-8c097a81c17d service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] No waiting events found dispatching network-vif-unplugged-c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:38:51.960293 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-ca9ecfa3-d066-4ee8-8917-2eb9b586b440 req-8eaab4eb-1842-45de-a700-8c097a81c17d service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Received unexpected event network-vif-unplugged-c20ef5b7-7e77-4061-980b-db836ec71eec for instance with vm_state active and task_state rebuilding.
May 19 04:38:52.115395 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:52.115604 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:52.119175 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:38:52.119372 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Claim successful on node np0000001025
May 19 04:38:52.346301 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "refresh_cache-87e8e02e-e385-418c-be0c-bb25a377d081" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:38:52.376564 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 11a634a9-3bdd-4085-abc2-a0ad70710975 could not be found.
May 19 04:38:52.377517 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:38:52.377768 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a12d997-15f6-4776-89f7-965ae348fbb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:38:52.378496 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:38:52.397594 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-0483ec63-0c26-4479-b1a9-74a7adaac022 req-ce91903a-8558-4c54-b86e-f4e8e42263fd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:52.431586 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Booting with volume 676791bb-a268-438c-8db2-e4e5a9014ea5 at /dev/vda
May 19 04:38:52.437864 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:52.463570 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-0483ec63-0c26-4479-b1a9-74a7adaac022 req-ce91903a-8558-4c54-b86e-f4e8e42263fd service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:38:52.474677 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:38:52.485188 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:38:52.505416 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:52.543130 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:38:52.543205 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:38:52.551150 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:38:52.552183 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe8e:26b9', 'fe80::fc16:3eff:fe75:10d8', 'fe80::946f:41ff:fe06:ab72', 'fe80::fc16:3eff:feee:132d', 'fe80::bc20:d2ff:fef5:7278'] 
May 19 04:38:52.552332 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:38:52.552407 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:38:52.552646 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] <== get_connector_properties: return (77ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:38:52.552850 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Updating existing volume attachment record: 41aeeddb-b357-4585-90fd-5975487e4e4c {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:38:52.612403 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-0483ec63-0c26-4479-b1a9-74a7adaac022 req-ce91903a-8558-4c54-b86e-f4e8e42263fd service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:38:53.114793 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0483ec63-0c26-4479-b1a9-74a7adaac022 req-ce91903a-8558-4c54-b86e-f4e8e42263fd service nova] Releasing lock "refresh_cache-87e8e02e-e385-418c-be0c-bb25a377d081" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:38:53.115448 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquired lock "refresh_cache-87e8e02e-e385-418c-be0c-bb25a377d081" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:38:53.115619 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:38:53.121543 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:53.464763 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:38:53.464994 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:38:53.599045 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:38:53.599235 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:38:53.599368 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:38:53.599470 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] No VIF found with MAC fa:16:3e:8e:26:b9, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:38:53.686436 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:38:53.842918 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:53.964780 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Updating instance_info_cache with network_info: [{"id": "3587c521-ddbe-4301-84ca-17721980c57a", "address": "fa:16:3e:16:6b:7e", "network": {"id": "c2482d3a-1a67-42d2-92b3-13ee3ae383c7", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-380374163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49561da7541f44898968cb455fb3e6bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3587c521-dd", "ovs_interfaceid": "3587c521-ddbe-4301-84ca-17721980c57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:38:53.967155 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:38:54.074624 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:54.184465 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-206f6adf-c98f-45c2-a64c-8159f52f9d07 req-c481d5a9-812b-4e11-afa1-a200bd66040f service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Received event network-vif-unplugged-3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:54.185033 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-206f6adf-c98f-45c2-a64c-8159f52f9d07 req-c481d5a9-812b-4e11-afa1-a200bd66040f service nova] Acquiring lock "87e8e02e-e385-418c-be0c-bb25a377d081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:54.185241 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-206f6adf-c98f-45c2-a64c-8159f52f9d07 req-c481d5a9-812b-4e11-afa1-a200bd66040f service nova] Lock "87e8e02e-e385-418c-be0c-bb25a377d081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:54.185635 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-206f6adf-c98f-45c2-a64c-8159f52f9d07 req-c481d5a9-812b-4e11-afa1-a200bd66040f service nova] Lock "87e8e02e-e385-418c-be0c-bb25a377d081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:54.185635 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-206f6adf-c98f-45c2-a64c-8159f52f9d07 req-c481d5a9-812b-4e11-afa1-a200bd66040f service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] No waiting events found dispatching network-vif-unplugged-3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:38:54.185807 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-206f6adf-c98f-45c2-a64c-8159f52f9d07 req-c481d5a9-812b-4e11-afa1-a200bd66040f service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Received unexpected event network-vif-unplugged-3587c521-ddbe-4301-84ca-17721980c57a for instance with vm_state building and task_state block_device_mapping.
May 19 04:38:54.472097 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Releasing lock "refresh_cache-87e8e02e-e385-418c-be0c-bb25a377d081" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:38:54.472097 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Instance network_info: |[{"id": "3587c521-ddbe-4301-84ca-17721980c57a", "address": "fa:16:3e:16:6b:7e", "network": {"id": "c2482d3a-1a67-42d2-92b3-13ee3ae383c7", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-380374163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49561da7541f44898968cb455fb3e6bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3587c521-dd", "ovs_interfaceid": "3587c521-ddbe-4301-84ca-17721980c57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:38:54.473822 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.358s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:54.474500 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:38:54.655795 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:38:54.657058 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:38:54.657289 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Creating image(s)
May 19 04:38:54.657634 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:38:54.657716 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Ensure instance console log exists: /opt/stack/data/nova/instances/87e8e02e-e385-418c-be0c-bb25a377d081/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:38:54.657953 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:54.658140 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:54.658292 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:54.658706 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Start _get_guest_xml network_info=[{"id": "3587c521-ddbe-4301-84ca-17721980c57a", "address": "fa:16:3e:16:6b:7e", "network": {"id": "c2482d3a-1a67-42d2-92b3-13ee3ae383c7", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-380374163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49561da7541f44898968cb455fb3e6bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3587c521-dd", "ovs_interfaceid": "3587c521-ddbe-4301-84ca-17721980c57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '41aeeddb-b357-4585-90fd-5975487e4e4c', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '676791bb-a268-438c-8db2-e4e5a9014ea5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '87e8e02e-e385-418c-be0c-bb25a377d081', 'attached_at': '', 'detached_at': '', 'volume_id': '676791bb-a268-438c-8db2-e4e5a9014ea5', 'serial': '676791bb-a268-438c-8db2-e4e5a9014ea5'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:38:54.661264 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:38:54.662763 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestInstancesWithCinderVolumes-server-2097951664', uuid='87e8e02e-e385-418c-be0c-bb25a377d081'), owner=OwnerMeta(userid='85bb755af78441a09efcb1f00474515e', username='tempest-TestInstancesWithCinderVolumes-1156876148-project-member', projectid='49561da7541f44898968cb455fb3e6bd', projectname='tempest-TestInstancesWithCinderVolumes-1156876148'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3587c521-ddbe-4301-84ca-17721980c57a", "address": "fa:16:3e:16:6b:7e", "network": {"id": "c2482d3a-1a67-42d2-92b3-13ee3ae383c7", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-380374163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49561da7541f44898968cb455fb3e6bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3587c521-dd", "ovs_interfaceid": "3587c521-ddbe-4301-84ca-17721980c57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165534.662303) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:38:54.664868 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:38:54.665336 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:38:54.666340 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:38:54.666498 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:38:54.667424 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:38:54.667747 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:38:54.667938 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:38:54.667984 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:38:54.668091 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:38:54.668340 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:38:54.668340 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:38:54.668508 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:38:54.668538 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:38:54.669205 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:38:54.669357 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:38:54.669485 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:38:54.680050 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:38:54.680050 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '676791bb-a268-438c-8db2-e4e5a9014ea5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:38:54.680050 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:38:54.936742 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.558s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:38:54.937509 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a12d997-15f6-4776-89f7-965ae348fbb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:38:54.940131 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:38:54.969641 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:54.969641 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:54.969641 np0000001025 nova-compute[97981]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:54.969641 np0000001025 nova-compute[97981]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:54.969641 np0000001025 nova-compute[97981]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:54.969641 np0000001025 nova-compute[97981]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:54.969641 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:38:54.969903 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsi session list stdout=tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:54.969903 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:54.969903 np0000001025 nova-compute[97981]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:54.969903 np0000001025 nova-compute[97981]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:54.969903 np0000001025 nova-compute[97981]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:54.969903 np0000001025 nova-compute[97981]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:54.969903 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:38:54.970259 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', '51'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3', '54')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:38:54.970384 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1, 0): [] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:38:54.971100 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1') {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 19 04:38:54.971279 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1, 0): [] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:38:54.971470 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1') {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 19 04:38:54.972070 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721834597380>, {}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:38:54.972070 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Disconnecting from: [] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:38:54.972220 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.036s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:38:54.972561 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] <== disconnect_volume: return (2594ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:38:54.972792 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:38:54.974839 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.294s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:38:54.974839 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '676791bb-a268-438c-8db2-e4e5a9014ea5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:38:54.980469 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:38:54.980677 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:38:54.981018 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:54.982699 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:54.987911 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:38:54.988742 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:38:54.989368 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:38:54.989887 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:38:54.993956 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:38:54.993956 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:38:55.008677 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:38:55.008677 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:55.009869 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:38:55.009869 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:55.025980 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5] added
May 19 04:38:55.025980 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:38:55.025980 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:38:55.025980 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:38:55.025980 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:38:55.025980 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:38:55.025980 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:55.025980 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:38:55.026435 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0365(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:38:55.026435 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:38:55.028599 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5] added
May 19 04:38:55.028599 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:38:55.028599 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:38:55.028599 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:38:55.028599 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:38:55.028599 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:38:55.028599 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:55.028878 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:38:55.028924 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0374(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:38:55.029068 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:38:55.086622 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93a5d16bed8c474fa58e1982fa784db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0c7a19a41a44fba4c0fca71022a5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:38:55.107374 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:55.163573 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d7e0710d-14a0-44fc-9c27-90c2eed6553d tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "6cd7138c-f217-4858-8941-89693e62ae6e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.472s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:55.426799 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:55.426799 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:55.426799 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Shelving
May 19 04:38:55.483524 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:38:55.635646 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Successfully created port: 2f49d1e8-3715-4f15-8d97-10c3446283ad {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:38:55.987811 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:38:56.028080 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:38:56.031780 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:38:56.041122 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:38:56.041122 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:38:56.047296 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:38:56.047296 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:56.054439 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:56.067449 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:56.073832 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:56.073832 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:56.073832 np0000001025 nova-compute[97981]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:56.073832 np0000001025 nova-compute[97981]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:56.073832 np0000001025 nova-compute[97981]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:56.073832 np0000001025 nova-compute[97981]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:56.073832 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:38:56.074300 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsi session list stdout=tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:56.074300 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:56.074300 np0000001025 nova-compute[97981]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:56.074300 np0000001025 nova-compute[97981]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:56.074300 np0000001025 nova-compute[97981]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:56.074300 np0000001025 nova-compute[97981]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:56.074300 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:38:56.082593 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:56.082593 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:56.082593 np0000001025 nova-compute[97981]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:56.082593 np0000001025 nova-compute[97981]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:56.082593 np0000001025 nova-compute[97981]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:56.082593 np0000001025 nova-compute[97981]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:56.082593 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:38:56.082846 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsi session list stdout=tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:56.082846 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:56.082846 np0000001025 nova-compute[97981]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:56.082846 np0000001025 nova-compute[97981]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:56.082846 np0000001025 nova-compute[97981]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:56.082846 np0000001025 nova-compute[97981]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:56.082846 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:38:56.123852 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5, portal: 192.168.40.100,3260]
May 19 04:38:56.123852 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5, portal: 192.168.40.100,3260] successful.
May 19 04:38:56.123852 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:56.142411 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:56.143288 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5, portal: 192.168.50.100,3260]
May 19 04:38:56.143288 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5, portal: 192.168.50.100,3260] successful.
May 19 04:38:56.143288 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:56.160150 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:56.160150 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:56.160150 np0000001025 nova-compute[97981]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:56.160150 np0000001025 nova-compute[97981]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:56.160150 np0000001025 nova-compute[97981]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:56.160150 np0000001025 nova-compute[97981]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:56.160150 np0000001025 nova-compute[97981]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:38:56.160150 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:38:56.160150 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:38:56.160150 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsi session list stdout=tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:56.160150 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:56.160150 np0000001025 nova-compute[97981]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:56.160150 np0000001025 nova-compute[97981]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:56.160150 np0000001025 nova-compute[97981]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:56.160150 np0000001025 nova-compute[97981]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:56.160150 np0000001025 nova-compute[97981]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:38:56.160150 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:38:56.160150 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:38:56.160150 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:38:56.160150 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:38:56.165755 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Preparing to wait for external event volume-reimaged-2a12d997-15f6-4776-89f7-965ae348fbb1 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:38:56.165911 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Acquiring lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:56.166187 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:56.166582 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:56.168930 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:56.170188 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] HCTL ('11', '-', '-', 0) found on session 55 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:38:56.172976 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:38:56.189125 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Successfully updated port: 2f49d1e8-3715-4f15-8d97-10c3446283ad {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:38:56.192333 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:56.192333 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:56.192333 np0000001025 nova-compute[97981]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:56.192333 np0000001025 nova-compute[97981]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:56.192333 np0000001025 nova-compute[97981]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:56.192333 np0000001025 nova-compute[97981]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:56.192333 np0000001025 nova-compute[97981]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:38:56.192333 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:38:56.192333 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:38:56.192333 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsi session list stdout=tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:56.192333 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:56.192333 np0000001025 nova-compute[97981]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:56.192333 np0000001025 nova-compute[97981]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:56.192333 np0000001025 nova-compute[97981]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:56.192333 np0000001025 nova-compute[97981]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:56.192333 np0000001025 nova-compute[97981]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:38:56.192333 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:38:56.192333 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:38:56.192333 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:38:56.192333 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:38:56.192333 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] HCTL ('12', '-', '-', 0) found on session 56 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:38:56.193098 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:38:56.202148 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Searching for a device in session 55 and hctl ['11', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:38:56.218878 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Searching for a device in session 56 and hctl ['12', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:38:56.267166 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a85a0a91-0529-4f25-8e0f-939b1069cd1c req-49a0f4d4-bb75-4140-a560-801ca44937ea service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Received event network-changed-2f49d1e8-3715-4f15-8d97-10c3446283ad {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:56.267166 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a85a0a91-0529-4f25-8e0f-939b1069cd1c req-49a0f4d4-bb75-4140-a560-801ca44937ea service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Refreshing instance network info cache due to event network-changed-2f49d1e8-3715-4f15-8d97-10c3446283ad. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:38:56.267858 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a0a91-0529-4f25-8e0f-939b1069cd1c req-49a0f4d4-bb75-4140-a560-801ca44937ea service nova] Acquiring lock "refresh_cache-aa2cdf1d-65ef-4cf4-b742-72ae783cde27" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:38:56.268204 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a0a91-0529-4f25-8e0f-939b1069cd1c req-49a0f4d4-bb75-4140-a560-801ca44937ea service nova] Acquired lock "refresh_cache-aa2cdf1d-65ef-4cf4-b742-72ae783cde27" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:38:56.268204 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a85a0a91-0529-4f25-8e0f-939b1069cd1c req-49a0f4d4-bb75-4140-a560-801ca44937ea service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Refreshing network info cache for port 2f49d1e8-3715-4f15-8d97-10c3446283ad {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:38:56.461531 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:56.467562 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:56.496717 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:56.529502 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:56.694946 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "refresh_cache-aa2cdf1d-65ef-4cf4-b742-72ae783cde27" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:38:56.774224 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-a85a0a91-0529-4f25-8e0f-939b1069cd1c req-49a0f4d4-bb75-4140-a560-801ca44937ea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:56.781664 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999672801000088 future=<Future at 0x721850269af0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:38:56.783771 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Instance destroyed successfully.
May 19 04:38:56.785080 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'numa_topology' on Instance uuid e415a06a-1c69-49b7-9bd3-f68ce343b0b7 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:38:56.814929 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Rebuilding instance
May 19 04:38:56.858520 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a85a0a91-0529-4f25-8e0f-939b1069cd1c req-49a0f4d4-bb75-4140-a560-801ca44937ea service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:38:57.001100 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:38:57.002392 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:38:57.002625 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Creating image(s)
May 19 04:38:57.003737 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:57.003737 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "/opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:57.005392 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "/opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:57.007195 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:38:57.011382 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:38:57.011619 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:57.012444 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:57.030195 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b19d7474-a8a1-40b3-9d98-b6c30e5faf80 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:57.030505 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b19d7474-a8a1-40b3-9d98-b6c30e5faf80 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:57.030820 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b19d7474-a8a1-40b3-9d98-b6c30e5faf80 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:57.041839 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a85a0a91-0529-4f25-8e0f-939b1069cd1c req-49a0f4d4-bb75-4140-a560-801ca44937ea service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:38:57.049375 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b19d7474-a8a1-40b3-9d98-b6c30e5faf80 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=97981) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 19 04:38:57.051213 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-b19d7474-a8a1-40b3-9d98-b6c30e5faf80 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'flavor' on Instance uuid 346344d1-df0a-4fd8-9396-b5fde8cf53d1 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:38:57.116953 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.104s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:57.118028 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:57.118663 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:57.121274 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:38:57.123787 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:38:57.123871 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:57.203130 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Searching for a device in session 55 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:38:57.203407 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '676791bb-a268-438c-8db2-e4e5a9014ea5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:38:57.217774 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:57.218443 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:57.218974 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Searching for a device in session 56 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:38:57.219149 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '676791bb-a268-438c-8db2-e4e5a9014ea5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:38:57.277915 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk 1073741824" returned: 0 in 0.059s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:57.278429 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.160s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:57.278820 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:57.384400 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.105s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:57.384799 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:38:57.385337 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:57.426277 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Beginning cold snapshot process
May 19 04:38:57.503105 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:57.503738 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Cannot resize image /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:38:57.503738 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:38:57.503835 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Ensure instance console log exists: /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:38:57.504516 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:57.504814 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:57.505028 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:57.558823 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a85a0a91-0529-4f25-8e0f-939b1069cd1c req-49a0f4d4-bb75-4140-a560-801ca44937ea service nova] Releasing lock "refresh_cache-aa2cdf1d-65ef-4cf4-b742-72ae783cde27" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:38:57.560052 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquired lock "refresh_cache-aa2cdf1d-65ef-4cf4-b742-72ae783cde27" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:38:57.560354 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:38:57.991541 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:38:58.093494 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:58.097361 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:58.135421 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:58.137893 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:58.163796 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:58.168934 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:38:58.243404 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:58.261664 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:58.277749 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:58.321932 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:58.330552 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:38:58.337287 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d5147396-1bed-419f-92dc-bde7d4e788d1 req-f97d50db-a546-4eb4-b45d-e665bde7a659 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Received event network-vif-unplugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:58.337287 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d5147396-1bed-419f-92dc-bde7d4e788d1 req-f97d50db-a546-4eb4-b45d-e665bde7a659 service nova] Acquiring lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:58.337287 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d5147396-1bed-419f-92dc-bde7d4e788d1 req-f97d50db-a546-4eb4-b45d-e665bde7a659 service nova] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:58.337287 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d5147396-1bed-419f-92dc-bde7d4e788d1 req-f97d50db-a546-4eb4-b45d-e665bde7a659 service nova] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:58.337287 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d5147396-1bed-419f-92dc-bde7d4e788d1 req-f97d50db-a546-4eb4-b45d-e665bde7a659 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] No waiting events found dispatching network-vif-unplugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:38:58.337287 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-d5147396-1bed-419f-92dc-bde7d4e788d1 req-f97d50db-a546-4eb4-b45d-e665bde7a659 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Received unexpected event network-vif-unplugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c for instance with vm_state active and task_state shelving_image_uploading.
May 19 04:38:58.337287 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d5147396-1bed-419f-92dc-bde7d4e788d1 req-f97d50db-a546-4eb4-b45d-e665bde7a659 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Received event network-vif-unplugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:58.337287 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d5147396-1bed-419f-92dc-bde7d4e788d1 req-f97d50db-a546-4eb4-b45d-e665bde7a659 service nova] Acquiring lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:58.337287 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d5147396-1bed-419f-92dc-bde7d4e788d1 req-f97d50db-a546-4eb4-b45d-e665bde7a659 service nova] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:58.337287 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d5147396-1bed-419f-92dc-bde7d4e788d1 req-f97d50db-a546-4eb4-b45d-e665bde7a659 service nova] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:58.337287 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d5147396-1bed-419f-92dc-bde7d4e788d1 req-f97d50db-a546-4eb4-b45d-e665bde7a659 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] No waiting events found dispatching network-vif-unplugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:38:58.337287 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-d5147396-1bed-419f-92dc-bde7d4e788d1 req-f97d50db-a546-4eb4-b45d-e665bde7a659 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Received unexpected event network-vif-unplugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c for instance with vm_state active and task_state shelving_image_uploading.
May 19 04:38:58.435359 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3fb52a33-2102-4d6c-8d45-bad29b2a96e8 req-116dcc22-9a31-44e7-8061-a723691cc122 service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Received event network-vif-unplugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:38:58.435359 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3fb52a33-2102-4d6c-8d45-bad29b2a96e8 req-116dcc22-9a31-44e7-8061-a723691cc122 service nova] Acquiring lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:58.435359 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3fb52a33-2102-4d6c-8d45-bad29b2a96e8 req-116dcc22-9a31-44e7-8061-a723691cc122 service nova] Lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:58.435359 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3fb52a33-2102-4d6c-8d45-bad29b2a96e8 req-116dcc22-9a31-44e7-8061-a723691cc122 service nova] Lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:58.435359 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3fb52a33-2102-4d6c-8d45-bad29b2a96e8 req-116dcc22-9a31-44e7-8061-a723691cc122 service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] No waiting events found dispatching network-vif-unplugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:38:58.435359 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-3fb52a33-2102-4d6c-8d45-bad29b2a96e8 req-116dcc22-9a31-44e7-8061-a723691cc122 service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Received unexpected event network-vif-unplugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 for instance with vm_state active and task_state rebuilding.
May 19 04:38:58.505325 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:58.548780 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999653816999853 future=<Future at 0x7218502680e0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:38:58.554948 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999601202000122 future=<Future at 0x7218506f98b0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:38:58.556638 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Instance destroyed successfully.
May 19 04:38:58.557155 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Instance destroyed successfully.
May 19 04:38:58.559085 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-b19d7474-a8a1-40b3-9d98-b6c30e5faf80 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'numa_topology' on Instance uuid 346344d1-df0a-4fd8-9396-b5fde8cf53d1 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:38:58.562567 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Updating instance_info_cache with network_info: [{"id": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "address": "fa:16:3e:3c:c4:ae", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f49d1e8-37", "ovs_interfaceid": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:38:58.665512 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Detaching volume de39af6d-0810-4cc6-af4b-fd4602ea4ea2
May 19 04:38:58.712305 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Attempting to driver detach volume de39af6d-0810-4cc6-af4b-fd4602ea4ea2 from mountpoint /dev/vdb
May 19 04:38:58.715712 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Found disk vdb by alias ua-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:38:58.715829 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Attempting to detach device vdb from instance 6cd7138c-f217-4858-8941-89693e62ae6e from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:38:58.716080 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:38:58.716080 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:38:58.716080 np0000001025 nova-compute[97981]:   <alias name="ua-de39af6d-0810-4cc6-af4b-fd4602ea4ea2"/>
May 19 04:38:58.716080 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-1"/>
May 19 04:38:58.716080 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:38:58.716080 np0000001025 nova-compute[97981]:   <serial>de39af6d-0810-4cc6-af4b-fd4602ea4ea2</serial>
May 19 04:38:58.716080 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:38:58.716080 np0000001025 nova-compute[97981]: </disk>
May 19 04:38:58.716080 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:38:58.723181 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Successfully detached device vdb from instance 6cd7138c-f217-4858-8941-89693e62ae6e from the persistent domain config.
May 19 04:38:58.724067 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:38:58.724503 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:38:58.724654 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:38:58.950930 np0000001025 nova-compute[97981]: DEBUG nova.privsep.utils [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97981) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 19 04:38:58.952617 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk /opt/stack/data/nova/instances/snapshots/tmpfxwy3e0v/442f1e0c56404b9d90303cf87ebed94f {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:38:59.008561 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Found WWN 33000000053f24c3a for multipath device dm-2 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:38:59.009264 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.035s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:38:59.009479 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] <== connect_volume: return (4329ms) {'type': 'block', 'scsi_wwn': '33000000053f24c3a', 'path': '/dev/dm-2', 'multipath_id': '33000000053f24c3a'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:38:59.009907 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000053f24c3a', 'path': '/dev/dm-2', 'multipath_id': '33000000053f24c3a'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:38:59.010525 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.286s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:38:59.011316 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:38:59.011458 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:38:59.045094 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:59.045094 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:59.045094 np0000001025 nova-compute[97981]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:59.045094 np0000001025 nova-compute[97981]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:59.045094 np0000001025 nova-compute[97981]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:59.045094 np0000001025 nova-compute[97981]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:59.045094 np0000001025 nova-compute[97981]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:38:59.045094 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:38:59.045094 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:38:59.045440 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsi session list stdout=tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:59.045440 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:38:59.045440 np0000001025 nova-compute[97981]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:59.045440 np0000001025 nova-compute[97981]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:38:59.045440 np0000001025 nova-compute[97981]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:59.045440 np0000001025 nova-compute[97981]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3 (non-flash)
May 19 04:38:59.045440 np0000001025 nova-compute[97981]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:38:59.045440 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:38:59.045440 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:38:59.045440 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', '51'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c32a0fa2-eae7-4a21-b346-168c1c2393c3', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '56')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:38:59.045793 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', '51')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:38:59.046694 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', '52')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:38:59.048818 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721850740d60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2'): ({'sde'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:38:59.048990 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Removing multipathed devices sde, sdd {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:38:59.049256 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Flush multipath device 330000000d2175c04 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:38:59.067935 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-b19d7474-a8a1-40b3-9d98-b6c30e5faf80 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Object Instance<346344d1-df0a-4fd8-9396-b5fde8cf53d1> lazy-loaded attributes: flavor,numa_topology {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:38:59.067935 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b19d7474-a8a1-40b3-9d98-b6c30e5faf80 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:38:59.069280 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Releasing lock "refresh_cache-aa2cdf1d-65ef-4cf4-b742-72ae783cde27" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:38:59.069886 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Instance network_info: |[{"id": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "address": "fa:16:3e:3c:c4:ae", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f49d1e8-37", "ovs_interfaceid": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:38:59.073316 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Start _get_guest_xml network_info=[{"id": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "address": "fa:16:3e:3c:c4:ae", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f49d1e8-37", "ovs_interfaceid": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:38:59.082006 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:38:59.083679 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1563421223', uuid='aa2cdf1d-65ef-4cf4-b742-72ae783cde27'), owner=OwnerMeta(userid='93a5d16bed8c474fa58e1982fa784db9', username='tempest-VolumeMultiattachTests-1349332830-project-member', projectid='7e0c7a19a41a44fba4c0fca71022a5a1', projectname='tempest-VolumeMultiattachTests-1349332830'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "address": "fa:16:3e:3c:c4:ae", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f49d1e8-37", "ovs_interfaceid": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165539.0831897) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:38:59.086266 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:38:59.086909 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:38:59.087456 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:38:59.088152 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:38:59.088330 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:38:59.089637 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:38:59.089965 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:38:59.090200 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:38:59.090277 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:38:59.090520 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:38:59.090520 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:38:59.090689 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:38:59.090824 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:38:59.090924 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:38:59.091017 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:38:59.091132 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:38:59.091302 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:38:59.105533 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1563421223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumemultiattachtests-server-1563421223',id=28,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhD1xUGbzXEFTpwLqV7IdahQdRsxUTWfjsap1G2V5FlaOoCCsM3NvS7ZgZ3Tks73vH5y6V2PuKxg4zJpt6nENVtmQis2Ldrn3RUIJ9Ob13Jj154qwicTD8P/PfTnb2SSg==',key_name='tempest-keypair-883733818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e0c7a19a41a44fba4c0fca71022a5a1',ramdisk_id='',reservation_id='r-s912lur9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1349332830',owner_user_name='tempest-VolumeMultiattachTests-1349332830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:38:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93a5d16bed8c474fa58e1982fa784db9',uuid=aa2cdf1d-65ef-4cf4-b742-72ae783cde27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "address": "fa:16:3e:3c:c4:ae", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f49d1e8-37", "ovs_interfaceid": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:38:59.105985 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Converting VIF {"id": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "address": "fa:16:3e:3c:c4:ae", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f49d1e8-37", "ovs_interfaceid": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:38:59.107449 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c4:ae,bridge_name='br-int',has_traffic_filtering=True,id=2f49d1e8-3715-4f15-8d97-10c3446283ad,network=Network(c948b992-32a1-4652-a328-d2d326ea9148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f49d1e8-37') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:38:59.107918 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lazy-loading 'pci_devices' on Instance uuid aa2cdf1d-65ef-4cf4-b742-72ae783cde27 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:38:59.140573 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:38:59.193885 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:38:59.194091 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:38:59.195399 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:38:59.210424 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:38:59.210708 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:38:59.225806 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:59.259390 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2, portal: 192.168.40.100,3260]
May 19 04:38:59.259390 np0000001025 nova-compute[97981]: Logout of [sid: 51, target: iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2, portal: 192.168.40.100,3260] successful.
May 19 04:38:59.259390 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:59.281853 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk /opt/stack/data/nova/instances/snapshots/tmpfxwy3e0v/442f1e0c56404b9d90303cf87ebed94f" returned: 0 in 0.329s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:38:59.282382 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Snapshot extracted, beginning image upload
May 19 04:38:59.286417 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:59.300790 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:59.330097 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2, portal: 192.168.50.100,3260]
May 19 04:38:59.330097 np0000001025 nova-compute[97981]: Logout of [sid: 52, target: iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2, portal: 192.168.50.100,3260] successful.
May 19 04:38:59.330097 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:59.347488 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:38:59.347706 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:38:59.347831 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] <== disconnect_volume: return (623ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:38:59.347977 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:38:59.520227 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:38:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-2097951664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testinstanceswithcindervolumes-server-2097951664',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDys8kZ8GSlPlg14lt3R+yQZ5b9y4aStMqqbMzrUHV4yGfbqNZ7bAcEfosY6Qz7abVnl9kdBTekBYcX1xF/v+nQ9Q5E+cGgCcntwl/ULjaoOkU5Odi6+UrT58NDQ6WLChw==',key_name='tempest-TestInstancesWithCinderVolumes-220059066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49561da7541f44898968cb455fb3e6bd',ramdisk_id='',reservation_id='r-dsqglhdr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-1156876148',owner_user_name='tempest-TestInstancesWithCinderVolumes-1156876148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:38:52Z,user_data=None,user_id='85bb755af78441a09efcb1f00474515e',uuid=87e8e02e-e385-418c-be0c-bb25a377d081,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3587c521-ddbe-4301-84ca-17721980c57a", "address": "fa:16:3e:16:6b:7e", "network": {"id": "c2482d3a-1a67-42d2-92b3-13ee3ae383c7", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-380374163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49561da7541f44898968cb455fb3e6bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3587c521-dd", "ovs_interfaceid": "3587c521-ddbe-4301-84ca-17721980c57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:38:59.520724 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Converting VIF {"id": "3587c521-ddbe-4301-84ca-17721980c57a", "address": "fa:16:3e:16:6b:7e", "network": {"id": "c2482d3a-1a67-42d2-92b3-13ee3ae383c7", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-380374163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49561da7541f44898968cb455fb3e6bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3587c521-dd", "ovs_interfaceid": "3587c521-ddbe-4301-84ca-17721980c57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:38:59.520987 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:6b:7e,bridge_name='br-int',has_traffic_filtering=True,id=3587c521-ddbe-4301-84ca-17721980c57a,network=Network(c2482d3a-1a67-42d2-92b3-13ee3ae383c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3587c521-dd') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:38:59.521504 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lazy-loading 'pci_devices' on Instance uuid 87e8e02e-e385-418c-be0c-bb25a377d081 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:38:59.589198 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b19d7474-a8a1-40b3-9d98-b6c30e5faf80 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.558s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:59.613184 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] End _get_guest_xml xml=<domain type="qemu">
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:   <uuid>aa2cdf1d-65ef-4cf4-b742-72ae783cde27</uuid>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:   <name>instance-0000001c</name>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <nova:name>tempest-VolumeMultiattachTests-server-1563421223</nova:name>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:38:59</nova:creationTime>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:         <nova:user uuid="93a5d16bed8c474fa58e1982fa784db9">tempest-VolumeMultiattachTests-1349332830-project-member</nova:user>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:         <nova:project uuid="7e0c7a19a41a44fba4c0fca71022a5a1">tempest-VolumeMultiattachTests-1349332830</nova:project>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:         <nova:port uuid="2f49d1e8-3715-4f15-8d97-10c3446283ad">
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     <system>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <entry name="serial">aa2cdf1d-65ef-4cf4-b742-72ae783cde27</entry>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <entry name="uuid">aa2cdf1d-65ef-4cf4-b742-72ae783cde27</entry>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     </system>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:   <os>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:   </os>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:   <features>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:   </features>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:   <devices>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk"/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     </disk>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk.config"/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     </disk>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:3c:c4:ae"/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <target dev="tap2f49d1e8-37"/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     </interface>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/console.log" append="off"/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     </serial>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     <video>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     </video>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     </rng>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:   </devices>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]: </domain>
May 19 04:38:59.613184 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:38:59.617178 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Preparing to wait for external event network-vif-plugged-2f49d1e8-3715-4f15-8d97-10c3446283ad {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:38:59.617178 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:38:59.617178 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:38:59.617178 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:38:59.617178 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1563421223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumemultiattachtests-server-1563421223',id=28,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhD1xUGbzXEFTpwLqV7IdahQdRsxUTWfjsap1G2V5FlaOoCCsM3NvS7ZgZ3Tks73vH5y6V2PuKxg4zJpt6nENVtmQis2Ldrn3RUIJ9Ob13Jj154qwicTD8P/PfTnb2SSg==',key_name='tempest-keypair-883733818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e0c7a19a41a44fba4c0fca71022a5a1',ramdisk_id='',reservation_id='r-s912lur9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1349332830',owner_user_name='tempest-VolumeMultiattachTests-1349332830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:38:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93a5d16bed8c474fa58e1982fa784db9',uuid=aa2cdf1d-65ef-4cf4-b742-72ae783cde27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "address": "fa:16:3e:3c:c4:ae", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f49d1e8-37", "ovs_interfaceid": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:38:59.617178 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Converting VIF {"id": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "address": "fa:16:3e:3c:c4:ae", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f49d1e8-37", "ovs_interfaceid": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:38:59.617178 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c4:ae,bridge_name='br-int',has_traffic_filtering=True,id=2f49d1e8-3715-4f15-8d97-10c3446283ad,network=Network(c948b992-32a1-4652-a328-d2d326ea9148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f49d1e8-37') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:38:59.617178 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c4:ae,bridge_name='br-int',has_traffic_filtering=True,id=2f49d1e8-3715-4f15-8d97-10c3446283ad,network=Network(c948b992-32a1-4652-a328-d2d326ea9148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f49d1e8-37') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:38:59.617178 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:59.617178 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:59.619401 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:38:59.619401 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:59.619401 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '606eb383-4d18-5a15-bdce-453e70120c59', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:59.621768 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:59.636205 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:59.638532 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:59.638716 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f49d1e8-37, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:59.639119 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f49d1e8-37, col_values=(('qos', UUID('1450551a-9e1c-4d85-ae1f-bf62c0356cfd')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:59.640571 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f49d1e8-37, col_values=(('external_ids', {'iface-id': '2f49d1e8-3715-4f15-8d97-10c3446283ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:c4:ae', 'vm-uuid': 'aa2cdf1d-65ef-4cf4-b742-72ae783cde27'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:38:59.643561 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:38:59.659685 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:38:59.662521 np0000001025 nova-compute[97981]: INFO os_vif [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c4:ae,bridge_name='br-int',has_traffic_filtering=True,id=2f49d1e8-3715-4f15-8d97-10c3446283ad,network=Network(c948b992-32a1-4652-a328-d2d326ea9148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f49d1e8-37')
May 19 04:39:00.025857 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] End _get_guest_xml xml=<domain type="qemu">
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:   <uuid>87e8e02e-e385-418c-be0c-bb25a377d081</uuid>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:   <name>instance-0000001b</name>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestInstancesWithCinderVolumes-server-2097951664</nova:name>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:38:54</nova:creationTime>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:         <nova:properties/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:         <nova:user uuid="85bb755af78441a09efcb1f00474515e">tempest-TestInstancesWithCinderVolumes-1156876148-project-member</nova:user>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:         <nova:project uuid="49561da7541f44898968cb455fb3e6bd">tempest-TestInstancesWithCinderVolumes-1156876148</nova:project>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:         <nova:port uuid="3587c521-ddbe-4301-84ca-17721980c57a">
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     <system>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <entry name="serial">87e8e02e-e385-418c-be0c-bb25a377d081</entry>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <entry name="uuid">87e8e02e-e385-418c-be0c-bb25a377d081</entry>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     </system>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:   <os>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:   </os>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:   <features>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:   </features>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:   <devices>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/87e8e02e-e385-418c-be0c-bb25a377d081/disk.config"/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     </disk>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <alias name="ua-676791bb-a268-438c-8db2-e4e5a9014ea5"/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-2"/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <serial>676791bb-a268-438c-8db2-e4e5a9014ea5</serial>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     </disk>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:16:6b:7e"/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <target dev="tap3587c521-dd"/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     </interface>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/87e8e02e-e385-418c-be0c-bb25a377d081/console.log" append="off"/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     </serial>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     <video>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     </video>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     </rng>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:   </devices>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]: </domain>
May 19 04:39:00.025857 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:39:00.025857 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Preparing to wait for external event network-vif-plugged-3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:39:00.025857 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "87e8e02e-e385-418c-be0c-bb25a377d081-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:00.025857 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "87e8e02e-e385-418c-be0c-bb25a377d081-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:00.025857 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "87e8e02e-e385-418c-be0c-bb25a377d081-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:00.025857 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:38:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-2097951664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testinstanceswithcindervolumes-server-2097951664',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDys8kZ8GSlPlg14lt3R+yQZ5b9y4aStMqqbMzrUHV4yGfbqNZ7bAcEfosY6Qz7abVnl9kdBTekBYcX1xF/v+nQ9Q5E+cGgCcntwl/ULjaoOkU5Odi6+UrT58NDQ6WLChw==',key_name='tempest-TestInstancesWithCinderVolumes-220059066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49561da7541f44898968cb455fb3e6bd',ramdisk_id='',reservation_id='r-dsqglhdr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-1156876148',owner_user_name='tempest-TestInstancesWithCinderVolumes-1156876148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:38:52Z,user_data=None,user_id='85bb755af78441a09efcb1f00474515e',uuid=87e8e02e-e385-418c-be0c-bb25a377d081,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3587c521-ddbe-4301-84ca-17721980c57a", "address": "fa:16:3e:16:6b:7e", "network": {"id": "c2482d3a-1a67-42d2-92b3-13ee3ae383c7", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-380374163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49561da7541f44898968cb455fb3e6bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3587c521-dd", "ovs_interfaceid": "3587c521-ddbe-4301-84ca-17721980c57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:39:00.025857 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Converting VIF {"id": "3587c521-ddbe-4301-84ca-17721980c57a", "address": "fa:16:3e:16:6b:7e", "network": {"id": "c2482d3a-1a67-42d2-92b3-13ee3ae383c7", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-380374163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49561da7541f44898968cb455fb3e6bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3587c521-dd", "ovs_interfaceid": "3587c521-ddbe-4301-84ca-17721980c57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:39:00.025857 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:6b:7e,bridge_name='br-int',has_traffic_filtering=True,id=3587c521-ddbe-4301-84ca-17721980c57a,network=Network(c2482d3a-1a67-42d2-92b3-13ee3ae383c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3587c521-dd') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:39:00.028395 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:6b:7e,bridge_name='br-int',has_traffic_filtering=True,id=3587c521-ddbe-4301-84ca-17721980c57a,network=Network(c2482d3a-1a67-42d2-92b3-13ee3ae383c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3587c521-dd') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:39:00.030375 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:00.030631 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:00.030838 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:39:00.032314 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:00.032473 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6633ae7a-da32-5908-b8da-113306a56830', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:00.035042 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:00.052561 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:00.054560 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:00.054744 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3587c521-dd, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:00.055028 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3587c521-dd, col_values=(('qos', UUID('0e864569-559e-45aa-9ad0-2c53f85011db')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:00.055181 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3587c521-dd, col_values=(('external_ids', {'iface-id': '3587c521-ddbe-4301-84ca-17721980c57a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:6b:7e', 'vm-uuid': '87e8e02e-e385-418c-be0c-bb25a377d081'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:00.055890 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:00.057034 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:00.078130 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:00.079708 np0000001025 nova-compute[97981]: INFO os_vif [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:6b:7e,bridge_name='br-int',has_traffic_filtering=True,id=3587c521-ddbe-4301-84ca-17721980c57a,network=Network(c2482d3a-1a67-42d2-92b3-13ee3ae383c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3587c521-dd')
May 19 04:39:00.316001 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:00.426248 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Instance destroyed successfully.
May 19 04:39:00.428544 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-780352072',display_name='tempest-ServerActionsTestOtherA-server-1649255047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-tempest-common-compute-instance-780352072',id=23,image_ref='77cbe94e-3270-472e-a2a4-99ad3be8837f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWjOIOVsMyvCxHSFbUg/KisSEpUltBBUDn7k40MoaIFEqu0hiq0xGxCl65mWduVoYJ4X6DBai5dMDbW4PlxibjrzT90yPIjDM/NptUDmKdJDlF8xak6SVAX4dfbERZ5hw==',key_name='tempest-keypair-1176894162',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:38:06Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='336d55ae51114828ba5ad8c0ac87ca9b',ramdisk_id='',reservation_id='r-roxanvg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77cbe94e-3270-472e-a2a4-99ad3be8837f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-281327203',owner_user_name='tempest-ServerActionsTestOtherA-281327203-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:38:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6374f2e55af946f9abf35d0c8a1cd206',uuid=6cd7138c-f217-4858-8941-89693e62ae6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "address": "fa:16:3e:8e:26:b9", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ea210-38", "ovs_interfaceid": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:39:00.428802 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converting VIF {"id": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "address": "fa:16:3e:8e:26:b9", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ea210-38", "ovs_interfaceid": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:39:00.429542 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:26:b9,bridge_name='br-int',has_traffic_filtering=True,id=919ea210-38da-46cf-9d56-5cbcf6a822a6,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919ea210-38') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:39:00.429747 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:26:b9,bridge_name='br-int',has_traffic_filtering=True,id=919ea210-38da-46cf-9d56-5cbcf6a822a6,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919ea210-38') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:39:00.433127 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:00.433127 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap919ea210-38, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:00.433127 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:00.433205 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:00.458207 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:00.463363 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:00.463574 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=182aeebe-47e9-4c94-bfb7-ed2acb9b2630) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:00.464122 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:00.464714 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:00.486088 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:00.489190 np0000001025 nova-compute[97981]: INFO os_vif [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:26:b9,bridge_name='br-int',has_traffic_filtering=True,id=919ea210-38da-46cf-9d56-5cbcf6a822a6,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919ea210-38')
May 19 04:39:00.494696 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:39:00.494988 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:39:00.495118 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:00.926531 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ec66f963-62e4-4db1-a2dd-589a82e7d854 req-4596a757-f1f3-48fd-8268-2e8a25d52154 service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Received event network-vif-unplugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:00.927199 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ec66f963-62e4-4db1-a2dd-589a82e7d854 req-4596a757-f1f3-48fd-8268-2e8a25d52154 service nova] Acquiring lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:00.927477 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ec66f963-62e4-4db1-a2dd-589a82e7d854 req-4596a757-f1f3-48fd-8268-2e8a25d52154 service nova] Lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:00.927595 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ec66f963-62e4-4db1-a2dd-589a82e7d854 req-4596a757-f1f3-48fd-8268-2e8a25d52154 service nova] Lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:00.927736 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ec66f963-62e4-4db1-a2dd-589a82e7d854 req-4596a757-f1f3-48fd-8268-2e8a25d52154 service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] No waiting events found dispatching network-vif-unplugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:39:00.927860 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-ec66f963-62e4-4db1-a2dd-589a82e7d854 req-4596a757-f1f3-48fd-8268-2e8a25d52154 service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Received unexpected event network-vif-unplugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 for instance with vm_state active and task_state rebuilding.
May 19 04:39:00.928476 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ec66f963-62e4-4db1-a2dd-589a82e7d854 req-4596a757-f1f3-48fd-8268-2e8a25d52154 service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Received event network-vif-unplugged-7a1337f5-a743-48fe-97e4-3ace03005016 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:00.928476 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ec66f963-62e4-4db1-a2dd-589a82e7d854 req-4596a757-f1f3-48fd-8268-2e8a25d52154 service nova] Acquiring lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:00.928476 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ec66f963-62e4-4db1-a2dd-589a82e7d854 req-4596a757-f1f3-48fd-8268-2e8a25d52154 service nova] Lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:00.928476 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ec66f963-62e4-4db1-a2dd-589a82e7d854 req-4596a757-f1f3-48fd-8268-2e8a25d52154 service nova] Lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:00.928835 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ec66f963-62e4-4db1-a2dd-589a82e7d854 req-4596a757-f1f3-48fd-8268-2e8a25d52154 service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] No waiting events found dispatching network-vif-unplugged-7a1337f5-a743-48fe-97e4-3ace03005016 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:39:00.928907 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-ec66f963-62e4-4db1-a2dd-589a82e7d854 req-4596a757-f1f3-48fd-8268-2e8a25d52154 service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Received unexpected event network-vif-unplugged-7a1337f5-a743-48fe-97e4-3ace03005016 for instance with vm_state stopped and task_state None.
May 19 04:39:00.929063 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ec66f963-62e4-4db1-a2dd-589a82e7d854 req-4596a757-f1f3-48fd-8268-2e8a25d52154 service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Received event network-vif-unplugged-7a1337f5-a743-48fe-97e4-3ace03005016 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:00.929298 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ec66f963-62e4-4db1-a2dd-589a82e7d854 req-4596a757-f1f3-48fd-8268-2e8a25d52154 service nova] Acquiring lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:00.929426 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ec66f963-62e4-4db1-a2dd-589a82e7d854 req-4596a757-f1f3-48fd-8268-2e8a25d52154 service nova] Lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:00.929577 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ec66f963-62e4-4db1-a2dd-589a82e7d854 req-4596a757-f1f3-48fd-8268-2e8a25d52154 service nova] Lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:00.929736 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ec66f963-62e4-4db1-a2dd-589a82e7d854 req-4596a757-f1f3-48fd-8268-2e8a25d52154 service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] No waiting events found dispatching network-vif-unplugged-7a1337f5-a743-48fe-97e4-3ace03005016 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:39:00.929879 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-ec66f963-62e4-4db1-a2dd-589a82e7d854 req-4596a757-f1f3-48fd-8268-2e8a25d52154 service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Received unexpected event network-vif-unplugged-7a1337f5-a743-48fe-97e4-3ace03005016 for instance with vm_state stopped and task_state None.
May 19 04:39:01.183012 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:39:01.184450 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:39:01.184627 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No VIF found with MAC fa:16:3e:3c:c4:ae, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:39:01.185694 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Using config drive
May 19 04:39:01.598012 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:39:01.598250 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:39:01.598250 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] No VIF found with MAC fa:16:3e:16:6b:7e, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:39:01.598647 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Using config drive
May 19 04:39:01.690874 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:01.811789 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Creating config drive at /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk.config
May 19 04:39:01.815656 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk4n5yxa7 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:01.866119 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk4n5yxa7" returned: 0 in 0.050s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:01.923076 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Snapshot image upload complete
May 19 04:39:01.923438 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:02.105381 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:02.236422 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Creating config drive at /opt/stack/data/nova/instances/87e8e02e-e385-418c-be0c-bb25a377d081/disk.config
May 19 04:39:02.240647 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/87e8e02e-e385-418c-be0c-bb25a377d081/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxp86ttd_ {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:02.271669 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:02.298224 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/87e8e02e-e385-418c-be0c-bb25a377d081/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxp86ttd_" returned: 0 in 0.057s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:02.319434 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:02.381151 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:02.436192 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Shelve offloading
May 19 04:39:02.595280 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:02.612944 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:02.615972 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:02.649355 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:02.667252 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:02.849631 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:02.860271 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.364s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:39:02.860271 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:39:02.860271 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:39:02.893152 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:39:02.893152 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:39:02.893152 np0000001025 nova-compute[97981]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:02.893152 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:02.893152 np0000001025 nova-compute[97981]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:02.893152 np0000001025 nova-compute[97981]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:02.893152 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:02.896033 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsi session list stdout=tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:39:02.896033 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:39:02.896033 np0000001025 nova-compute[97981]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:02.896033 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:02.896033 np0000001025 nova-compute[97981]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:02.896033 np0000001025 nova-compute[97981]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:02.896033 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:02.896033 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', '57'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', '58')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:39:02.899492 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2, 0): [] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:39:02.899492 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2') {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 19 04:39:02.899492 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2, 0): [] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:39:02.899492 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2') {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 19 04:39:02.899492 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721834486d40>, {}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:39:02.899492 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Disconnecting from: [] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:39:02.899492 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.040s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:39:02.899492 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] <== disconnect_volume: return (2404ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:39:02.899492 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:39:02.899492 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:02.903091 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Deleting instance files /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e_del
May 19 04:39:02.903091 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Deletion of /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e_del complete
May 19 04:39:02.949863 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Instance destroyed successfully.
May 19 04:39:02.950441 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:02.959425 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "refresh_cache-e415a06a-1c69-49b7-9bd3-f68ce343b0b7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:39:02.959514 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquired lock "refresh_cache-e415a06a-1c69-49b7-9bd3-f68ce343b0b7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:39:02.960751 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:39:02.970086 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:03.163102 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:03.192842 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:03.205475 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:03.209524 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:03.247301 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:03.255967 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:03.465683 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:03.478955 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165543.4786036, aa2cdf1d-65ef-4cf4-b742-72ae783cde27 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:03.479257 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] VM Started (Lifecycle Event)
May 19 04:39:03.574174 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "32cc5240-7a56-4cee-9b41-54e17386b39f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:03.575258 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "32cc5240-7a56-4cee-9b41-54e17386b39f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:03.774937 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:03.913416 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Updating instance_info_cache with network_info: [{"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:39:03.917265 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Booting with volume de39af6d-0810-4cc6-af4b-fd4602ea4ea2 at /dev/vdb
May 19 04:39:03.955213 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:39:03.967130 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:39:03.982197 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:03.983944 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165543.983721, aa2cdf1d-65ef-4cf4-b742-72ae783cde27 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:03.984060 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] VM Paused (Lifecycle Event)
May 19 04:39:03.989432 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:04.031243 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:39:04.031349 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:39:04.038511 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:39:04.039526 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:fe16:6b7e', 'fe80::6898:26ff:fe86:46b0'] 
May 19 04:39:04.039828 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:39:04.039828 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:39:04.039992 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:39:04.040262 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Updating existing volume attachment record: 9532ab9b-e83a-490f-bb5e-aa1bb19b1621 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:39:04.076488 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:39:04.415458 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Releasing lock "refresh_cache-e415a06a-1c69-49b7-9bd3-f68ce343b0b7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:39:04.415922 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:04.416255 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:04.486512 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:04.489124 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:39:04.525786 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:04.525786 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:04.525786 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:04.525786 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:04.525786 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:04.527048 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Terminating instance
May 19 04:39:04.635072 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:04.635225 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:04.638234 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:39:04.638368 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Claim successful on node np0000001025
May 19 04:39:04.879986 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Instance destroyed successfully.
May 19 04:39:04.880475 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'resources' on Instance uuid e415a06a-1c69-49b7-9bd3-f68ce343b0b7 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:04.917295 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-09b95f0f-8043-4f2a-ae0d-db41f42b750c req-0684479c-c6e3-4607-b2f7-9dbe9a70f912 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Received event network-changed-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:04.917428 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-09b95f0f-8043-4f2a-ae0d-db41f42b750c req-0684479c-c6e3-4607-b2f7-9dbe9a70f912 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Refreshing instance network info cache due to event network-changed-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:39:04.917583 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-09b95f0f-8043-4f2a-ae0d-db41f42b750c req-0684479c-c6e3-4607-b2f7-9dbe9a70f912 service nova] Acquiring lock "refresh_cache-e415a06a-1c69-49b7-9bd3-f68ce343b0b7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:39:04.917676 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-09b95f0f-8043-4f2a-ae0d-db41f42b750c req-0684479c-c6e3-4607-b2f7-9dbe9a70f912 service nova] Acquired lock "refresh_cache-e415a06a-1c69-49b7-9bd3-f68ce343b0b7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:39:04.917788 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-09b95f0f-8043-4f2a-ae0d-db41f42b750c req-0684479c-c6e3-4607-b2f7-9dbe9a70f912 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Refreshing network info cache for port 5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:39:04.992269 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:39:04.992513 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165544.992353, 87e8e02e-e385-418c-be0c-bb25a377d081 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:04.992599 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] VM Started (Lifecycle Event)
May 19 04:39:05.029939 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:39:05.032855 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Instance destroyed successfully.
May 19 04:39:05.033283 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'resources' on Instance uuid 346344d1-df0a-4fd8-9396-b5fde8cf53d1 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:05.080892 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00041422799995416426 future=<Future at 0x7218506009e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:39:05.081428 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Emitting event <LifecycleEvent: 1779165530.0802972, 11a634a9-3bdd-4085-abc2-a0ad70710975 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:05.081572 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:39:05.081750 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] VM Stopped (Lifecycle Event)
May 19 04:39:05.082642 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=6.698465570000053 future=<Future at 0x721850269af0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:39:05.082777 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=6.698326663999978 future=<Future at 0x721850269af0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:39:05.383134 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Object Instance<e415a06a-1c69-49b7-9bd3-f68ce343b0b7> lazy-loaded attributes: numa_topology,resources {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:39:05.384209 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1460978051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumeshelvetestjson-server-1460978051',id=25,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuu3onWzOWOhTwLe3vZlOngY/CNVOE694TNfiS2EbzzOJkaGAyIrxidDf/5+IdWjmIe9CYb9T+M3VPE0CkhNbotNWs4WbsLT86SQsfo4cFhFoJ7Md7HRdavMADvBfS/PA==',key_name='tempest-keypair-1653098683',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:38:14Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8a3dfff83ce24e619f87507f951f6c69',ramdisk_id='',reservation_id='r-a8neifui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-51274594',owner_user_name='tempest-AttachVolumeShelveTestJSON-51274594-project-member',shelved_at='2026-05-19T04:39:01.923102',shelved_host='np0000001025',shelved_image_id='172923ff-8178-4c61-9d70-323ff53b9cf3'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:38:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7955853f574d42e58ba89f18ed109760',uuid=e415a06a-1c69-49b7-9bd3-f68ce343b0b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:39:05.384436 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converting VIF {"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:39:05.385282 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:10:d8,bridge_name='br-int',has_traffic_filtering=True,id=5b2a0762-a1d4-4a8c-a81b-de0fef92e15c,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2a0762-a1') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:39:05.385593 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:10:d8,bridge_name='br-int',has_traffic_filtering=True,id=5b2a0762-a1d4-4a8c-a81b-de0fef92e15c,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2a0762-a1') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:39:05.387670 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:05.387670 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b2a0762-a1, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:05.390062 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:05.396561 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:05.397687 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:05.398096 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18594b8c-584a-4acc-80bc-9017cf771b08) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:05.398719 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:05.399467 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:05.405747 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:05.408195 np0000001025 nova-compute[97981]: INFO os_vif [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:10:d8,bridge_name='br-int',has_traffic_filtering=True,id=5b2a0762-a1d4-4a8c-a81b-de0fef92e15c,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2a0762-a1')
May 19 04:39:05.408537 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Deleting instance files /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7_del
May 19 04:39:05.416446 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Deletion of /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7_del complete
May 19 04:39:05.419748 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-09b95f0f-8043-4f2a-ae0d-db41f42b750c req-0684479c-c6e3-4607-b2f7-9dbe9a70f912 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:05.496305 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:05.498258 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165545.4977934, 87e8e02e-e385-418c-be0c-bb25a377d081 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:05.498468 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] VM Paused (Lifecycle Event)
May 19 04:39:05.535655 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-163161666',display_name='tempest-TestVolumeBootPattern-server-163161666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-163161666',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuhilx0tRF3WlGuiMFtVh9wNHP60rfodDvgDjikOW6n/GDk2wQf/EIHZEMv8fxrhWlZUDYtJXkQ3L6iNm1XDZzZAGzLcp+gX7pll6FIzgta7AklQ/uWj1eFkrn6Nrm6Tw==',key_name='tempest-keypair-685402957',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:38:15Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-1yosq7sn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:38:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c46088fb3e74b819bb456461716a801',uuid=346344d1-df0a-4fd8-9396-b5fde8cf53d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7a1337f5-a743-48fe-97e4-3ace03005016", "address": "fa:16:3e:ee:13:2d", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1337f5-a7", "ovs_interfaceid": "7a1337f5-a743-48fe-97e4-3ace03005016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:39:05.535918 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "7a1337f5-a743-48fe-97e4-3ace03005016", "address": "fa:16:3e:ee:13:2d", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1337f5-a7", "ovs_interfaceid": "7a1337f5-a743-48fe-97e4-3ace03005016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:39:05.536463 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:13:2d,bridge_name='br-int',has_traffic_filtering=True,id=7a1337f5-a743-48fe-97e4-3ace03005016,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1337f5-a7') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:39:05.536724 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:13:2d,bridge_name='br-int',has_traffic_filtering=True,id=7a1337f5-a743-48fe-97e4-3ace03005016,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1337f5-a7') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:39:05.538541 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:05.538790 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a1337f5-a7, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:05.540377 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:05.541834 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:05.542510 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:05.542670 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=839b804b-a0f0-4d70-b0c7-3f47c4a50c33) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:05.544311 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:05.546072 np0000001025 nova-compute[97981]: INFO os_vif [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:13:2d,bridge_name='br-int',has_traffic_filtering=True,id=7a1337f5-a743-48fe-97e4-3ace03005016,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1337f5-a7')
May 19 04:39:05.547364 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:39:05.547626 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df1fb2f1-04f8-4ec6-ba79-00a835271b79', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:39:05.547748 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:05.548094 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:39:05.548390 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df1fb2f1-04f8-4ec6-ba79-00a835271b79', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:39:05.548521 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:39:05.583447 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:39:05.583447 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:39:05.583447 np0000001025 nova-compute[97981]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:05.583447 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:05.583447 np0000001025 nova-compute[97981]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:05.583447 np0000001025 nova-compute[97981]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:05.583447 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:05.583447 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:39:05.583447 np0000001025 nova-compute[97981]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79 (non-flash)
May 19 04:39:05.583447 np0000001025 nova-compute[97981]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:05.583447 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:05.583447 np0000001025 nova-compute[97981]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:05.583447 np0000001025 nova-compute[97981]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:05.583447 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:05.583874 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', '57'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', '58')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:39:05.583874 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', '46')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:39:05.584684 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:05.586100 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79', '45')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:39:05.587031 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218500e3380>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79'): ({'sdj'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:39:05.587275 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Removing multipathed devices sdk, sdj {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:39:05.587527 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flush multipath device 3300000003d5fd3e3 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:39:05.648016 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:39:05.699181 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:39:05.757764 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:39:05.758325 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:39:05.760183 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:39:05.776220 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:39:05.776449 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:39:05.788627 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:05.800075 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-09b95f0f-8043-4f2a-ae0d-db41f42b750c req-0684479c-c6e3-4607-b2f7-9dbe9a70f912 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:05.833138 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79, portal: 192.168.40.100,3260]
May 19 04:39:05.833138 np0000001025 nova-compute[97981]: Logout of [sid: 46, target: iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79, portal: 192.168.40.100,3260] successful.
May 19 04:39:05.833138 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:05.851528 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:05.864313 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:05.902799 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79, portal: 192.168.50.100,3260]
May 19 04:39:05.902799 np0000001025 nova-compute[97981]: Logout of [sid: 45, target: iqn.2023-03.storpool.com:os--volume-df1fb2f1-04f8-4ec6-ba79-00a835271b79, portal: 192.168.50.100,3260] successful.
May 19 04:39:05.902799 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:05.920870 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:05.921149 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:39:05.921288 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== disconnect_volume: return (373ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:39:05.921430 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:39:05.921683 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Deleting instance files /opt/stack/data/nova/instances/346344d1-df0a-4fd8-9396-b5fde8cf53d1_del
May 19 04:39:05.923148 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Deletion of /opt/stack/data/nova/instances/346344d1-df0a-4fd8-9396-b5fde8cf53d1_del complete
May 19 04:39:06.001621 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:06.006472 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:39:06.012805 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-09b95f0f-8043-4f2a-ae0d-db41f42b750c req-0684479c-c6e3-4607-b2f7-9dbe9a70f912 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Updated VIF entry in instance network info cache for port 5b2a0762-a1d4-4a8c-a81b-de0fef92e15c. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:39:06.013586 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-09b95f0f-8043-4f2a-ae0d-db41f42b750c req-0684479c-c6e3-4607-b2f7-9dbe9a70f912 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Updating instance_info_cache with network_info: [{"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:39:06.033534 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Deleted allocations for instance e415a06a-1c69-49b7-9bd3-f68ce343b0b7
May 19 04:39:06.159612 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:39:06.159833 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Creating image(s)
May 19 04:39:06.160367 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "/opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:06.160925 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "/opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:06.160925 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "/opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:06.161536 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "aa87fb1898e7ff6fde1ffbc27a67163ebeb59fbf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:06.161767 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "aa87fb1898e7ff6fde1ffbc27a67163ebeb59fbf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:06.294948 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:39:06.295284 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:39:06.428084 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Took 1.40 seconds to destroy the instance on the hypervisor.
May 19 04:39:06.428602 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:39:06.428769 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:39:06.428884 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:39:06.429130 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:06.499631 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:06.503708 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:06.504167 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa87fb1898e7ff6fde1ffbc27a67163ebeb59fbf.part --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:06.520478 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:39:06.522475 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-09b95f0f-8043-4f2a-ae0d-db41f42b750c req-0684479c-c6e3-4607-b2f7-9dbe9a70f912 service nova] Releasing lock "refresh_cache-e415a06a-1c69-49b7-9bd3-f68ce343b0b7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:39:06.539483 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:06.558659 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:06.590097 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa87fb1898e7ff6fde1ffbc27a67163ebeb59fbf.part --force-share --output=json" returned: 0 in 0.086s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:06.590933 np0000001025 nova-compute[97981]: DEBUG nova.virt.images [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] 77cbe94e-3270-472e-a2a4-99ad3be8837f was qcow2, converting to raw {{(pid=97981) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 19 04:39:06.591399 np0000001025 nova-compute[97981]: DEBUG nova.privsep.utils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97981) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 19 04:39:06.591616 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aa87fb1898e7ff6fde1ffbc27a67163ebeb59fbf.part /opt/stack/data/nova/instances/_base/aa87fb1898e7ff6fde1ffbc27a67163ebeb59fbf.converted {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:06.674646 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-76452b43-8844-4475-b002-d90f30d73f65 req-52474766-b8ee-470d-85dd-75bdac0f4e98 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Received event volume-reimaged-2a12d997-15f6-4776-89f7-965ae348fbb1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:06.675328 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-76452b43-8844-4475-b002-d90f30d73f65 req-52474766-b8ee-470d-85dd-75bdac0f4e98 service nova] Acquiring lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:06.675660 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-76452b43-8844-4475-b002-d90f30d73f65 req-52474766-b8ee-470d-85dd-75bdac0f4e98 service nova] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:06.675805 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-76452b43-8844-4475-b002-d90f30d73f65 req-52474766-b8ee-470d-85dd-75bdac0f4e98 service nova] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:06.675980 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-76452b43-8844-4475-b002-d90f30d73f65 req-52474766-b8ee-470d-85dd-75bdac0f4e98 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Processing event volume-reimaged-2a12d997-15f6-4776-89f7-965ae348fbb1 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:39:06.677038 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Instance event wait completed in 10 seconds for volume-reimaged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:39:06.770150 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aa87fb1898e7ff6fde1ffbc27a67163ebeb59fbf.part /opt/stack/data/nova/instances/_base/aa87fb1898e7ff6fde1ffbc27a67163ebeb59fbf.converted" returned: 0 in 0.178s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:06.780486 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa87fb1898e7ff6fde1ffbc27a67163ebeb59fbf.converted --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:06.802164 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:39:06.890621 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa87fb1898e7ff6fde1ffbc27a67163ebeb59fbf.converted --force-share --output=json" returned: 0 in 0.110s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:06.891272 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "aa87fb1898e7ff6fde1ffbc27a67163ebeb59fbf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.729s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:06.891702 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:06.895798 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:06.896924 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa87fb1898e7ff6fde1ffbc27a67163ebeb59fbf --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:07.015014 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa87fb1898e7ff6fde1ffbc27a67163ebeb59fbf --force-share --output=json" returned: 0 in 0.118s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:07.015999 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "aa87fb1898e7ff6fde1ffbc27a67163ebeb59fbf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:07.016652 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "aa87fb1898e7ff6fde1ffbc27a67163ebeb59fbf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:07.017343 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:07.023010 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:07.023010 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa87fb1898e7ff6fde1ffbc27a67163ebeb59fbf --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:07.066595 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-de695bc1-f2c0-4365-891b-ccdf0c8d4531 req-0bca0d9d-6303-4315-9330-3e9c1d464a5b service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Received event network-vif-deleted-7a1337f5-a743-48fe-97e4-3ace03005016 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:07.066595 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-de695bc1-f2c0-4365-891b-ccdf0c8d4531 req-0bca0d9d-6303-4315-9330-3e9c1d464a5b service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Neutron deleted interface 7a1337f5-a743-48fe-97e4-3ace03005016; detaching it from the instance and deleting it from the info cache
May 19 04:39:07.067251 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-de695bc1-f2c0-4365-891b-ccdf0c8d4531 req-0bca0d9d-6303-4315-9330-3e9c1d464a5b service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:39:07.070765 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:07.135762 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa87fb1898e7ff6fde1ffbc27a67163ebeb59fbf --force-share --output=json" returned: 0 in 0.113s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:07.138035 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aa87fb1898e7ff6fde1ffbc27a67163ebeb59fbf,backing_fmt=raw /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:07.184532 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Booting with volume 2a12d997-15f6-4776-89f7-965ae348fbb1 at /dev/vda
May 19 04:39:07.187691 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aa87fb1898e7ff6fde1ffbc27a67163ebeb59fbf,backing_fmt=raw /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk 1073741824" returned: 0 in 0.051s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:07.188425 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "aa87fb1898e7ff6fde1ffbc27a67163ebeb59fbf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.172s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:07.188868 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa87fb1898e7ff6fde1ffbc27a67163ebeb59fbf --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:07.253381 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:39:07.265046 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:39:07.276567 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa87fb1898e7ff6fde1ffbc27a67163ebeb59fbf --force-share --output=json" returned: 0 in 0.087s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:07.277069 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:39:07.277357 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:07.303023 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:07.325474 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.686s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:07.325474 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:39:07.330553 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.791s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:07.352747 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:39:07.352981 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:39:07.362374 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:39:07.368125 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:fe16:6b7e', 'fe80::6898:26ff:fe86:46b0'] 
May 19 04:39:07.368125 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:39:07.368125 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:39:07.368125 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:39:07.368125 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Updating existing volume attachment record: 28825852-236d-4422-863c-c403cf284c42 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:39:07.370768 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:07.371707 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Cannot resize image /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:39:07.372033 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:39:07.373343 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Ensure instance console log exists: /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:39:07.373759 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:07.373940 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:07.374087 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:07.376002 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Start _get_guest_xml network_info=[{"id": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "address": "fa:16:3e:8e:26:b9", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ea210-38", "ovs_interfaceid": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-19T04:31:47Z,direct_url=<?>,disk_format='qcow2',id=77cbe94e-3270-472e-a2a4-99ad3be8837f,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-19T04:31:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '9532ab9b-e83a-490f-bb5e-aa1bb19b1621', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6cd7138c-f217-4858-8941-89693e62ae6e', 'attached_at': '', 'detached_at': '', 'volume_id': 'de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'serial': 'de39af6d-0810-4cc6-af4b-fd4602ea4ea2'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:39:07.382309 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 19 04:39:07.384252 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='77cbe94e-3270-472e-a2a4-99ad3be8837f', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1649255047', uuid='6cd7138c-f217-4858-8941-89693e62ae6e'), owner=OwnerMeta(userid='6374f2e55af946f9abf35d0c8a1cd206', username='tempest-ServerActionsTestOtherA-281327203-project-member', projectid='336d55ae51114828ba5ad8c0ac87ca9b', projectname='tempest-ServerActionsTestOtherA-281327203'), image=ImageMeta(id='77cbe94e-3270-472e-a2a4-99ad3be8837f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "address": "fa:16:3e:8e:26:b9", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ea210-38", "ovs_interfaceid": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165547.3831213) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:39:07.392356 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:39:07.392356 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:39:07.394265 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:39:07.394819 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:39:07.395570 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:39:07.395976 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-19T04:31:47Z,direct_url=<?>,disk_format='qcow2',id=77cbe94e-3270-472e-a2a4-99ad3be8837f,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-19T04:31:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:39:07.396165 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:39:07.396314 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:39:07.396448 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:39:07.396580 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:39:07.396715 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:39:07.396940 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:39:07.397070 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:39:07.401278 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:39:07.401278 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:39:07.401961 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:39:07.407529 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6cd7138c-f217-4858-8941-89693e62ae6e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:07.459956 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e8afff05-ed71-4d1a-a3dd-03ea9d422b8c req-71825556-774d-4779-bb9c-d18f07a83276 service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Received event network-vif-plugged-2f49d1e8-3715-4f15-8d97-10c3446283ad {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:07.459956 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e8afff05-ed71-4d1a-a3dd-03ea9d422b8c req-71825556-774d-4779-bb9c-d18f07a83276 service nova] Acquiring lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:07.460580 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e8afff05-ed71-4d1a-a3dd-03ea9d422b8c req-71825556-774d-4779-bb9c-d18f07a83276 service nova] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:07.460580 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e8afff05-ed71-4d1a-a3dd-03ea9d422b8c req-71825556-774d-4779-bb9c-d18f07a83276 service nova] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:07.460580 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e8afff05-ed71-4d1a-a3dd-03ea9d422b8c req-71825556-774d-4779-bb9c-d18f07a83276 service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Processing event network-vif-plugged-2f49d1e8-3715-4f15-8d97-10c3446283ad {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:39:07.461272 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:39:07.473392 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165547.472808, aa2cdf1d-65ef-4cf4-b742-72ae783cde27 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:07.473392 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] VM Resumed (Lifecycle Event)
May 19 04:39:07.476593 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:39:07.490828 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Instance spawned successfully.
May 19 04:39:07.492846 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:39:07.515015 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:39:07.574522 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-de695bc1-f2c0-4365-891b-ccdf0c8d4531 req-0bca0d9d-6303-4315-9330-3e9c1d464a5b service nova] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Detach interface failed, port_id=7a1337f5-a743-48fe-97e4-3ace03005016, reason: Instance 346344d1-df0a-4fd8-9396-b5fde8cf53d1 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:39:07.788118 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:39:07.788380 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:39:07.836557 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:39:07.836945 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:39:07.837402 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:07.837846 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:07.930576 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa432d60cb324c6d87818107e05e0053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490151decdde445593a86a16976f6b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:39:07.935242 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:39:07.935563 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:39:07.935728 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:07.936159 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:39:07.936364 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:39:07.951021 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:07.952129 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:07.952903 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:39:07.953234 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:39:07.954041 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:39:07.954041 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:39:07.968103 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:39:07.968103 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:07.970449 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:39:07.970449 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:07.980987 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:07.987585 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:39:07.989695 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2] added
May 19 04:39:07.989695 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:39:07.989695 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:07.989695 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:07.989695 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:07.989695 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:07.989695 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:07.990743 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:39:07.990743 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0362(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:39:07.990743 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:39:07.991060 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2] added
May 19 04:39:07.991060 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:39:07.991060 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:07.991060 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:07.991060 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:07.991060 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:07.991060 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:07.991520 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:39:07.991809 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0386(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:39:07.991988 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:39:07.999990 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:07.999990 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:07.999990 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:07.999990 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:07.999990 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:07.999990 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:08.020135 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Took 1.59 seconds to deallocate network for instance.
May 19 04:39:08.169762 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:08.291076 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:39:08.340957 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:39:08.429812 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Successfully created port: 074c374b-3c37-4167-a2d2-3316204ce080 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:39:08.494320 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:39:08.507816 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Took 11.51 seconds to spawn the instance on the hypervisor.
May 19 04:39:08.508006 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:08.581373 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Took 0.56 seconds to detach 1 volumes for instance.
May 19 04:39:08.799433 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.469s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:08.845845 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:39:08.991598 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:39:08.992361 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:39:09.007586 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:39:09.007586 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:39:09.011251 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:39:09.011251 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:09.022419 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Took 16.96 seconds to build instance.
May 19 04:39:09.025285 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:09.026495 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:09.039306 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:09.039306 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:09.039306 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:09.039496 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:09.039496 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:09.039496 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:09.042867 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:09.042867 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:09.042867 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:09.045875 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:09.045875 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:09.045875 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:09.061853 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Successfully updated port: 074c374b-3c37-4167-a2d2-3316204ce080 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:39:09.077647 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2, portal: 192.168.50.100,3260]
May 19 04:39:09.077647 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2, portal: 192.168.50.100,3260] successful.
May 19 04:39:09.077647 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:09.079825 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2, portal: 192.168.40.100,3260]
May 19 04:39:09.079825 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2, portal: 192.168.40.100,3260] successful.
May 19 04:39:09.079825 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:09.088922 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:09.090813 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:09.091980 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:09.099483 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:09.109174 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:09.109174 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:09.109174 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:09.109174 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:09.109174 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:09.109174 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:09.109174 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:09.109174 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:09.109174 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:09.109174 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:09.109174 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:39:09.109174 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:39:09.109525 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] HCTL ('7', '-', '-', 0) found on session 59 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:39:09.109525 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:39:09.116195 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:09.116195 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:09.116195 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:09.116195 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:09.116195 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:09.117972 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:09.117972 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:09.117972 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:09.117972 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:09.117972 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:09.117972 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:39:09.117972 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:39:09.117972 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] HCTL ('8', '-', '-', 0) found on session 60 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:39:09.117972 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:39:09.136282 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Searching for a device in session 59 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:39:09.136282 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:39:09.138005 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Searching for a device in session 60 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:39:09.138413 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:39:09.152428 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f01d66dc-46c1-4e6c-b004-91647323716e req-67976066-13f8-4433-9176-4560e5c05f15 service nova] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Received event network-changed-074c374b-3c37-4167-a2d2-3316204ce080 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:09.152428 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f01d66dc-46c1-4e6c-b004-91647323716e req-67976066-13f8-4433-9176-4560e5c05f15 service nova] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Refreshing instance network info cache due to event network-changed-074c374b-3c37-4167-a2d2-3316204ce080. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:39:09.152428 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f01d66dc-46c1-4e6c-b004-91647323716e req-67976066-13f8-4433-9176-4560e5c05f15 service nova] Acquiring lock "refresh_cache-32cc5240-7a56-4cee-9b41-54e17386b39f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:39:09.152428 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f01d66dc-46c1-4e6c-b004-91647323716e req-67976066-13f8-4433-9176-4560e5c05f15 service nova] Acquired lock "refresh_cache-32cc5240-7a56-4cee-9b41-54e17386b39f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:39:09.152601 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-f01d66dc-46c1-4e6c-b004-91647323716e req-67976066-13f8-4433-9176-4560e5c05f15 service nova] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Refreshing network info cache for port 074c374b-3c37-4167-a2d2-3316204ce080 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:39:09.307512 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-506a0eff-f770-47b4-9107-e1a7cd718dec tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 13.881s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:09.352797 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Booting with volume 234422a2-4faa-4b84-9742-2491b748d237 at /dev/vda
May 19 04:39:09.496090 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:39:09.496465 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:39:09.524565 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ab6450f7-a642-4c55-ab18-4cdf5ff91fed tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.468s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:09.532708 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1d0a768d-dc10-4f79-8adc-ac8ed5acfe8a req-50601cc6-93ee-4862-a293-6ba44231e9c6 service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Received event network-vif-plugged-2f49d1e8-3715-4f15-8d97-10c3446283ad {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:09.533257 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1d0a768d-dc10-4f79-8adc-ac8ed5acfe8a req-50601cc6-93ee-4862-a293-6ba44231e9c6 service nova] Acquiring lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:09.533361 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1d0a768d-dc10-4f79-8adc-ac8ed5acfe8a req-50601cc6-93ee-4862-a293-6ba44231e9c6 service nova] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:09.533503 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1d0a768d-dc10-4f79-8adc-ac8ed5acfe8a req-50601cc6-93ee-4862-a293-6ba44231e9c6 service nova] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:09.533623 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1d0a768d-dc10-4f79-8adc-ac8ed5acfe8a req-50601cc6-93ee-4862-a293-6ba44231e9c6 service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] No waiting events found dispatching network-vif-plugged-2f49d1e8-3715-4f15-8d97-10c3446283ad {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:39:09.533746 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-1d0a768d-dc10-4f79-8adc-ac8ed5acfe8a req-50601cc6-93ee-4862-a293-6ba44231e9c6 service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Received unexpected event network-vif-plugged-2f49d1e8-3715-4f15-8d97-10c3446283ad for instance with vm_state active and task_state None.
May 19 04:39:09.533845 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1d0a768d-dc10-4f79-8adc-ac8ed5acfe8a req-50601cc6-93ee-4862-a293-6ba44231e9c6 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Received event network-vif-plugged-3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:09.533950 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1d0a768d-dc10-4f79-8adc-ac8ed5acfe8a req-50601cc6-93ee-4862-a293-6ba44231e9c6 service nova] Acquiring lock "87e8e02e-e385-418c-be0c-bb25a377d081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:09.534066 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1d0a768d-dc10-4f79-8adc-ac8ed5acfe8a req-50601cc6-93ee-4862-a293-6ba44231e9c6 service nova] Lock "87e8e02e-e385-418c-be0c-bb25a377d081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:09.534181 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1d0a768d-dc10-4f79-8adc-ac8ed5acfe8a req-50601cc6-93ee-4862-a293-6ba44231e9c6 service nova] Lock "87e8e02e-e385-418c-be0c-bb25a377d081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:09.534274 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1d0a768d-dc10-4f79-8adc-ac8ed5acfe8a req-50601cc6-93ee-4862-a293-6ba44231e9c6 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Processing event network-vif-plugged-3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:39:09.534406 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1d0a768d-dc10-4f79-8adc-ac8ed5acfe8a req-50601cc6-93ee-4862-a293-6ba44231e9c6 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Received event network-vif-plugged-3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:09.534514 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1d0a768d-dc10-4f79-8adc-ac8ed5acfe8a req-50601cc6-93ee-4862-a293-6ba44231e9c6 service nova] Acquiring lock "87e8e02e-e385-418c-be0c-bb25a377d081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:09.534649 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1d0a768d-dc10-4f79-8adc-ac8ed5acfe8a req-50601cc6-93ee-4862-a293-6ba44231e9c6 service nova] Lock "87e8e02e-e385-418c-be0c-bb25a377d081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:09.534767 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1d0a768d-dc10-4f79-8adc-ac8ed5acfe8a req-50601cc6-93ee-4862-a293-6ba44231e9c6 service nova] Lock "87e8e02e-e385-418c-be0c-bb25a377d081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:09.534867 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1d0a768d-dc10-4f79-8adc-ac8ed5acfe8a req-50601cc6-93ee-4862-a293-6ba44231e9c6 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] No waiting events found dispatching network-vif-plugged-3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:39:09.534961 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-1d0a768d-dc10-4f79-8adc-ac8ed5acfe8a req-50601cc6-93ee-4862-a293-6ba44231e9c6 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Received unexpected event network-vif-plugged-3587c521-ddbe-4301-84ca-17721980c57a for instance with vm_state building and task_state spawning.
May 19 04:39:09.538518 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Instance event wait completed in 5 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:39:09.540201 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165549.5394003, 87e8e02e-e385-418c-be0c-bb25a377d081 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:09.540201 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] VM Resumed (Lifecycle Event)
May 19 04:39:09.540959 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:39:09.543676 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Instance spawned successfully.
May 19 04:39:09.543955 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:39:09.556501 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:39:09.560588 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Creating image(s)
May 19 04:39:09.560908 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:39:09.561032 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Ensure instance console log exists: /opt/stack/data/nova/instances/11a634a9-3bdd-4085-abc2-a0ad70710975/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:39:09.561251 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:09.561400 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:09.561531 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:09.561964 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Start _get_guest_xml network_info=[{"id": "c20ef5b7-7e77-4061-980b-db836ec71eec", "address": "fa:16:3e:6d:b2:6e", "network": {"id": "9bde70f2-7770-457c-8b6b-364b5adcf4fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1641494804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2110bc6ddf24455ab91b4ba84e6170a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20ef5b7-7e", "ovs_interfaceid": "c20ef5b7-7e77-4061-980b-db836ec71eec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-19T04:31:47Z,direct_url=<?>,disk_format='qcow2',id=77cbe94e-3270-472e-a2a4-99ad3be8837f,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-19T04:31:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '28825852-236d-4422-863c-c403cf284c42', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a12d997-15f6-4776-89f7-965ae348fbb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '11a634a9-3bdd-4085-abc2-a0ad70710975', 'attached_at': '', 'detached_at': '', 'volume_id': '2a12d997-15f6-4776-89f7-965ae348fbb1', 'serial': '2a12d997-15f6-4776-89f7-965ae348fbb1'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:39:09.565040 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "refresh_cache-32cc5240-7a56-4cee-9b41-54e17386b39f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:39:09.569921 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 19 04:39:09.570820 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='77cbe94e-3270-472e-a2a4-99ad3be8837f', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-1399018170', uuid='11a634a9-3bdd-4085-abc2-a0ad70710975'), owner=OwnerMeta(userid='2b98924a893b435ca15d660c63fbf024', username='tempest-ServerActionsV293TestJSON-1582643744-project-member', projectid='e2110bc6ddf24455ab91b4ba84e6170a', projectname='tempest-ServerActionsV293TestJSON-1582643744'), image=ImageMeta(id='', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c20ef5b7-7e77-4061-980b-db836ec71eec", "address": "fa:16:3e:6d:b2:6e", "network": {"id": "9bde70f2-7770-457c-8b6b-364b5adcf4fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1641494804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2110bc6ddf24455ab91b4ba84e6170a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20ef5b7-7e", "ovs_interfaceid": "c20ef5b7-7e77-4061-980b-db836ec71eec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165549.5705628) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:39:09.571747 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:39:09.572037 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:39:09.574636 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:39:09.574994 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:39:09.577406 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:39:09.577406 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:39:09.577406 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-19T04:31:47Z,direct_url=<?>,disk_format='qcow2',id=77cbe94e-3270-472e-a2a4-99ad3be8837f,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-19T04:31:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:39:09.577406 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:39:09.577406 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:39:09.577406 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:39:09.577406 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:39:09.577406 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:39:09.577406 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:39:09.577406 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:39:09.577735 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:39:09.577735 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:39:09.577735 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:39:09.577886 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lazy-loading 'vcpu_model' on Instance uuid 11a634a9-3bdd-4085-abc2-a0ad70710975 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:09.586743 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:39:09.607304 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:09.654724 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:39:09.655262 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:39:09.658719 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-f01d66dc-46c1-4e6c-b004-91647323716e req-67976066-13f8-4433-9176-4560e5c05f15 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:09.666425 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:39:09.667504 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:fe16:6b7e', 'fe80::6898:26ff:fe86:46b0'] 
May 19 04:39:09.667707 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:39:09.667815 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:39:09.668070 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:39:09.668306 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Updating existing volume attachment record: 4c93bbad-8e2d-49ca-962c-1c88fe55abd2 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:39:09.745033 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-f01d66dc-46c1-4e6c-b004-91647323716e req-67976066-13f8-4433-9176-4560e5c05f15 service nova] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:39:09.955148 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:39:09.975903 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-f01d66dc-46c1-4e6c-b004-91647323716e req-67976066-13f8-4433-9176-4560e5c05f15 service nova] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:39:09.999796 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:39:10.044385 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:10.051444 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:39:10.056062 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:10.056275 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:10.056675 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:10.057008 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:10.057472 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:10.057757 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:10.097731 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:39:10.098143 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a12d997-15f6-4776-89f7-965ae348fbb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:39:10.098351 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:10.194054 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:10.194260 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:10.194390 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Unshelving
May 19 04:39:10.480478 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f01d66dc-46c1-4e6c-b004-91647323716e req-67976066-13f8-4433-9176-4560e5c05f15 service nova] Releasing lock "refresh_cache-32cc5240-7a56-4cee-9b41-54e17386b39f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:39:10.481082 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquired lock "refresh_cache-32cc5240-7a56-4cee-9b41-54e17386b39f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:39:10.481306 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:39:10.511527 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.421s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:10.543556 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:10.555486 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:39:10.565748 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Took 15.91 seconds to spawn the instance on the hypervisor.
May 19 04:39:10.565993 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:10.567745 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Deleted allocations for instance 346344d1-df0a-4fd8-9396-b5fde8cf53d1
May 19 04:39:10.970880 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Found WWN 330000000d2175c04 for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:39:10.971309 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:39:10.971470 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000d2175c04', 'path': '/dev/dm-0', 'multipath_id': '330000000d2175c04'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:39:10.971582 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d2175c04', 'path': '/dev/dm-0', 'multipath_id': '330000000d2175c04'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:39:10.976682 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.878s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:39:10.977334 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a12d997-15f6-4776-89f7-965ae348fbb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:39:10.994297 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:10.995074 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:10.995642 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:39:10.995810 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:39:10.996332 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:39:10.996569 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:39:11.010779 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:39:11.010779 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:11.017518 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:39:11.017518 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:11.026810 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1] added
May 19 04:39:11.026810 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:39:11.026810 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:11.026810 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:11.026810 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:11.026810 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:11.026810 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:11.027187 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:39:11.027187 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0313(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:39:11.027347 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:39:11.032859 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1] added
May 19 04:39:11.032859 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:39:11.032859 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:11.032859 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:11.032859 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:11.032859 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:11.032859 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:11.033071 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:39:11.033919 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0366(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:39:11.033919 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:39:11.086341 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Took 23.08 seconds to build instance.
May 19 04:39:11.147972 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:39:11.317702 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e3d90c50-910c-4361-8414-4985a352588d req-7f11e25f-df9b-4e0a-b06f-d8eb8b770339 service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Received event network-changed-2f49d1e8-3715-4f15-8d97-10c3446283ad {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:11.320085 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e3d90c50-910c-4361-8414-4985a352588d req-7f11e25f-df9b-4e0a-b06f-d8eb8b770339 service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Refreshing instance network info cache due to event network-changed-2f49d1e8-3715-4f15-8d97-10c3446283ad. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:39:11.320085 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e3d90c50-910c-4361-8414-4985a352588d req-7f11e25f-df9b-4e0a-b06f-d8eb8b770339 service nova] Acquiring lock "refresh_cache-aa2cdf1d-65ef-4cf4-b742-72ae783cde27" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:39:11.320085 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e3d90c50-910c-4361-8414-4985a352588d req-7f11e25f-df9b-4e0a-b06f-d8eb8b770339 service nova] Acquired lock "refresh_cache-aa2cdf1d-65ef-4cf4-b742-72ae783cde27" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:39:11.320085 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e3d90c50-910c-4361-8414-4985a352588d req-7f11e25f-df9b-4e0a-b06f-d8eb8b770339 service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Refreshing network info cache for port 2f49d1e8-3715-4f15-8d97-10c3446283ad {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:39:11.409784 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:11.480260 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-780352072',display_name='tempest-ServerActionsTestOtherA-server-1649255047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-tempest-common-compute-instance-780352072',id=23,image_ref='77cbe94e-3270-472e-a2a4-99ad3be8837f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWjOIOVsMyvCxHSFbUg/KisSEpUltBBUDn7k40MoaIFEqu0hiq0xGxCl65mWduVoYJ4X6DBai5dMDbW4PlxibjrzT90yPIjDM/NptUDmKdJDlF8xak6SVAX4dfbERZ5hw==',key_name='tempest-keypair-1176894162',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:38:06Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='336d55ae51114828ba5ad8c0ac87ca9b',ramdisk_id='',reservation_id='r-roxanvg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='77cbe94e-3270-472e-a2a4-99ad3be8837f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-281327203',owner_user_name='tempest-ServerActionsTestOtherA-281327203-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:39:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6374f2e55af946f9abf35d0c8a1cd206',uuid=6cd7138c-f217-4858-8941-89693e62ae6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "address": "fa:16:3e:8e:26:b9", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ea210-38", "ovs_interfaceid": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:39:11.481621 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converting VIF {"id": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "address": "fa:16:3e:8e:26:b9", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ea210-38", "ovs_interfaceid": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:39:11.482472 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:26:b9,bridge_name='br-int',has_traffic_filtering=True,id=919ea210-38da-46cf-9d56-5cbcf6a822a6,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919ea210-38') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:39:11.485216 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] End _get_guest_xml xml=<domain type="qemu">
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:   <uuid>6cd7138c-f217-4858-8941-89693e62ae6e</uuid>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:   <name>instance-00000017</name>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServerActionsTestOtherA-server-1649255047</nova:name>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:39:07</nova:creationTime>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <nova:image uuid="77cbe94e-3270-472e-a2a4-99ad3be8837f">
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:         <nova:user uuid="6374f2e55af946f9abf35d0c8a1cd206">tempest-ServerActionsTestOtherA-281327203-project-member</nova:user>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:         <nova:project uuid="336d55ae51114828ba5ad8c0ac87ca9b">tempest-ServerActionsTestOtherA-281327203</nova:project>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="77cbe94e-3270-472e-a2a4-99ad3be8837f"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:         <nova:port uuid="919ea210-38da-46cf-9d56-5cbcf6a822a6">
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     <system>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <entry name="serial">6cd7138c-f217-4858-8941-89693e62ae6e</entry>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <entry name="uuid">6cd7138c-f217-4858-8941-89693e62ae6e</entry>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     </system>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:   <os>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:   </os>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:   <features>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:   </features>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:   <devices>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     </disk>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk.config"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     </disk>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <alias name="ua-de39af6d-0810-4cc6-af4b-fd4602ea4ea2"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-0"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <target dev="vdb" bus="virtio"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <serial>de39af6d-0810-4cc6-af4b-fd4602ea4ea2</serial>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     </disk>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:8e:26:b9"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <target dev="tap919ea210-38"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     </interface>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/console.log" append="off"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     </serial>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     <video>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     </video>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     </rng>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:   </devices>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]: </domain>
May 19 04:39:11.485216 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:39:11.490455 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-780352072',display_name='tempest-ServerActionsTestOtherA-server-1649255047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-tempest-common-compute-instance-780352072',id=23,image_ref='77cbe94e-3270-472e-a2a4-99ad3be8837f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWjOIOVsMyvCxHSFbUg/KisSEpUltBBUDn7k40MoaIFEqu0hiq0xGxCl65mWduVoYJ4X6DBai5dMDbW4PlxibjrzT90yPIjDM/NptUDmKdJDlF8xak6SVAX4dfbERZ5hw==',key_name='tempest-keypair-1176894162',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:38:06Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='336d55ae51114828ba5ad8c0ac87ca9b',ramdisk_id='',reservation_id='r-roxanvg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='77cbe94e-3270-472e-a2a4-99ad3be8837f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-281327203',owner_user_name='tempest-ServerActionsTestOtherA-281327203-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:39:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6374f2e55af946f9abf35d0c8a1cd206',uuid=6cd7138c-f217-4858-8941-89693e62ae6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "address": "fa:16:3e:8e:26:b9", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ea210-38", "ovs_interfaceid": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:39:11.490455 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converting VIF {"id": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "address": "fa:16:3e:8e:26:b9", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ea210-38", "ovs_interfaceid": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:39:11.491660 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:26:b9,bridge_name='br-int',has_traffic_filtering=True,id=919ea210-38da-46cf-9d56-5cbcf6a822a6,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919ea210-38') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:39:11.491660 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:26:b9,bridge_name='br-int',has_traffic_filtering=True,id=919ea210-38da-46cf-9d56-5cbcf6a822a6,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919ea210-38') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:39:11.491804 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:11.492076 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:11.492381 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:39:11.493500 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:11.493763 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f46a1fd6-7cae-508c-8a15-eef20b4ca714', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:11.495985 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:11.498411 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:11.498719 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap919ea210-38, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:11.499291 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap919ea210-38, col_values=(('qos', UUID('bd7ea7a6-c178-49d6-829c-a79353b5d9a9')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:11.499667 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap919ea210-38, col_values=(('external_ids', {'iface-id': '919ea210-38da-46cf-9d56-5cbcf6a822a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:26:b9', 'vm-uuid': '6cd7138c-f217-4858-8941-89693e62ae6e'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:11.503585 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:11.507738 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:11.509304 np0000001025 nova-compute[97981]: INFO os_vif [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:26:b9,bridge_name='br-int',has_traffic_filtering=True,id=919ea210-38da-46cf-9d56-5cbcf6a822a6,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919ea210-38')
May 19 04:39:11.587820 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c5f58f17-dac7-4215-a52e-54e6d9a6ec61 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "346344d1-df0a-4fd8-9396-b5fde8cf53d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.064s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:11.589565 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "87e8e02e-e385-418c-be0c-bb25a377d081" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.591s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:11.717953 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Booting with volume 5afb0a3d-3c54-47c8-a9e0-fed41297513c at /dev/vdc
May 19 04:39:11.772094 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Updating instance_info_cache with network_info: [{"id": "074c374b-3c37-4167-a2d2-3316204ce080", "address": "fa:16:3e:ed:8d:89", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap074c374b-3c", "ovs_interfaceid": "074c374b-3c37-4167-a2d2-3316204ce080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:39:11.777094 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:39:11.784511 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.001178578999997626 future=<Future at 0x721850269af0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:39:11.784511 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:39:11.784511 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=1.765600080000013 future=<Future at 0x7218502680e0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:39:11.784511 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=1.7654947019998417 future=<Future at 0x7218502680e0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:39:11.785599 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Emitting event <LifecycleEvent: 1779165536.7810133, e415a06a-1c69-49b7-9bd3-f68ce343b0b7 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:11.785599 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] VM Stopped (Lifecycle Event)
May 19 04:39:11.790322 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:39:11.792409 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:39:11.792560 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Creating image(s)
May 19 04:39:11.792815 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:39:11.792964 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Ensure instance console log exists: /opt/stack/data/nova/instances/32cc5240-7a56-4cee-9b41-54e17386b39f/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:39:11.797881 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:11.797881 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:11.798059 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:11.798840 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:39:11.822682 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-e3d90c50-910c-4361-8414-4985a352588d req-7f11e25f-df9b-4e0a-b06f-d8eb8b770339 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:11.828146 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:11.871327 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:39:11.871649 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:39:11.885550 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:39:11.885766 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:fe16:6b7e', 'fe80::6898:26ff:fe86:46b0'] 
May 19 04:39:11.885993 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:39:11.886091 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:39:11.886409 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:39:11.887091 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Updating existing volume attachment record: 4f975f32-0afd-4e83-a8ca-b9576f4f24b6 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:39:12.028440 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:39:12.034159 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:39:12.045040 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:39:12.045040 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:39:12.054311 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:39:12.054311 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:12.064642 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:12.072875 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:12.085513 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:12.085513 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:12.085513 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:12.085513 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:12.085513 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:12.085513 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:12.085513 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:12.085513 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:12.085513 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:12.085513 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:12.092343 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:12.092343 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:12.092343 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:12.092343 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:12.092343 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:12.092511 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:12.092511 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:12.092511 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:12.092511 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:12.092511 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:12.125668 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1, portal: 192.168.40.100,3260]
May 19 04:39:12.125668 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1, portal: 192.168.40.100,3260] successful.
May 19 04:39:12.125668 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:12.134768 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1, portal: 192.168.50.100,3260]
May 19 04:39:12.134768 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1, portal: 192.168.50.100,3260] successful.
May 19 04:39:12.134768 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:12.140023 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:12.146847 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:12.155435 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:12.155435 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:12.155435 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:12.155435 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:12.155435 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:12.155435 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:12.155435 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:12.155685 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:12.155685 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:12.155685 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:12.155685 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:12.155685 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:12.155685 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:12.155685 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:12.155897 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:39:12.156007 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:39:12.156737 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] HCTL ('9', '-', '-', 0) found on session 61 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:39:12.156871 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:39:12.164434 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:12.164434 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:12.164434 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:12.164434 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:12.164434 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:12.164434 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:12.164434 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:12.164718 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:12.164718 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:12.164718 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:12.164718 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:12.164718 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:12.164718 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:12.164718 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:12.164897 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:39:12.164963 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:39:12.165819 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] HCTL ('10', '-', '-', 0) found on session 62 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:39:12.165875 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:39:12.199370 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Searching for a device in session 61 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:39:12.199370 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a12d997-15f6-4776-89f7-965ae348fbb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:39:12.199370 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Searching for a device in session 62 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:39:12.199370 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2a12d997-15f6-4776-89f7-965ae348fbb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:39:12.282704 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Releasing lock "refresh_cache-32cc5240-7a56-4cee-9b41-54e17386b39f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:39:12.282704 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Instance network_info: |[{"id": "074c374b-3c37-4167-a2d2-3316204ce080", "address": "fa:16:3e:ed:8d:89", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap074c374b-3c", "ovs_interfaceid": "074c374b-3c37-4167-a2d2-3316204ce080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:39:12.288849 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Start _get_guest_xml network_info=[{"id": "074c374b-3c37-4167-a2d2-3316204ce080", "address": "fa:16:3e:ed:8d:89", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap074c374b-3c", "ovs_interfaceid": "074c374b-3c37-4167-a2d2-3316204ce080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '4c93bbad-8e2d-49ca-962c-1c88fe55abd2', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '234422a2-4faa-4b84-9742-2491b748d237', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '32cc5240-7a56-4cee-9b41-54e17386b39f', 'attached_at': '', 'detached_at': '', 'volume_id': '234422a2-4faa-4b84-9742-2491b748d237', 'serial': '234422a2-4faa-4b84-9742-2491b748d237', 'multiattach': True}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:39:12.292165 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3514a650-61e4-4abb-a3d9-017386ddf320 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:12.302967 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:39:12.304582 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-998021487', uuid='32cc5240-7a56-4cee-9b41-54e17386b39f'), owner=OwnerMeta(userid='aa432d60cb324c6d87818107e05e0053', username='tempest-AttachVolumeMultiAttachTest-1659172696-project-member', projectid='490151decdde445593a86a16976f6b34', projectname='tempest-AttachVolumeMultiAttachTest-1659172696'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "074c374b-3c37-4167-a2d2-3316204ce080", "address": "fa:16:3e:ed:8d:89", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap074c374b-3c", "ovs_interfaceid": "074c374b-3c37-4167-a2d2-3316204ce080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165552.3040786) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:39:12.305932 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:39:12.306251 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:39:12.306993 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:39:12.307222 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:39:12.308568 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:39:12.308834 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:39:12.309099 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:39:12.309232 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:39:12.309395 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:39:12.309501 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:39:12.309622 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:39:12.309828 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:39:12.309953 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:39:12.310678 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:39:12.310832 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:39:12.310991 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:39:12.324746 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-e3d90c50-910c-4361-8414-4985a352588d req-7f11e25f-df9b-4e0a-b06f-d8eb8b770339 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:12.329451 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:39:12.329770 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '234422a2-4faa-4b84-9742-2491b748d237', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:39:12.329905 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:12.639543 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e3d90c50-910c-4361-8414-4985a352588d req-7f11e25f-df9b-4e0a-b06f-d8eb8b770339 service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Updated VIF entry in instance network info cache for port 2f49d1e8-3715-4f15-8d97-10c3446283ad. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:39:12.639962 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e3d90c50-910c-4361-8414-4985a352588d req-7f11e25f-df9b-4e0a-b06f-d8eb8b770339 service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Updating instance_info_cache with network_info: [{"id": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "address": "fa:16:3e:3c:c4:ae", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f49d1e8-37", "ovs_interfaceid": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:39:12.747523 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-700e3db6-a84d-4a64-8919-432a4799582e req-27e96e4d-94e7-42d3-ac1f-b18070cb1b65 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Received event network-changed-3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:12.747737 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-700e3db6-a84d-4a64-8919-432a4799582e req-27e96e4d-94e7-42d3-ac1f-b18070cb1b65 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Refreshing instance network info cache due to event network-changed-3587c521-ddbe-4301-84ca-17721980c57a. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:39:12.747971 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-700e3db6-a84d-4a64-8919-432a4799582e req-27e96e4d-94e7-42d3-ac1f-b18070cb1b65 service nova] Acquiring lock "refresh_cache-87e8e02e-e385-418c-be0c-bb25a377d081" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:39:12.748075 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-700e3db6-a84d-4a64-8919-432a4799582e req-27e96e4d-94e7-42d3-ac1f-b18070cb1b65 service nova] Acquired lock "refresh_cache-87e8e02e-e385-418c-be0c-bb25a377d081" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:39:12.748250 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-700e3db6-a84d-4a64-8919-432a4799582e req-27e96e4d-94e7-42d3-ac1f-b18070cb1b65 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Refreshing network info cache for port 3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:39:12.758530 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:12.996603 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:39:13.026308 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:39:13.026511 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:39:13.026632 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:39:13.026733 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] No VIF found with MAC fa:16:3e:8e:26:b9, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:39:13.028222 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Using config drive
May 19 04:39:13.144753 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e3d90c50-910c-4361-8414-4985a352588d req-7f11e25f-df9b-4e0a-b06f-d8eb8b770339 service nova] Releasing lock "refresh_cache-aa2cdf1d-65ef-4cf4-b742-72ae783cde27" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:39:13.170728 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:13.251540 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-700e3db6-a84d-4a64-8919-432a4799582e req-27e96e4d-94e7-42d3-ac1f-b18070cb1b65 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:13.531908 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lazy-loading 'ec2_ids' on Instance uuid 6cd7138c-f217-4858-8941-89693e62ae6e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:13.549290 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0012028000001009787 future=<Future at 0x7218502680e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:39:13.549406 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:39:13.549512 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=0.005015029000105642 future=<Future at 0x7218506f98b0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:39:13.551502 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=0.003058020000025863 future=<Future at 0x7218506f98b0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:39:13.551726 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Emitting event <LifecycleEvent: 1779165538.547974, 6cd7138c-f217-4858-8941-89693e62ae6e => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:13.552407 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] VM Stopped (Lifecycle Event)
May 19 04:39:13.555075 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00030552099997294135 future=<Future at 0x7218506f98b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:39:13.555075 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:39:13.555640 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] Emitting event <LifecycleEvent: 1779165538.554461, 346344d1-df0a-4fd8-9396-b5fde8cf53d1 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:13.555908 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] VM Stopped (Lifecycle Event)
May 19 04:39:13.577461 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:13.579234 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:13.581386 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'pci_requests' on Instance uuid e415a06a-1c69-49b7-9bd3-f68ce343b0b7 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:13.784002 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-700e3db6-a84d-4a64-8919-432a4799582e req-27e96e4d-94e7-42d3-ac1f-b18070cb1b65 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:13.962252 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-700e3db6-a84d-4a64-8919-432a4799582e req-27e96e4d-94e7-42d3-ac1f-b18070cb1b65 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Updated VIF entry in instance network info cache for port 3587c521-ddbe-4301-84ca-17721980c57a. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:39:13.962494 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-700e3db6-a84d-4a64-8919-432a4799582e req-27e96e4d-94e7-42d3-ac1f-b18070cb1b65 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Updating instance_info_cache with network_info: [{"id": "3587c521-ddbe-4301-84ca-17721980c57a", "address": "fa:16:3e:16:6b:7e", "network": {"id": "c2482d3a-1a67-42d2-92b3-13ee3ae383c7", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-380374163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49561da7541f44898968cb455fb3e6bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3587c521-dd", "ovs_interfaceid": "3587c521-ddbe-4301-84ca-17721980c57a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:39:14.021582 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Found WWN 330000000ea42bea5 for multipath device dm-1 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:39:14.023120 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:39:14.023787 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] <== connect_volume: return (3924ms) {'type': 'block', 'scsi_wwn': '330000000ea42bea5', 'path': '/dev/dm-1', 'multipath_id': '330000000ea42bea5'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:39:14.023982 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ea42bea5', 'path': '/dev/dm-1', 'multipath_id': '330000000ea42bea5'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:39:14.024756 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.694s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:39:14.025255 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '234422a2-4faa-4b84-9742-2491b748d237', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:39:14.039193 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Object Instance<6cd7138c-f217-4858-8941-89693e62ae6e> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:39:14.039430 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lazy-loading 'keypairs' on Instance uuid 6cd7138c-f217-4858-8941-89693e62ae6e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:14.042413 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:14.043135 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:14.044354 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:39:14.044633 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:39:14.047374 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:39:14.052647 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:39:14.056340 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:14.061141 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-196b9486-4348-475a-8513-7842d34fcb42 tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 346344d1-df0a-4fd8-9396-b5fde8cf53d1] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:14.062018 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 4 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:39:14.064985 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:39:14.064985 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:14.071613 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:39:14.071613 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:14.083768 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237] added
May 19 04:39:14.083768 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:39:14.083768 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:14.083768 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:14.083768 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:14.083768 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:14.083768 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:14.083768 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:39:14.083967 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0392(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:39:14.084140 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:39:14.087270 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'numa_topology' on Instance uuid e415a06a-1c69-49b7-9bd3-f68ce343b0b7 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:14.089141 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237] added
May 19 04:39:14.089141 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:39:14.089141 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:14.089141 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:14.089141 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:14.089141 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:14.089141 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:14.089141 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:39:14.089141 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0362(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:39:14.089141 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:39:14.464729 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-700e3db6-a84d-4a64-8919-432a4799582e req-27e96e4d-94e7-42d3-ac1f-b18070cb1b65 service nova] Releasing lock "refresh_cache-87e8e02e-e385-418c-be0c-bb25a377d081" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:39:14.533410 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1399018170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serveractionsv293testjson-server-261623189',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFEE7MfVouu9pqjSZuefRPAqoz2KwFtdLVyP66SNkY10e8a8acmINjhhjRaCSrP+4JYHVyxJ7DR6qdX1Kgex1JRulJwwAy9kC1zv4B6aG+7K383hOjahrwa67Ca8VXO3A==',key_name='tempest-keypair-1684840035',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:38:08Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e2110bc6ddf24455ab91b4ba84e6170a',ramdisk_id='',reservation_id='r-6q1ykbfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='77cbe94e-3270-472e-a2a4-99ad3be8837f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1582643744',owner_user_name='tempest-ServerActionsV293TestJSON-1582643744-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:39:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b98924a893b435ca15d660c63fbf024',uuid=11a634a9-3bdd-4085-abc2-a0ad70710975,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c20ef5b7-7e77-4061-980b-db836ec71eec", "address": "fa:16:3e:6d:b2:6e", "network": {"id": "9bde70f2-7770-457c-8b6b-364b5adcf4fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1641494804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2110bc6ddf24455ab91b4ba84e6170a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20ef5b7-7e", "ovs_interfaceid": "c20ef5b7-7e77-4061-980b-db836ec71eec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:39:14.533661 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Converting VIF {"id": "c20ef5b7-7e77-4061-980b-db836ec71eec", "address": "fa:16:3e:6d:b2:6e", "network": {"id": "9bde70f2-7770-457c-8b6b-364b5adcf4fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1641494804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2110bc6ddf24455ab91b4ba84e6170a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20ef5b7-7e", "ovs_interfaceid": "c20ef5b7-7e77-4061-980b-db836ec71eec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:39:14.534323 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=c20ef5b7-7e77-4061-980b-db836ec71eec,network=Network(9bde70f2-7770-457c-8b6b-364b5adcf4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20ef5b7-7e') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:39:14.540410 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] End _get_guest_xml xml=<domain type="qemu">
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:   <uuid>11a634a9-3bdd-4085-abc2-a0ad70710975</uuid>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:   <name>instance-00000016</name>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1399018170</nova:name>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:39:09</nova:creationTime>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <nova:image uuid="77cbe94e-3270-472e-a2a4-99ad3be8837f">
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:         <nova:user uuid="2b98924a893b435ca15d660c63fbf024">tempest-ServerActionsV293TestJSON-1582643744-project-member</nova:user>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:         <nova:project uuid="e2110bc6ddf24455ab91b4ba84e6170a">tempest-ServerActionsV293TestJSON-1582643744</nova:project>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid="77cbe94e-3270-472e-a2a4-99ad3be8837f"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:         <nova:port uuid="c20ef5b7-7e77-4061-980b-db836ec71eec">
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     <system>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <entry name="serial">11a634a9-3bdd-4085-abc2-a0ad70710975</entry>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <entry name="uuid">11a634a9-3bdd-4085-abc2-a0ad70710975</entry>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     </system>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:   <os>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:   </os>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:   <features>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:   </features>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:   <devices>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/11a634a9-3bdd-4085-abc2-a0ad70710975/disk.config"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     </disk>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <alias name="ua-2a12d997-15f6-4776-89f7-965ae348fbb1"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-1"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <serial>2a12d997-15f6-4776-89f7-965ae348fbb1</serial>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     </disk>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:6d:b2:6e"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <target dev="tapc20ef5b7-7e"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     </interface>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/11a634a9-3bdd-4085-abc2-a0ad70710975/console.log" append="off"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     </serial>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     <video>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     </video>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     </rng>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:   </devices>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]: </domain>
May 19 04:39:14.540410 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:39:14.542223 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1399018170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serveractionsv293testjson-server-261623189',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFEE7MfVouu9pqjSZuefRPAqoz2KwFtdLVyP66SNkY10e8a8acmINjhhjRaCSrP+4JYHVyxJ7DR6qdX1Kgex1JRulJwwAy9kC1zv4B6aG+7K383hOjahrwa67Ca8VXO3A==',key_name='tempest-keypair-1684840035',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:38:08Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e2110bc6ddf24455ab91b4ba84e6170a',ramdisk_id='',reservation_id='r-6q1ykbfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='77cbe94e-3270-472e-a2a4-99ad3be8837f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1582643744',owner_user_name='tempest-ServerActionsV293TestJSON-1582643744-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:39:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b98924a893b435ca15d660c63fbf024',uuid=11a634a9-3bdd-4085-abc2-a0ad70710975,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c20ef5b7-7e77-4061-980b-db836ec71eec", "address": "fa:16:3e:6d:b2:6e", "network": {"id": "9bde70f2-7770-457c-8b6b-364b5adcf4fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1641494804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2110bc6ddf24455ab91b4ba84e6170a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20ef5b7-7e", "ovs_interfaceid": "c20ef5b7-7e77-4061-980b-db836ec71eec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:39:14.542223 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Converting VIF {"id": "c20ef5b7-7e77-4061-980b-db836ec71eec", "address": "fa:16:3e:6d:b2:6e", "network": {"id": "9bde70f2-7770-457c-8b6b-364b5adcf4fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1641494804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2110bc6ddf24455ab91b4ba84e6170a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20ef5b7-7e", "ovs_interfaceid": "c20ef5b7-7e77-4061-980b-db836ec71eec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:39:14.542223 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=c20ef5b7-7e77-4061-980b-db836ec71eec,network=Network(9bde70f2-7770-457c-8b6b-364b5adcf4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20ef5b7-7e') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:39:14.542433 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=c20ef5b7-7e77-4061-980b-db836ec71eec,network=Network(9bde70f2-7770-457c-8b6b-364b5adcf4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20ef5b7-7e') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:39:14.542679 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:14.542875 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:14.545393 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:39:14.545393 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:14.545393 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f1affce-4bbc-5e25-bf3f-b9d6b8adbf1f', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:14.546707 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Object Instance<6cd7138c-f217-4858-8941-89693e62ae6e> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:39:14.550255 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 19 04:39:14.551826 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:14.560599 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:14.564769 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:14.565663 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-1f24d0da-7494-45bb-b4e1-391dc705418a tempest-VolumesActionsTest-2133751040 tempest-VolumesActionsTest-2133751040-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 19 04:39:14.569130 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:14.569130 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc20ef5b7-7e, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:14.569130 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc20ef5b7-7e, col_values=(('qos', UUID('81406f8e-acbd-442c-9b28-896ac7aa1a2a')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:14.569130 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc20ef5b7-7e, col_values=(('external_ids', {'iface-id': 'c20ef5b7-7e77-4061-980b-db836ec71eec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:b2:6e', 'vm-uuid': '11a634a9-3bdd-4085-abc2-a0ad70710975'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:14.569595 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:14.570940 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:14.581068 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:14.582278 np0000001025 nova-compute[97981]: INFO os_vif [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=c20ef5b7-7e77-4061-980b-db836ec71eec,network=Network(9bde70f2-7770-457c-8b6b-364b5adcf4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20ef5b7-7e')
May 19 04:39:14.590216 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:39:14.591128 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Claim successful on node np0000001025
May 19 04:39:14.780531 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Creating config drive at /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk.config
May 19 04:39:14.784772 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4vgaaejr {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:14.843822 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4vgaaejr" returned: 0 in 0.059s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:14.981504 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7e00f0d1-34fc-4118-86ac-81bf03b068ad req-1aedf1f8-acc0-40cd-a97c-a00bfb579c3d service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Received event network-changed-3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:14.986761 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7e00f0d1-34fc-4118-86ac-81bf03b068ad req-1aedf1f8-acc0-40cd-a97c-a00bfb579c3d service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Refreshing instance network info cache due to event network-changed-3587c521-ddbe-4301-84ca-17721980c57a. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:39:14.986984 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7e00f0d1-34fc-4118-86ac-81bf03b068ad req-1aedf1f8-acc0-40cd-a97c-a00bfb579c3d service nova] Acquiring lock "refresh_cache-87e8e02e-e385-418c-be0c-bb25a377d081" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:39:14.987105 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7e00f0d1-34fc-4118-86ac-81bf03b068ad req-1aedf1f8-acc0-40cd-a97c-a00bfb579c3d service nova] Acquired lock "refresh_cache-87e8e02e-e385-418c-be0c-bb25a377d081" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:39:14.987254 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-7e00f0d1-34fc-4118-86ac-81bf03b068ad req-1aedf1f8-acc0-40cd-a97c-a00bfb579c3d service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Refreshing network info cache for port 3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:39:15.084517 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:39:15.089330 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:39:15.100837 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:39:15.100837 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:39:15.102688 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:39:15.102688 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:15.117176 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:15.125122 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:15.138754 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:15.138754 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:15.138754 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:15.138754 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:15.138754 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:15.138754 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:15.138754 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:15.139160 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:15.139160 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:15.139160 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:15.139160 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:15.139160 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:15.139160 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:15.139160 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:15.144914 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:15.144914 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:15.144914 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:15.144914 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:15.144914 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:15.144914 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:15.144914 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:15.145131 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:15.145131 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:15.145131 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:15.145131 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:15.145131 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:15.145131 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:15.145131 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:15.189734 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237, portal: 192.168.50.100,3260]
May 19 04:39:15.189734 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237, portal: 192.168.50.100,3260] successful.
May 19 04:39:15.189734 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:15.196058 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237, portal: 192.168.40.100,3260]
May 19 04:39:15.196058 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237, portal: 192.168.40.100,3260] successful.
May 19 04:39:15.196058 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:15.203392 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:15.211933 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:15.220673 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:15.220673 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:15.220673 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:15.220673 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:15.220673 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:15.220673 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:15.220673 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:15.220673 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:15.220673 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:15.221016 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:15.221016 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:15.221016 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:15.221016 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:15.221016 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:15.221016 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:15.221016 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:15.221016 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:15.221016 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:15.224167 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:39:15.224167 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:39:15.224167 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] HCTL ('13', '-', '-', 0) found on session 63 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:39:15.224167 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:39:15.228458 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:15.228458 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:15.228458 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:15.228458 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:15.228458 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:15.228458 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:15.228458 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:15.228458 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:15.228458 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:15.228729 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:15.228729 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:15.228729 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:15.228729 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:15.228729 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:15.228729 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:15.228729 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:15.228729 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:15.228729 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:15.228968 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:39:15.228968 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:39:15.230341 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] HCTL ('14', '-', '-', 0) found on session 64 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:39:15.230341 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:39:15.247426 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching for a device in session 64 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:39:15.247426 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '234422a2-4faa-4b84-9742-2491b748d237', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:39:15.249454 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching for a device in session 63 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:39:15.249572 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '234422a2-4faa-4b84-9742-2491b748d237', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:39:15.347393 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:15.385192 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:15.491252 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-7e00f0d1-34fc-4118-86ac-81bf03b068ad req-1aedf1f8-acc0-40cd-a97c-a00bfb579c3d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:15.510162 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:15.517437 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:15.524386 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:15.947391 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-7e00f0d1-34fc-4118-86ac-81bf03b068ad req-1aedf1f8-acc0-40cd-a97c-a00bfb579c3d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:16.045221 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:39:16.102892 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:39:16.102892 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:39:16.122325 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:39:16.122325 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:39:16.122325 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] No VIF found with MAC fa:16:3e:6d:b2:6e, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:39:16.122325 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Using config drive
May 19 04:39:16.170188 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-7e00f0d1-34fc-4118-86ac-81bf03b068ad req-1aedf1f8-acc0-40cd-a97c-a00bfb579c3d service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Updated VIF entry in instance network info cache for port 3587c521-ddbe-4301-84ca-17721980c57a. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:39:16.170188 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-7e00f0d1-34fc-4118-86ac-81bf03b068ad req-1aedf1f8-acc0-40cd-a97c-a00bfb579c3d service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Updating instance_info_cache with network_info: [{"id": "3587c521-ddbe-4301-84ca-17721980c57a", "address": "fa:16:3e:16:6b:7e", "network": {"id": "c2482d3a-1a67-42d2-92b3-13ee3ae383c7", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-380374163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49561da7541f44898968cb455fb3e6bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3587c521-dd", "ovs_interfaceid": "3587c521-ddbe-4301-84ca-17721980c57a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:39:16.287888 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Instance event wait completed in 0 seconds for  {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:39:16.288067 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:39:16.288930 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165556.288622, 6cd7138c-f217-4858-8941-89693e62ae6e => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:16.289125 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] VM Resumed (Lifecycle Event)
May 19 04:39:16.292055 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Instance spawned successfully.
May 19 04:39:16.292214 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:39:16.606132 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:39:16.626095 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lazy-loading 'ec2_ids' on Instance uuid 11a634a9-3bdd-4085-abc2-a0ad70710975 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:16.672287 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7e00f0d1-34fc-4118-86ac-81bf03b068ad req-1aedf1f8-acc0-40cd-a97c-a00bfb579c3d service nova] Releasing lock "refresh_cache-87e8e02e-e385-418c-be0c-bb25a377d081" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:39:16.792150 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:16.795407 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:39:16.798311 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:16.798437 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:16.798726 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:16.798992 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:16.799298 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:16.799585 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:16.974621 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "57adc083-429a-4f23-9154-7de8b6e74d8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:16.975018 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:17.060053 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Found WWN 33000000050cc254c for multipath device dm-7 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:39:17.060315 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:39:17.060507 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] <== connect_volume: return (4730ms) {'type': 'block', 'scsi_wwn': '33000000050cc254c', 'path': '/dev/dm-7', 'multipath_id': '33000000050cc254c'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:39:17.060633 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000050cc254c', 'path': '/dev/dm-7', 'multipath_id': '33000000050cc254c'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:39:17.116230 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.538s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:17.116612 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:17.131908 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Object Instance<11a634a9-3bdd-4085-abc2-a0ad70710975> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:39:17.131908 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lazy-loading 'keypairs' on Instance uuid 11a634a9-3bdd-4085-abc2-a0ad70710975 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:17.223293 np0000001025 nova-compute[97981]: INFO nova.network.neutron [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Updating port 5b2a0762-a1d4-4a8c-a81b-de0fef92e15c with attributes {'binding:host_id': 'np0000001025', 'device_owner': 'compute:nova'}
May 19 04:39:17.297615 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 19 04:39:17.297976 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165557.29767, 6cd7138c-f217-4858-8941-89693e62ae6e => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:17.298074 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] VM Started (Lifecycle Event)
May 19 04:39:17.306290 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:17.476490 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:39:17.567169 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:39:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-998021487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumemultiattachtest-server-998021487',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-dy62941y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:39:09Z,user_data=None,user_id='aa432d60cb324c6d87818107e05e0053',uuid=32cc5240-7a56-4cee-9b41-54e17386b39f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "074c374b-3c37-4167-a2d2-3316204ce080", "address": "fa:16:3e:ed:8d:89", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap074c374b-3c", "ovs_interfaceid": "074c374b-3c37-4167-a2d2-3316204ce080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:39:17.567403 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "074c374b-3c37-4167-a2d2-3316204ce080", "address": "fa:16:3e:ed:8d:89", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap074c374b-3c", "ovs_interfaceid": "074c374b-3c37-4167-a2d2-3316204ce080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:39:17.568072 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:8d:89,bridge_name='br-int',has_traffic_filtering=True,id=074c374b-3c37-4167-a2d2-3316204ce080,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap074c374b-3c') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:39:17.568772 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'pci_devices' on Instance uuid 32cc5240-7a56-4cee-9b41-54e17386b39f {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:17.636193 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Object Instance<11a634a9-3bdd-4085-abc2-a0ad70710975> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:39:17.637016 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 19 04:39:17.713016 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "refresh_cache-e415a06a-1c69-49b7-9bd3-f68ce343b0b7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:39:17.713322 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquired lock "refresh_cache-e415a06a-1c69-49b7-9bd3-f68ce343b0b7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:39:17.713651 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:39:17.771470 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Creating config drive at /opt/stack/data/nova/instances/11a634a9-3bdd-4085-abc2-a0ad70710975/disk.config
May 19 04:39:17.775857 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/11a634a9-3bdd-4085-abc2-a0ad70710975/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgcpz560o {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:17.803431 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:17.807432 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:39:17.821038 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:17.821363 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:17.821674 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=97981) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 19 04:39:17.838832 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3913257f-9f79-418d-8c70-61be253259e5 req-b100375c-9c43-47ea-8e57-ee69ac5bb210 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Received event network-changed-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:17.838832 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3913257f-9f79-418d-8c70-61be253259e5 req-b100375c-9c43-47ea-8e57-ee69ac5bb210 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Refreshing instance network info cache due to event network-changed-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:39:17.838832 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3913257f-9f79-418d-8c70-61be253259e5 req-b100375c-9c43-47ea-8e57-ee69ac5bb210 service nova] Acquiring lock "refresh_cache-e415a06a-1c69-49b7-9bd3-f68ce343b0b7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:39:17.849264 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/11a634a9-3bdd-4085-abc2-a0ad70710975/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgcpz560o" returned: 0 in 0.073s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:18.033921 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:18.071471 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] End _get_guest_xml xml=<domain type="qemu">
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:   <uuid>32cc5240-7a56-4cee-9b41-54e17386b39f</uuid>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:   <name>instance-0000001d</name>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-998021487</nova:name>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:39:12</nova:creationTime>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:         <nova:user uuid="aa432d60cb324c6d87818107e05e0053">tempest-AttachVolumeMultiAttachTest-1659172696-project-member</nova:user>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:         <nova:project uuid="490151decdde445593a86a16976f6b34">tempest-AttachVolumeMultiAttachTest-1659172696</nova:project>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:         <nova:port uuid="074c374b-3c37-4167-a2d2-3316204ce080">
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     <system>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <entry name="serial">32cc5240-7a56-4cee-9b41-54e17386b39f</entry>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <entry name="uuid">32cc5240-7a56-4cee-9b41-54e17386b39f</entry>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     </system>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:   <os>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:   </os>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:   <features>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:   </features>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:   <devices>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/32cc5240-7a56-4cee-9b41-54e17386b39f/disk.config"/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     </disk>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <alias name="ua-234422a2-4faa-4b84-9742-2491b748d237"/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-7"/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <serial>234422a2-4faa-4b84-9742-2491b748d237</serial>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <shareable/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     </disk>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:ed:8d:89"/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <target dev="tap074c374b-3c"/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     </interface>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/32cc5240-7a56-4cee-9b41-54e17386b39f/console.log" append="off"/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     </serial>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     <video>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     </video>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     </rng>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:   </devices>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]: </domain>
May 19 04:39:18.071471 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:39:18.073306 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Preparing to wait for external event network-vif-plugged-074c374b-3c37-4167-a2d2-3316204ce080 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:39:18.073306 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "32cc5240-7a56-4cee-9b41-54e17386b39f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:18.073306 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "32cc5240-7a56-4cee-9b41-54e17386b39f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:18.073306 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "32cc5240-7a56-4cee-9b41-54e17386b39f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:18.073306 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:39:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-998021487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumemultiattachtest-server-998021487',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-dy62941y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:39:09Z,user_data=None,user_id='aa432d60cb324c6d87818107e05e0053',uuid=32cc5240-7a56-4cee-9b41-54e17386b39f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "074c374b-3c37-4167-a2d2-3316204ce080", "address": "fa:16:3e:ed:8d:89", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap074c374b-3c", "ovs_interfaceid": "074c374b-3c37-4167-a2d2-3316204ce080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:39:18.073306 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "074c374b-3c37-4167-a2d2-3316204ce080", "address": "fa:16:3e:ed:8d:89", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap074c374b-3c", "ovs_interfaceid": "074c374b-3c37-4167-a2d2-3316204ce080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:39:18.073800 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:8d:89,bridge_name='br-int',has_traffic_filtering=True,id=074c374b-3c37-4167-a2d2-3316204ce080,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap074c374b-3c') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:39:18.074016 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:8d:89,bridge_name='br-int',has_traffic_filtering=True,id=074c374b-3c37-4167-a2d2-3316204ce080,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap074c374b-3c') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:39:18.074341 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:18.074658 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:18.074980 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:39:18.075653 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:18.075828 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ebdc299d-2f1a-5534-8619-4c07c45664a7', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:18.076682 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:18.077454 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:18.082612 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:18.084798 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:18.084994 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap074c374b-3c, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:18.085429 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap074c374b-3c, col_values=(('qos', UUID('188da85c-14e4-4c23-9154-e7cdf8531c9e')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:18.085632 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap074c374b-3c, col_values=(('external_ids', {'iface-id': '074c374b-3c37-4167-a2d2-3316204ce080', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:8d:89', 'vm-uuid': '32cc5240-7a56-4cee-9b41-54e17386b39f'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:18.086666 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:18.088121 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:18.096858 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:18.097918 np0000001025 nova-compute[97981]: INFO os_vif [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:8d:89,bridge_name='br-int',has_traffic_filtering=True,id=074c374b-3c37-4167-a2d2-3316204ce080,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap074c374b-3c')
May 19 04:39:18.173363 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:18.218701 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:18.287520 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:18.332409 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:18.414428 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:18.584274 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-bec60f80-b9f0-401e-9ff8-f4a5c5cb83a4 req-83a0e582-776c-4efb-ad86-c958bacbfb08 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Received event network-vif-plugged-c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:18.584468 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bec60f80-b9f0-401e-9ff8-f4a5c5cb83a4 req-83a0e582-776c-4efb-ad86-c958bacbfb08 service nova] Acquiring lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:18.584619 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bec60f80-b9f0-401e-9ff8-f4a5c5cb83a4 req-83a0e582-776c-4efb-ad86-c958bacbfb08 service nova] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:18.584737 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bec60f80-b9f0-401e-9ff8-f4a5c5cb83a4 req-83a0e582-776c-4efb-ad86-c958bacbfb08 service nova] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:18.585413 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-bec60f80-b9f0-401e-9ff8-f4a5c5cb83a4 req-83a0e582-776c-4efb-ad86-c958bacbfb08 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] No waiting events found dispatching network-vif-plugged-c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:39:18.585413 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-bec60f80-b9f0-401e-9ff8-f4a5c5cb83a4 req-83a0e582-776c-4efb-ad86-c958bacbfb08 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Received unexpected event network-vif-plugged-c20ef5b7-7e77-4061-980b-db836ec71eec for instance with vm_state active and task_state rebuild_spawning.
May 19 04:39:18.661229 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:18.672086 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:18.676550 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:18.707769 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:18.714168 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:18.826295 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Updating instance_info_cache with network_info: [{"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:39:18.836316 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a12a4432-3967-4690-9335-df6ce1466e4f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.015s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:18.837593 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.803s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:18.843143 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:39:18.843460 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Claim successful on node np0000001025
May 19 04:39:19.195373 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165559.1949358, 11a634a9-3bdd-4085-abc2-a0ad70710975 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:19.195816 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] VM Resumed (Lifecycle Event)
May 19 04:39:19.196921 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Instance event wait completed in 0 seconds for  {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:39:19.197133 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:39:19.199053 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Instance spawned successfully.
May 19 04:39:19.199396 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:39:19.329269 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Releasing lock "refresh_cache-e415a06a-1c69-49b7-9bd3-f68ce343b0b7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:39:19.330591 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:39:19.330819 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3913257f-9f79-418d-8c70-61be253259e5 req-b100375c-9c43-47ea-8e57-ee69ac5bb210 service nova] Acquired lock "refresh_cache-e415a06a-1c69-49b7-9bd3-f68ce343b0b7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:39:19.330983 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3913257f-9f79-418d-8c70-61be253259e5 req-b100375c-9c43-47ea-8e57-ee69ac5bb210 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Refreshing network info cache for port 5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:39:19.332844 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Creating image(s)
May 19 04:39:19.333515 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "/opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:19.334431 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "/opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:19.335086 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "/opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:19.335337 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'trusted_certs' on Instance uuid e415a06a-1c69-49b7-9bd3-f68ce343b0b7 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:19.618725 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:39:19.618883 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:39:19.618996 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No VIF found with MAC fa:16:3e:ed:8d:89, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:39:19.619464 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Using config drive
May 19 04:39:19.699953 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:19.703121 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:39:19.704882 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:19.704998 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:19.705246 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:19.705457 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:19.705676 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:19.705921 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:19.833531 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-3913257f-9f79-418d-8c70-61be253259e5 req-b100375c-9c43-47ea-8e57-ee69ac5bb210 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:19.841366 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Object Instance<e415a06a-1c69-49b7-9bd3-f68ce343b0b7> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:39:19.841698 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "b3432c6f70c1b62792d4abff28acbf8dc21c843d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:19.842242 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "b3432c6f70c1b62792d4abff28acbf8dc21c843d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:20.127152 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:20.210995 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 19 04:39:20.210995 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165560.2101536, 11a634a9-3bdd-4085-abc2-a0ad70710975 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:20.210995 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] VM Started (Lifecycle Event)
May 19 04:39:20.216002 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:20.393456 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-3913257f-9f79-418d-8c70-61be253259e5 req-b100375c-9c43-47ea-8e57-ee69ac5bb210 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:20.445237 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Creating config drive at /opt/stack/data/nova/instances/32cc5240-7a56-4cee-9b41-54e17386b39f/disk.config
May 19 04:39:20.454677 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/32cc5240-7a56-4cee-9b41-54e17386b39f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphkqx90hg {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:20.521686 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/32cc5240-7a56-4cee-9b41-54e17386b39f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphkqx90hg" returned: 0 in 0.067s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:20.588836 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:39:20.589365 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:39:20.627160 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3913257f-9f79-418d-8c70-61be253259e5 req-b100375c-9c43-47ea-8e57-ee69ac5bb210 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Updated VIF entry in instance network info cache for port 5b2a0762-a1d4-4a8c-a81b-de0fef92e15c. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:39:20.627693 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3913257f-9f79-418d-8c70-61be253259e5 req-b100375c-9c43-47ea-8e57-ee69ac5bb210 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Updating instance_info_cache with network_info: [{"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:39:20.667344 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4ebdb5c1-565c-49b4-bacc-551def201ed3 req-9952cf81-fbf7-47d2-8860-bf5c4429d175 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Received event network-vif-plugged-c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:20.669130 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4ebdb5c1-565c-49b4-bacc-551def201ed3 req-9952cf81-fbf7-47d2-8860-bf5c4429d175 service nova] Acquiring lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:20.669556 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4ebdb5c1-565c-49b4-bacc-551def201ed3 req-9952cf81-fbf7-47d2-8860-bf5c4429d175 service nova] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:20.670136 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4ebdb5c1-565c-49b4-bacc-551def201ed3 req-9952cf81-fbf7-47d2-8860-bf5c4429d175 service nova] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:20.670378 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4ebdb5c1-565c-49b4-bacc-551def201ed3 req-9952cf81-fbf7-47d2-8860-bf5c4429d175 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] No waiting events found dispatching network-vif-plugged-c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:39:20.670600 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-4ebdb5c1-565c-49b4-bacc-551def201ed3 req-9952cf81-fbf7-47d2-8860-bf5c4429d175 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Received unexpected event network-vif-plugged-c20ef5b7-7e77-4061-980b-db836ec71eec for instance with vm_state active and task_state None.
May 19 04:39:20.717947 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:20.721842 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:39:20.732987 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:20.883037 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:20.885996 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:20.886387 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3432c6f70c1b62792d4abff28acbf8dc21c843d.part --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:20.993355 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3432c6f70c1b62792d4abff28acbf8dc21c843d.part --force-share --output=json" returned: 0 in 0.107s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:20.993753 np0000001025 nova-compute[97981]: DEBUG nova.virt.images [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] 172923ff-8178-4c61-9d70-323ff53b9cf3 was qcow2, converting to raw {{(pid=97981) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 19 04:39:20.995579 np0000001025 nova-compute[97981]: DEBUG nova.privsep.utils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97981) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 19 04:39:20.995579 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b3432c6f70c1b62792d4abff28acbf8dc21c843d.part /opt/stack/data/nova/instances/_base/b3432c6f70c1b62792d4abff28acbf8dc21c843d.converted {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:21.009804 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:21.039595 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:21.042218 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:21.096134 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:39:21.131047 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3913257f-9f79-418d-8c70-61be253259e5 req-b100375c-9c43-47ea-8e57-ee69ac5bb210 service nova] Releasing lock "refresh_cache-e415a06a-1c69-49b7-9bd3-f68ce343b0b7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:39:21.145206 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:21.235808 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-be95d6b0-cf04-4f69-b714-0fabe8193c75 req-9a6b7b88-c458-4fdf-bc2d-8ac84d41bc95 service nova] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Received event network-vif-plugged-074c374b-3c37-4167-a2d2-3316204ce080 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:21.235808 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-be95d6b0-cf04-4f69-b714-0fabe8193c75 req-9a6b7b88-c458-4fdf-bc2d-8ac84d41bc95 service nova] Acquiring lock "32cc5240-7a56-4cee-9b41-54e17386b39f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:21.235808 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-be95d6b0-cf04-4f69-b714-0fabe8193c75 req-9a6b7b88-c458-4fdf-bc2d-8ac84d41bc95 service nova] Lock "32cc5240-7a56-4cee-9b41-54e17386b39f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:21.235808 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-be95d6b0-cf04-4f69-b714-0fabe8193c75 req-9a6b7b88-c458-4fdf-bc2d-8ac84d41bc95 service nova] Lock "32cc5240-7a56-4cee-9b41-54e17386b39f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:21.235808 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-be95d6b0-cf04-4f69-b714-0fabe8193c75 req-9a6b7b88-c458-4fdf-bc2d-8ac84d41bc95 service nova] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Processing event network-vif-plugged-074c374b-3c37-4167-a2d2-3316204ce080 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:39:21.242377 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b3432c6f70c1b62792d4abff28acbf8dc21c843d.part /opt/stack/data/nova/instances/_base/b3432c6f70c1b62792d4abff28acbf8dc21c843d.converted" returned: 0 in 0.246s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:21.262979 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3432c6f70c1b62792d4abff28acbf8dc21c843d.converted --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:21.358881 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3432c6f70c1b62792d4abff28acbf8dc21c843d.converted --force-share --output=json" returned: 0 in 0.096s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:21.360479 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "b3432c6f70c1b62792d4abff28acbf8dc21c843d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.517s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:21.360479 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:21.364199 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:21.366267 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3432c6f70c1b62792d4abff28acbf8dc21c843d --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:21.432046 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:21.434865 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:21.461006 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0b6380f1-eed7-4731-aae9-1be4f826413a req-240c5d69-7988-4c9c-af93-09aabf5f348a service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Received event network-vif-plugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:21.462753 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0b6380f1-eed7-4731-aae9-1be4f826413a req-240c5d69-7988-4c9c-af93-09aabf5f348a service nova] Acquiring lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:21.462872 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0b6380f1-eed7-4731-aae9-1be4f826413a req-240c5d69-7988-4c9c-af93-09aabf5f348a service nova] Lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:21.462971 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0b6380f1-eed7-4731-aae9-1be4f826413a req-240c5d69-7988-4c9c-af93-09aabf5f348a service nova] Lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:21.463253 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0b6380f1-eed7-4731-aae9-1be4f826413a req-240c5d69-7988-4c9c-af93-09aabf5f348a service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] No waiting events found dispatching network-vif-plugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:39:21.463253 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-0b6380f1-eed7-4731-aae9-1be4f826413a req-240c5d69-7988-4c9c-af93-09aabf5f348a service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Received unexpected event network-vif-plugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 for instance with vm_state active and task_state None.
May 19 04:39:21.464262 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:21.465723 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3432c6f70c1b62792d4abff28acbf8dc21c843d --force-share --output=json" returned: 0 in 0.099s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:21.468529 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "b3432c6f70c1b62792d4abff28acbf8dc21c843d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:21.468529 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "b3432c6f70c1b62792d4abff28acbf8dc21c843d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:21.468529 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:21.470227 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:21.470894 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3432c6f70c1b62792d4abff28acbf8dc21c843d --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:21.571716 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3432c6f70c1b62792d4abff28acbf8dc21c843d --force-share --output=json" returned: 0 in 0.100s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:21.572523 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b3432c6f70c1b62792d4abff28acbf8dc21c843d,backing_fmt=raw /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:21.616913 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.780s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:21.619641 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.884s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:21.620023 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:39:21.622925 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Trying to apply a migration context that does not seem to be set for this instance {{(pid=97981) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 19 04:39:21.630501 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b3432c6f70c1b62792d4abff28acbf8dc21c843d,backing_fmt=raw /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk 1073741824" returned: 0 in 0.058s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:21.630972 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "b3432c6f70c1b62792d4abff28acbf8dc21c843d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.164s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:21.631391 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3432c6f70c1b62792d4abff28acbf8dc21c843d --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:21.744725 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3432c6f70c1b62792d4abff28acbf8dc21c843d --force-share --output=json" returned: 0 in 0.113s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:21.745454 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'migration_context' on Instance uuid e415a06a-1c69-49b7-9bd3-f68ce343b0b7 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:21.994525 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165561.9940505, 32cc5240-7a56-4cee-9b41-54e17386b39f => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:21.995153 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:39:21.995364 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] VM Started (Lifecycle Event)
May 19 04:39:22.003791 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:39:22.006296 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Instance spawned successfully.
May 19 04:39:22.006561 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:39:22.134145 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:39:22.134145 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:39:22.134433 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:22.134860 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:22.229469 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c46088fb3e74b819bb456461716a801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b3c0fa8f894ed2a7c3bcfac99ce74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:39:22.250622 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Object Instance<e415a06a-1c69-49b7-9bd3-f68ce343b0b7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:39:22.251130 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Rebasing disk image.
May 19 04:39:22.251265 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:22.334686 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.083s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:22.335100 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c -F raw /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:22.502555 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:22.506217 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:39:22.520075 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:22.520075 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:22.520075 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:22.520075 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:22.520075 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:22.520075 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:22.647868 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-76452b43-8844-4475-b002-d90f30d73f65 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.031s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:22.649816 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:39:22.933179 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Successfully created port: a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:39:23.010886 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:39:23.010886 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165563.0100436, 32cc5240-7a56-4cee-9b41-54e17386b39f => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:23.012775 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] VM Paused (Lifecycle Event)
May 19 04:39:23.022539 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Took 11.23 seconds to spawn the instance on the hypervisor.
May 19 04:39:23.023011 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:23.087697 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:23.163225 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:39:23.177646 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:23.331553 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-28821e2c-a5e2-43fd-afcb-cc22e886f51d req-4c65b6ed-13fa-4bdd-b682-110aed95d86c service nova] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Received event network-vif-plugged-074c374b-3c37-4167-a2d2-3316204ce080 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:23.332045 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-28821e2c-a5e2-43fd-afcb-cc22e886f51d req-4c65b6ed-13fa-4bdd-b682-110aed95d86c service nova] Acquiring lock "32cc5240-7a56-4cee-9b41-54e17386b39f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:23.332045 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-28821e2c-a5e2-43fd-afcb-cc22e886f51d req-4c65b6ed-13fa-4bdd-b682-110aed95d86c service nova] Lock "32cc5240-7a56-4cee-9b41-54e17386b39f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:23.334307 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-28821e2c-a5e2-43fd-afcb-cc22e886f51d req-4c65b6ed-13fa-4bdd-b682-110aed95d86c service nova] Lock "32cc5240-7a56-4cee-9b41-54e17386b39f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:23.334536 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-28821e2c-a5e2-43fd-afcb-cc22e886f51d req-4c65b6ed-13fa-4bdd-b682-110aed95d86c service nova] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] No waiting events found dispatching network-vif-plugged-074c374b-3c37-4167-a2d2-3316204ce080 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:39:23.334699 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-28821e2c-a5e2-43fd-afcb-cc22e886f51d req-4c65b6ed-13fa-4bdd-b682-110aed95d86c service nova] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Received unexpected event network-vif-plugged-074c374b-3c37-4167-a2d2-3316204ce080 for instance with vm_state active and task_state None.
May 19 04:39:23.516889 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:23.519088 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165563.5187523, 32cc5240-7a56-4cee-9b41-54e17386b39f => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:23.519237 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] VM Resumed (Lifecycle Event)
May 19 04:39:23.539624 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3bb6c2e1-ff1f-458e-b356-bf0594d282d3 req-f8b0803c-9f6a-4a1f-ab78-b9221f0214a7 service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Received event network-vif-plugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:23.540002 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3bb6c2e1-ff1f-458e-b356-bf0594d282d3 req-f8b0803c-9f6a-4a1f-ab78-b9221f0214a7 service nova] Acquiring lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:23.542449 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Took 18.96 seconds to build instance.
May 19 04:39:23.546135 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3bb6c2e1-ff1f-458e-b356-bf0594d282d3 req-f8b0803c-9f6a-4a1f-ab78-b9221f0214a7 service nova] Lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:23.546135 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3bb6c2e1-ff1f-458e-b356-bf0594d282d3 req-f8b0803c-9f6a-4a1f-ab78-b9221f0214a7 service nova] Lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:23.546135 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3bb6c2e1-ff1f-458e-b356-bf0594d282d3 req-f8b0803c-9f6a-4a1f-ab78-b9221f0214a7 service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] No waiting events found dispatching network-vif-plugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:39:23.546135 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-3bb6c2e1-ff1f-458e-b356-bf0594d282d3 req-f8b0803c-9f6a-4a1f-ab78-b9221f0214a7 service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Received unexpected event network-vif-plugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 for instance with vm_state active and task_state None.
May 19 04:39:23.612701 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Successfully updated port: a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:39:23.613006 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c -F raw /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk" returned: 0 in 1.278s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:23.614144 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:39:23.614333 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Ensure instance console log exists: /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:39:23.614636 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:23.619550 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:23.619712 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:23.621689 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Start _get_guest_xml network_info=[{"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0937d9953355e445564354e0f91ab562',container_format='bare',created_at=2026-05-19T04:38:55Z,direct_url=<?>,disk_format='qcow2',id=172923ff-8178-4c61-9d70-323ff53b9cf3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1460978051-shelved',owner='8a3dfff83ce24e619f87507f951f6c69',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-19T04:39:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '4f975f32-0afd-4e83-a8ca-b9576f4f24b6', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c', 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5afb0a3d-3c54-47c8-a9e0-fed41297513c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attached', 'instance': 'e415a06a-1c69-49b7-9bd3-f68ce343b0b7', 'attached_at': '', 'detached_at': '', 'volume_id': '5afb0a3d-3c54-47c8-a9e0-fed41297513c', 'serial': '5afb0a3d-3c54-47c8-a9e0-fed41297513c'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:39:23.623975 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:39:23.625407 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1460978051', uuid='e415a06a-1c69-49b7-9bd3-f68ce343b0b7'), owner=OwnerMeta(userid='7955853f574d42e58ba89f18ed109760', username='tempest-AttachVolumeShelveTestJSON-51274594-project-member', projectid='8a3dfff83ce24e619f87507f951f6c69', projectname='tempest-AttachVolumeShelveTestJSON-51274594'), image=ImageMeta(id='172923ff-8178-4c61-9d70-323ff53b9cf3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165563.6250188) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:39:23.627188 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:39:23.627840 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:39:23.628691 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:39:23.628894 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:39:23.629799 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:39:23.630242 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0937d9953355e445564354e0f91ab562',container_format='bare',created_at=2026-05-19T04:38:55Z,direct_url=<?>,disk_format='qcow2',id=172923ff-8178-4c61-9d70-323ff53b9cf3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1460978051-shelved',owner='8a3dfff83ce24e619f87507f951f6c69',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-19T04:39:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:39:23.630916 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:39:23.631392 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:39:23.631525 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:39:23.631613 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:39:23.631704 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:39:23.631842 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:39:23.631962 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:39:23.632085 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:39:23.632211 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:39:23.632318 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:39:23.632468 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'vcpu_model' on Instance uuid e415a06a-1c69-49b7-9bd3-f68ce343b0b7 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:23.667419 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Booting with volume ce533ab0-3286-48fd-9b76-1009e42dd4d9 at /dev/vda
May 19 04:39:23.682581 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ed350a1e-2f7e-4b78-86ce-c40e19ce87fb req-f6332612-ca19-4755-bb6c-f1d6d5e988d6 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Received event network-changed-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:23.685587 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ed350a1e-2f7e-4b78-86ce-c40e19ce87fb req-f6332612-ca19-4755-bb6c-f1d6d5e988d6 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Refreshing instance network info cache due to event network-changed-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:39:23.685587 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ed350a1e-2f7e-4b78-86ce-c40e19ce87fb req-f6332612-ca19-4755-bb6c-f1d6d5e988d6 service nova] Acquiring lock "refresh_cache-57adc083-429a-4f23-9154-7de8b6e74d8a" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:39:23.685587 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ed350a1e-2f7e-4b78-86ce-c40e19ce87fb req-f6332612-ca19-4755-bb6c-f1d6d5e988d6 service nova] Acquired lock "refresh_cache-57adc083-429a-4f23-9154-7de8b6e74d8a" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:39:23.685587 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-ed350a1e-2f7e-4b78-86ce-c40e19ce87fb req-f6332612-ca19-4755-bb6c-f1d6d5e988d6 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Refreshing network info cache for port a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:39:23.727270 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:39:23.741011 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:39:23.769271 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:23.812054 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:39:23.813097 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:39:23.823051 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:39:23.828081 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:fe16:6b7e', 'fe80::6898:26ff:fe86:46b0', 'fe80::fc16:3eff:fe8e:26b9', 'fe80::fc16:3eff:fe6d:b26e', 'fe80::30c3:b4ff:fe77:721a', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc'] 
May 19 04:39:23.828081 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:39:23.828081 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:39:23.828081 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:39:23.828081 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Updating existing volume attachment record: 5f55d44b-2c98-4a64-81f9-2887b18eb3d9 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:39:24.022430 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:24.029294 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:39:24.046513 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-47d6e934-2f3c-417c-b72c-cca2390f2248 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "32cc5240-7a56-4cee-9b41-54e17386b39f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.472s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:24.115349 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "refresh_cache-57adc083-429a-4f23-9154-7de8b6e74d8a" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:39:24.134632 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Object Instance<e415a06a-1c69-49b7-9bd3-f68ce343b0b7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:39:24.155867 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:39:24.156458 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c', 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5afb0a3d-3c54-47c8-a9e0-fed41297513c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:39:24.156730 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:24.158383 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:39:24.158800 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c', 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5afb0a3d-3c54-47c8-a9e0-fed41297513c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:39:24.174167 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:24.174743 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:24.175236 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:39:24.175492 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:39:24.176481 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:39:24.176481 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:39:24.189886 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-ed350a1e-2f7e-4b78-86ce-c40e19ce87fb req-f6332612-ca19-4755-bb6c-f1d6d5e988d6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:24.194399 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:39:24.194399 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:24.201884 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:39:24.201884 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:24.208678 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c] added
May 19 04:39:24.208678 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:39:24.208678 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:24.208678 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:24.208678 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:24.208678 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:24.208678 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:24.209023 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:39:24.209023 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.033(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:39:24.209151 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:39:24.213267 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c] added
May 19 04:39:24.213267 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:39:24.213267 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:24.213267 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:24.213267 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:24.213267 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:24.213267 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:24.213756 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:39:24.213756 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0381(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:39:24.213861 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:39:24.290378 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-ed350a1e-2f7e-4b78-86ce-c40e19ce87fb req-f6332612-ca19-4755-bb6c-f1d6d5e988d6 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:39:24.472930 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-ed350a1e-2f7e-4b78-86ce-c40e19ce87fb req-f6332612-ca19-4755-bb6c-f1d6d5e988d6 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:39:24.979441 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ed350a1e-2f7e-4b78-86ce-c40e19ce87fb req-f6332612-ca19-4755-bb6c-f1d6d5e988d6 service nova] Releasing lock "refresh_cache-57adc083-429a-4f23-9154-7de8b6e74d8a" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:39:24.982436 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquired lock "refresh_cache-57adc083-429a-4f23-9154-7de8b6e74d8a" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:39:24.982740 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:39:25.211022 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:39:25.216530 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:39:25.224803 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:39:25.224803 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:39:25.234097 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:39:25.234097 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:25.243190 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:25.248922 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:25.265584 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:25.265584 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:25.265584 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:25.265584 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:25.265584 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:25.265584 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:25.265584 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:25.265584 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:25.265584 np0000001025 nova-compute[97981]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2fb0682-132b-4fc8-9932-059a70a5f8ef (non-flash)
May 19 04:39:25.265584 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:25.265972 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:25.265972 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:25.265972 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:25.265972 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:25.265972 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:25.265972 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:25.265972 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:25.265972 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:25.265972 np0000001025 nova-compute[97981]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2fb0682-132b-4fc8-9932-059a70a5f8ef (non-flash)
May 19 04:39:25.265972 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:25.271427 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:25.271427 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:25.271427 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:25.271427 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:25.271427 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:25.271427 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:25.271427 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:25.271427 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:25.271427 np0000001025 nova-compute[97981]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2fb0682-132b-4fc8-9932-059a70a5f8ef (non-flash)
May 19 04:39:25.271427 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:25.271721 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:25.271721 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:25.271721 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:25.271721 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:25.271721 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:25.271721 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:25.271721 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:25.271721 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:25.271721 np0000001025 nova-compute[97981]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2fb0682-132b-4fc8-9932-059a70a5f8ef (non-flash)
May 19 04:39:25.271721 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:25.314250 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c, portal: 192.168.50.100,3260]
May 19 04:39:25.314250 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c, portal: 192.168.50.100,3260] successful.
May 19 04:39:25.314250 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:25.327368 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:25.328066 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c, portal: 192.168.40.100,3260]
May 19 04:39:25.328066 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c, portal: 192.168.40.100,3260] successful.
May 19 04:39:25.328066 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:25.343417 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2fb0682-132b-4fc8-9932-059a70a5f8ef (non-flash)
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:25.352131 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2fb0682-132b-4fc8-9932-059a70a5f8ef (non-flash)
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:25.352131 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:39:25.352131 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:39:25.353272 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] HCTL ('16', '-', '-', 0) found on session 66 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:39:25.353433 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:39:25.363499 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:25.363499 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:25.363499 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:25.363499 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:25.363499 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:25.363499 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:25.363499 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:25.363499 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:25.363499 np0000001025 nova-compute[97981]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2fb0682-132b-4fc8-9932-059a70a5f8ef (non-flash)
May 19 04:39:25.363499 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:25.363499 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:25.363499 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:25.363499 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:25.363499 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:25.363499 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:25.363499 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:25.363499 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:25.363499 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:25.363499 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:25.363499 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:25.363499 np0000001025 nova-compute[97981]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2fb0682-132b-4fc8-9932-059a70a5f8ef (non-flash)
May 19 04:39:25.363499 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:25.363499 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:25.363499 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:25.364468 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:39:25.364699 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:39:25.366831 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] HCTL ('17', '-', '-', 0) found on session 67 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:39:25.366831 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:39:25.372410 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Searching for a device in session 66 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:39:25.372410 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5afb0a3d-3c54-47c8-a9e0-fed41297513c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:39:25.384692 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Searching for a device in session 67 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:39:25.384840 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5afb0a3d-3c54-47c8-a9e0-fed41297513c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:39:25.582029 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:39:25.775591 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:25.927879 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Updating instance_info_cache with network_info: [{"id": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "address": "fa:16:3e:e2:ca:8e", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80a69f3-5d", "ovs_interfaceid": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:39:25.964951 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:39:25.966710 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:39:25.966710 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Creating image(s)
May 19 04:39:25.968615 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:39:25.968868 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Ensure instance console log exists: /opt/stack/data/nova/instances/57adc083-429a-4f23-9154-7de8b6e74d8a/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:39:25.969260 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:25.969349 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:25.969545 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:26.175943 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:39:26.432093 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Releasing lock "refresh_cache-57adc083-429a-4f23-9154-7de8b6e74d8a" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:39:26.432093 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Instance network_info: |[{"id": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "address": "fa:16:3e:e2:ca:8e", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80a69f3-5d", "ovs_interfaceid": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:39:26.433309 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Start _get_guest_xml network_info=[{"id": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "address": "fa:16:3e:e2:ca:8e", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80a69f3-5d", "ovs_interfaceid": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '5f55d44b-2c98-4a64-81f9-2887b18eb3d9', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '57adc083-429a-4f23-9154-7de8b6e74d8a', 'attached_at': '', 'detached_at': '', 'volume_id': 'ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'serial': 'ce533ab0-3286-48fd-9b76-1009e42dd4d9'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:39:26.437083 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:39:26.439862 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-844446081', uuid='57adc083-429a-4f23-9154-7de8b6e74d8a'), owner=OwnerMeta(userid='5c46088fb3e74b819bb456461716a801', username='tempest-TestVolumeBootPattern-1071176852-project-member', projectid='28b3c0fa8f894ed2a7c3bcfac99ce74c', projectname='tempest-TestVolumeBootPattern-1071176852'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "address": "fa:16:3e:e2:ca:8e", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80a69f3-5d", "ovs_interfaceid": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165566.4383812) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:39:26.440410 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:39:26.440842 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:39:26.441734 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:39:26.442006 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:39:26.442841 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:39:26.443260 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:39:26.443430 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:39:26.443546 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:39:26.443690 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:39:26.443810 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:39:26.443944 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:39:26.444154 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:39:26.444292 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:39:26.444431 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:39:26.444555 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:39:26.444694 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:39:26.454290 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:39:26.455135 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:39:26.455135 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:27.163153 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "b32b8038-72c4-443c-aea3-07cd61ad67f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:27.163153 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:27.197386 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Found WWN 33000000019518c5e for multipath device dm-10 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:39:27.197724 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:39:27.198155 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '33000000019518c5e', 'path': '/dev/dm-10', 'multipath_id': '33000000019518c5e'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:39:27.198338 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000019518c5e', 'path': '/dev/dm-10', 'multipath_id': '33000000019518c5e'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:39:27.198858 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.744s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:39:27.199369 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:39:27.215214 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:27.215214 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:27.215594 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:39:27.215793 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:39:27.216712 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:39:27.216712 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:39:27.230557 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:39:27.230557 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:27.237585 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:39:27.237585 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:27.244692 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9] added
May 19 04:39:27.244692 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:39:27.244692 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:27.244692 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:27.244692 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:27.244692 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:27.244692 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:27.244955 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:39:27.245086 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0292(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:39:27.245399 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:39:27.251499 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9] added
May 19 04:39:27.251499 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:39:27.251499 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:27.251499 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:27.251499 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:27.251499 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:27.251499 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:27.251499 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:39:27.251499 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0346(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:39:27.251499 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:39:27.666128 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:39:27.704081 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1460978051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumeshelvetestjson-server-1460978051',id=25,image_ref='172923ff-8178-4c61-9d70-323ff53b9cf3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1653098683',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:38:14Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8a3dfff83ce24e619f87507f951f6c69',ramdisk_id='',reservation_id='r-a8neifui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-51274594',owner_user_name='tempest-AttachVolumeShelveTestJSON-51274594-project-member',shelved_at='2026-05-19T04:39:01.923102',shelved_host='np0000001025',shelved_image_id='172923ff-8178-4c61-9d70-323ff53b9cf3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:39:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7955853f574d42e58ba89f18ed109760',uuid=e415a06a-1c69-49b7-9bd3-f68ce343b0b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:39:27.705396 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converting VIF {"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:39:27.706394 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:10:d8,bridge_name='br-int',has_traffic_filtering=True,id=5b2a0762-a1d4-4a8c-a81b-de0fef92e15c,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2a0762-a1') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:39:27.707215 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'pci_devices' on Instance uuid e415a06a-1c69-49b7-9bd3-f68ce343b0b7 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:28.089492 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:28.179081 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:28.209408 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Object Instance<e415a06a-1c69-49b7-9bd3-f68ce343b0b7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:39:28.211448 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] End _get_guest_xml xml=<domain type="qemu">
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:   <uuid>e415a06a-1c69-49b7-9bd3-f68ce343b0b7</uuid>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:   <name>instance-00000019</name>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1460978051</nova:name>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:39:23</nova:creationTime>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:           <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:           <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:         <nova:user uuid="7955853f574d42e58ba89f18ed109760">tempest-AttachVolumeShelveTestJSON-51274594-project-member</nova:user>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:         <nova:project uuid="8a3dfff83ce24e619f87507f951f6c69">tempest-AttachVolumeShelveTestJSON-51274594</nova:project>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:         <nova:port uuid="5b2a0762-a1d4-4a8c-a81b-de0fef92e15c">
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     <system>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <entry name="serial">e415a06a-1c69-49b7-9bd3-f68ce343b0b7</entry>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <entry name="uuid">e415a06a-1c69-49b7-9bd3-f68ce343b0b7</entry>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     </system>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:   <os>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:   </os>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:   <features>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:   </features>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:   <devices>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     </disk>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk.config"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     </disk>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <alias name="ua-5afb0a3d-3c54-47c8-a9e0-fed41297513c"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-10"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <target dev="vdc" bus="virtio"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <serial>5afb0a3d-3c54-47c8-a9e0-fed41297513c</serial>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     </disk>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:75:10:d8"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <target dev="tap5b2a0762-a1"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     </interface>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/console.log" append="off"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     </serial>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     <video>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     </video>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     </rng>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:   </devices>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]: </domain>
May 19 04:39:28.211448 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:39:28.219051 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Preparing to wait for external event network-vif-plugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:39:28.219051 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:28.219051 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:28.219051 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:28.219051 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1460978051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumeshelvetestjson-server-1460978051',id=25,image_ref='172923ff-8178-4c61-9d70-323ff53b9cf3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1653098683',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:38:14Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8a3dfff83ce24e619f87507f951f6c69',ramdisk_id='',reservation_id='r-a8neifui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-51274594',owner_user_name='tempest-AttachVolumeShelveTestJSON-51274594-project-member',shelved_at='2026-05-19T04:39:01.923102',shelved_host='np0000001025',shelved_image_id='172923ff-8178-4c61-9d70-323ff53b9cf3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:39:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7955853f574d42e58ba89f18ed109760',uuid=e415a06a-1c69-49b7-9bd3-f68ce343b0b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:39:28.219051 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converting VIF {"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:39:28.219051 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:10:d8,bridge_name='br-int',has_traffic_filtering=True,id=5b2a0762-a1d4-4a8c-a81b-de0fef92e15c,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2a0762-a1') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:39:28.219051 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:10:d8,bridge_name='br-int',has_traffic_filtering=True,id=5b2a0762-a1d4-4a8c-a81b-de0fef92e15c,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2a0762-a1') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:39:28.219051 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:28.219051 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:28.219051 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:39:28.220461 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:28.220461 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '487b9ef3-411d-5e63-b4f8-f27a64c9aa5a', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:28.222724 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:28.222724 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:28.223495 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:28.226823 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:28.226823 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b2a0762-a1, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:28.227612 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b2a0762-a1, col_values=(('qos', UUID('61d88188-85a9-4b50-9a29-1b105d077c2e')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:28.227932 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b2a0762-a1, col_values=(('external_ids', {'iface-id': '5b2a0762-a1d4-4a8c-a81b-de0fef92e15c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:10:d8', 'vm-uuid': 'e415a06a-1c69-49b7-9bd3-f68ce343b0b7'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:28.230944 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:28.236450 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:28.236694 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:28.236988 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:28.238099 np0000001025 nova-compute[97981]: INFO os_vif [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:10:d8,bridge_name='br-int',has_traffic_filtering=True,id=5b2a0762-a1d4-4a8c-a81b-de0fef92e15c,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2a0762-a1')
May 19 04:39:28.240980 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:39:28.241301 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Claim successful on node np0000001025
May 19 04:39:28.245580 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:39:28.253944 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:39:28.264297 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:39:28.264297 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:39:28.278222 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:39:28.278222 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:28.281723 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:28.296444 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:28.301944 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:28.301944 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:28.301944 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:28.301944 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:28.301944 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:28.301944 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:28.301944 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:28.301944 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:28.301944 np0000001025 nova-compute[97981]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2fb0682-132b-4fc8-9932-059a70a5f8ef (non-flash)
May 19 04:39:28.301944 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:28.301944 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:28.301944 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:28.302433 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:28.302433 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:28.302433 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:28.302433 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:28.302433 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:28.302433 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:28.302433 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:28.302433 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:28.302433 np0000001025 nova-compute[97981]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2fb0682-132b-4fc8-9932-059a70a5f8ef (non-flash)
May 19 04:39:28.302433 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:28.302433 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:28.302433 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:28.316640 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:28.316640 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:28.316640 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:28.316640 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:28.316640 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:28.316640 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:28.316640 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:28.316640 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:28.316640 np0000001025 nova-compute[97981]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2fb0682-132b-4fc8-9932-059a70a5f8ef (non-flash)
May 19 04:39:28.316640 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:28.316640 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:28.316640 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:28.317093 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:28.317093 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:28.317093 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:28.317093 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:28.317093 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:28.317093 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:28.317093 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:28.317093 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:28.317093 np0000001025 nova-compute[97981]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2fb0682-132b-4fc8-9932-059a70a5f8ef (non-flash)
May 19 04:39:28.317093 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:28.317093 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:28.317093 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:28.358265 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9, portal: 192.168.50.100,3260]
May 19 04:39:28.358265 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9, portal: 192.168.50.100,3260] successful.
May 19 04:39:28.358265 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:28.363195 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9, portal: 192.168.40.100,3260]
May 19 04:39:28.363195 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9, portal: 192.168.40.100,3260] successful.
May 19 04:39:28.363195 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:28.372465 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:28.378145 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:28.397920 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:28.397920 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:28.397920 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:28.397920 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:28.397920 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:28.397920 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:28.397920 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:28.397920 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:28.397920 np0000001025 nova-compute[97981]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2fb0682-132b-4fc8-9932-059a70a5f8ef (non-flash)
May 19 04:39:28.397920 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:28.397920 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:28.397920 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:28.397920 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:28.397920 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:28.398453 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:28.398453 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:28.398453 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:28.398453 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:28.398453 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:28.398453 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:28.398453 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:28.398453 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:28.398453 np0000001025 nova-compute[97981]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2fb0682-132b-4fc8-9932-059a70a5f8ef (non-flash)
May 19 04:39:28.398453 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:28.398453 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:28.398453 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:28.398453 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:28.398453 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:28.398798 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:28.398798 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:28.398798 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:28.398798 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:28.398798 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:28.398798 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:28.398798 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:28.398798 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:28.398798 np0000001025 nova-compute[97981]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2fb0682-132b-4fc8-9932-059a70a5f8ef (non-flash)
May 19 04:39:28.398798 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:28.398798 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:28.398798 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:28.398798 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:28.398798 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:28.399731 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:28.399731 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:28.399731 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:28.399731 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:28.399731 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:28.399731 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:28.399731 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:28.399731 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:28.399731 np0000001025 nova-compute[97981]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2fb0682-132b-4fc8-9932-059a70a5f8ef (non-flash)
May 19 04:39:28.399731 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:28.399731 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:28.399731 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:28.399731 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:28.399731 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:28.399731 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:39:28.399731 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:39:28.399731 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:39:28.399731 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:39:28.401787 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] HCTL ('19', '-', '-', 0) found on session 69 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:39:28.401916 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:39:28.402527 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] HCTL ('18', '-', '-', 0) found on session 68 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:39:28.402527 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:39:28.428151 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching for a device in session 69 and hctl ['19', '*', '*', 0] yield: sdm {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:39:28.428151 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:39:28.428151 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching for a device in session 68 and hctl ['18', '*', '*', 0] yield: sdn {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:39:28.428151 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:39:28.616394 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:39:28.616738 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:39:29.216474 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:39:29.615743 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:39:29.617499 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:39:29.761678 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:39:29.762417 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:39:29.762417 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:39:29.762417 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] No VIF found with MAC fa:16:3e:75:10:d8, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:39:29.762417 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Using config drive
May 19 04:39:29.776189 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:39:29.776514 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:39:30.232484 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Found WWN 3300000004eff2e31 for multipath device dm-11 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:39:30.233338 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:39:30.233338 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== connect_volume: return (3778ms) {'type': 'block', 'scsi_wwn': '3300000004eff2e31', 'path': '/dev/dm-11', 'multipath_id': '3300000004eff2e31'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:39:30.233338 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004eff2e31', 'path': '/dev/dm-11', 'multipath_id': '3300000004eff2e31'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:39:30.267865 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'ec2_ids' on Instance uuid e415a06a-1c69-49b7-9bd3-f68ce343b0b7 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:30.280165 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:39:30.615705 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:39:30.615980 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:39:30.616273 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:39:30.737967 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-844446081',display_name='tempest-TestVolumeBootPattern-server-844446081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-844446081',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxOKS9yEjObdHLZH1HI2bMkXDqbbhfdJb44v4wqJB4om8oUnQbceKvRmo5zkW64bMRcZfWY0eLqrWurjfNHYBjiuL8Xlu0w3AcYixWZlDbIAggkM7Ws8vQ5t98+fmLn7g==',key_name='tempest-keypair-1937042662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-naev0poy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c46088fb3e74b819bb456461716a801',uuid=57adc083-429a-4f23-9154-7de8b6e74d8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "address": "fa:16:3e:e2:ca:8e", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80a69f3-5d", "ovs_interfaceid": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:39:30.738203 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "address": "fa:16:3e:e2:ca:8e", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80a69f3-5d", "ovs_interfaceid": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:39:30.738824 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ca:8e,bridge_name='br-int',has_traffic_filtering=True,id=a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80a69f3-5d') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:39:30.739418 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'pci_devices' on Instance uuid 57adc083-429a-4f23-9154-7de8b6e74d8a {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:30.772205 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Object Instance<e415a06a-1c69-49b7-9bd3-f68ce343b0b7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:39:30.772413 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'keypairs' on Instance uuid e415a06a-1c69-49b7-9bd3-f68ce343b0b7 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:30.792165 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.555s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:30.792651 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:39:31.242162 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] End _get_guest_xml xml=<domain type="qemu">
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:   <uuid>57adc083-429a-4f23-9154-7de8b6e74d8a</uuid>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:   <name>instance-0000001e</name>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestVolumeBootPattern-server-844446081</nova:name>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:39:26</nova:creationTime>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:         <nova:user uuid="5c46088fb3e74b819bb456461716a801">tempest-TestVolumeBootPattern-1071176852-project-member</nova:user>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:         <nova:project uuid="28b3c0fa8f894ed2a7c3bcfac99ce74c">tempest-TestVolumeBootPattern-1071176852</nova:project>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:         <nova:port uuid="a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b">
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     <system>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <entry name="serial">57adc083-429a-4f23-9154-7de8b6e74d8a</entry>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <entry name="uuid">57adc083-429a-4f23-9154-7de8b6e74d8a</entry>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     </system>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:   <os>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:   </os>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:   <features>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:   </features>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:   <devices>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/57adc083-429a-4f23-9154-7de8b6e74d8a/disk.config"/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     </disk>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <alias name="ua-ce533ab0-3286-48fd-9b76-1009e42dd4d9"/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-11"/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <serial>ce533ab0-3286-48fd-9b76-1009e42dd4d9</serial>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     </disk>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:e2:ca:8e"/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <target dev="tapa80a69f3-5d"/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     </interface>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/57adc083-429a-4f23-9154-7de8b6e74d8a/console.log" append="off"/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     </serial>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     <video>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     </video>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     </rng>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:   </devices>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]: </domain>
May 19 04:39:31.242162 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:39:31.248363 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Preparing to wait for external event network-vif-plugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:39:31.248363 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:31.248363 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:31.248363 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:31.248363 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-844446081',display_name='tempest-TestVolumeBootPattern-server-844446081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-844446081',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxOKS9yEjObdHLZH1HI2bMkXDqbbhfdJb44v4wqJB4om8oUnQbceKvRmo5zkW64bMRcZfWY0eLqrWurjfNHYBjiuL8Xlu0w3AcYixWZlDbIAggkM7Ws8vQ5t98+fmLn7g==',key_name='tempest-keypair-1937042662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-naev0poy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c46088fb3e74b819bb456461716a801',uuid=57adc083-429a-4f23-9154-7de8b6e74d8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "address": "fa:16:3e:e2:ca:8e", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80a69f3-5d", "ovs_interfaceid": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:39:31.248363 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "address": "fa:16:3e:e2:ca:8e", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80a69f3-5d", "ovs_interfaceid": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:39:31.248363 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ca:8e,bridge_name='br-int',has_traffic_filtering=True,id=a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80a69f3-5d') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:39:31.248363 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ca:8e,bridge_name='br-int',has_traffic_filtering=True,id=a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80a69f3-5d') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:39:31.248363 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:31.248363 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:31.248363 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:39:31.251671 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:31.251671 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '703bc732-1645-5ca1-a752-43756597687a', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:31.251671 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:31.257148 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:31.262596 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:31.262596 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa80a69f3-5d, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:31.262596 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa80a69f3-5d, col_values=(('qos', UUID('a82c0850-68ff-47ab-9cbf-0d4f3e87edde')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:31.262596 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa80a69f3-5d, col_values=(('external_ids', {'iface-id': 'a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:ca:8e', 'vm-uuid': '57adc083-429a-4f23-9154-7de8b6e74d8a'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:31.264940 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:31.272988 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:31.274286 np0000001025 nova-compute[97981]: INFO os_vif [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ca:8e,bridge_name='br-int',has_traffic_filtering=True,id=a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80a69f3-5d')
May 19 04:39:31.280090 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Object Instance<e415a06a-1c69-49b7-9bd3-f68ce343b0b7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:39:31.288436 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:31.299127 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:39:31.299341 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:39:31.299503 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:31.299717 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:31.398543 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa432d60cb324c6d87818107e05e0053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490151decdde445593a86a16976f6b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:39:31.464668 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Creating config drive at /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk.config
May 19 04:39:31.469605 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoq9ax4n2 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:31.521787 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoq9ax4n2" returned: 0 in 0.052s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:31.610611 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:39:31.611423 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:39:31.614914 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:39:31.615340 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:39:31.804991 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:39:32.014185 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:32.056935 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:32.072537 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Successfully created port: b9855804-ae85-4e19-b3c0-586032713aff {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:39:32.167776 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:32.309473 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:39:32.326883 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-51f00b3b-e2e1-4092-a3ac-7af9733d73c9 req-e51a4187-ef57-424b-8100-c42765b5e5c5 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Received event network-vif-plugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:32.327232 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-51f00b3b-e2e1-4092-a3ac-7af9733d73c9 req-e51a4187-ef57-424b-8100-c42765b5e5c5 service nova] Acquiring lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:32.327458 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-51f00b3b-e2e1-4092-a3ac-7af9733d73c9 req-e51a4187-ef57-424b-8100-c42765b5e5c5 service nova] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:32.327583 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-51f00b3b-e2e1-4092-a3ac-7af9733d73c9 req-e51a4187-ef57-424b-8100-c42765b5e5c5 service nova] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:32.327698 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-51f00b3b-e2e1-4092-a3ac-7af9733d73c9 req-e51a4187-ef57-424b-8100-c42765b5e5c5 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Processing event network-vif-plugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:39:32.424537 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:32.431853 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:32.435701 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:32.464362 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:32.472523 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:32.803937 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:39:32.805262 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:39:32.805262 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No VIF found with MAC fa:16:3e:e2:ca:8e, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:39:32.805695 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Using config drive
May 19 04:39:32.905176 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Successfully updated port: b9855804-ae85-4e19-b3c0-586032713aff {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:39:32.968879 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165572.96843, e415a06a-1c69-49b7-9bd3-f68ce343b0b7 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:32.968879 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] VM Started (Lifecycle Event)
May 19 04:39:32.969993 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:39:32.975192 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:39:32.978010 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Instance spawned successfully.
May 19 04:39:33.179250 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:33.315874 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:33.323600 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:39:33.324719 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:39:33.325044 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Creating image(s)
May 19 04:39:33.328801 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "/opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:33.329034 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "/opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:33.329716 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "/opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:33.330335 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:33.338690 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:33.340018 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:33.376131 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:33.407791 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "refresh_cache-b32b8038-72c4-443c-aea3-07cd61ad67f6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:39:33.407791 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquired lock "refresh_cache-b32b8038-72c4-443c-aea3-07cd61ad67f6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:39:33.407791 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:39:33.437872 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.098s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:33.438400 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:33.438602 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:33.438986 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:33.441925 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:33.442289 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:33.474333 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:33.484756 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:39:33.522548 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Creating config drive at /opt/stack/data/nova/instances/57adc083-429a-4f23-9154-7de8b6e74d8a/disk.config
May 19 04:39:33.526837 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/57adc083-429a-4f23-9154-7de8b6e74d8a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprjx7qdzz {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:33.565520 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.123s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:33.568689 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:33.588139 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/57adc083-429a-4f23-9154-7de8b6e74d8a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprjx7qdzz" returned: 0 in 0.059s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:33.636016 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk 1073741824" returned: 0 in 0.067s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:33.636477 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:33.637706 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:33.751153 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.114s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:33.755219 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:39:33.755219 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:33.857483 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:33.858040 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Cannot resize image /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:39:33.858596 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:39:33.858895 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Ensure instance console log exists: /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:39:33.859060 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:33.859323 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:33.859498 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:33.896338 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8b7a1577-95ad-44c8-87c8-ac10751ba060 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.702s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:33.975975 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:39:33.989631 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165573.989229, e415a06a-1c69-49b7-9bd3-f68ce343b0b7 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:33.989787 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] VM Paused (Lifecycle Event)
May 19 04:39:34.085460 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:34.113821 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:34.115694 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:34.185030 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:34.225554 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:34.411769 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-859c801d-c65d-4f6c-b2e6-a5249c21295f req-61da62d1-7509-47eb-a96f-3a96fee9d408 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Received event network-vif-plugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:34.413131 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-859c801d-c65d-4f6c-b2e6-a5249c21295f req-61da62d1-7509-47eb-a96f-3a96fee9d408 service nova] Acquiring lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:34.413407 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-859c801d-c65d-4f6c-b2e6-a5249c21295f req-61da62d1-7509-47eb-a96f-3a96fee9d408 service nova] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:34.414284 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-859c801d-c65d-4f6c-b2e6-a5249c21295f req-61da62d1-7509-47eb-a96f-3a96fee9d408 service nova] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:34.414284 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-859c801d-c65d-4f6c-b2e6-a5249c21295f req-61da62d1-7509-47eb-a96f-3a96fee9d408 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Processing event network-vif-plugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:39:34.437288 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Updating instance_info_cache with network_info: [{"id": "b9855804-ae85-4e19-b3c0-586032713aff", "address": "fa:16:3e:0e:aa:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9855804-ae", "ovs_interfaceid": "b9855804-ae85-4e19-b3c0-586032713aff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:39:34.457079 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-53e324f5-a3a2-450e-8446-794077e1261e req-64f2c024-95e6-4a52-85cd-ae16eed7c2d9 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Received event network-vif-plugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:34.459640 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-53e324f5-a3a2-450e-8446-794077e1261e req-64f2c024-95e6-4a52-85cd-ae16eed7c2d9 service nova] Acquiring lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:34.460867 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-53e324f5-a3a2-450e-8446-794077e1261e req-64f2c024-95e6-4a52-85cd-ae16eed7c2d9 service nova] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:34.460996 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-53e324f5-a3a2-450e-8446-794077e1261e req-64f2c024-95e6-4a52-85cd-ae16eed7c2d9 service nova] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:34.461155 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-53e324f5-a3a2-450e-8446-794077e1261e req-64f2c024-95e6-4a52-85cd-ae16eed7c2d9 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] No waiting events found dispatching network-vif-plugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:39:34.463459 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-53e324f5-a3a2-450e-8446-794077e1261e req-64f2c024-95e6-4a52-85cd-ae16eed7c2d9 service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Received unexpected event network-vif-plugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c for instance with vm_state active and task_state None.
May 19 04:39:34.463606 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-53e324f5-a3a2-450e-8446-794077e1261e req-64f2c024-95e6-4a52-85cd-ae16eed7c2d9 service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Received event network-changed-b9855804-ae85-4e19-b3c0-586032713aff {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:34.463695 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-53e324f5-a3a2-450e-8446-794077e1261e req-64f2c024-95e6-4a52-85cd-ae16eed7c2d9 service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Refreshing instance network info cache due to event network-changed-b9855804-ae85-4e19-b3c0-586032713aff. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:39:34.463808 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-53e324f5-a3a2-450e-8446-794077e1261e req-64f2c024-95e6-4a52-85cd-ae16eed7c2d9 service nova] Acquiring lock "refresh_cache-b32b8038-72c4-443c-aea3-07cd61ad67f6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:39:34.493904 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:34.500119 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165574.4995916, e415a06a-1c69-49b7-9bd3-f68ce343b0b7 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:34.500288 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] VM Resumed (Lifecycle Event)
May 19 04:39:34.506803 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:34.510921 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:34.543159 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:34.544852 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:34.615281 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:39:34.616795 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:39:34.940084 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Releasing lock "refresh_cache-b32b8038-72c4-443c-aea3-07cd61ad67f6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:39:34.940084 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Instance network_info: |[{"id": "b9855804-ae85-4e19-b3c0-586032713aff", "address": "fa:16:3e:0e:aa:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9855804-ae", "ovs_interfaceid": "b9855804-ae85-4e19-b3c0-586032713aff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:39:34.941842 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Start _get_guest_xml network_info=[{"id": "b9855804-ae85-4e19-b3c0-586032713aff", "address": "fa:16:3e:0e:aa:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9855804-ae", "ovs_interfaceid": "b9855804-ae85-4e19-b3c0-586032713aff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:39:34.945632 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-53e324f5-a3a2-450e-8446-794077e1261e req-64f2c024-95e6-4a52-85cd-ae16eed7c2d9 service nova] Acquired lock "refresh_cache-b32b8038-72c4-443c-aea3-07cd61ad67f6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:39:34.945866 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-53e324f5-a3a2-450e-8446-794077e1261e req-64f2c024-95e6-4a52-85cd-ae16eed7c2d9 service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Refreshing network info cache for port b9855804-ae85-4e19-b3c0-586032713aff {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:39:34.949671 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:39:34.953244 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='b32b8038-72c4-443c-aea3-07cd61ad67f6'), owner=OwnerMeta(userid='aa432d60cb324c6d87818107e05e0053', username='tempest-AttachVolumeMultiAttachTest-1659172696-project-member', projectid='490151decdde445593a86a16976f6b34', projectname='tempest-AttachVolumeMultiAttachTest-1659172696'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b9855804-ae85-4e19-b3c0-586032713aff", "address": "fa:16:3e:0e:aa:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9855804-ae", "ovs_interfaceid": "b9855804-ae85-4e19-b3c0-586032713aff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165574.9506266) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:39:34.954526 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:39:34.954850 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:39:34.956983 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:39:34.956983 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:39:34.957531 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:39:34.957708 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:39:34.957959 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:39:34.957959 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:39:34.958275 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:39:34.962129 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:39:34.962129 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:39:34.962129 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:39:34.962129 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:39:34.962129 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:39:34.962129 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:39:34.962129 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:39:34.982385 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:39:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='multiattach-server-0',id=31,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9kq9UfoFPrqlSUYASLa2M8/KXwpiWIksTRz6r+vXFFf5G7djO79flSW+4jvUEBmYvioxzxvTch1hKVIwlMIaMSuT3AyUPlX/5ZPn59wF6pdcyyqAHuNzAVPjAjiGd+6A==',key_name='tempest-keypair-818275091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-dk1cxip1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa432d60cb324c6d87818107e05e0053',uuid=b32b8038-72c4-443c-aea3-07cd61ad67f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9855804-ae85-4e19-b3c0-586032713aff", "address": "fa:16:3e:0e:aa:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9855804-ae", "ovs_interfaceid": "b9855804-ae85-4e19-b3c0-586032713aff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:39:34.982921 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "b9855804-ae85-4e19-b3c0-586032713aff", "address": "fa:16:3e:0e:aa:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9855804-ae", "ovs_interfaceid": "b9855804-ae85-4e19-b3c0-586032713aff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:39:34.984280 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:aa:6f,bridge_name='br-int',has_traffic_filtering=True,id=b9855804-ae85-4e19-b3c0-586032713aff,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9855804-ae') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:39:34.985751 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'pci_devices' on Instance uuid b32b8038-72c4-443c-aea3-07cd61ad67f6 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:35.004830 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:35.010565 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:39:35.113975 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:39:35.117737 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:39:35.120583 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Instance spawned successfully.
May 19 04:39:35.120971 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:39:35.127677 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:35.128046 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:35.128260 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:35.128468 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:39:35.449097 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-53e324f5-a3a2-450e-8446-794077e1261e req-64f2c024-95e6-4a52-85cd-ae16eed7c2d9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:35.490127 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] End _get_guest_xml xml=<domain type="qemu">
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:   <uuid>b32b8038-72c4-443c-aea3-07cd61ad67f6</uuid>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:   <name>instance-0000001f</name>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <nova:name>multiattach-server-0</nova:name>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:39:34</nova:creationTime>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:         <nova:user uuid="aa432d60cb324c6d87818107e05e0053">tempest-AttachVolumeMultiAttachTest-1659172696-project-member</nova:user>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:         <nova:project uuid="490151decdde445593a86a16976f6b34">tempest-AttachVolumeMultiAttachTest-1659172696</nova:project>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:         <nova:port uuid="b9855804-ae85-4e19-b3c0-586032713aff">
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     <system>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <entry name="serial">b32b8038-72c4-443c-aea3-07cd61ad67f6</entry>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <entry name="uuid">b32b8038-72c4-443c-aea3-07cd61ad67f6</entry>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     </system>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:   <os>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:   </os>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:   <features>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:   </features>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:   <devices>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk"/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     </disk>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk.config"/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     </disk>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:0e:aa:6f"/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <target dev="tapb9855804-ae"/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     </interface>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/console.log" append="off"/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     </serial>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     <video>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     </video>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     </rng>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:   </devices>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]: </domain>
May 19 04:39:35.490127 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:39:35.493648 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Preparing to wait for external event network-vif-plugged-b9855804-ae85-4e19-b3c0-586032713aff {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:39:35.493648 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "b32b8038-72c4-443c-aea3-07cd61ad67f6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:35.493648 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:35.493648 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:35.493648 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:39:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='multiattach-server-0',id=31,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9kq9UfoFPrqlSUYASLa2M8/KXwpiWIksTRz6r+vXFFf5G7djO79flSW+4jvUEBmYvioxzxvTch1hKVIwlMIaMSuT3AyUPlX/5ZPn59wF6pdcyyqAHuNzAVPjAjiGd+6A==',key_name='tempest-keypair-818275091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-dk1cxip1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa432d60cb324c6d87818107e05e0053',uuid=b32b8038-72c4-443c-aea3-07cd61ad67f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9855804-ae85-4e19-b3c0-586032713aff", "address": "fa:16:3e:0e:aa:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9855804-ae", "ovs_interfaceid": "b9855804-ae85-4e19-b3c0-586032713aff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:39:35.493648 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "b9855804-ae85-4e19-b3c0-586032713aff", "address": "fa:16:3e:0e:aa:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9855804-ae", "ovs_interfaceid": "b9855804-ae85-4e19-b3c0-586032713aff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:39:35.493648 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:aa:6f,bridge_name='br-int',has_traffic_filtering=True,id=b9855804-ae85-4e19-b3c0-586032713aff,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9855804-ae') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:39:35.493648 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:aa:6f,bridge_name='br-int',has_traffic_filtering=True,id=b9855804-ae85-4e19-b3c0-586032713aff,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9855804-ae') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:39:35.493648 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:35.495020 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:35.495020 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:39:35.495742 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:35.495950 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a9ab3b2-af5d-5c9f-96d9-d2cf31a7183f', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:35.498005 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:35.498999 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:35.500772 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:35.500945 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9855804-ae, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:35.501291 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9855804-ae, col_values=(('qos', UUID('ed66ebc6-f5e2-41de-94c7-17b74a344702')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:35.501457 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9855804-ae, col_values=(('external_ids', {'iface-id': 'b9855804-ae85-4e19-b3c0-586032713aff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:aa:6f', 'vm-uuid': 'b32b8038-72c4-443c-aea3-07cd61ad67f6'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:35.502319 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:35.504391 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:35.509358 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:35.509993 np0000001025 nova-compute[97981]: INFO os_vif [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:aa:6f,bridge_name='br-int',has_traffic_filtering=True,id=b9855804-ae85-4e19-b3c0-586032713aff,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9855804-ae')
May 19 04:39:35.513466 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165575.512979, 57adc083-429a-4f23-9154-7de8b6e74d8a => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:35.513654 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] VM Started (Lifecycle Event)
May 19 04:39:35.633806 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:35.633955 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:35.634269 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:35.634523 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:35.634778 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:35.635033 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:35.822146 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-53e324f5-a3a2-450e-8446-794077e1261e req-64f2c024-95e6-4a52-85cd-ae16eed7c2d9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:35.978910 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-53e324f5-a3a2-450e-8446-794077e1261e req-64f2c024-95e6-4a52-85cd-ae16eed7c2d9 service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Updated VIF entry in instance network info cache for port b9855804-ae85-4e19-b3c0-586032713aff. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:39:35.979626 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-53e324f5-a3a2-450e-8446-794077e1261e req-64f2c024-95e6-4a52-85cd-ae16eed7c2d9 service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Updating instance_info_cache with network_info: [{"id": "b9855804-ae85-4e19-b3c0-586032713aff", "address": "fa:16:3e:0e:aa:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9855804-ae", "ovs_interfaceid": "b9855804-ae85-4e19-b3c0-586032713aff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:39:36.019395 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:36.021281 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:39:36.146088 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Took 10.18 seconds to spawn the instance on the hypervisor.
May 19 04:39:36.146292 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:36.164929 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:36.269992 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:36.270372 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:36.376970 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:36.377422 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-10 (vdc) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:39:36.380268 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:36.466252 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:36.466927 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:36.486678 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-53e324f5-a3a2-450e-8446-794077e1261e req-64f2c024-95e6-4a52-85cd-ae16eed7c2d9 service nova] Releasing lock "refresh_cache-b32b8038-72c4-443c-aea3-07cd61ad67f6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:39:36.515028 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-52bd446b-46cc-414d-8589-b052ce6bb6b3 req-d57dbe39-e483-4330-af4e-e7e8a7615e9e service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Received event network-vif-plugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:36.517763 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-52bd446b-46cc-414d-8589-b052ce6bb6b3 req-d57dbe39-e483-4330-af4e-e7e8a7615e9e service nova] Acquiring lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:36.519225 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-52bd446b-46cc-414d-8589-b052ce6bb6b3 req-d57dbe39-e483-4330-af4e-e7e8a7615e9e service nova] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:36.519298 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-52bd446b-46cc-414d-8589-b052ce6bb6b3 req-d57dbe39-e483-4330-af4e-e7e8a7615e9e service nova] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:36.519531 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-52bd446b-46cc-414d-8589-b052ce6bb6b3 req-d57dbe39-e483-4330-af4e-e7e8a7615e9e service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] No waiting events found dispatching network-vif-plugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:39:36.519932 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-52bd446b-46cc-414d-8589-b052ce6bb6b3 req-d57dbe39-e483-4330-af4e-e7e8a7615e9e service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Received unexpected event network-vif-plugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b for instance with vm_state active and task_state None.
May 19 04:39:36.525500 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:39:36.526130 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165576.525744, 57adc083-429a-4f23-9154-7de8b6e74d8a => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:36.526294 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] VM Paused (Lifecycle Event)
May 19 04:39:36.557454 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:36.562004 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:36.659388 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Took 18.68 seconds to build instance.
May 19 04:39:36.661664 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:36.661955 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:36.749909 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:36.750417 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:39:36.753674 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:39:36.755161 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:36.849314 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:36.849894 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:36.946951 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:36.951427 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:39:36.953396 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:39:36.955595 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-11 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:39:36.957692 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:39:36.959337 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:37.005595 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:37.007167 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=12092MB free_disk=73.2906723022461GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:39:37.007167 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:37.007167 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:37.032977 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:37.039921 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165577.0379689, 57adc083-429a-4f23-9154-7de8b6e74d8a => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:37.039921 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] VM Resumed (Lifecycle Event)
May 19 04:39:37.040958 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:39:37.041255 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:39:37.041698 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No VIF found with MAC fa:16:3e:0e:aa:6f, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:39:37.042504 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Using config drive
May 19 04:39:37.163755 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a949bb1d-32fa-459b-946c-7eb4b80ad481 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.189s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:37.542771 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:37.555485 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:37.560344 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:39:37.748489 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Creating config drive at /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk.config
May 19 04:39:37.754583 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6m1m4us7 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:37.830371 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6m1m4us7" returned: 0 in 0.075s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:38.089761 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 5951341b-0ad5-4fb0-82ad-b464c081f37f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:39:38.089761 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 11a634a9-3bdd-4085-abc2-a0ad70710975 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:39:38.089761 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 6cd7138c-f217-4858-8941-89693e62ae6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:39:38.089761 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 87e8e02e-e385-418c-be0c-bb25a377d081 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:39:38.089761 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance aa2cdf1d-65ef-4cf4-b742-72ae783cde27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:39:38.089761 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 32cc5240-7a56-4cee-9b41-54e17386b39f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:39:38.089761 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance e415a06a-1c69-49b7-9bd3-f68ce343b0b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:39:38.089761 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 57adc083-429a-4f23-9154-7de8b6e74d8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:39:38.089761 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance b32b8038-72c4-443c-aea3-07cd61ad67f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:39:38.089761 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:39:38.089761 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=2240MB phys_disk=95GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:39:37 up 30 min,  2 users,  load average: 8.20, 6.46, 3.34\n', 'num_instances': '9', 'num_vm_active': '8', 'num_task_None': '8', 'num_os_type_None': '9', 'num_proj_336d55ae51114828ba5ad8c0ac87ca9b': '2', 'io_workload': '1', 'num_proj_e2110bc6ddf24455ab91b4ba84e6170a': '1', 'num_proj_8a3dfff83ce24e619f87507f951f6c69': '1', 'num_proj_49561da7541f44898968cb455fb3e6bd': '1', 'num_proj_7e0c7a19a41a44fba4c0fca71022a5a1': '1', 'num_proj_490151decdde445593a86a16976f6b34': '2', 'num_proj_28b3c0fa8f894ed2a7c3bcfac99ce74c': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:39:38.181338 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:38.384471 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:38.397006 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:38.519983 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:38.559336 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:38.561572 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:38.608140 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2f4a6418-fd1d-4624-af16-9c8259844fc4 req-1a901386-8dfa-4214-80ea-f4da7e242217 service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Received event network-vif-plugged-b9855804-ae85-4e19-b3c0-586032713aff {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:38.608347 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2f4a6418-fd1d-4624-af16-9c8259844fc4 req-1a901386-8dfa-4214-80ea-f4da7e242217 service nova] Acquiring lock "b32b8038-72c4-443c-aea3-07cd61ad67f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:38.609231 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2f4a6418-fd1d-4624-af16-9c8259844fc4 req-1a901386-8dfa-4214-80ea-f4da7e242217 service nova] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:38.609231 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2f4a6418-fd1d-4624-af16-9c8259844fc4 req-1a901386-8dfa-4214-80ea-f4da7e242217 service nova] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:38.614234 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2f4a6418-fd1d-4624-af16-9c8259844fc4 req-1a901386-8dfa-4214-80ea-f4da7e242217 service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Processing event network-vif-plugged-b9855804-ae85-4e19-b3c0-586032713aff {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:39:38.619242 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-74a42c09-8046-4420-b600-5f6df0f8c132 req-09aa5a32-6c90-4c40-825d-c787daa7f1f8 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Received event network-changed-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:38.619402 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-74a42c09-8046-4420-b600-5f6df0f8c132 req-09aa5a32-6c90-4c40-825d-c787daa7f1f8 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Refreshing instance network info cache due to event network-changed-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:39:38.619583 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-74a42c09-8046-4420-b600-5f6df0f8c132 req-09aa5a32-6c90-4c40-825d-c787daa7f1f8 service nova] Acquiring lock "refresh_cache-57adc083-429a-4f23-9154-7de8b6e74d8a" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:39:38.619691 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-74a42c09-8046-4420-b600-5f6df0f8c132 req-09aa5a32-6c90-4c40-825d-c787daa7f1f8 service nova] Acquired lock "refresh_cache-57adc083-429a-4f23-9154-7de8b6e74d8a" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:39:38.621528 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-74a42c09-8046-4420-b600-5f6df0f8c132 req-09aa5a32-6c90-4c40-825d-c787daa7f1f8 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Refreshing network info cache for port a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:39:38.682066 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:39:38.682385 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:39:39.128279 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-74a42c09-8046-4420-b600-5f6df0f8c132 req-09aa5a32-6c90-4c40-825d-c787daa7f1f8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:39.147838 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:39:39.149598 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165579.149227, b32b8038-72c4-443c-aea3-07cd61ad67f6 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:39.149739 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] VM Started (Lifecycle Event)
May 19 04:39:39.151737 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:39:39.157684 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Instance spawned successfully.
May 19 04:39:39.158162 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:39:39.188933 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:39:39.502046 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-74a42c09-8046-4420-b600-5f6df0f8c132 req-09aa5a32-6c90-4c40-825d-c787daa7f1f8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:39.635902 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-74a42c09-8046-4420-b600-5f6df0f8c132 req-09aa5a32-6c90-4c40-825d-c787daa7f1f8 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Updated VIF entry in instance network info cache for port a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:39:39.635902 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-74a42c09-8046-4420-b600-5f6df0f8c132 req-09aa5a32-6c90-4c40-825d-c787daa7f1f8 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Updating instance_info_cache with network_info: [{"id": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "address": "fa:16:3e:e2:ca:8e", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80a69f3-5d", "ovs_interfaceid": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:39:39.652283 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:39.654164 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:39:39.667931 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:39.668089 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:39.668479 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:39.668746 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:39.671420 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:39.671706 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:39.704032 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:39:39.704383 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.698s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:39.704927 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:39:40.136973 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-74a42c09-8046-4420-b600-5f6df0f8c132 req-09aa5a32-6c90-4c40-825d-c787daa7f1f8 service nova] Releasing lock "refresh_cache-57adc083-429a-4f23-9154-7de8b6e74d8a" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:39:40.159101 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:39:40.159853 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165580.1591418, b32b8038-72c4-443c-aea3-07cd61ad67f6 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:40.159853 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] VM Paused (Lifecycle Event)
May 19 04:39:40.178672 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Took 6.85 seconds to spawn the instance on the hypervisor.
May 19 04:39:40.179190 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:40.502524 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:40.662300 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:40.663949 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165580.6637204, b32b8038-72c4-443c-aea3-07cd61ad67f6 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:40.664086 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] VM Resumed (Lifecycle Event)
May 19 04:39:40.675722 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f2dc170a-0893-46a3-9b91-d0808be1b004 req-102cb6b9-25b6-4241-b863-82fbf2907280 service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Received event network-vif-plugged-b9855804-ae85-4e19-b3c0-586032713aff {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:40.676442 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f2dc170a-0893-46a3-9b91-d0808be1b004 req-102cb6b9-25b6-4241-b863-82fbf2907280 service nova] Acquiring lock "b32b8038-72c4-443c-aea3-07cd61ad67f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:40.678899 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f2dc170a-0893-46a3-9b91-d0808be1b004 req-102cb6b9-25b6-4241-b863-82fbf2907280 service nova] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:40.679287 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f2dc170a-0893-46a3-9b91-d0808be1b004 req-102cb6b9-25b6-4241-b863-82fbf2907280 service nova] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:40.679287 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f2dc170a-0893-46a3-9b91-d0808be1b004 req-102cb6b9-25b6-4241-b863-82fbf2907280 service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] No waiting events found dispatching network-vif-plugged-b9855804-ae85-4e19-b3c0-586032713aff {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:39:40.679399 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-f2dc170a-0893-46a3-9b91-d0808be1b004 req-102cb6b9-25b6-4241-b863-82fbf2907280 service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Received unexpected event network-vif-plugged-b9855804-ae85-4e19-b3c0-586032713aff for instance with vm_state active and task_state None.
May 19 04:39:40.689401 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Took 12.52 seconds to build instance.
May 19 04:39:41.169401 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:41.171613 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:39:41.191158 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.029s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:41.703239 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:39:41.703622 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:39:41.704605 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.91 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:39:42.180883 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9b8b49ef-b2e8-49d4-90e5-0a34dc5825a6 req-cf231598-cc92-436c-8c0b-da92a1c9768e service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Received event network-changed-b9855804-ae85-4e19-b3c0-586032713aff {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:42.182474 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9b8b49ef-b2e8-49d4-90e5-0a34dc5825a6 req-cf231598-cc92-436c-8c0b-da92a1c9768e service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Refreshing instance network info cache due to event network-changed-b9855804-ae85-4e19-b3c0-586032713aff. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:39:42.182628 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9b8b49ef-b2e8-49d4-90e5-0a34dc5825a6 req-cf231598-cc92-436c-8c0b-da92a1c9768e service nova] Acquiring lock "refresh_cache-b32b8038-72c4-443c-aea3-07cd61ad67f6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:39:42.182720 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9b8b49ef-b2e8-49d4-90e5-0a34dc5825a6 req-cf231598-cc92-436c-8c0b-da92a1c9768e service nova] Acquired lock "refresh_cache-b32b8038-72c4-443c-aea3-07cd61ad67f6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:39:42.182868 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-9b8b49ef-b2e8-49d4-90e5-0a34dc5825a6 req-cf231598-cc92-436c-8c0b-da92a1c9768e service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Refreshing network info cache for port b9855804-ae85-4e19-b3c0-586032713aff {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:39:42.687805 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-9b8b49ef-b2e8-49d4-90e5-0a34dc5825a6 req-cf231598-cc92-436c-8c0b-da92a1c9768e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:43.110499 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-9b8b49ef-b2e8-49d4-90e5-0a34dc5825a6 req-cf231598-cc92-436c-8c0b-da92a1c9768e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:43.187221 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:43.302527 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-9b8b49ef-b2e8-49d4-90e5-0a34dc5825a6 req-cf231598-cc92-436c-8c0b-da92a1c9768e service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Updated VIF entry in instance network info cache for port b9855804-ae85-4e19-b3c0-586032713aff. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:39:43.302837 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-9b8b49ef-b2e8-49d4-90e5-0a34dc5825a6 req-cf231598-cc92-436c-8c0b-da92a1c9768e service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Updating instance_info_cache with network_info: [{"id": "b9855804-ae85-4e19-b3c0-586032713aff", "address": "fa:16:3e:0e:aa:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9855804-ae", "ovs_interfaceid": "b9855804-ae85-4e19-b3c0-586032713aff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:39:43.370952 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "93c62882-ef27-41d5-8178-e1ccc945fe1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:43.371477 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "93c62882-ef27-41d5-8178-e1ccc945fe1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:43.582502 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:43.582768 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:43.805376 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9b8b49ef-b2e8-49d4-90e5-0a34dc5825a6 req-cf231598-cc92-436c-8c0b-da92a1c9768e service nova] Releasing lock "refresh_cache-b32b8038-72c4-443c-aea3-07cd61ad67f6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:39:43.873467 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:39:44.084804 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:39:44.434359 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:44.434830 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:44.437606 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:39:44.437800 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Claim successful on node np0000001025
May 19 04:39:44.634479 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:45.518463 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:46.064855 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:39:46.065098 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:39:46.567751 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:39:47.075635 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.641s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:47.076366 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.442s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:47.076939 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:39:47.082959 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:39:47.083248 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Claim successful on node np0000001025
May 19 04:39:47.582475 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:39:47.582886 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:39:47.583080 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:47.583270 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:47.667177 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f331813eed6416a9bfa432c8b3ed42a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ec00acc80453dbe8d6a1295e9eb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:39:48.042942 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:48.094835 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:39:48.186979 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:48.217444 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Successfully created port: 7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:39:48.600629 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:39:48.654464 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:39:48.654643 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:39:48.775748 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Successfully updated port: 7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:39:48.821591 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-67b28303-e337-4a82-bcb8-4e28dd17793b req-98c3a59a-a366-44a8-9bba-2b25dbcd2c6a service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Received event network-changed-7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:48.821659 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-67b28303-e337-4a82-bcb8-4e28dd17793b req-98c3a59a-a366-44a8-9bba-2b25dbcd2c6a service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Refreshing instance network info cache due to event network-changed-7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:39:48.822056 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-67b28303-e337-4a82-bcb8-4e28dd17793b req-98c3a59a-a366-44a8-9bba-2b25dbcd2c6a service nova] Acquiring lock "refresh_cache-93c62882-ef27-41d5-8178-e1ccc945fe1d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:39:48.822056 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-67b28303-e337-4a82-bcb8-4e28dd17793b req-98c3a59a-a366-44a8-9bba-2b25dbcd2c6a service nova] Acquired lock "refresh_cache-93c62882-ef27-41d5-8178-e1ccc945fe1d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:39:48.822056 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-67b28303-e337-4a82-bcb8-4e28dd17793b req-98c3a59a-a366-44a8-9bba-2b25dbcd2c6a service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Refreshing network info cache for port 7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:39:49.157367 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:39:49.277743 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "refresh_cache-93c62882-ef27-41d5-8178-e1ccc945fe1d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:39:49.324014 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-67b28303-e337-4a82-bcb8-4e28dd17793b req-98c3a59a-a366-44a8-9bba-2b25dbcd2c6a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:49.388867 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-67b28303-e337-4a82-bcb8-4e28dd17793b req-98c3a59a-a366-44a8-9bba-2b25dbcd2c6a service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:39:49.532314 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-67b28303-e337-4a82-bcb8-4e28dd17793b req-98c3a59a-a366-44a8-9bba-2b25dbcd2c6a service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:39:49.617436 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:39:49.620274 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:39:49.620577 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Creating image(s)
May 19 04:39:49.623421 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "/opt/stack/data/nova/instances/93c62882-ef27-41d5-8178-e1ccc945fe1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:49.623680 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "/opt/stack/data/nova/instances/93c62882-ef27-41d5-8178-e1ccc945fe1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:49.624784 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "/opt/stack/data/nova/instances/93c62882-ef27-41d5-8178-e1ccc945fe1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:49.625466 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:49.628887 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:49.629984 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:49.668155 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.592s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:49.668947 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:39:49.726836 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.097s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:49.727601 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:49.728374 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:49.728827 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:49.732066 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:49.732922 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:49.818255 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.085s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:49.818858 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/93c62882-ef27-41d5-8178-e1ccc945fe1d/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:49.882437 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/93c62882-ef27-41d5-8178-e1ccc945fe1d/disk 1073741824" returned: 0 in 0.063s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:49.883073 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.155s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:49.883549 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:49.969567 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.085s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:49.970077 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93c62882-ef27-41d5-8178-e1ccc945fe1d/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:39:49.970481 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c62882-ef27-41d5-8178-e1ccc945fe1d/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:50.035683 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-67b28303-e337-4a82-bcb8-4e28dd17793b req-98c3a59a-a366-44a8-9bba-2b25dbcd2c6a service nova] Releasing lock "refresh_cache-93c62882-ef27-41d5-8178-e1ccc945fe1d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:39:50.039460 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquired lock "refresh_cache-93c62882-ef27-41d5-8178-e1ccc945fe1d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:39:50.039721 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:39:50.069614 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c62882-ef27-41d5-8178-e1ccc945fe1d/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:50.069809 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Cannot resize image /opt/stack/data/nova/instances/93c62882-ef27-41d5-8178-e1ccc945fe1d/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:39:50.070060 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:39:50.070216 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Ensure instance console log exists: /opt/stack/data/nova/instances/93c62882-ef27-41d5-8178-e1ccc945fe1d/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:39:50.070521 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:50.070741 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:50.070894 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:50.178149 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:39:50.178515 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:39:50.178923 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:50.179497 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:50.259771 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa432d60cb324c6d87818107e05e0053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490151decdde445593a86a16976f6b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:39:50.519865 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:50.636131 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:39:50.682515 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:39:50.769179 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Successfully created port: 451d5caa-1b64-4a79-8aea-b1fa65cf3131 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:39:50.858240 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:50.866907 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:39:51.027389 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Updating instance_info_cache with network_info: [{"id": "7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3", "address": "fa:16:3e:f1:29:3e", "network": {"id": "3f564857-63e6-46af-9e0f-3a2de30297d4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-951031274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "529ec00acc80453dbe8d6a1295e9eb13", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1bbc34-ba", "ovs_interfaceid": "7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:39:51.187379 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:39:51.361133 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Successfully updated port: 451d5caa-1b64-4a79-8aea-b1fa65cf3131 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:39:51.406061 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ef5075d9-7a58-465c-9d98-43679edf65ec req-9ca18d83-04e7-46f4-b26e-4ae8335dce7d service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Received event network-changed-451d5caa-1b64-4a79-8aea-b1fa65cf3131 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:51.406139 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ef5075d9-7a58-465c-9d98-43679edf65ec req-9ca18d83-04e7-46f4-b26e-4ae8335dce7d service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Refreshing instance network info cache due to event network-changed-451d5caa-1b64-4a79-8aea-b1fa65cf3131. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:39:51.406932 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ef5075d9-7a58-465c-9d98-43679edf65ec req-9ca18d83-04e7-46f4-b26e-4ae8335dce7d service nova] Acquiring lock "refresh_cache-e644a772-cf7c-4b15-b21b-ea54e773a1f9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:39:51.406932 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ef5075d9-7a58-465c-9d98-43679edf65ec req-9ca18d83-04e7-46f4-b26e-4ae8335dce7d service nova] Acquired lock "refresh_cache-e644a772-cf7c-4b15-b21b-ea54e773a1f9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:39:51.406932 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-ef5075d9-7a58-465c-9d98-43679edf65ec req-9ca18d83-04e7-46f4-b26e-4ae8335dce7d service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Refreshing network info cache for port 451d5caa-1b64-4a79-8aea-b1fa65cf3131 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:39:51.529300 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Releasing lock "refresh_cache-93c62882-ef27-41d5-8178-e1ccc945fe1d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:39:51.529573 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Instance network_info: |[{"id": "7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3", "address": "fa:16:3e:f1:29:3e", "network": {"id": "3f564857-63e6-46af-9e0f-3a2de30297d4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-951031274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "529ec00acc80453dbe8d6a1295e9eb13", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1bbc34-ba", "ovs_interfaceid": "7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:39:51.532030 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Start _get_guest_xml network_info=[{"id": "7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3", "address": "fa:16:3e:f1:29:3e", "network": {"id": "3f564857-63e6-46af-9e0f-3a2de30297d4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-951031274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "529ec00acc80453dbe8d6a1295e9eb13", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1bbc34-ba", "ovs_interfaceid": "7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:39:51.538016 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:39:51.539367 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-1445499294', uuid='93c62882-ef27-41d5-8178-e1ccc945fe1d'), owner=OwnerMeta(userid='1f331813eed6416a9bfa432c8b3ed42a', username='tempest-VolumesSnapshotTestJSON-492014726-project-member', projectid='529ec00acc80453dbe8d6a1295e9eb13', projectname='tempest-VolumesSnapshotTestJSON-492014726'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3", "address": "fa:16:3e:f1:29:3e", "network": {"id": "3f564857-63e6-46af-9e0f-3a2de30297d4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-951031274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "529ec00acc80453dbe8d6a1295e9eb13", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1bbc34-ba", "ovs_interfaceid": "7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165591.5389163) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:39:51.540620 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:39:51.541015 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:39:51.541980 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:39:51.542184 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:39:51.543503 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:39:51.543860 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:39:51.544046 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:39:51.544197 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:39:51.544318 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:39:51.544397 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:39:51.544492 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:39:51.545771 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:39:51.545938 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:39:51.546095 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:39:51.546255 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:39:51.546414 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:39:51.559041 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:39:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1445499294',display_name='tempest-VolumesSnapshotTestJSON-instance-1445499294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumessnapshottestjson-instance-1445499294',id=32,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOfx03V3DO1gmslCMTV5n44+8Uj4/GhVidcn6x+Lexj/PUPq1y/PZH7HmlaxNmkcPHmBrzZpJZN0qOhTDBSo5AHAoBYGySFBAf/ghc8Yovo7ZoNfOmhi+b8oKV2di+ELg==',key_name='tempest-keypair-983319923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='529ec00acc80453dbe8d6a1295e9eb13',ramdisk_id='',reservation_id='r-hy19v7eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-492014726',owner_user_name='tempest-VolumesSnapshotTestJSON-492014726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:39:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f331813eed6416a9bfa432c8b3ed42a',uuid=93c62882-ef27-41d5-8178-e1ccc945fe1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3", "address": "fa:16:3e:f1:29:3e", "network": {"id": "3f564857-63e6-46af-9e0f-3a2de30297d4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-951031274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "529ec00acc80453dbe8d6a1295e9eb13", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1bbc34-ba", "ovs_interfaceid": "7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:39:51.559273 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Converting VIF {"id": "7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3", "address": "fa:16:3e:f1:29:3e", "network": {"id": "3f564857-63e6-46af-9e0f-3a2de30297d4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-951031274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "529ec00acc80453dbe8d6a1295e9eb13", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1bbc34-ba", "ovs_interfaceid": "7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:39:51.559893 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:29:3e,bridge_name='br-int',has_traffic_filtering=True,id=7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3,network=Network(3f564857-63e6-46af-9e0f-3a2de30297d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1bbc34-ba') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:39:51.560446 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lazy-loading 'pci_devices' on Instance uuid 93c62882-ef27-41d5-8178-e1ccc945fe1d {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:51.684503 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:51.686540 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:51.786585 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "87e8e02e-e385-418c-be0c-bb25a377d081" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:51.786803 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "87e8e02e-e385-418c-be0c-bb25a377d081" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:51.862452 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "refresh_cache-e644a772-cf7c-4b15-b21b-ea54e773a1f9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:39:51.909475 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-ef5075d9-7a58-465c-9d98-43679edf65ec req-9ca18d83-04e7-46f4-b26e-4ae8335dce7d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:51.993054 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-ef5075d9-7a58-465c-9d98-43679edf65ec req-9ca18d83-04e7-46f4-b26e-4ae8335dce7d service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:39:52.065340 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] End _get_guest_xml xml=<domain type="qemu">
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:   <uuid>93c62882-ef27-41d5-8178-e1ccc945fe1d</uuid>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:   <name>instance-00000020</name>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1445499294</nova:name>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:39:51</nova:creationTime>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:         <nova:user uuid="1f331813eed6416a9bfa432c8b3ed42a">tempest-VolumesSnapshotTestJSON-492014726-project-member</nova:user>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:         <nova:project uuid="529ec00acc80453dbe8d6a1295e9eb13">tempest-VolumesSnapshotTestJSON-492014726</nova:project>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:         <nova:port uuid="7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3">
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     <system>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <entry name="serial">93c62882-ef27-41d5-8178-e1ccc945fe1d</entry>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <entry name="uuid">93c62882-ef27-41d5-8178-e1ccc945fe1d</entry>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     </system>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:   <os>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:   </os>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:   <features>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:   </features>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:   <devices>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/93c62882-ef27-41d5-8178-e1ccc945fe1d/disk"/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     </disk>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/93c62882-ef27-41d5-8178-e1ccc945fe1d/disk.config"/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     </disk>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:f1:29:3e"/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <target dev="tap7d1bbc34-ba"/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     </interface>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/93c62882-ef27-41d5-8178-e1ccc945fe1d/console.log" append="off"/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     </serial>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     <video>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     </video>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     </rng>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:   </devices>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]: </domain>
May 19 04:39:52.065340 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:39:52.068681 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Preparing to wait for external event network-vif-plugged-7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:39:52.068681 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "93c62882-ef27-41d5-8178-e1ccc945fe1d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:52.068681 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "93c62882-ef27-41d5-8178-e1ccc945fe1d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:52.068681 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "93c62882-ef27-41d5-8178-e1ccc945fe1d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:52.068681 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:39:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1445499294',display_name='tempest-VolumesSnapshotTestJSON-instance-1445499294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumessnapshottestjson-instance-1445499294',id=32,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOfx03V3DO1gmslCMTV5n44+8Uj4/GhVidcn6x+Lexj/PUPq1y/PZH7HmlaxNmkcPHmBrzZpJZN0qOhTDBSo5AHAoBYGySFBAf/ghc8Yovo7ZoNfOmhi+b8oKV2di+ELg==',key_name='tempest-keypair-983319923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='529ec00acc80453dbe8d6a1295e9eb13',ramdisk_id='',reservation_id='r-hy19v7eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-492014726',owner_user_name='tempest-VolumesSnapshotTestJSON-492014726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:39:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f331813eed6416a9bfa432c8b3ed42a',uuid=93c62882-ef27-41d5-8178-e1ccc945fe1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3", "address": "fa:16:3e:f1:29:3e", "network": {"id": "3f564857-63e6-46af-9e0f-3a2de30297d4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-951031274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "529ec00acc80453dbe8d6a1295e9eb13", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1bbc34-ba", "ovs_interfaceid": "7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:39:52.068681 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Converting VIF {"id": "7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3", "address": "fa:16:3e:f1:29:3e", "network": {"id": "3f564857-63e6-46af-9e0f-3a2de30297d4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-951031274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "529ec00acc80453dbe8d6a1295e9eb13", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1bbc34-ba", "ovs_interfaceid": "7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:39:52.068681 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:29:3e,bridge_name='br-int',has_traffic_filtering=True,id=7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3,network=Network(3f564857-63e6-46af-9e0f-3a2de30297d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1bbc34-ba') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:39:52.068681 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:29:3e,bridge_name='br-int',has_traffic_filtering=True,id=7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3,network=Network(3f564857-63e6-46af-9e0f-3a2de30297d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1bbc34-ba') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:39:52.071667 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:52.071667 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:52.071667 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:39:52.073581 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:52.073873 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e51e4663-a53a-510e-bf62-9728d48b72c8', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:52.075017 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:52.076186 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:52.077776 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:52.081969 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:52.081969 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d1bbc34-ba, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:52.081969 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d1bbc34-ba, col_values=(('qos', UUID('1c8ab86d-5f9b-4921-839b-56d87abd25fa')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:52.081969 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d1bbc34-ba, col_values=(('external_ids', {'iface-id': '7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:29:3e', 'vm-uuid': '93c62882-ef27-41d5-8178-e1ccc945fe1d'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:52.085572 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:52.087400 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:52.089124 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:52.090187 np0000001025 nova-compute[97981]: INFO os_vif [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:29:3e,bridge_name='br-int',has_traffic_filtering=True,id=7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3,network=Network(3f564857-63e6-46af-9e0f-3a2de30297d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1bbc34-ba')
May 19 04:39:52.179800 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-ef5075d9-7a58-465c-9d98-43679edf65ec req-9ca18d83-04e7-46f4-b26e-4ae8335dce7d service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:39:52.190083 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lazy-loading 'flavor' on Instance uuid aa2cdf1d-65ef-4cf4-b742-72ae783cde27 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:52.197965 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:39:52.199522 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:39:52.200016 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Creating image(s)
May 19 04:39:52.200758 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "/opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:52.200868 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "/opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:52.201422 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "/opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:52.202092 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:52.206779 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:52.208472 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:52.292784 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lazy-loading 'flavor' on Instance uuid 87e8e02e-e385-418c-be0c-bb25a377d081 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:52.311328 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.103s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:52.311714 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:52.312412 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:52.312844 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:52.315879 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:39:52.316362 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:52.417631 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.101s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:52.418164 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:52.469765 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk 1073741824" returned: 0 in 0.051s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:52.470254 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.158s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:52.470764 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:52.556599 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.086s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:52.557035 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:39:52.557337 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:52.640922 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:52.641329 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Cannot resize image /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:39:52.641666 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:39:52.641821 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Ensure instance console log exists: /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:39:52.642074 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:52.642334 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:52.642481 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:52.682093 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ef5075d9-7a58-465c-9d98-43679edf65ec req-9ca18d83-04e7-46f4-b26e-4ae8335dce7d service nova] Releasing lock "refresh_cache-e644a772-cf7c-4b15-b21b-ea54e773a1f9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:39:52.682748 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquired lock "refresh_cache-e644a772-cf7c-4b15-b21b-ea54e773a1f9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:39:52.682911 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:39:53.191740 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:53.194944 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:53.251047 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:39:53.302819 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "87e8e02e-e385-418c-be0c-bb25a377d081" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:53.407075 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:53.537943 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Updating instance_info_cache with network_info: [{"id": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "address": "fa:16:3e:a1:aa:43", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap451d5caa-1b", "ovs_interfaceid": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:39:53.616438 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:39:53.616572 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:39:53.616619 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] No VIF found with MAC fa:16:3e:f1:29:3e, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:39:53.617049 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Using config drive
May 19 04:39:54.039847 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Releasing lock "refresh_cache-e644a772-cf7c-4b15-b21b-ea54e773a1f9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:39:54.040264 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Instance network_info: |[{"id": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "address": "fa:16:3e:a1:aa:43", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap451d5caa-1b", "ovs_interfaceid": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:39:54.042012 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Start _get_guest_xml network_info=[{"id": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "address": "fa:16:3e:a1:aa:43", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap451d5caa-1b", "ovs_interfaceid": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:39:54.043797 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:39:54.045187 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='e644a772-cf7c-4b15-b21b-ea54e773a1f9'), owner=OwnerMeta(userid='aa432d60cb324c6d87818107e05e0053', username='tempest-AttachVolumeMultiAttachTest-1659172696-project-member', projectid='490151decdde445593a86a16976f6b34', projectname='tempest-AttachVolumeMultiAttachTest-1659172696'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "address": "fa:16:3e:a1:aa:43", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap451d5caa-1b", "ovs_interfaceid": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165594.0448244) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:39:54.046097 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:39:54.046624 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:39:54.047309 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:39:54.047547 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:39:54.048652 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:39:54.049038 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:39:54.049265 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:39:54.049405 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:39:54.049585 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:39:54.049709 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:39:54.049849 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:39:54.050043 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:39:54.050258 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:39:54.050436 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:39:54.050591 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:39:54.050760 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:39:54.062303 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:39:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='multiattach-server-1',id=33,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9kq9UfoFPrqlSUYASLa2M8/KXwpiWIksTRz6r+vXFFf5G7djO79flSW+4jvUEBmYvioxzxvTch1hKVIwlMIaMSuT3AyUPlX/5ZPn59wF6pdcyyqAHuNzAVPjAjiGd+6A==',key_name='tempest-keypair-818275091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-uc510oti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa432d60cb324c6d87818107e05e0053',uuid=e644a772-cf7c-4b15-b21b-ea54e773a1f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "address": "fa:16:3e:a1:aa:43", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap451d5caa-1b", "ovs_interfaceid": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:39:54.062547 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "address": "fa:16:3e:a1:aa:43", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap451d5caa-1b", "ovs_interfaceid": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:39:54.063162 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:aa:43,bridge_name='br-int',has_traffic_filtering=True,id=451d5caa-1b64-4a79-8aea-b1fa65cf3131,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451d5caa-1b') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:39:54.063824 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'pci_devices' on Instance uuid e644a772-cf7c-4b15-b21b-ea54e773a1f9 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:54.122444 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:54.257508 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Creating config drive at /opt/stack/data/nova/instances/93c62882-ef27-41d5-8178-e1ccc945fe1d/disk.config
May 19 04:39:54.261441 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/93c62882-ef27-41d5-8178-e1ccc945fe1d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_xelu3gr {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:54.294380 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:54.294765 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:54.295114 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Attaching volume 06f28aae-b80a-4cf7-9a58-f2f84a6356aa to /dev/vdb
May 19 04:39:54.311454 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/93c62882-ef27-41d5-8178-e1ccc945fe1d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_xelu3gr" returned: 0 in 0.050s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:54.348920 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:39:54.360467 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:39:54.360913 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "87e8e02e-e385-418c-be0c-bb25a377d081" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:54.361319 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "87e8e02e-e385-418c-be0c-bb25a377d081" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:54.361712 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Attaching volume 48aece7a-6fef-499d-ac1b-f3aa37ac8b16 to /dev/vdb
May 19 04:39:54.377561 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:54.428447 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:39:54.430128 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:39:54.431963 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:39:54.440867 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:39:54.444463 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:fe16:6b7e', 'fe80::6898:26ff:fe86:46b0', 'fe80::fc16:3eff:fe8e:26b9', 'fe80::fc16:3eff:fe6d:b26e', 'fe80::30c3:b4ff:fe77:721a', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe75:10d8', 'fe80::946f:41ff:fe06:ab72', 'fe80::fc16:3eff:fee2:ca8e', 'fe80::bc20:d2ff:fef5:7278', 'fe80::fc16:3eff:fe0e:aa6f'] 
May 19 04:39:54.444906 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:39:54.445062 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:39:54.445386 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:39:54.445684 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Updating existing volume attachment record: 189f863f-6c6c-4789-b84d-1df61497a6e9 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:39:54.450898 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:39:54.474145 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:54.521773 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:39:54.522646 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:39:54.533503 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:39:54.533503 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:fe16:6b7e', 'fe80::6898:26ff:fe86:46b0', 'fe80::fc16:3eff:fe8e:26b9', 'fe80::fc16:3eff:fe6d:b26e', 'fe80::30c3:b4ff:fe77:721a', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe75:10d8', 'fe80::946f:41ff:fe06:ab72', 'fe80::fc16:3eff:fee2:ca8e', 'fe80::bc20:d2ff:fef5:7278', 'fe80::fc16:3eff:fe0e:aa6f'] 
May 19 04:39:54.533503 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:39:54.533503 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:39:54.533503 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:39:54.533503 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Updating existing volume attachment record: d5350cc9-c311-4d31-b905-61d6ab676994 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:39:54.571266 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] End _get_guest_xml xml=<domain type="qemu">
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:   <uuid>e644a772-cf7c-4b15-b21b-ea54e773a1f9</uuid>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:   <name>instance-00000021</name>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <nova:name>multiattach-server-1</nova:name>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:39:54</nova:creationTime>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:         <nova:user uuid="aa432d60cb324c6d87818107e05e0053">tempest-AttachVolumeMultiAttachTest-1659172696-project-member</nova:user>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:         <nova:project uuid="490151decdde445593a86a16976f6b34">tempest-AttachVolumeMultiAttachTest-1659172696</nova:project>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:         <nova:port uuid="451d5caa-1b64-4a79-8aea-b1fa65cf3131">
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     <system>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <entry name="serial">e644a772-cf7c-4b15-b21b-ea54e773a1f9</entry>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <entry name="uuid">e644a772-cf7c-4b15-b21b-ea54e773a1f9</entry>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     </system>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:   <os>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:   </os>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:   <features>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:   </features>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:   <devices>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk"/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     </disk>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk.config"/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     </disk>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:a1:aa:43"/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <target dev="tap451d5caa-1b"/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     </interface>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/console.log" append="off"/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     </serial>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     <video>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     </video>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     </rng>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:   </devices>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]: </domain>
May 19 04:39:54.571266 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:39:54.573499 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Preparing to wait for external event network-vif-plugged-451d5caa-1b64-4a79-8aea-b1fa65cf3131 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:39:54.573499 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:54.573499 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:54.573499 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:54.576516 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:39:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='multiattach-server-1',id=33,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9kq9UfoFPrqlSUYASLa2M8/KXwpiWIksTRz6r+vXFFf5G7djO79flSW+4jvUEBmYvioxzxvTch1hKVIwlMIaMSuT3AyUPlX/5ZPn59wF6pdcyyqAHuNzAVPjAjiGd+6A==',key_name='tempest-keypair-818275091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-uc510oti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa432d60cb324c6d87818107e05e0053',uuid=e644a772-cf7c-4b15-b21b-ea54e773a1f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "address": "fa:16:3e:a1:aa:43", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap451d5caa-1b", "ovs_interfaceid": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:39:54.576823 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "address": "fa:16:3e:a1:aa:43", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap451d5caa-1b", "ovs_interfaceid": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:39:54.578157 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:aa:43,bridge_name='br-int',has_traffic_filtering=True,id=451d5caa-1b64-4a79-8aea-b1fa65cf3131,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451d5caa-1b') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:39:54.578503 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:aa:43,bridge_name='br-int',has_traffic_filtering=True,id=451d5caa-1b64-4a79-8aea-b1fa65cf3131,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451d5caa-1b') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:39:54.581322 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:54.581624 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:54.581919 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:39:54.584412 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:54.584596 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3939f2d1-1661-5a3a-a477-031697398bcf', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:54.585342 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:54.586017 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:54.592047 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:54.596133 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:54.596343 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap451d5caa-1b, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:54.596728 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap451d5caa-1b, col_values=(('qos', UUID('ddeb076a-67f4-4467-8930-b13e666fa350')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:54.596928 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap451d5caa-1b, col_values=(('external_ids', {'iface-id': '451d5caa-1b64-4a79-8aea-b1fa65cf3131', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:aa:43', 'vm-uuid': 'e644a772-cf7c-4b15-b21b-ea54e773a1f9'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:54.597967 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:54.600786 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:54.615554 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:54.616801 np0000001025 nova-compute[97981]: INFO os_vif [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:aa:43,bridge_name='br-int',has_traffic_filtering=True,id=451d5caa-1b64-4a79-8aea-b1fa65cf3131,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451d5caa-1b')
May 19 04:39:54.820915 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:54.852855 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:54.934379 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:55.001187 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4d12b6ce-5797-4d4e-978a-ba2638b05ec6 req-7af85643-02e4-4899-b0ab-5ad5d1289759 service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Received event network-vif-plugged-7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:55.002931 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4d12b6ce-5797-4d4e-978a-ba2638b05ec6 req-7af85643-02e4-4899-b0ab-5ad5d1289759 service nova] Acquiring lock "93c62882-ef27-41d5-8178-e1ccc945fe1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:55.002931 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4d12b6ce-5797-4d4e-978a-ba2638b05ec6 req-7af85643-02e4-4899-b0ab-5ad5d1289759 service nova] Lock "93c62882-ef27-41d5-8178-e1ccc945fe1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:55.002931 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4d12b6ce-5797-4d4e-978a-ba2638b05ec6 req-7af85643-02e4-4899-b0ab-5ad5d1289759 service nova] Lock "93c62882-ef27-41d5-8178-e1ccc945fe1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:55.002931 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4d12b6ce-5797-4d4e-978a-ba2638b05ec6 req-7af85643-02e4-4899-b0ab-5ad5d1289759 service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Processing event network-vif-plugged-7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:39:55.025060 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:39:55.025444 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06f28aae-b80a-4cf7-9a58-f2f84a6356aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:39:55.025586 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:55.025983 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:39:55.026215 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06f28aae-b80a-4cf7-9a58-f2f84a6356aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:39:55.038801 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:55.039877 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:55.040414 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:39:55.040595 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:39:55.041010 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:39:55.041229 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:39:55.056904 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:39:55.056904 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:55.063716 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:39:55.063716 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:55.071298 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa] added
May 19 04:39:55.071298 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:39:55.071298 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:55.071298 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:55.071298 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:55.071298 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:55.071298 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:55.071919 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:39:55.072683 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0309(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:39:55.072683 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:39:55.082134 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa] added
May 19 04:39:55.082134 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:39:55.082134 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:55.082134 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:55.082134 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:55.082134 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:55.082134 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:55.082134 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:39:55.082134 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.041(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:39:55.082134 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:39:55.138946 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:39:55.139291 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '48aece7a-6fef-499d-ac1b-f3aa37ac8b16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:39:55.139435 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:55.172129 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:55.182357 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:55.207740 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:55.214398 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:55.637541 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:39:55.638364 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165595.6380703, 93c62882-ef27-41d5-8178-e1ccc945fe1d => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:55.638582 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] VM Started (Lifecycle Event)
May 19 04:39:55.641731 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:39:55.645825 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Instance spawned successfully.
May 19 04:39:55.646601 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:39:55.968534 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "6cd7138c-f217-4858-8941-89693e62ae6e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:55.968749 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "6cd7138c-f217-4858-8941-89693e62ae6e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:56.072943 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:39:56.082221 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:39:56.087768 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:39:56.087768 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:39:56.097932 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:39:56.097932 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:56.103385 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:56.112839 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:56.129144 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:56.139434 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:56.139434 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:56.139434 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:56.139434 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:56.139434 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:56.139434 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:56.139434 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:56.139434 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:56.139434 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:56.139434 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:56.139434 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:56.139434 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:56.139434 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:56.140209 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:56.140209 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:56.140209 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:56.140209 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:56.140209 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:56.140209 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:56.140209 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:56.140209 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:56.140209 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:56.140209 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:56.140209 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:56.140209 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:56.140209 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:56.144643 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:56.146766 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:39:56.158747 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:39:56.158901 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:39:56.159012 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No VIF found with MAC fa:16:3e:a1:aa:43, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:39:56.159578 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Using config drive
May 19 04:39:56.161427 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:56.161653 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:56.162172 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:56.162445 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:56.162764 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:56.163299 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:56.189952 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa, portal: 192.168.50.100,3260]
May 19 04:39:56.189952 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa, portal: 192.168.50.100,3260] successful.
May 19 04:39:56.189952 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:56.214680 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:56.230135 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa, portal: 192.168.40.100,3260]
May 19 04:39:56.230135 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa, portal: 192.168.40.100,3260] successful.
May 19 04:39:56.230135 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:56.236223 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:56.236223 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:56.236223 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:56.236223 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:56.236223 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:56.236223 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:56.236223 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:56.236223 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:56.236223 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:56.236223 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:56.236223 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:56.236223 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:56.236223 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:56.236223 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:56.236223 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:56.237376 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:56.237376 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:56.237376 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:56.237376 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:56.237376 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:56.237376 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:56.237376 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:56.237376 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:56.237376 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:56.237376 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:56.237376 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:56.237376 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:56.237376 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:56.237376 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:56.237376 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:56.237376 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.196s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:39:56.237376 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:39:56.238501 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] HCTL ('15', '-', '-', 0) found on session 70 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:39:56.238644 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:39:56.247131 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:56.258062 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Searching for a device in session 70 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:39:56.259493 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '06f28aae-b80a-4cf7-9a58-f2f84a6356aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:39:56.272251 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:56.272251 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:56.272251 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:56.272251 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:56.272251 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:56.272251 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:56.272251 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:56.272251 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:56.272251 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:56.272251 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:56.272251 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:56.272251 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:56.272251 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:56.272251 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:56.272251 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:56.272718 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:56.272718 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:56.272718 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:56.272718 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:56.272718 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:56.272718 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:56.272718 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:56.272718 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:56.272718 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:56.272718 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:56.272718 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:56.272718 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:56.272718 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:56.272718 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:56.272718 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:56.273179 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.233s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:39:56.273179 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:39:56.274651 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] HCTL ('20', '-', '-', 0) found on session 71 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:39:56.274803 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:39:56.297536 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Searching for a device in session 71 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:39:56.297756 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06f28aae-b80a-4cf7-9a58-f2f84a6356aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:39:56.471264 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Detaching volume de39af6d-0810-4cc6-af4b-fd4602ea4ea2
May 19 04:39:56.519692 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Attempting to driver detach volume de39af6d-0810-4cc6-af4b-fd4602ea4ea2 from mountpoint /dev/vdb
May 19 04:39:56.522819 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Found disk vdb by alias ua-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:39:56.523888 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Found disk vdb by alias ua-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:39:56.523999 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Attempting to detach device vdb from instance 6cd7138c-f217-4858-8941-89693e62ae6e from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:39:56.524239 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:39:56.524239 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:39:56.524239 np0000001025 nova-compute[97981]:   <alias name="ua-de39af6d-0810-4cc6-af4b-fd4602ea4ea2"/>
May 19 04:39:56.524239 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:39:56.524239 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:39:56.524239 np0000001025 nova-compute[97981]:   <serial>de39af6d-0810-4cc6-af4b-fd4602ea4ea2</serial>
May 19 04:39:56.524239 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 19 04:39:56.524239 np0000001025 nova-compute[97981]: </disk>
May 19 04:39:56.524239 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:39:56.531666 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Successfully detached device vdb from instance 6cd7138c-f217-4858-8941-89693e62ae6e from the persistent domain config.
May 19 04:39:56.531954 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] (1/8): Attempting to detach device vdb with device alias ua-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 from instance 6cd7138c-f217-4858-8941-89693e62ae6e from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:39:56.532286 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:39:56.532286 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:39:56.532286 np0000001025 nova-compute[97981]:   <alias name="ua-de39af6d-0810-4cc6-af4b-fd4602ea4ea2"/>
May 19 04:39:56.532286 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:39:56.532286 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:39:56.532286 np0000001025 nova-compute[97981]:   <serial>de39af6d-0810-4cc6-af4b-fd4602ea4ea2</serial>
May 19 04:39:56.532286 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 19 04:39:56.532286 np0000001025 nova-compute[97981]: </disk>
May 19 04:39:56.532286 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:39:56.656267 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:39:56.656755 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165596.6563146, 93c62882-ef27-41d5-8178-e1ccc945fe1d => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:56.656755 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] VM Paused (Lifecycle Event)
May 19 04:39:56.669029 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:56.671745 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Took 7.05 seconds to spawn the instance on the hypervisor.
May 19 04:39:56.672002 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:56.800658 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Creating config drive at /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk.config
May 19 04:39:56.805951 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpl380b18d {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:39:56.854427 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpl380b18d" returned: 0 in 0.048s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:39:57.041272 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:39:57.082317 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0303a3c5-83f3-4ffd-9fb2-23362475b0c7 req-11e27a9a-29ad-4f58-b8e4-d9971fb2e560 service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Received event network-vif-plugged-7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:57.082317 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0303a3c5-83f3-4ffd-9fb2-23362475b0c7 req-11e27a9a-29ad-4f58-b8e4-d9971fb2e560 service nova] Acquiring lock "93c62882-ef27-41d5-8178-e1ccc945fe1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:57.082317 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0303a3c5-83f3-4ffd-9fb2-23362475b0c7 req-11e27a9a-29ad-4f58-b8e4-d9971fb2e560 service nova] Lock "93c62882-ef27-41d5-8178-e1ccc945fe1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:57.082317 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0303a3c5-83f3-4ffd-9fb2-23362475b0c7 req-11e27a9a-29ad-4f58-b8e4-d9971fb2e560 service nova] Lock "93c62882-ef27-41d5-8178-e1ccc945fe1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:57.082317 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0303a3c5-83f3-4ffd-9fb2-23362475b0c7 req-11e27a9a-29ad-4f58-b8e4-d9971fb2e560 service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] No waiting events found dispatching network-vif-plugged-7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:39:57.082317 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-0303a3c5-83f3-4ffd-9fb2-23362475b0c7 req-11e27a9a-29ad-4f58-b8e4-d9971fb2e560 service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Received unexpected event network-vif-plugged-7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3 for instance with vm_state active and task_state None.
May 19 04:39:57.159265 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:57.163505 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165597.1631505, 93c62882-ef27-41d5-8178-e1ccc945fe1d => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:57.163668 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] VM Resumed (Lifecycle Event)
May 19 04:39:57.181578 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Took 12.80 seconds to build instance.
May 19 04:39:57.318076 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 for instance 6cd7138c-f217-4858-8941-89693e62ae6e {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:39:57.444799 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:57.470425 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:57.475598 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:57.601238 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:57.622343 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:57.656017 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b5da674f-db15-439e-bd6e-bdef90e36fa7 req-40b9f361-8ce8-4d7b-b124-40b91cd4cfe7 service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Received event network-vif-plugged-451d5caa-1b64-4a79-8aea-b1fa65cf3131 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:57.656017 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b5da674f-db15-439e-bd6e-bdef90e36fa7 req-40b9f361-8ce8-4d7b-b124-40b91cd4cfe7 service nova] Acquiring lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:57.656017 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b5da674f-db15-439e-bd6e-bdef90e36fa7 req-40b9f361-8ce8-4d7b-b124-40b91cd4cfe7 service nova] Lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:57.656017 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b5da674f-db15-439e-bd6e-bdef90e36fa7 req-40b9f361-8ce8-4d7b-b124-40b91cd4cfe7 service nova] Lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:57.656017 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b5da674f-db15-439e-bd6e-bdef90e36fa7 req-40b9f361-8ce8-4d7b-b124-40b91cd4cfe7 service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Processing event network-vif-plugged-451d5caa-1b64-4a79-8aea-b1fa65cf3131 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:39:57.666516 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:57.670808 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:39:57.683980 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "93c62882-ef27-41d5-8178-e1ccc945fe1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.313s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:58.056772 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Found WWN 330000000db1e4c2c for multipath device dm-14 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:39:58.057291 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:39:58.057550 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000db1e4c2c', 'path': '/dev/dm-14', 'multipath_id': '330000000db1e4c2c'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:39:58.057689 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000db1e4c2c', 'path': '/dev/dm-14', 'multipath_id': '330000000db1e4c2c'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:39:58.058386 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.919s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:39:58.058649 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '48aece7a-6fef-499d-ac1b-f3aa37ac8b16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:39:58.061028 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lazy-loading 'flavor' on Instance uuid aa2cdf1d-65ef-4cf4-b742-72ae783cde27 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:58.070901 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:58.071641 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:58.072434 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:39:58.072680 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:39:58.073255 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:39:58.073535 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:39:58.084561 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:39:58.084561 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:58.093813 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:39:58.093813 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:58.097801 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16] added
May 19 04:39:58.097801 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:39:58.097801 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:58.097801 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:58.097801 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:58.097801 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:58.097801 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:58.097979 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:39:58.098225 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0255(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:39:58.098659 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:39:58.103918 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16] added
May 19 04:39:58.103918 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:39:58.103918 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:58.103918 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:58.103918 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:39:58.103918 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:39:58.103918 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:58.104090 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:39:58.104209 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0307(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:39:58.104342 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:39:58.138990 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4577000d-f6df-4fc8-b49f-0e7724153597 req-c7cec9ec-d6d0-485a-8e04-5e6763da59c0 service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Received event network-changed-7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:58.139166 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4577000d-f6df-4fc8-b49f-0e7724153597 req-c7cec9ec-d6d0-485a-8e04-5e6763da59c0 service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Refreshing instance network info cache due to event network-changed-7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:39:58.139387 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4577000d-f6df-4fc8-b49f-0e7724153597 req-c7cec9ec-d6d0-485a-8e04-5e6763da59c0 service nova] Acquiring lock "refresh_cache-93c62882-ef27-41d5-8178-e1ccc945fe1d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:39:58.139495 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4577000d-f6df-4fc8-b49f-0e7724153597 req-c7cec9ec-d6d0-485a-8e04-5e6763da59c0 service nova] Acquired lock "refresh_cache-93c62882-ef27-41d5-8178-e1ccc945fe1d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:39:58.139661 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4577000d-f6df-4fc8-b49f-0e7724153597 req-c7cec9ec-d6d0-485a-8e04-5e6763da59c0 service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Refreshing network info cache for port 7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:39:58.173413 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165598.173101, 6cd7138c-f217-4858-8941-89693e62ae6e => ua-de39af6d-0810-4cc6-af4b-fd4602ea4ea2> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:39:58.176083 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Successfully detached device vdb from instance 6cd7138c-f217-4858-8941-89693e62ae6e from the live domain config.
May 19 04:39:58.177098 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:39:58.177452 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:39:58.177647 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:58.191518 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:58.225575 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Acquiring lock "11a634a9-3bdd-4085-abc2-a0ad70710975" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:58.225749 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:58.225913 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Acquiring lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:58.226046 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:58.226190 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:58.230077 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Terminating instance
May 19 04:39:58.257687 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:39:58.259054 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165598.2578518, e644a772-cf7c-4b15-b21b-ea54e773a1f9 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:58.259054 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] VM Started (Lifecycle Event)
May 19 04:39:58.261437 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:39:58.263267 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Instance spawned successfully.
May 19 04:39:58.264537 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:39:58.564660 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Attempting to attach volume 06f28aae-b80a-4cf7-9a58-f2f84a6356aa with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:39:58.565942 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:39:58.565942 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:39:58.565942 np0000001025 nova-compute[97981]:   <alias name="ua-06f28aae-b80a-4cf7-9a58-f2f84a6356aa"/>
May 19 04:39:58.565942 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-14"/>
May 19 04:39:58.565942 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:39:58.565942 np0000001025 nova-compute[97981]:   <serial>06f28aae-b80a-4cf7-9a58-f2f84a6356aa</serial>
May 19 04:39:58.565942 np0000001025 nova-compute[97981]: </disk>
May 19 04:39:58.565942 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:39:58.642473 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-4577000d-f6df-4fc8-b49f-0e7724153597 req-c7cec9ec-d6d0-485a-8e04-5e6763da59c0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:58.733587 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:39:58.761383 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:58.761383 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:58.770177 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:58.773061 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:39:58.784566 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:58.784699 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:58.785039 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:58.785268 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:58.785527 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:58.785772 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:39:58.790573 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:58.796245 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:58.824607 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:59.035063 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-4577000d-f6df-4fc8-b49f-0e7724153597 req-c7cec9ec-d6d0-485a-8e04-5e6763da59c0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:39:59.050738 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:59.057942 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:59.087595 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Instance destroyed successfully.
May 19 04:39:59.089762 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lazy-loading 'resources' on Instance uuid 11a634a9-3bdd-4085-abc2-a0ad70710975 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:39:59.099036 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:39:59.105096 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:39:59.115119 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:39:59.115119 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:39:59.128977 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:39:59.128977 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:59.144011 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:59.149428 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:59.167562 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:59.167562 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:59.167562 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:59.167562 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:59.167562 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:59.167562 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:59.167562 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:59.167562 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:59.167562 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:59.167562 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:59.167562 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:59.167562 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:59.167562 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:59.167562 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:59.167562 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:59.167990 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:59.167990 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:59.167990 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:59.167990 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:59.167990 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:59.167990 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:59.167990 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:59.167990 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:59.167990 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:59.167990 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:59.167990 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:59.167990 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:59.167990 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:59.167990 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:59.167990 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:59.177923 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:59.177923 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:59.177923 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:59.177923 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:59.177923 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:59.177923 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:59.177923 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:59.177923 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:59.177923 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:59.177923 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:59.177923 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:59.177923 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:59.177923 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:59.177923 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:59.177923 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:59.178687 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:59.178687 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:59.178687 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:59.178687 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:59.178687 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:59.178687 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:59.178687 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:59.178687 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:59.178687 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:59.178687 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:59.178687 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:59.178687 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:59.178687 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:59.178687 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:59.178687 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:59.210886 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4577000d-f6df-4fc8-b49f-0e7724153597 req-c7cec9ec-d6d0-485a-8e04-5e6763da59c0 service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Updated VIF entry in instance network info cache for port 7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:39:59.211288 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4577000d-f6df-4fc8-b49f-0e7724153597 req-c7cec9ec-d6d0-485a-8e04-5e6763da59c0 service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Updating instance_info_cache with network_info: [{"id": "7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3", "address": "fa:16:3e:f1:29:3e", "network": {"id": "3f564857-63e6-46af-9e0f-3a2de30297d4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-951031274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "529ec00acc80453dbe8d6a1295e9eb13", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1bbc34-ba", "ovs_interfaceid": "7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:39:59.229769 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16, portal: 192.168.50.100,3260]
May 19 04:39:59.229769 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16, portal: 192.168.50.100,3260] successful.
May 19 04:39:59.229769 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:59.240821 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16, portal: 192.168.40.100,3260]
May 19 04:39:59.240821 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16, portal: 192.168.40.100,3260] successful.
May 19 04:39:59.240821 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:59.241513 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:59.259185 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:39:59.263766 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:59.263766 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:59.263766 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:59.263766 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:59.263766 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:59.263766 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:59.263766 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:59.263766 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:59.263766 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:59.263766 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:59.263766 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:59.263766 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:59.263766 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:59.263766 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:59.263766 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:39:59.263766 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:39:59.263766 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:59.266588 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:59.266588 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:59.266588 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:59.266588 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:59.266588 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:59.266588 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:59.266588 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:59.266588 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:59.266588 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:59.266588 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:59.266588 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:59.266588 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:59.266588 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:59.266588 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:59.266588 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:39:59.266588 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:39:59.266588 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:59.266588 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:39:59.266588 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:39:59.266588 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] HCTL ('21', '-', '-', 0) found on session 72 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:39:59.266588 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:39:59.280532 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:39:59.280532 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165599.2766156, e644a772-cf7c-4b15-b21b-ea54e773a1f9 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:59.280532 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] VM Paused (Lifecycle Event)
May 19 04:39:59.284700 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Searching for a device in session 72 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:39:59.284700 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '48aece7a-6fef-499d-ac1b-f3aa37ac8b16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:39:59.289531 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:59.289531 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:59.289531 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:59.289531 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:59.289531 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:59.289531 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:59.289531 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:59.289531 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:59.289531 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:59.289531 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:59.289531 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:59.289531 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:59.289531 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:59.289531 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:59.289531 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:39:59.289531 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:39:59.289531 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:39:59.290378 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:59.290378 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:39:59.290378 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:59.290378 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:39:59.290378 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:59.290378 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:39:59.290378 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:59.290378 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:39:59.290378 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:59.290378 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:39:59.290378 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:59.290378 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:39:59.290378 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:59.290378 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:39:59.290378 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:39:59.290378 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:39:59.290378 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:39:59.290378 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.217s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:39:59.290378 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:39:59.291610 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] HCTL ('22', '-', '-', 0) found on session 73 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:39:59.291716 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:39:59.295039 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Took 7.10 seconds to spawn the instance on the hypervisor.
May 19 04:39:59.295259 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:59.306984 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Searching for a device in session 73 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:39:59.307164 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '48aece7a-6fef-499d-ac1b-f3aa37ac8b16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:39:59.591971 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1399018170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serveractionsv293testjson-server-261623189',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFEE7MfVouu9pqjSZuefRPAqoz2KwFtdLVyP66SNkY10e8a8acmINjhhjRaCSrP+4JYHVyxJ7DR6qdX1Kgex1JRulJwwAy9kC1zv4B6aG+7K383hOjahrwa67Ca8VXO3A==',key_name='tempest-keypair-1684840035',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:39:20Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2110bc6ddf24455ab91b4ba84e6170a',ramdisk_id='',reservation_id='r-6q1ykbfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='77cbe94e-3270-472e-a2a4-99ad3be8837f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1582643744',owner_user_name='tempest-ServerActionsV293TestJSON-1582643744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:39:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b98924a893b435ca15d660c63fbf024',uuid=11a634a9-3bdd-4085-abc2-a0ad70710975,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c20ef5b7-7e77-4061-980b-db836ec71eec", "address": "fa:16:3e:6d:b2:6e", "network": {"id": "9bde70f2-7770-457c-8b6b-364b5adcf4fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1641494804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2110bc6ddf24455ab91b4ba84e6170a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20ef5b7-7e", "ovs_interfaceid": "c20ef5b7-7e77-4061-980b-db836ec71eec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:39:59.592256 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Converting VIF {"id": "c20ef5b7-7e77-4061-980b-db836ec71eec", "address": "fa:16:3e:6d:b2:6e", "network": {"id": "9bde70f2-7770-457c-8b6b-364b5adcf4fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1641494804-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2110bc6ddf24455ab91b4ba84e6170a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20ef5b7-7e", "ovs_interfaceid": "c20ef5b7-7e77-4061-980b-db836ec71eec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:39:59.592843 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=c20ef5b7-7e77-4061-980b-db836ec71eec,network=Network(9bde70f2-7770-457c-8b6b-364b5adcf4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20ef5b7-7e') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:39:59.593157 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=c20ef5b7-7e77-4061-980b-db836ec71eec,network=Network(9bde70f2-7770-457c-8b6b-364b5adcf4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20ef5b7-7e') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:39:59.594591 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:59.594880 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc20ef5b7-7e, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:59.595980 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:59.597073 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:59.598064 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:59.599024 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:59.599204 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81406f8e-acbd-442c-9b28-896ac7aa1a2a) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:39:59.599629 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:59.600093 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:39:59.601244 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:39:59.602855 np0000001025 nova-compute[97981]: INFO os_vif [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=c20ef5b7-7e77-4061-980b-db836ec71eec,network=Network(9bde70f2-7770-457c-8b6b-364b5adcf4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20ef5b7-7e')
May 19 04:39:59.604090 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:39:59.604396 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a12d997-15f6-4776-89f7-965ae348fbb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:39:59.604542 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:39:59.712695 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1a0d25ec-350d-45a6-83f9-828cf8dfc322 req-c04c5740-77f5-488b-b6d0-937e362159bb service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Received event network-vif-plugged-451d5caa-1b64-4a79-8aea-b1fa65cf3131 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:39:59.712844 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1a0d25ec-350d-45a6-83f9-828cf8dfc322 req-c04c5740-77f5-488b-b6d0-937e362159bb service nova] Acquiring lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:39:59.713089 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1a0d25ec-350d-45a6-83f9-828cf8dfc322 req-c04c5740-77f5-488b-b6d0-937e362159bb service nova] Lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:39:59.713252 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1a0d25ec-350d-45a6-83f9-828cf8dfc322 req-c04c5740-77f5-488b-b6d0-937e362159bb service nova] Lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:39:59.713409 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1a0d25ec-350d-45a6-83f9-828cf8dfc322 req-c04c5740-77f5-488b-b6d0-937e362159bb service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] No waiting events found dispatching network-vif-plugged-451d5caa-1b64-4a79-8aea-b1fa65cf3131 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:39:59.713715 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-1a0d25ec-350d-45a6-83f9-828cf8dfc322 req-c04c5740-77f5-488b-b6d0-937e362159bb service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Received unexpected event network-vif-plugged-451d5caa-1b64-4a79-8aea-b1fa65cf3131 for instance with vm_state active and task_state None.
May 19 04:39:59.714723 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4577000d-f6df-4fc8-b49f-0e7724153597 req-c7cec9ec-d6d0-485a-8e04-5e6763da59c0 service nova] Releasing lock "refresh_cache-93c62882-ef27-41d5-8178-e1ccc945fe1d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:39:59.780711 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:39:59.782737 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165599.7824616, e644a772-cf7c-4b15-b21b-ea54e773a1f9 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:39:59.782981 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] VM Resumed (Lifecycle Event)
May 19 04:39:59.803277 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Took 15.21 seconds to build instance.
May 19 04:40:00.073356 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:40:00.218396 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0a395b4b-e0f1-4308-8aa7-72cfe5dc2520 req-66b0c132-f467-4b1d-854a-be34ad10ee16 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Received event network-vif-unplugged-c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:00.218396 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0a395b4b-e0f1-4308-8aa7-72cfe5dc2520 req-66b0c132-f467-4b1d-854a-be34ad10ee16 service nova] Acquiring lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:00.218396 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0a395b4b-e0f1-4308-8aa7-72cfe5dc2520 req-66b0c132-f467-4b1d-854a-be34ad10ee16 service nova] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:00.218396 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0a395b4b-e0f1-4308-8aa7-72cfe5dc2520 req-66b0c132-f467-4b1d-854a-be34ad10ee16 service nova] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:00.218396 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0a395b4b-e0f1-4308-8aa7-72cfe5dc2520 req-66b0c132-f467-4b1d-854a-be34ad10ee16 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] No waiting events found dispatching network-vif-unplugged-c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:40:00.218396 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0a395b4b-e0f1-4308-8aa7-72cfe5dc2520 req-66b0c132-f467-4b1d-854a-be34ad10ee16 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Received event network-vif-unplugged-c20ef5b7-7e77-4061-980b-db836ec71eec for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:40:00.218396 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0a395b4b-e0f1-4308-8aa7-72cfe5dc2520 req-66b0c132-f467-4b1d-854a-be34ad10ee16 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Received event network-vif-unplugged-c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:00.218678 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0a395b4b-e0f1-4308-8aa7-72cfe5dc2520 req-66b0c132-f467-4b1d-854a-be34ad10ee16 service nova] Acquiring lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:00.218678 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0a395b4b-e0f1-4308-8aa7-72cfe5dc2520 req-66b0c132-f467-4b1d-854a-be34ad10ee16 service nova] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:00.218750 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0a395b4b-e0f1-4308-8aa7-72cfe5dc2520 req-66b0c132-f467-4b1d-854a-be34ad10ee16 service nova] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:00.218888 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0a395b4b-e0f1-4308-8aa7-72cfe5dc2520 req-66b0c132-f467-4b1d-854a-be34ad10ee16 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] No waiting events found dispatching network-vif-unplugged-c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:40:00.219025 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0a395b4b-e0f1-4308-8aa7-72cfe5dc2520 req-66b0c132-f467-4b1d-854a-be34ad10ee16 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Received event network-vif-unplugged-c20ef5b7-7e77-4061-980b-db836ec71eec for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:40:00.241747 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:00.241895 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:00.241970 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:00.242080 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No VIF found with MAC fa:16:3e:3c:c4:ae, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:40:00.285927 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:00.289071 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:40:00.304962 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-102dd545-9e0a-41c8-b980-0952500923d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.722s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:00.792645 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999721407999914 future=<Future at 0x721850378d40 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:00.792967 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999475053999959 future=<Future at 0x721850378d40 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:00.792967 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999347201999853 future=<Future at 0x721850378d40 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:01.090755 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Found WWN 3300000000053c6c9 for multipath device dm-15 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:40:01.091078 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:01.091282 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] <== connect_volume: return (5951ms) {'type': 'block', 'scsi_wwn': '3300000000053c6c9', 'path': '/dev/dm-15', 'multipath_id': '3300000000053c6c9'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:01.091458 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000053c6c9', 'path': '/dev/dm-15', 'multipath_id': '3300000000053c6c9'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:40:01.091924 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.914s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:01.092397 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:40:01.092619 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:40:01.094879 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lazy-loading 'flavor' on Instance uuid 87e8e02e-e385-418c-be0c-bb25a377d081 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:01.126069 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:01.126069 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:01.126069 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:40:01.126069 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:40:01.126069 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:40:01.126069 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:40:01.126069 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:01.126069 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:01.126069 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:01.126069 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:01.126069 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:01.126069 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:01.126069 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:01.126069 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:01.126069 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:01.126069 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:01.126069 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:01.126501 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:01.126501 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:01.126501 np0000001025 nova-compute[97981]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:40:01.126501 np0000001025 nova-compute[97981]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2 (non-flash)
May 19 04:40:01.126501 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:40:01.126501 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:40:01.126501 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:01.126501 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:01.126501 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:01.126501 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:01.126501 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:01.126501 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:01.126501 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:01.126501 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:01.126501 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:01.126501 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:01.126501 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:01.126914 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', '59'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', '60'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', '62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c', '66'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c', '67'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', '68'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '71'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', '72'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', '73')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:40:01.126914 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', '60')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:01.128806 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2', '59')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:01.130794 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185012dc60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2'): ({'sdb'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:40:01.131042 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Removing multipathed devices sdc, sdb {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:40:01.131378 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Flush multipath device 330000000d2175c04 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:40:01.159739 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:40:01.209766 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:40:01.252704 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:40:01.253118 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:40:01.256717 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:40:01.270101 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:40:01.270355 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:40:01.285825 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:01.329899 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2, portal: 192.168.40.100,3260]
May 19 04:40:01.329899 np0000001025 nova-compute[97981]: Logout of [sid: 60, target: iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2, portal: 192.168.40.100,3260] successful.
May 19 04:40:01.329899 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:01.355041 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:01.370213 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:01.413675 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2, portal: 192.168.50.100,3260]
May 19 04:40:01.413675 np0000001025 nova-compute[97981]: Logout of [sid: 59, target: iqn.2023-03.storpool.com:os--volume-de39af6d-0810-4cc6-af4b-fd4602ea4ea2, portal: 192.168.50.100,3260] successful.
May 19 04:40:01.413675 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:01.435206 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:01.435434 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:01.435578 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] <== disconnect_volume: return (3257ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:01.435736 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:40:01.437599 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.833s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:01.437891 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a12d997-15f6-4776-89f7-965ae348fbb1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:40:01.438018 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:40:01.477373 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:01.477373 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:01.477373 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:40:01.477373 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:40:01.477373 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:01.477373 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:01.477373 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:01.477373 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:01.477373 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:01.477373 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:01.477373 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:01.477373 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:01.477373 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:01.477373 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:01.477373 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:01.478050 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:01.478050 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:01.478050 np0000001025 nova-compute[97981]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:40:01.478050 np0000001025 nova-compute[97981]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1 (non-flash)
May 19 04:40:01.478050 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:01.478050 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:01.478050 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:01.478050 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:01.478050 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:01.478050 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:01.478050 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:01.478050 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:01.478050 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:01.478050 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:01.478050 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:01.478050 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', '62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c', '66'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c', '67'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', '68'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '71'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', '72'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', '73')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:40:01.478050 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', '61')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:01.479072 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1', '62')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:01.480084 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185013b060>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1'): ({'sde'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:40:01.480462 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Removing multipathed devices sde, sdd {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:40:01.480618 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Flush multipath device 330000000ea42bea5 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:40:01.529620 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:40:01.593257 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:40:01.599727 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Attempting to attach volume 48aece7a-6fef-499d-ac1b-f3aa37ac8b16 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:40:01.601796 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:40:01.601796 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:40:01.601796 np0000001025 nova-compute[97981]:   <alias name="ua-48aece7a-6fef-499d-ac1b-f3aa37ac8b16"/>
May 19 04:40:01.601796 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-15"/>
May 19 04:40:01.601796 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:40:01.601796 np0000001025 nova-compute[97981]:   <serial>48aece7a-6fef-499d-ac1b-f3aa37ac8b16</serial>
May 19 04:40:01.601796 np0000001025 nova-compute[97981]: </disk>
May 19 04:40:01.601796 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:40:01.621700 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:01.649730 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:40:01.649971 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:40:01.651511 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:40:01.665620 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:40:01.665909 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:40:01.679502 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:01.726437 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1, portal: 192.168.40.100,3260]
May 19 04:40:01.726437 np0000001025 nova-compute[97981]: Logout of [sid: 61, target: iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1, portal: 192.168.40.100,3260] successful.
May 19 04:40:01.726437 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:01.769654 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:01.785768 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:01.795619 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bd9e101f-ff63-4e26-a01a-003a01da84cf tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.501s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:01.797434 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.174s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:01.833880 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1, portal: 192.168.50.100,3260]
May 19 04:40:01.833880 np0000001025 nova-compute[97981]: Logout of [sid: 62, target: iqn.2023-03.storpool.com:os--volume-2a12d997-15f6-4776-89f7-965ae348fbb1, portal: 192.168.50.100,3260] successful.
May 19 04:40:01.833880 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:01.854321 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:01.854590 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:01.854772 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] <== disconnect_volume: return (2250ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:01.854928 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:40:01.855232 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Deleting instance files /opt/stack/data/nova/instances/11a634a9-3bdd-4085-abc2-a0ad70710975_del
May 19 04:40:01.855743 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Deletion of /opt/stack/data/nova/instances/11a634a9-3bdd-4085-abc2-a0ad70710975_del complete
May 19 04:40:01.989949 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lazy-loading 'flavor' on Instance uuid 6cd7138c-f217-4858-8941-89693e62ae6e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:02.280568 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0a9b1ff4-06af-48c5-8e93-890998465ff6 req-974be6d7-0411-41df-99ff-979e514d6a43 service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Received event network-changed-b9855804-ae85-4e19-b3c0-586032713aff {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:02.283691 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0a9b1ff4-06af-48c5-8e93-890998465ff6 req-974be6d7-0411-41df-99ff-979e514d6a43 service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Refreshing instance network info cache due to event network-changed-b9855804-ae85-4e19-b3c0-586032713aff. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:40:02.283691 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0a9b1ff4-06af-48c5-8e93-890998465ff6 req-974be6d7-0411-41df-99ff-979e514d6a43 service nova] Acquiring lock "refresh_cache-b32b8038-72c4-443c-aea3-07cd61ad67f6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:40:02.283691 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0a9b1ff4-06af-48c5-8e93-890998465ff6 req-974be6d7-0411-41df-99ff-979e514d6a43 service nova] Acquired lock "refresh_cache-b32b8038-72c4-443c-aea3-07cd61ad67f6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:40:02.283691 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-0a9b1ff4-06af-48c5-8e93-890998465ff6 req-974be6d7-0411-41df-99ff-979e514d6a43 service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Refreshing network info cache for port b9855804-ae85-4e19-b3c0-586032713aff {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:40:02.301345 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lazy-loading 'flavor' on Instance uuid aa2cdf1d-65ef-4cf4-b742-72ae783cde27 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:02.311566 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "b32b8038-72c4-443c-aea3-07cd61ad67f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:02.311698 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:02.361717 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Took 3.63 seconds to destroy the instance on the hypervisor.
May 19 04:40:02.362310 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:40:02.362606 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:40:02.362739 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:40:02.362983 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:02.425136 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:02.786285 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-0a9b1ff4-06af-48c5-8e93-890998465ff6 req-974be6d7-0411-41df-99ff-979e514d6a43 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:02.814526 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'flavor' on Instance uuid b32b8038-72c4-443c-aea3-07cd61ad67f6 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:02.946848 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1928ff1b-3ead-49c3-af7f-1a9bfe08aa2b req-5cfd97c0-d289-4234-b9e9-610ae9ba7f93 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Received event network-vif-deleted-c20ef5b7-7e77-4061-980b-db836ec71eec {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:02.947097 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-1928ff1b-3ead-49c3-af7f-1a9bfe08aa2b req-5cfd97c0-d289-4234-b9e9-610ae9ba7f93 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Neutron deleted interface c20ef5b7-7e77-4061-980b-db836ec71eec; detaching it from the instance and deleting it from the info cache
May 19 04:40:02.947354 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1928ff1b-3ead-49c3-af7f-1a9bfe08aa2b req-5cfd97c0-d289-4234-b9e9-610ae9ba7f93 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:02.997098 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e13f000e-3b92-4af9-bdb7-e65bcc007537 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "6cd7138c-f217-4858-8941-89693e62ae6e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.028s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:03.128513 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-0a9b1ff4-06af-48c5-8e93-890998465ff6 req-974be6d7-0411-41df-99ff-979e514d6a43 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:03.194000 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:03.258131 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-0a9b1ff4-06af-48c5-8e93-890998465ff6 req-974be6d7-0411-41df-99ff-979e514d6a43 service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Updated VIF entry in instance network info cache for port b9855804-ae85-4e19-b3c0-586032713aff. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:40:03.258131 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-0a9b1ff4-06af-48c5-8e93-890998465ff6 req-974be6d7-0411-41df-99ff-979e514d6a43 service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Updating instance_info_cache with network_info: [{"id": "b9855804-ae85-4e19-b3c0-586032713aff", "address": "fa:16:3e:0e:aa:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9855804-ae", "ovs_interfaceid": "b9855804-ae85-4e19-b3c0-586032713aff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:03.273100 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:03.273399 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:03.273910 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:03.274009 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] No VIF found with MAC fa:16:3e:16:6b:7e, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:40:03.308528 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:03.311340 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:03.451314 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1928ff1b-3ead-49c3-af7f-1a9bfe08aa2b req-5cfd97c0-d289-4234-b9e9-610ae9ba7f93 service nova] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Detach interface failed, port_id=c20ef5b7-7e77-4061-980b-db836ec71eec, reason: Instance 11a634a9-3bdd-4085-abc2-a0ad70710975 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:40:03.524682 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "6cd7138c-f217-4858-8941-89693e62ae6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:03.524814 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "6cd7138c-f217-4858-8941-89693e62ae6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:03.524996 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:03.525180 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:03.525318 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:03.527605 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Terminating instance
May 19 04:40:03.758771 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0a9b1ff4-06af-48c5-8e93-890998465ff6 req-974be6d7-0411-41df-99ff-979e514d6a43 service nova] Releasing lock "refresh_cache-b32b8038-72c4-443c-aea3-07cd61ad67f6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:40:03.759144 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0a9b1ff4-06af-48c5-8e93-890998465ff6 req-974be6d7-0411-41df-99ff-979e514d6a43 service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Received event network-changed-451d5caa-1b64-4a79-8aea-b1fa65cf3131 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:03.759324 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0a9b1ff4-06af-48c5-8e93-890998465ff6 req-974be6d7-0411-41df-99ff-979e514d6a43 service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Refreshing instance network info cache due to event network-changed-451d5caa-1b64-4a79-8aea-b1fa65cf3131. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:40:03.759535 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0a9b1ff4-06af-48c5-8e93-890998465ff6 req-974be6d7-0411-41df-99ff-979e514d6a43 service nova] Acquiring lock "refresh_cache-e644a772-cf7c-4b15-b21b-ea54e773a1f9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:40:03.759712 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0a9b1ff4-06af-48c5-8e93-890998465ff6 req-974be6d7-0411-41df-99ff-979e514d6a43 service nova] Acquired lock "refresh_cache-e644a772-cf7c-4b15-b21b-ea54e773a1f9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:40:03.759867 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-0a9b1ff4-06af-48c5-8e93-890998465ff6 req-974be6d7-0411-41df-99ff-979e514d6a43 service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Refreshing network info cache for port 451d5caa-1b64-4a79-8aea-b1fa65cf3131 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:40:03.812557 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Took 1.45 seconds to deallocate network for instance.
May 19 04:40:03.823719 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:04.030980 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:40:04.055554 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:04.083975 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:04.193638 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:04.200191 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:04.209171 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:04.209459 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:04.209647 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Attaching volume 1497a529-407f-487e-a103-bfd3abdbb8e4 to /dev/vdc
May 19 04:40:04.237200 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-547235da-33e1-4699-a44a-515a3ab02094 req-912fb9b9-80c8-457e-a578-b10176872908 service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Received event network-vif-unplugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:04.237862 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-547235da-33e1-4699-a44a-515a3ab02094 req-912fb9b9-80c8-457e-a578-b10176872908 service nova] Acquiring lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:04.238031 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-547235da-33e1-4699-a44a-515a3ab02094 req-912fb9b9-80c8-457e-a578-b10176872908 service nova] Lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:04.238203 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-547235da-33e1-4699-a44a-515a3ab02094 req-912fb9b9-80c8-457e-a578-b10176872908 service nova] Lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:04.238352 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-547235da-33e1-4699-a44a-515a3ab02094 req-912fb9b9-80c8-457e-a578-b10176872908 service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] No waiting events found dispatching network-vif-unplugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:40:04.238513 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-547235da-33e1-4699-a44a-515a3ab02094 req-912fb9b9-80c8-457e-a578-b10176872908 service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Received event network-vif-unplugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:40:04.261973 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-0a9b1ff4-06af-48c5-8e93-890998465ff6 req-974be6d7-0411-41df-99ff-979e514d6a43 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:04.266978 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:04.284934 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:40:04.309582 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:04.368312 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:40:04.369380 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:40:04.385341 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:40:04.388496 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.99686012899997 future=<Future at 0x721850759c10 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:04.389339 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:fe16:6b7e', 'fe80::6898:26ff:fe86:46b0', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe75:10d8', 'fe80::946f:41ff:fe06:ab72', 'fe80::fc16:3eff:fee2:ca8e', 'fe80::bc20:d2ff:fef5:7278', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fef1:293e', 'fe80::8849:6dff:fe86:4a4b', 'fe80::fc16:3eff:fea1:aa43'] 
May 19 04:40:04.389492 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:40:04.389669 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:40:04.390448 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:04.390853 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Updating existing volume attachment record: 227bed17-2e5b-461b-a6cb-abb301eb4eae {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:40:04.400673 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Took 0.59 seconds to detach 1 volumes for instance.
May 19 04:40:04.403561 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Instance destroyed successfully.
May 19 04:40:04.404977 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lazy-loading 'resources' on Instance uuid 6cd7138c-f217-4858-8941-89693e62ae6e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:04.407531 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Deleting volume: 2a12d997-15f6-4776-89f7-965ae348fbb1 {{(pid=97981) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 19 04:40:04.601386 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:04.661572 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-0a9b1ff4-06af-48c5-8e93-890998465ff6 req-974be6d7-0411-41df-99ff-979e514d6a43 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:04.811799 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-0a9b1ff4-06af-48c5-8e93-890998465ff6 req-974be6d7-0411-41df-99ff-979e514d6a43 service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Updated VIF entry in instance network info cache for port 451d5caa-1b64-4a79-8aea-b1fa65cf3131. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:40:04.811799 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-0a9b1ff4-06af-48c5-8e93-890998465ff6 req-974be6d7-0411-41df-99ff-979e514d6a43 service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Updating instance_info_cache with network_info: [{"id": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "address": "fa:16:3e:a1:aa:43", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap451d5caa-1b", "ovs_interfaceid": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:04.866703 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e248509f-1e97-450f-9baa-8accbe9663a3 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "87e8e02e-e385-418c-be0c-bb25a377d081" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.505s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:04.915784 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-780352072',display_name='tempest-ServerActionsTestOtherA-server-1649255047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-tempest-common-compute-instance-780352072',id=23,image_ref='77cbe94e-3270-472e-a2a4-99ad3be8837f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWjOIOVsMyvCxHSFbUg/KisSEpUltBBUDn7k40MoaIFEqu0hiq0xGxCl65mWduVoYJ4X6DBai5dMDbW4PlxibjrzT90yPIjDM/NptUDmKdJDlF8xak6SVAX4dfbERZ5hw==',key_name='tempest-keypair-1176894162',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:39:17Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='336d55ae51114828ba5ad8c0ac87ca9b',ramdisk_id='',reservation_id='r-roxanvg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='77cbe94e-3270-472e-a2a4-99ad3be8837f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-281327203',owner_user_name='tempest-ServerActionsTestOtherA-281327203-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:39:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6374f2e55af946f9abf35d0c8a1cd206',uuid=6cd7138c-f217-4858-8941-89693e62ae6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "address": "fa:16:3e:8e:26:b9", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ea210-38", "ovs_interfaceid": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:40:04.916314 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converting VIF {"id": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "address": "fa:16:3e:8e:26:b9", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap919ea210-38", "ovs_interfaceid": "919ea210-38da-46cf-9d56-5cbcf6a822a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:40:04.917010 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:26:b9,bridge_name='br-int',has_traffic_filtering=True,id=919ea210-38da-46cf-9d56-5cbcf6a822a6,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919ea210-38') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:40:04.917249 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:26:b9,bridge_name='br-int',has_traffic_filtering=True,id=919ea210-38da-46cf-9d56-5cbcf6a822a6,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919ea210-38') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:40:04.919550 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:04.919911 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap919ea210-38, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:04.921484 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:04.926251 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:04.927208 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:04.927395 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd7ea7a6-c178-49d6-829c-a79353b5d9a9) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:04.928157 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:04.928816 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:04.930846 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:04.932794 np0000001025 nova-compute[97981]: INFO os_vif [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:26:b9,bridge_name='br-int',has_traffic_filtering=True,id=919ea210-38da-46cf-9d56-5cbcf6a822a6,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap919ea210-38')
May 19 04:40:04.933217 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Deleting instance files /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e_del
May 19 04:40:04.933956 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Deletion of /opt/stack/data/nova/instances/6cd7138c-f217-4858-8941-89693e62ae6e_del complete
May 19 04:40:04.940693 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "b32b8038-72c4-443c-aea3-07cd61ad67f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:04.940914 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:04.941117 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Attaching volume c6c2c4b5-04b6-4084-ab2f-2487d1148c47 to /dev/vdb
May 19 04:40:04.953780 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:04.953976 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:04.995381 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:05.011553 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:40:05.025516 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1497a529-407f-487e-a103-bfd3abdbb8e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'aa2cdf1d-65ef-4cf4-b742-72ae783cde27', 'attached_at': '', 'detached_at': '', 'volume_id': '1497a529-407f-487e-a103-bfd3abdbb8e4', 'serial': '1497a529-407f-487e-a103-bfd3abdbb8e4'} {{(pid=97981) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 19 04:40:05.028219 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:40:05.028585 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1497a529-407f-487e-a103-bfd3abdbb8e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:05.028767 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:05.029242 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:05.029598 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1497a529-407f-487e-a103-bfd3abdbb8e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:40:05.035568 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:05.055134 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:05.056939 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:05.058230 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:05.058773 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:40:05.059652 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:05.062122 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:40:05.076581 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:40:05.076581 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:05.077943 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:40:05.079128 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:40:05.082418 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:40:05.082418 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:05.094984 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4] added
May 19 04:40:05.094984 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:40:05.094984 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:05.094984 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:05.094984 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:05.094984 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:05.094984 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:05.095250 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:40:05.095329 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0368(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:40:05.095522 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:40:05.099174 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:40:05.099174 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:fe16:6b7e', 'fe80::6898:26ff:fe86:46b0', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe75:10d8', 'fe80::946f:41ff:fe06:ab72', 'fe80::fc16:3eff:fee2:ca8e', 'fe80::bc20:d2ff:fef5:7278', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fef1:293e', 'fe80::8849:6dff:fe86:4a4b', 'fe80::fc16:3eff:fea1:aa43'] 
May 19 04:40:05.099383 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:40:05.099383 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:40:05.099553 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:05.099732 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Updating existing volume attachment record: 883d6c07-facd-4133-a36f-10176328ec1d {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:40:05.107403 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4] added
May 19 04:40:05.107403 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:40:05.107403 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:05.107403 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:05.107403 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:05.107403 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:05.107403 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:05.107909 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:40:05.108218 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0483(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:40:05.108638 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:40:05.314021 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0a9b1ff4-06af-48c5-8e93-890998465ff6 req-974be6d7-0411-41df-99ff-979e514d6a43 service nova] Releasing lock "refresh_cache-e644a772-cf7c-4b15-b21b-ea54e773a1f9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:40:05.441159 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Took 1.41 seconds to destroy the instance on the hypervisor.
May 19 04:40:05.441858 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:40:05.442086 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:40:05.442243 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:40:05.442552 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:05.523354 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:05.657888 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:40:05.658205 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:40:05.669378 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:40:05.669833 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:05.670130 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:05.774148 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "87e8e02e-e385-418c-be0c-bb25a377d081" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:05.774468 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "87e8e02e-e385-418c-be0c-bb25a377d081" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:06.095979 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:40:06.107155 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:40:06.107155 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:06.110426 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:40:06.118960 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:40:06.125357 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:40:06.125357 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:06.139275 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:06.139275 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:06.139275 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:06.139275 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:06.139275 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:06.139275 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:06.139275 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:06.139275 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:06.139275 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:06.139275 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:06.139275 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:06.139275 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:06.139275 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:06.139970 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:06.139970 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:06.139970 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:06.139970 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:06.139970 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:06.139970 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:06.139970 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:06.139970 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:06.139970 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:06.139970 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:06.139970 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:06.139970 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:06.139970 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:06.140357 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:06.158554 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:06.158554 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:06.158554 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:06.158554 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:06.158554 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:06.158554 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:06.158554 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:06.158554 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:06.158554 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:06.158554 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:06.158554 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:06.158554 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:06.158554 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:06.158878 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:06.158878 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:06.158878 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:06.158878 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:06.158878 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:06.158878 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:06.158878 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:06.158878 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:06.158878 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:06.158878 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:06.158878 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:06.158878 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:06.158878 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:06.164191 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:40:06.199325 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4, portal: 192.168.40.100,3260]
May 19 04:40:06.199325 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4, portal: 192.168.40.100,3260] successful.
May 19 04:40:06.199325 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:06.215238 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:06.225118 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4, portal: 192.168.50.100,3260]
May 19 04:40:06.225118 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4, portal: 192.168.50.100,3260] successful.
May 19 04:40:06.225118 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:06.237444 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:06.238015 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:06.238015 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:06.238100 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:40:06.240033 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] HCTL ('7', '-', '-', 0) found on session 74 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:40:06.240232 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:40:06.258362 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Searching for a device in session 74 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:40:06.258362 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1497a529-407f-487e-a103-bfd3abdbb8e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:06.270706 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:06.271695 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.212s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:06.271894 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:40:06.274229 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] HCTL ('8', '-', '-', 0) found on session 75 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:40:06.274229 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:40:06.279610 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lazy-loading 'flavor' on Instance uuid 87e8e02e-e385-418c-be0c-bb25a377d081 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:06.297816 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Searching for a device in session 75 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:40:06.297816 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1497a529-407f-487e-a103-bfd3abdbb8e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:40:06.333741 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c1cd9b82-5145-4cef-8858-3238fc1e010d req-0a659af0-5191-4bbf-aac9-79b71cfc4f8f service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Received event network-vif-unplugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:06.334650 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c1cd9b82-5145-4cef-8858-3238fc1e010d req-0a659af0-5191-4bbf-aac9-79b71cfc4f8f service nova] Acquiring lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:06.334900 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c1cd9b82-5145-4cef-8858-3238fc1e010d req-0a659af0-5191-4bbf-aac9-79b71cfc4f8f service nova] Lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:06.335057 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c1cd9b82-5145-4cef-8858-3238fc1e010d req-0a659af0-5191-4bbf-aac9-79b71cfc4f8f service nova] Lock "6cd7138c-f217-4858-8941-89693e62ae6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:06.335239 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c1cd9b82-5145-4cef-8858-3238fc1e010d req-0a659af0-5191-4bbf-aac9-79b71cfc4f8f service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] No waiting events found dispatching network-vif-unplugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:40:06.335384 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c1cd9b82-5145-4cef-8858-3238fc1e010d req-0a659af0-5191-4bbf-aac9-79b71cfc4f8f service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Received event network-vif-unplugged-919ea210-38da-46cf-9d56-5cbcf6a822a6 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:40:06.335517 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c1cd9b82-5145-4cef-8858-3238fc1e010d req-0a659af0-5191-4bbf-aac9-79b71cfc4f8f service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Received event network-vif-deleted-919ea210-38da-46cf-9d56-5cbcf6a822a6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:06.335685 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-c1cd9b82-5145-4cef-8858-3238fc1e010d req-0a659af0-5191-4bbf-aac9-79b71cfc4f8f service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Neutron deleted interface 919ea210-38da-46cf-9d56-5cbcf6a822a6; detaching it from the instance and deleting it from the info cache
May 19 04:40:06.335807 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c1cd9b82-5145-4cef-8858-3238fc1e010d req-0a659af0-5191-4bbf-aac9-79b71cfc4f8f service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:06.470354 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:06.678623 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.725s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:06.722961 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Deleted allocations for instance 11a634a9-3bdd-4085-abc2-a0ad70710975
May 19 04:40:06.840928 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c1cd9b82-5145-4cef-8858-3238fc1e010d req-0a659af0-5191-4bbf-aac9-79b71cfc4f8f service nova] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Detach interface failed, port_id=919ea210-38da-46cf-9d56-5cbcf6a822a6, reason: Instance 6cd7138c-f217-4858-8941-89693e62ae6e could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:40:06.972303 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Took 1.53 seconds to deallocate network for instance.
May 19 04:40:07.061055 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:40:07.284829 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "87e8e02e-e385-418c-be0c-bb25a377d081" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:07.479984 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:07.480195 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:07.732253 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4dd7c7b1-f86c-42fd-8113-fa177dd3d112 tempest-ServerActionsV293TestJSON-1582643744 tempest-ServerActionsV293TestJSON-1582643744-project-member] Lock "11a634a9-3bdd-4085-abc2-a0ad70710975" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.506s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:08.054121 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:40:08.054384 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:40:08.081917 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Found WWN 330000000acf53476 for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:40:08.082350 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.053s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:08.083365 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.413s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:08.083532 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:40:08.084033 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] <== connect_volume: return (3055ms) {'type': 'block', 'scsi_wwn': '330000000acf53476', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000acf53476'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:08.084281 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000acf53476', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000acf53476'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:40:08.093345 np0000001025 nova-compute[97981]: WARNING stevedore.named [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 19 04:40:08.093613 np0000001025 nova-compute[97981]: WARNING castellan.key_manager [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:40:08.093697 np0000001025 nova-compute[97981]: WARNING nova.keymgr.conf_key_mgr [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:40:08.104277 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:08.105146 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:08.106811 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:08.107022 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:40:08.108498 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:08.108693 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:40:08.122997 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:40:08.122997 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:08.130078 np0000001025 nova-compute[97981]: WARNING os_brick.encryptors.luks [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 19 04:40:08.130078 np0000001025 nova-compute[97981]: WARNING stevedore.named [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 19 04:40:08.130405 np0000001025 nova-compute[97981]: WARNING castellan.key_manager [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:40:08.130453 np0000001025 nova-compute[97981]: WARNING nova.keymgr.conf_key_mgr [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:40:08.131045 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x721834416d50>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1497a529-407f-487e-a103-bfd3abdbb8e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'aa2cdf1d-65ef-4cf4-b742-72ae783cde27', 'attached_at': '', 'detached_at': '', 'volume_id': '1497a529-407f-487e-a103-bfd3abdbb8e4', 'serial': '1497a529-407f-487e-a103-bfd3abdbb8e4'} {{(pid=97981) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 19 04:40:08.131270 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors.luks [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] formatting encrypted volume /dev/dm-0 {{(pid=97981) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 19 04:40:08.137537 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:40:08.137537 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:08.142586 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47] added
May 19 04:40:08.142586 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:40:08.142586 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:08.142586 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:08.142586 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:08.142586 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:08.142586 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:08.143021 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:40:08.143021 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0359(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:40:08.143161 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:40:08.150688 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47] added
May 19 04:40:08.150688 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:40:08.150688 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:08.150688 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:08.150688 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:08.150688 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:08.150688 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:08.151303 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:40:08.151303 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0424(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:40:08.151303 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:40:08.197771 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:08.364068 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "87e8e02e-e385-418c-be0c-bb25a377d081" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:08.364655 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "87e8e02e-e385-418c-be0c-bb25a377d081" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:08.364728 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Attaching volume 3d33411d-7cc5-4e9d-a217-fd0909091806 to /dev/vdc
May 19 04:40:08.401439 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:08.412840 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:40:08.438048 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:08.487524 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:40:08.487881 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:40:08.496240 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:40:08.497982 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:fe16:6b7e', 'fe80::6898:26ff:fe86:46b0', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe75:10d8', 'fe80::946f:41ff:fe06:ab72', 'fe80::fc16:3eff:fee2:ca8e', 'fe80::bc20:d2ff:fef5:7278', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fef1:293e', 'fe80::8849:6dff:fe86:4a4b', 'fe80::fc16:3eff:fea1:aa43'] 
May 19 04:40:08.498208 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:40:08.498208 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:40:08.498556 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:08.498864 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Updating existing volume attachment record: 1dd50dbb-0b48-4453-b81b-b44517c58436 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:40:08.557588 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:40:09.061098 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:40:09.061542 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3d33411d-7cc5-4e9d-a217-fd0909091806', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:09.061751 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:09.066750 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.586s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:09.120299 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Deleted allocations for instance 6cd7138c-f217-4858-8941-89693e62ae6e
May 19 04:40:09.143746 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:40:09.151939 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:40:09.163624 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:40:09.163624 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:40:09.172786 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:40:09.172786 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:09.178963 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:09.186393 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:09.202011 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:09.215799 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:09.215799 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:09.215799 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:09.215799 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:09.215799 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:09.215799 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:09.215799 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:09.215799 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:09.215799 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:09.215799 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:09.215799 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:09.215799 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:09.215799 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:09.215799 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:09.215799 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:09.216292 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:09.216292 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:09.216292 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:09.216292 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:09.216292 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:09.216292 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:09.216292 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:09.216292 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:09.216292 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:09.216292 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:09.216292 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:09.216292 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:09.216292 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:09.216292 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:09.216292 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:09.276980 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47, portal: 192.168.40.100,3260]
May 19 04:40:09.276980 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47, portal: 192.168.40.100,3260] successful.
May 19 04:40:09.276980 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:09.292679 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47, portal: 192.168.50.100,3260]
May 19 04:40:09.292679 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47, portal: 192.168.50.100,3260] successful.
May 19 04:40:09.292679 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:09.294322 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:09.307950 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:09.331289 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:09.331289 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:09.331289 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:09.331289 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:09.331289 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:09.331289 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:09.331289 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:09.331289 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:09.331289 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:09.331289 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:09.331289 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:09.331289 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:09.331289 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:09.331289 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:09.331289 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:09.331289 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:09.331289 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:09.331650 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:09.331650 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:09.331650 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:09.331650 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:09.331650 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:09.331650 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:09.331650 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:09.331650 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:09.331650 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:09.331650 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:09.331650 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:09.331650 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:09.331650 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:09.331650 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:09.331650 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:09.331650 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:09.331650 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:09.332046 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.225s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:09.332046 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:40:09.345444 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] HCTL ('9', '-', '-', 0) found on session 76 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:40:09.345444 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:40:09.355783 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:09.355783 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:09.355783 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:09.355783 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:09.355783 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:09.355783 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:09.355783 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:09.355783 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:09.355783 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:09.355783 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:09.355783 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:09.355783 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:09.355783 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:09.355783 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:09.355783 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:09.355783 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:09.355783 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:09.356309 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:09.356309 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:09.356309 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:09.356309 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:09.356309 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:09.356309 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:09.356309 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:09.356309 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:09.356309 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:09.356309 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:09.356309 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:09.356309 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:09.356309 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:09.356309 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:09.356309 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:09.356309 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:09.356309 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:09.356309 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.248s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:09.356309 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:40:09.357969 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] HCTL ('10', '-', '-', 0) found on session 77 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:40:09.358458 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:40:09.367275 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching for a device in session 76 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:40:09.367797 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:40:09.377867 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching for a device in session 77 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:40:09.378067 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:40:09.495769 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:09.928154 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:10.110233 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:40:10.141399 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5853c034-c74d-446f-87d4-d1614e48c523 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "6cd7138c-f217-4858-8941-89693e62ae6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.614s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:10.631902 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:10.632343 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:11.133764 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Found WWN 330000000de3b6c24 for multipath device dm-1 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:40:11.134128 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.051s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:11.134400 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] <== connect_volume: return (5464ms) {'type': 'block', 'scsi_wwn': '330000000de3b6c24', 'path': '/dev/dm-1', 'multipath_id': '330000000de3b6c24'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:11.134597 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000de3b6c24', 'path': '/dev/dm-1', 'multipath_id': '330000000de3b6c24'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:40:11.136252 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Detaching volume 5afb0a3d-3c54-47c8-a9e0-fed41297513c
May 19 04:40:11.137808 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.075s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:11.138144 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3d33411d-7cc5-4e9d-a217-fd0909091806', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:40:11.145023 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'flavor' on Instance uuid b32b8038-72c4-443c-aea3-07cd61ad67f6 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:11.154218 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:11.154699 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:11.155242 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:11.155440 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:40:11.155803 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:11.156151 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:40:11.169069 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:40:11.169069 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:11.176570 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:40:11.176570 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:11.188465 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806] added
May 19 04:40:11.188465 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:40:11.188465 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:11.188465 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:11.188465 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:11.188465 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:11.188465 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:11.188662 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:40:11.188860 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0334(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:40:11.189269 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:40:11.199940 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806] added
May 19 04:40:11.199940 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:40:11.199940 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:11.199940 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:11.199940 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:11.199940 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:11.199940 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:11.200249 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:40:11.200424 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0444(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:40:11.200608 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:40:11.211227 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Attempting to driver detach volume 5afb0a3d-3c54-47c8-a9e0-fed41297513c from mountpoint /dev/vdc
May 19 04:40:11.216044 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Found disk vdc by alias ua-5afb0a3d-3c54-47c8-a9e0-fed41297513c {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:40:11.217997 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Found disk vdc by alias ua-5afb0a3d-3c54-47c8-a9e0-fed41297513c {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:40:11.218153 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Attempting to detach device vdc from instance e415a06a-1c69-49b7-9bd3-f68ce343b0b7 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:40:11.218465 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:40:11.218465 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:40:11.218465 np0000001025 nova-compute[97981]:   <alias name="ua-5afb0a3d-3c54-47c8-a9e0-fed41297513c"/>
May 19 04:40:11.218465 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-10"/>
May 19 04:40:11.218465 np0000001025 nova-compute[97981]:   <target dev="vdc" bus="virtio"/>
May 19 04:40:11.218465 np0000001025 nova-compute[97981]:   <serial>5afb0a3d-3c54-47c8-a9e0-fed41297513c</serial>
May 19 04:40:11.218465 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 19 04:40:11.218465 np0000001025 nova-compute[97981]: </disk>
May 19 04:40:11.218465 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:40:11.224170 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Successfully detached device vdc from instance e415a06a-1c69-49b7-9bd3-f68ce343b0b7 from the persistent domain config.
May 19 04:40:11.225703 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] (1/8): Attempting to detach device vdc with device alias ua-5afb0a3d-3c54-47c8-a9e0-fed41297513c from instance e415a06a-1c69-49b7-9bd3-f68ce343b0b7 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:40:11.226039 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:40:11.226039 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:40:11.226039 np0000001025 nova-compute[97981]:   <alias name="ua-5afb0a3d-3c54-47c8-a9e0-fed41297513c"/>
May 19 04:40:11.226039 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-10"/>
May 19 04:40:11.226039 np0000001025 nova-compute[97981]:   <target dev="vdc" bus="virtio"/>
May 19 04:40:11.226039 np0000001025 nova-compute[97981]:   <serial>5afb0a3d-3c54-47c8-a9e0-fed41297513c</serial>
May 19 04:40:11.226039 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 19 04:40:11.226039 np0000001025 nova-compute[97981]: </disk>
May 19 04:40:11.226039 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:40:11.648396 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Attempting to attach volume c6c2c4b5-04b6-4084-ab2f-2487d1148c47 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:40:11.650000 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:40:11.650000 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:40:11.650000 np0000001025 nova-compute[97981]:   <alias name="ua-c6c2c4b5-04b6-4084-ab2f-2487d1148c47"/>
May 19 04:40:11.650000 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-1"/>
May 19 04:40:11.650000 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:40:11.650000 np0000001025 nova-compute[97981]:   <serial>c6c2c4b5-04b6-4084-ab2f-2487d1148c47</serial>
May 19 04:40:11.650000 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:40:11.650000 np0000001025 nova-compute[97981]: </disk>
May 19 04:40:11.650000 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:40:11.896471 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165611.896075, e415a06a-1c69-49b7-9bd3-f68ce343b0b7 => ua-5afb0a3d-3c54-47c8-a9e0-fed41297513c> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:40:11.896787 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-5afb0a3d-3c54-47c8-a9e0-fed41297513c for instance e415a06a-1c69-49b7-9bd3-f68ce343b0b7 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:40:11.899513 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Successfully detached device vdc from instance e415a06a-1c69-49b7-9bd3-f68ce343b0b7 from the live domain config.
May 19 04:40:11.901344 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:40:11.901604 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c', 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5afb0a3d-3c54-47c8-a9e0-fed41297513c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:11.901705 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:12.189709 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:40:12.201027 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:40:12.201908 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:40:12.201908 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:40:12.216312 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:40:12.216312 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:12.220741 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Secret XML: <secret ephemeral="no" private="no">
May 19 04:40:12.220741 np0000001025 nova-compute[97981]:   <usage type="volume">
May 19 04:40:12.220741 np0000001025 nova-compute[97981]:     <volume>1497a529-407f-487e-a103-bfd3abdbb8e4</volume>
May 19 04:40:12.220741 np0000001025 nova-compute[97981]:   </usage>
May 19 04:40:12.220741 np0000001025 nova-compute[97981]: </secret>
May 19 04:40:12.220741 np0000001025 nova-compute[97981]:  {{(pid=97981) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 19 04:40:12.225567 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:12.234655 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:12.238857 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lazy-loading 'flavor' on Instance uuid aa2cdf1d-65ef-4cf4-b742-72ae783cde27 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:12.258480 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:12.258480 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:12.258480 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:12.258480 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:12.258480 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:12.258480 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:12.258480 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:12.258480 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:12.258480 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:12.258480 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:12.258480 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:12.258480 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:12.258480 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:12.258480 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:12.258480 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:12.258480 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:12.258480 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:12.259036 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:12.259036 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:12.259036 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:12.259036 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:12.259036 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:12.259036 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:12.259036 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:12.259036 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:12.259036 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:12.259036 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:12.259036 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:12.259036 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:12.259036 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:12.259036 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:12.259036 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:12.259036 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:12.259036 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:12.264014 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:12.264014 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:12.264014 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:12.264014 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:12.264014 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:12.264014 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:12.264014 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:12.264014 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:12.264014 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:12.264014 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:12.264014 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:12.264014 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:12.264014 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:12.264014 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:12.264014 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:12.264014 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:12.264014 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:12.264638 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:12.264638 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:12.264638 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:12.264638 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:12.264638 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:12.264638 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:12.264638 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:12.264638 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:12.264638 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:12.264638 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:12.264638 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:12.264638 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:12.264638 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:12.264638 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:12.264638 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:12.264638 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:12.264638 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:12.321053 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806, portal: 192.168.40.100,3260]
May 19 04:40:12.321053 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806, portal: 192.168.40.100,3260] successful.
May 19 04:40:12.321053 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:12.327919 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806, portal: 192.168.50.100,3260]
May 19 04:40:12.327919 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806, portal: 192.168.50.100,3260] successful.
May 19 04:40:12.327919 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:12.335205 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:12.342610 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:12.357330 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:12.357330 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:12.357330 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:12.357330 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:12.357330 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:12.357330 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:12.357330 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:12.357330 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:12.357330 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:12.357330 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:12.357330 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:12.357330 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:12.357330 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:12.357330 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:12.357330 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:12.357330 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:12.357330 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:12.357330 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:12.357330 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:12.357985 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:12.357985 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:12.357985 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:12.357985 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:12.357985 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:12.357985 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:12.357985 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:12.357985 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:12.357985 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:12.357985 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:12.357985 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:12.357985 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:12.357985 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:12.357985 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:12.357985 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:12.357985 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:12.357985 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:12.357985 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:12.357985 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:12.357985 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:12.357985 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:40:12.359230 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] HCTL ('23', '-', '-', 0) found on session 78 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:40:12.359345 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Scanning host 23 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:12.371550 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:12.372579 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.216s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:12.372579 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:40:12.373383 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Searching for a device in session 78 and hctl ['23', '*', '*', 0] yield: sdr {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:40:12.373559 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Connected to sdr using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3d33411d-7cc5-4e9d-a217-fd0909091806', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:40:12.375059 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] HCTL ('24', '-', '-', 0) found on session 79 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:40:12.375310 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Scanning host 24 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:40:12.391644 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Searching for a device in session 79 and hctl ['24', '*', '*', 0] yield: sds {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:40:12.391644 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Connected to sds using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3d33411d-7cc5-4e9d-a217-fd0909091806', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:40:12.741624 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Attempting to attach volume 1497a529-407f-487e-a103-bfd3abdbb8e4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:40:12.742673 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:40:12.742673 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:40:12.742673 np0000001025 nova-compute[97981]:   <alias name="ua-1497a529-407f-487e-a103-bfd3abdbb8e4"/>
May 19 04:40:12.742673 np0000001025 nova-compute[97981]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 19 04:40:12.742673 np0000001025 nova-compute[97981]:   <target dev="vdc" bus="virtio"/>
May 19 04:40:12.742673 np0000001025 nova-compute[97981]:   <serial>1497a529-407f-487e-a103-bfd3abdbb8e4</serial>
May 19 04:40:12.742673 np0000001025 nova-compute[97981]:   <encryption format="luks">
May 19 04:40:12.742673 np0000001025 nova-compute[97981]:     <secret type="passphrase" uuid="c301b491-9277-438b-8aee-0f00d303d1d0"/>
May 19 04:40:12.742673 np0000001025 nova-compute[97981]:   </encryption>
May 19 04:40:12.742673 np0000001025 nova-compute[97981]: </disk>
May 19 04:40:12.742673 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:40:13.156177 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:40:13.199665 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:13.326741 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:13.326886 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:13.327009 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:13.327154 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No VIF found with MAC fa:16:3e:0e:aa:6f, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:40:13.857058 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:13.857469 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:14.171350 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Found WWN 3300000009cc8910f for multipath device dm-5 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:40:14.171543 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:14.171846 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] <== connect_volume: return (5110ms) {'type': 'block', 'scsi_wwn': '3300000009cc8910f', 'path': '/dev/dm-5', 'multipath_id': '3300000009cc8910f'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:14.172032 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009cc8910f', 'path': '/dev/dm-5', 'multipath_id': '3300000009cc8910f'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:40:14.172360 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.271s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:14.172718 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c', 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5afb0a3d-3c54-47c8-a9e0-fed41297513c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:40:14.172902 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:40:14.175422 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lazy-loading 'flavor' on Instance uuid 87e8e02e-e385-418c-be0c-bb25a377d081 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:14.204560 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:14.204560 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:14.204560 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:14.204560 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:14.204560 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:14.204560 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:14.204560 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:14.204560 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:14.204560 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:14.204560 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:14.204560 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:14.204560 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:14.204560 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:14.204560 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:14.204560 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:14.204560 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:14.204560 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:14.204560 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:14.204560 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:14.205131 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:14.205131 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:14.205131 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:14.205131 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:14.205131 np0000001025 nova-compute[97981]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:14.205131 np0000001025 nova-compute[97981]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c (non-flash)
May 19 04:40:14.205131 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:14.205131 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:14.205131 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:14.205131 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:14.205131 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:14.205131 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:14.205131 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:14.205131 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:14.205131 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:14.205131 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:14.205131 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:14.205131 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:14.205131 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:14.205131 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c', '66'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c', '67'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', '68'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '71'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', '72'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', '73'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', '78'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', '79')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:40:14.205131 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c', '67')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:14.206423 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c', '66')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:14.207476 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721850740180>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c'): ({'sdk'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:40:14.207680 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Removing multipathed devices sdk, sdl {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:40:14.207884 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Flush multipath device 33000000019518c5e {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:40:14.241601 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:40:14.298620 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:40:14.350522 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Checking to see if SCSI volumes sdk, sdl have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:40:14.350710 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] SCSI volumes sdk, sdl have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:40:14.352215 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Checking to see if device paths {'sdk', 'sdl'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:40:14.358901 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:40:14.368616 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Device paths {'sdk', 'sdl'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:40:14.368941 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:40:14.382431 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:14.422319 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c, portal: 192.168.40.100,3260]
May 19 04:40:14.422319 np0000001025 nova-compute[97981]: Logout of [sid: 67, target: iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c, portal: 192.168.40.100,3260] successful.
May 19 04:40:14.422319 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:14.447251 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:14.461413 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:14.512226 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c, portal: 192.168.50.100,3260]
May 19 04:40:14.512226 np0000001025 nova-compute[97981]: Logout of [sid: 66, target: iqn.2023-03.storpool.com:os--volume-5afb0a3d-3c54-47c8-a9e0-fed41297513c, portal: 192.168.50.100,3260] successful.
May 19 04:40:14.512226 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:14.545282 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:14.545509 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:14.545624 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] <== disconnect_volume: return (2644ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:14.545741 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:40:14.677041 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Attempting to attach volume 3d33411d-7cc5-4e9d-a217-fd0909091806 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:40:14.679698 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:40:14.679698 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:40:14.679698 np0000001025 nova-compute[97981]:   <alias name="ua-3d33411d-7cc5-4e9d-a217-fd0909091806"/>
May 19 04:40:14.679698 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-5"/>
May 19 04:40:14.679698 np0000001025 nova-compute[97981]:   <target dev="vdc" bus="virtio"/>
May 19 04:40:14.679698 np0000001025 nova-compute[97981]:   <serial>3d33411d-7cc5-4e9d-a217-fd0909091806</serial>
May 19 04:40:14.679698 np0000001025 nova-compute[97981]: </disk>
May 19 04:40:14.679698 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:40:14.887479 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e0fb1797-7d0d-4279-a6fe-ccdfd127c0bb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.946s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:14.920453 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:14.920630 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:14.923593 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:40:14.923815 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Claim successful on node np0000001025
May 19 04:40:14.929053 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:15.091291 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'flavor' on Instance uuid e415a06a-1c69-49b7-9bd3-f68ce343b0b7 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:15.201939 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-085ee234-88ef-4b57-8e0c-0befecc448f1 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "57adc083-429a-4f23-9154-7de8b6e74d8a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:15.201939 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-085ee234-88ef-4b57-8e0c-0befecc448f1 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:15.201939 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-085ee234-88ef-4b57-8e0c-0befecc448f1 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:15.206614 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-085ee234-88ef-4b57-8e0c-0befecc448f1 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=97981) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 19 04:40:15.206614 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-085ee234-88ef-4b57-8e0c-0befecc448f1 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'flavor' on Instance uuid 57adc083-429a-4f23-9154-7de8b6e74d8a {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:15.276976 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:15.276976 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:15.276976 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:15.277212 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:15.277247 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No VIF found with MAC fa:16:3e:3c:c4:ae, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:40:15.401681 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:15.401883 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:15.792964 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00044294899998931214 future=<Future at 0x721850378d40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:15.793355 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Emitting event <LifecycleEvent: 1779165600.7922223, 11a634a9-3bdd-4085-abc2-a0ad70710975 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:40:15.793513 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] VM Stopped (Lifecycle Event)
May 19 04:40:15.794813 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:15.794813 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=3.5903728709999996 future=<Future at 0x721850759c10 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:15.795150 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=3.5902620199999546 future=<Future at 0x721850759c10 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:15.905838 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'flavor' on Instance uuid e644a772-cf7c-4b15-b21b-ea54e773a1f9 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:16.097343 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ebd9ea63-cdb1-43e8-be91-41398259e98a tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.465s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:16.234736 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:16.237631 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:16.259699 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:16.259699 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:16.281302 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:16.287159 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:16.296708 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 11a634a9-3bdd-4085-abc2-a0ad70710975] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:16.347401 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:16.347401 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:16.347581 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:16.347632 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:16.347727 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] No VIF found with MAC fa:16:3e:16:6b:7e, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:40:16.433064 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-34c8c393-b378-4054-a955-874b7a194ac4 req-ad11a9dd-e044-4e08-930a-9559ea86d762 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Received event network-vif-unplugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:16.433398 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-34c8c393-b378-4054-a955-874b7a194ac4 req-ad11a9dd-e044-4e08-930a-9559ea86d762 service nova] Acquiring lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:16.433644 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-34c8c393-b378-4054-a955-874b7a194ac4 req-ad11a9dd-e044-4e08-930a-9559ea86d762 service nova] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:16.433765 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-34c8c393-b378-4054-a955-874b7a194ac4 req-ad11a9dd-e044-4e08-930a-9559ea86d762 service nova] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:16.434060 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-34c8c393-b378-4054-a955-874b7a194ac4 req-ad11a9dd-e044-4e08-930a-9559ea86d762 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] No waiting events found dispatching network-vif-unplugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:40:16.434257 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-34c8c393-b378-4054-a955-874b7a194ac4 req-ad11a9dd-e044-4e08-930a-9559ea86d762 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Received unexpected event network-vif-unplugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b for instance with vm_state active and task_state powering-off.
May 19 04:40:16.460013 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:40:16.460013 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:40:16.531087 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999784198000043 future=<Future at 0x72183443fe30 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:16.534216 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Instance destroyed successfully.
May 19 04:40:16.534216 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-085ee234-88ef-4b57-8e0c-0befecc448f1 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'numa_topology' on Instance uuid 57adc083-429a-4f23-9154-7de8b6e74d8a {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:16.832956 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-947a07bf-07ec-4e3c-bbd8-d3ea02e05c32 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.624s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:16.911355 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:16.962554 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:40:17.036606 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-085ee234-88ef-4b57-8e0c-0befecc448f1 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Object Instance<57adc083-429a-4f23-9154-7de8b6e74d8a> lazy-loaded attributes: flavor,numa_topology {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:40:17.036857 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-085ee234-88ef-4b57-8e0c-0befecc448f1 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:17.064172 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:17.064395 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:17.064652 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:17.064822 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:17.064969 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:17.066948 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Terminating instance
May 19 04:40:17.389994 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:17.389994 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:17.468220 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.547s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:17.468682 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:40:17.543698 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-085ee234-88ef-4b57-8e0c-0befecc448f1 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.342s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:17.569779 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:40:17.590250 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:17.592419 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:17.611900 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:17.617732 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:17.639911 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:17.651067 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:17.742330 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-14dd3053-7046-4fb1-be8e-51881c13f4bb req-3dec214f-2643-45bb-b9c7-b7f9beb6ac8c service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Received event network-vif-unplugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:17.742794 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-14dd3053-7046-4fb1-be8e-51881c13f4bb req-3dec214f-2643-45bb-b9c7-b7f9beb6ac8c service nova] Acquiring lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:17.742997 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-14dd3053-7046-4fb1-be8e-51881c13f4bb req-3dec214f-2643-45bb-b9c7-b7f9beb6ac8c service nova] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:17.743194 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-14dd3053-7046-4fb1-be8e-51881c13f4bb req-3dec214f-2643-45bb-b9c7-b7f9beb6ac8c service nova] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:17.743384 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-14dd3053-7046-4fb1-be8e-51881c13f4bb req-3dec214f-2643-45bb-b9c7-b7f9beb6ac8c service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] No waiting events found dispatching network-vif-unplugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:40:17.743542 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-14dd3053-7046-4fb1-be8e-51881c13f4bb req-3dec214f-2643-45bb-b9c7-b7f9beb6ac8c service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Received event network-vif-unplugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:40:17.893179 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lazy-loading 'flavor' on Instance uuid aa2cdf1d-65ef-4cf4-b742-72ae783cde27 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:17.905204 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6140b42a-1410-47ba-911b-4abe58fc046b tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "87e8e02e-e385-418c-be0c-bb25a377d081" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.541s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:17.906905 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999818420999873 future=<Future at 0x7218501887d0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:17.908706 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Instance destroyed successfully.
May 19 04:40:17.909118 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'resources' on Instance uuid e415a06a-1c69-49b7-9bd3-f68ce343b0b7 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:17.974201 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:40:17.974678 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:40:17.975000 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:17.975265 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:17.984385 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:17.984542 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:17.984743 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Attaching volume c6c2c4b5-04b6-4084-ab2f-2487d1148c47 to /dev/vdb
May 19 04:40:18.040147 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:18.051881 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:40:18.057118 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6374f2e55af946f9abf35d0c8a1cd206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336d55ae51114828ba5ad8c0ac87ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:40:18.071980 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:18.109311 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:40:18.109662 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:40:18.117259 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:40:18.118657 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:fe16:6b7e', 'fe80::6898:26ff:fe86:46b0', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fef1:293e', 'fe80::8849:6dff:fe86:4a4b', 'fe80::fc16:3eff:fea1:aa43'] 
May 19 04:40:18.118801 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:40:18.118927 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:40:18.119157 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] <== get_connector_properties: return (78ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:18.119391 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Updating existing volume attachment record: d921ebd6-8776-49cf-8134-8d8cd93b5d97 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:40:18.202080 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:18.412384 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1460978051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumeshelvetestjson-server-1460978051',id=25,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuu3onWzOWOhTwLe3vZlOngY/CNVOE694TNfiS2EbzzOJkaGAyIrxidDf/5+IdWjmIe9CYb9T+M3VPE0CkhNbotNWs4WbsLT86SQsfo4cFhFoJ7Md7HRdavMADvBfS/PA==',key_name='tempest-keypair-1653098683',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:39:33Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a3dfff83ce24e619f87507f951f6c69',ramdisk_id='',reservation_id='r-a8neifui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-51274594',owner_user_name='tempest-AttachVolumeShelveTestJSON-51274594-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:39:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7955853f574d42e58ba89f18ed109760',uuid=e415a06a-1c69-49b7-9bd3-f68ce343b0b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:40:18.412551 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converting VIF {"id": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "address": "fa:16:3e:75:10:d8", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2a0762-a1", "ovs_interfaceid": "5b2a0762-a1d4-4a8c-a81b-de0fef92e15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:40:18.413346 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:10:d8,bridge_name='br-int',has_traffic_filtering=True,id=5b2a0762-a1d4-4a8c-a81b-de0fef92e15c,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2a0762-a1') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:40:18.414557 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:10:d8,bridge_name='br-int',has_traffic_filtering=True,id=5b2a0762-a1d4-4a8c-a81b-de0fef92e15c,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2a0762-a1') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:40:18.415543 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:18.415872 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b2a0762-a1, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:18.417497 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:18.418294 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:18.424177 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:18.425321 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:18.425595 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61d88188-85a9-4b50-9a29-1b105d077c2e) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:18.426497 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:18.427073 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:18.431015 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:18.433231 np0000001025 nova-compute[97981]: INFO os_vif [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:10:d8,bridge_name='br-int',has_traffic_filtering=True,id=5b2a0762-a1d4-4a8c-a81b-de0fef92e15c,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2a0762-a1')
May 19 04:40:18.433557 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Deleting instance files /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7_del
May 19 04:40:18.440730 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Deletion of /opt/stack/data/nova/instances/e415a06a-1c69-49b7-9bd3-f68ce343b0b7_del complete
May 19 04:40:18.480127 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:40:18.513584 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Successfully created port: 37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:40:18.520992 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-73db23c4-eb95-434a-9b3d-258758edacb1 req-a64f6a98-d111-4141-8e43-e4a1c1d3cb49 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Received event network-vif-unplugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:18.522567 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-73db23c4-eb95-434a-9b3d-258758edacb1 req-a64f6a98-d111-4141-8e43-e4a1c1d3cb49 service nova] Acquiring lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:18.522567 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-73db23c4-eb95-434a-9b3d-258758edacb1 req-a64f6a98-d111-4141-8e43-e4a1c1d3cb49 service nova] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:18.522567 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-73db23c4-eb95-434a-9b3d-258758edacb1 req-a64f6a98-d111-4141-8e43-e4a1c1d3cb49 service nova] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:18.522567 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-73db23c4-eb95-434a-9b3d-258758edacb1 req-a64f6a98-d111-4141-8e43-e4a1c1d3cb49 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] No waiting events found dispatching network-vif-unplugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:40:18.522567 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-73db23c4-eb95-434a-9b3d-258758edacb1 req-a64f6a98-d111-4141-8e43-e4a1c1d3cb49 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Received unexpected event network-vif-unplugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b for instance with vm_state stopped and task_state None.
May 19 04:40:18.671269 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:40:18.671667 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:18.671821 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:18.672199 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:18.672376 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:40:18.686627 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:18.687204 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:18.687676 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:18.687910 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:40:18.688267 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:18.688426 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.startup = automatic
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.scan = manual
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:40:18.701239 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:40:18.701239 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.startup = automatic
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.scan = manual
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:40:18.707138 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:40:18.707138 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:18.718435 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:18.721085 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:18.745879 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:18.745879 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:18.745879 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:18.745879 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:18.745879 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:18.745879 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:18.745879 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:18.745879 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:18.745879 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:18.745879 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:18.745879 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:18.745879 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:18.745879 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:18.745879 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:18.745879 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:18.745879 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:18.745879 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:18.746601 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:18.746601 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:18.746601 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:18.746601 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:18.746601 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:18.746601 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:18.746601 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:18.746601 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:18.746601 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:18.746601 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:18.746601 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:18.746601 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:18.746601 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:18.746601 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:18.746601 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:18.746601 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:18.746601 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:18.746601 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.059s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:18.746944 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:40:18.748149 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] HCTL ('9', '0', '0', 0) found on session 76 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:40:18.748391 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:40:18.753238 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:18.753238 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:18.753238 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:18.753238 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:18.753238 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:18.753238 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:18.753238 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:18.753238 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:18.753238 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:18.753238 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:18.753238 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:18.753238 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:18.753238 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:18.753238 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:18.753238 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:18.753238 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:18.753238 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:18.753580 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:18.753580 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:18.753580 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:18.753580 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:18.753580 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:18.753580 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:18.753580 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:18.753580 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:18.753580 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:18.753580 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:18.753580 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:18.753580 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:18.753580 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:18.753580 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:18.753580 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:18.753580 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:18.753580 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:18.753886 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.065s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:18.753886 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:40:18.754613 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] HCTL ('10', '0', '0', 0) found on session 77 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:40:18.754731 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:40:18.761574 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching for a device in session 76 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:40:18.761830 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:40:18.765528 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching for a device in session 77 and hctl ('10', '0', '0', 0) yield: sde {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:40:18.765685 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:40:18.899496 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:18.946602 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Took 1.38 seconds to destroy the instance on the hypervisor.
May 19 04:40:18.947395 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:40:18.947821 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:40:18.947922 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:40:18.948235 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:18.986146 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:40:19.019694 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Successfully updated port: 37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:40:19.057174 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'flavor' on Instance uuid 57adc083-429a-4f23-9154-7de8b6e74d8a {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:19.385861 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0005377410000164673 future=<Future at 0x721850759c10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:19.387103 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] Emitting event <LifecycleEvent: 1779165604.385098, 6cd7138c-f217-4858-8941-89693e62ae6e => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:40:19.387412 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:19.387548 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] VM Stopped (Lifecycle Event)
May 19 04:40:19.388580 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=12.142271789000006 future=<Future at 0x72183443fe30 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:19.388792 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=12.14207607100002 future=<Future at 0x72183443fe30 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:19.463219 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:19.489814 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Booting with volume aed1b29d-163e-4ba7-b0b8-8576d4be428a at /dev/vda
May 19 04:40:19.521991 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "refresh_cache-f6207103-8a47-4cc8-b1e0-c0ffd79e0173" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:40:19.522156 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquired lock "refresh_cache-f6207103-8a47-4cc8-b1e0-c0ffd79e0173" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:40:19.522315 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:40:19.532982 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:19.545248 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:40:19.562634 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "refresh_cache-57adc083-429a-4f23-9154-7de8b6e74d8a" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:40:19.562760 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquired lock "refresh_cache-57adc083-429a-4f23-9154-7de8b6e74d8a" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:40:19.562834 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:40:19.562975 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'info_cache' on Instance uuid 57adc083-429a-4f23-9154-7de8b6e74d8a {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:19.565678 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:19.611604 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:40:19.611877 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:40:19.620558 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:40:19.621759 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:fe16:6b7e', 'fe80::6898:26ff:fe86:46b0', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fef1:293e', 'fe80::8849:6dff:fe86:4a4b', 'fe80::fc16:3eff:fea1:aa43'] 
May 19 04:40:19.621862 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:40:19.622013 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:40:19.622274 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:19.622500 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Updating existing volume attachment record: 8c99f9c7-534f-40c9-983d-577cff569e5d {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:40:19.688630 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:40:19.822160 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4e812bb8-81f6-4fdd-ab89-5070138f86da req-1501f959-819f-4c2a-99e4-9a64357f8a7a service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Received event network-vif-unplugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:19.822401 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4e812bb8-81f6-4fdd-ab89-5070138f86da req-1501f959-819f-4c2a-99e4-9a64357f8a7a service nova] Acquiring lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:19.822637 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4e812bb8-81f6-4fdd-ab89-5070138f86da req-1501f959-819f-4c2a-99e4-9a64357f8a7a service nova] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:19.822763 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4e812bb8-81f6-4fdd-ab89-5070138f86da req-1501f959-819f-4c2a-99e4-9a64357f8a7a service nova] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:19.822875 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4e812bb8-81f6-4fdd-ab89-5070138f86da req-1501f959-819f-4c2a-99e4-9a64357f8a7a service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] No waiting events found dispatching network-vif-unplugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:40:19.823057 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4e812bb8-81f6-4fdd-ab89-5070138f86da req-1501f959-819f-4c2a-99e4-9a64357f8a7a service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Received event network-vif-unplugged-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:40:19.823201 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4e812bb8-81f6-4fdd-ab89-5070138f86da req-1501f959-819f-4c2a-99e4-9a64357f8a7a service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Received event network-changed-37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:19.823332 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4e812bb8-81f6-4fdd-ab89-5070138f86da req-1501f959-819f-4c2a-99e4-9a64357f8a7a service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Refreshing instance network info cache due to event network-changed-37cbdb78-cc1c-48e2-879d-959cb26c29f9. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:40:19.823476 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4e812bb8-81f6-4fdd-ab89-5070138f86da req-1501f959-819f-4c2a-99e4-9a64357f8a7a service nova] Acquiring lock "refresh_cache-f6207103-8a47-4cc8-b1e0-c0ffd79e0173" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:40:19.891048 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5265a59b-adce-4a97-901c-adaec3aee6d5 tempest-TaggedBootDevicesTest-171323133 tempest-TaggedBootDevicesTest-171323133-project-member] [instance: 6cd7138c-f217-4858-8941-89693e62ae6e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:20.046319 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:20.046727 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:20.046784 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Attaching volume 82d50c4c-3f93-4fc1-adcd-170812ca09de to /dev/vdd
May 19 04:40:20.066374 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Object Instance<57adc083-429a-4f23-9154-7de8b6e74d8a> lazy-loaded attributes: flavor,info_cache {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:40:20.093747 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:40:20.096745 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:20.109891 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:40:20.132392 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:20.181929 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:40:20.182731 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:40:20.190829 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:40:20.192671 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:fe16:6b7e', 'fe80::6898:26ff:fe86:46b0', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fef1:293e', 'fe80::8849:6dff:fe86:4a4b', 'fe80::fc16:3eff:fea1:aa43'] 
May 19 04:40:20.192817 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:40:20.192943 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:40:20.193235 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:20.193685 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Updating existing volume attachment record: 5a65b331-c4ea-4667-b8a0-5eb6e213d026 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:40:20.316264 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:20.422993 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:20.479883 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Updating instance_info_cache with network_info: [{"id": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "address": "fa:16:3e:91:89:b7", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cbdb78-cc", "ovs_interfaceid": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:20.569060 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:20.580660 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-432487cf-d43b-4918-8f94-ee3632a37b25 req-57263edf-e6c8-46b2-98e9-ecfa6c6d775d service nova] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Received event network-vif-deleted-5b2a0762-a1d4-4a8c-a81b-de0fef92e15c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:20.704842 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Found WWN 330000000de3b6c24 for multipath device dm-1 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:40:20.705316 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.033s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:20.705543 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] <== connect_volume: return (2033ms) {'type': 'block', 'scsi_wwn': '330000000de3b6c24', 'path': '/dev/dm-1', 'multipath_id': '330000000de3b6c24'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:20.705679 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000de3b6c24', 'path': '/dev/dm-1', 'multipath_id': '330000000de3b6c24'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:40:20.710465 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'flavor' on Instance uuid e644a772-cf7c-4b15-b21b-ea54e773a1f9 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:20.753970 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:40:20.754317 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '82d50c4c-3f93-4fc1-adcd-170812ca09de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:20.754454 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:20.755577 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:20.755772 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '82d50c4c-3f93-4fc1-adcd-170812ca09de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:40:20.782088 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:20.782865 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:20.783604 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:20.783760 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:40:20.784280 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:20.784448 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:40:20.799342 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:40:20.799342 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:20.806192 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:40:20.806192 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:20.816132 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de] added
May 19 04:40:20.816132 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:40:20.816132 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:20.816132 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:20.816132 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:20.816132 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:20.816132 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:20.816132 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:40:20.816132 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:40:20.816132 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:40:20.823102 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de] added
May 19 04:40:20.823102 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:40:20.823102 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:20.823102 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:20.823102 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:20.823102 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:20.823102 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:20.823332 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:40:20.823515 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.039(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:40:20.823689 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:40:20.925720 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Took 1.98 seconds to deallocate network for instance.
May 19 04:40:20.963571 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:20.982742 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Releasing lock "refresh_cache-f6207103-8a47-4cc8-b1e0-c0ffd79e0173" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:40:20.983038 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Instance network_info: |[{"id": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "address": "fa:16:3e:91:89:b7", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cbdb78-cc", "ovs_interfaceid": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:40:20.983507 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4e812bb8-81f6-4fdd-ab89-5070138f86da req-1501f959-819f-4c2a-99e4-9a64357f8a7a service nova] Acquired lock "refresh_cache-f6207103-8a47-4cc8-b1e0-c0ffd79e0173" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:40:20.983665 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4e812bb8-81f6-4fdd-ab89-5070138f86da req-1501f959-819f-4c2a-99e4-9a64357f8a7a service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Refreshing network info cache for port 37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:40:21.130301 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Updating instance_info_cache with network_info: [{"id": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "address": "fa:16:3e:e2:ca:8e", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80a69f3-5d", "ovs_interfaceid": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:21.214728 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Attempting to attach volume c6c2c4b5-04b6-4084-ab2f-2487d1148c47 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:40:21.216258 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:40:21.216258 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:40:21.216258 np0000001025 nova-compute[97981]:   <alias name="ua-c6c2c4b5-04b6-4084-ab2f-2487d1148c47"/>
May 19 04:40:21.216258 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-1"/>
May 19 04:40:21.216258 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:40:21.216258 np0000001025 nova-compute[97981]:   <serial>c6c2c4b5-04b6-4084-ab2f-2487d1148c47</serial>
May 19 04:40:21.216258 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:40:21.216258 np0000001025 nova-compute[97981]: </disk>
May 19 04:40:21.216258 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:40:21.432070 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:21.432319 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:21.488629 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-4e812bb8-81f6-4fdd-ab89-5070138f86da req-1501f959-819f-4c2a-99e4-9a64357f8a7a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:21.633751 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Releasing lock "refresh_cache-57adc083-429a-4f23-9154-7de8b6e74d8a" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:40:21.771892 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:40:21.773201 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:40:21.773680 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Creating image(s)
May 19 04:40:21.774117 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:40:21.774289 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Ensure instance console log exists: /opt/stack/data/nova/instances/f6207103-8a47-4cc8-b1e0-c0ffd79e0173/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:40:21.774573 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:21.774826 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:21.775040 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:21.775683 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Start _get_guest_xml network_info=[{"id": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "address": "fa:16:3e:91:89:b7", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cbdb78-cc", "ovs_interfaceid": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '8c99f9c7-534f-40c9-983d-577cff569e5d', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f6207103-8a47-4cc8-b1e0-c0ffd79e0173', 'attached_at': '', 'detached_at': '', 'volume_id': 'aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'serial': 'aed1b29d-163e-4ba7-b0b8-8576d4be428a'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:40:21.777831 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:40:21.779313 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-985806649', uuid='f6207103-8a47-4cc8-b1e0-c0ffd79e0173'), owner=OwnerMeta(userid='6374f2e55af946f9abf35d0c8a1cd206', username='tempest-ServerActionsTestOtherA-281327203-project-member', projectid='336d55ae51114828ba5ad8c0ac87ca9b', projectname='tempest-ServerActionsTestOtherA-281327203'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "address": "fa:16:3e:91:89:b7", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cbdb78-cc", "ovs_interfaceid": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165621.7788715) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:40:21.780261 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:40:21.780679 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:40:21.781437 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:40:21.781621 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:40:21.783537 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:40:21.783892 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:40:21.784066 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:40:21.784210 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:40:21.784371 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:40:21.784740 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:40:21.784960 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:40:21.785097 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:40:21.785270 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:40:21.785433 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:40:21.785583 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:40:21.785735 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:40:21.802608 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:40:21.802902 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:21.803127 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:21.815455 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:40:21.824202 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:40:21.834491 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:40:21.834491 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:40:21.842366 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:40:21.842366 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:21.851236 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:21.866137 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:21.869315 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-4e812bb8-81f6-4fdd-ab89-5070138f86da req-1501f959-819f-4c2a-99e4-9a64357f8a7a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:21.875350 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:21.875350 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:21.875350 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:21.875350 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:21.875350 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:21.875350 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:21.875350 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:21.875350 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:21.875350 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:21.875350 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:21.875350 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:21.875350 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:21.875350 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:21.875350 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:21.875350 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:21.875350 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:21.875350 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:21.875926 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:21.875926 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:21.875926 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:21.875926 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:21.875926 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:21.875926 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:21.875926 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:21.875926 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:21.875926 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:21.875926 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:21.875926 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:21.875926 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:21.875926 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:21.875926 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:21.875926 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:21.875926 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:21.875926 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:21.886356 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:21.886356 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:21.886356 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:21.886356 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:21.886356 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:21.886356 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:21.886356 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:21.886356 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:21.886356 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:21.886356 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:21.886356 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:21.886356 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:21.886356 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:21.886356 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:21.886356 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:21.886356 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:21.886356 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:21.887026 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:21.887026 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:21.887026 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:21.887026 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:21.887026 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:21.887026 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:21.887026 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:21.887026 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:21.887026 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:21.887026 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:21.887026 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:21.887026 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:21.887026 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:21.887026 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:21.887026 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:21.887026 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:21.887026 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:21.949069 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de, portal: 192.168.50.100,3260]
May 19 04:40:21.949069 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de, portal: 192.168.50.100,3260] successful.
May 19 04:40:21.949069 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:21.957956 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de, portal: 192.168.40.100,3260]
May 19 04:40:21.957956 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de, portal: 192.168.40.100,3260] successful.
May 19 04:40:21.957956 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:21.967048 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:21.972942 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:21.988990 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:21.988990 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:40:21.990861 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] HCTL ('16', '-', '-', 0) found on session 80 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:40:21.990861 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:40:21.997359 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:21.997359 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:21.997359 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:21.997359 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:21.997359 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:21.997359 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:21.997359 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:21.997359 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:21.997359 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:21.997359 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:21.997359 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:21.997359 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:21.997359 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:21.997359 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:21.997359 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:21.997359 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:21.997359 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:21.997359 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:21.997359 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:21.997953 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:21.997953 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:21.997953 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:21.997953 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:21.997953 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:21.997953 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:21.997953 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:21.997953 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:21.997953 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:21.997953 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:21.997953 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:21.997953 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:21.997953 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:21.997953 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:21.997953 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:21.997953 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:21.997953 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:21.997953 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:21.997953 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:21.997953 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.214s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:21.997953 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:40:21.999235 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] HCTL ('17', '-', '-', 0) found on session 81 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:40:21.999235 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:40:22.008575 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Searching for a device in session 80 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:40:22.008801 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '82d50c4c-3f93-4fc1-adcd-170812ca09de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:40:22.024760 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Searching for a device in session 81 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:40:22.024760 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '82d50c4c-3f93-4fc1-adcd-170812ca09de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:40:22.044418 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4e812bb8-81f6-4fdd-ab89-5070138f86da req-1501f959-819f-4c2a-99e4-9a64357f8a7a service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Updated VIF entry in instance network info cache for port 37cbdb78-cc1c-48e2-879d-959cb26c29f9. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:40:22.045405 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4e812bb8-81f6-4fdd-ab89-5070138f86da req-1501f959-819f-4c2a-99e4-9a64357f8a7a service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Updating instance_info_cache with network_info: [{"id": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "address": "fa:16:3e:91:89:b7", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cbdb78-cc", "ovs_interfaceid": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:22.124530 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:40:22.124774 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:40:22.547502 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4e812bb8-81f6-4fdd-ab89-5070138f86da req-1501f959-819f-4c2a-99e4-9a64357f8a7a service nova] Releasing lock "refresh_cache-f6207103-8a47-4cc8-b1e0-c0ffd79e0173" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:40:22.627488 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:40:22.645606 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Instance destroyed successfully.
May 19 04:40:22.646035 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'numa_topology' on Instance uuid 57adc083-429a-4f23-9154-7de8b6e74d8a {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:22.797953 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:40:22.865511 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:22.865726 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:22.865776 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:22.865948 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No VIF found with MAC fa:16:3e:a1:aa:43, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:40:23.136084 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.704s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:23.147887 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Object Instance<57adc083-429a-4f23-9154-7de8b6e74d8a> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:40:23.148275 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'resources' on Instance uuid 57adc083-429a-4f23-9154-7de8b6e74d8a {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:23.182825 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Deleted allocations for instance e415a06a-1c69-49b7-9bd3-f68ce343b0b7
May 19 04:40:23.203653 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:23.232979 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "87e8e02e-e385-418c-be0c-bb25a377d081" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:23.233450 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "87e8e02e-e385-418c-be0c-bb25a377d081" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:23.426240 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:23.651362 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Object Instance<57adc083-429a-4f23-9154-7de8b6e74d8a> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:40:23.652301 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-844446081',display_name='tempest-TestVolumeBootPattern-server-844446081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-844446081',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxOKS9yEjObdHLZH1HI2bMkXDqbbhfdJb44v4wqJB4om8oUnQbceKvRmo5zkW64bMRcZfWY0eLqrWurjfNHYBjiuL8Xlu0w3AcYixWZlDbIAggkM7Ws8vQ5t98+fmLn7g==',key_name='tempest-keypair-1937042662',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:39:36Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-naev0poy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:40:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c46088fb3e74b819bb456461716a801',uuid=57adc083-429a-4f23-9154-7de8b6e74d8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "address": "fa:16:3e:e2:ca:8e", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80a69f3-5d", "ovs_interfaceid": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:40:23.652546 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "address": "fa:16:3e:e2:ca:8e", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80a69f3-5d", "ovs_interfaceid": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:40:23.653369 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ca:8e,bridge_name='br-int',has_traffic_filtering=True,id=a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80a69f3-5d') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:40:23.653688 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ca:8e,bridge_name='br-int',has_traffic_filtering=True,id=a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80a69f3-5d') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:40:23.655690 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:23.656446 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa80a69f3-5d, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:23.664241 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:23.665398 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:23.665398 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:23.666165 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:23.666268 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a82c0850-68ff-47ab-9cbf-0d4f3e87edde) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:23.668327 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:23.670398 np0000001025 nova-compute[97981]: INFO os_vif [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ca:8e,bridge_name='br-int',has_traffic_filtering=True,id=a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80a69f3-5d')
May 19 04:40:23.671672 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:40:23.671672 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:23.671965 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:23.735442 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Detaching volume 48aece7a-6fef-499d-ac1b-f3aa37ac8b16
May 19 04:40:23.769579 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Attempting to driver detach volume 48aece7a-6fef-499d-ac1b-f3aa37ac8b16 from mountpoint /dev/vdb
May 19 04:40:23.772515 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Found disk vdb by alias ua-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:40:23.773334 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Found disk vdb by alias ua-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:40:23.773436 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Attempting to detach device vdb from instance 87e8e02e-e385-418c-be0c-bb25a377d081 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:40:23.773639 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:40:23.773639 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:40:23.773639 np0000001025 nova-compute[97981]:   <alias name="ua-48aece7a-6fef-499d-ac1b-f3aa37ac8b16"/>
May 19 04:40:23.773639 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-15"/>
May 19 04:40:23.773639 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:40:23.773639 np0000001025 nova-compute[97981]:   <serial>48aece7a-6fef-499d-ac1b-f3aa37ac8b16</serial>
May 19 04:40:23.773639 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:40:23.773639 np0000001025 nova-compute[97981]: </disk>
May 19 04:40:23.773639 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:40:23.779515 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Successfully detached device vdb from instance 87e8e02e-e385-418c-be0c-bb25a377d081 from the persistent domain config.
May 19 04:40:23.779683 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] (1/8): Attempting to detach device vdb with device alias ua-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 from instance 87e8e02e-e385-418c-be0c-bb25a377d081 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:40:23.779849 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:40:23.779849 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:40:23.779849 np0000001025 nova-compute[97981]:   <alias name="ua-48aece7a-6fef-499d-ac1b-f3aa37ac8b16"/>
May 19 04:40:23.779849 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-15"/>
May 19 04:40:23.779849 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:40:23.779849 np0000001025 nova-compute[97981]:   <serial>48aece7a-6fef-499d-ac1b-f3aa37ac8b16</serial>
May 19 04:40:23.779849 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:40:23.779849 np0000001025 nova-compute[97981]: </disk>
May 19 04:40:23.779849 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:40:23.814273 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Found WWN 3300000003578c8c9 for multipath device dm-6 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:40:23.814571 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.059s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:23.814718 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] <== connect_volume: return (3060ms) {'type': 'block', 'scsi_wwn': '3300000003578c8c9', 'path': '/dev/dm-6', 'multipath_id': '3300000003578c8c9'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:23.814833 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003578c8c9', 'path': '/dev/dm-6', 'multipath_id': '3300000003578c8c9'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:40:23.815407 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.012s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:23.815717 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:40:23.824071 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lazy-loading 'flavor' on Instance uuid aa2cdf1d-65ef-4cf4-b742-72ae783cde27 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:23.830473 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:23.832716 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:23.832716 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:23.832716 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:40:23.832716 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:23.832716 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:40:23.844838 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:40:23.844838 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:23.852127 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:40:23.852127 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:23.860750 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a] added
May 19 04:40:23.860750 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:40:23.860750 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:23.860750 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:23.860750 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:23.860750 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:23.860750 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:23.860944 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:40:23.861118 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:40:23.861297 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:40:23.864361 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a] added
May 19 04:40:23.864361 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:40:23.864361 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:23.864361 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:23.864361 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:23.864361 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:23.864361 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:23.864513 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:40:23.864634 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:40:23.864748 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:40:24.191795 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d93b8da6-85c8-4096-aefc-c722dd14a68d tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "e415a06a-1c69-49b7-9bd3-f68ce343b0b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.127s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:24.328722 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Attempting to attach volume 82d50c4c-3f93-4fc1-adcd-170812ca09de with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:40:24.332354 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:40:24.332354 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:40:24.332354 np0000001025 nova-compute[97981]:   <alias name="ua-82d50c4c-3f93-4fc1-adcd-170812ca09de"/>
May 19 04:40:24.332354 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-6"/>
May 19 04:40:24.332354 np0000001025 nova-compute[97981]:   <target dev="vdd" bus="virtio"/>
May 19 04:40:24.332354 np0000001025 nova-compute[97981]:   <serial>82d50c4c-3f93-4fc1-adcd-170812ca09de</serial>
May 19 04:40:24.332354 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:40:24.332354 np0000001025 nova-compute[97981]: </disk>
May 19 04:40:24.332354 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:40:24.417318 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05d6e299-6001-47c0-b387-743c78b02179 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.431s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:24.470998 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165624.4705677, 87e8e02e-e385-418c-be0c-bb25a377d081 => ua-48aece7a-6fef-499d-ac1b-f3aa37ac8b16> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:40:24.473748 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 for instance 87e8e02e-e385-418c-be0c-bb25a377d081 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:40:24.476953 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Successfully detached device vdb from instance 87e8e02e-e385-418c-be0c-bb25a377d081 from the live domain config.
May 19 04:40:24.478003 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:40:24.478181 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '48aece7a-6fef-499d-ac1b-f3aa37ac8b16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:24.478810 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:24.861971 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:40:24.865280 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:40:24.874865 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:40:24.874865 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:40:24.880884 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:40:24.880884 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:24.887549 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:24.899511 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:24.913133 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:24.930739 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:24.930739 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:24.930739 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:24.930739 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:24.930739 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:24.930739 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:24.930739 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:24.930739 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:24.930739 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:24.930739 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:24.930739 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:24.930739 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:24.930739 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:24.930739 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:24.930739 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:24.930739 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:24.930739 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:24.930739 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:24.930739 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:24.931083 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:24.931083 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:24.931083 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:24.931083 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:24.931083 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:24.931083 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:24.931083 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:24.931083 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:24.931083 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:24.931083 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:24.931083 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:24.931083 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:24.931083 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:24.931083 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:24.931083 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:24.931083 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:24.931083 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:24.931083 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:24.931083 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:24.990573 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a, portal: 192.168.40.100,3260]
May 19 04:40:24.990573 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a, portal: 192.168.40.100,3260] successful.
May 19 04:40:24.990573 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:25.001890 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:25.008033 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a, portal: 192.168.50.100,3260]
May 19 04:40:25.008033 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a, portal: 192.168.50.100,3260] successful.
May 19 04:40:25.008033 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:25.020760 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:25.032829 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:25.032829 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:25.032829 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:25.032829 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:25.032829 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:25.032829 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:25.032829 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:25.032829 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:25.032829 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:25.032829 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:25.032829 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:25.032829 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:25.032829 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:25.032829 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:25.032829 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:25.032829 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:25.032829 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:25.032829 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:25.032829 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:25.032829 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:25.032829 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:25.033584 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:25.033584 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:25.033584 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:25.033584 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:25.033584 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:25.033584 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:25.033584 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:25.033584 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:25.033584 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:25.033584 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:25.033584 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:25.033584 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:25.033584 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:25.033584 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:25.033584 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:25.033584 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:25.033584 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:25.033584 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:25.033584 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:25.033584 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:25.033584 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:25.033584 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:25.033584 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:40:25.035285 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] HCTL ('25', '-', '-', 0) found on session 82 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:40:25.035365 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Scanning host 25 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:40:25.047698 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:25.047698 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:25.047698 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:25.047698 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:25.047698 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:25.047698 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:25.047698 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:25.047698 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:25.047698 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:25.047698 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:25.047698 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:25.047698 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:25.047698 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:25.047698 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:25.047698 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:25.047698 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:25.047698 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:25.047698 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:25.047698 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:25.047698 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:25.047698 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:25.048471 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:25.048471 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:25.048471 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:25.048471 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:25.048471 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:25.048471 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:25.048471 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:25.048471 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:25.048471 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:25.048471 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:25.048471 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:25.048471 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:25.048471 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:25.048471 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:25.048471 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:25.048471 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:25.048471 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:25.048471 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:25.048471 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:25.048471 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:25.048471 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:25.048471 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.216s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:25.048471 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:40:25.050573 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] HCTL ('26', '-', '-', 0) found on session 83 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:40:25.050714 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Scanning host 26 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:40:25.060392 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Searching for a device in session 82 and hctl ['25', '*', '*', 0] yield: sdt {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:40:25.060621 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Connected to sdt using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:40:25.065704 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9e5fb7fd-95ba-4d87-bab4-ae6981cfe0e9 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "b32b8038-72c4-443c-aea3-07cd61ad67f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:25.065704 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9e5fb7fd-95ba-4d87-bab4-ae6981cfe0e9 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:25.069014 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Searching for a device in session 83 and hctl ['26', '*', '*', 0] yield: sdu {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:40:25.069189 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Connected to sdu using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:40:25.569286 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-9e5fb7fd-95ba-4d87-bab4-ae6981cfe0e9 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Detaching volume c6c2c4b5-04b6-4084-ab2f-2487d1148c47
May 19 04:40:25.620593 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-9e5fb7fd-95ba-4d87-bab4-ae6981cfe0e9 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Attempting to driver detach volume c6c2c4b5-04b6-4084-ab2f-2487d1148c47 from mountpoint /dev/vdb
May 19 04:40:25.624537 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9e5fb7fd-95ba-4d87-bab4-ae6981cfe0e9 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Found disk vdb by alias ua-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:40:25.625522 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9e5fb7fd-95ba-4d87-bab4-ae6981cfe0e9 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Found disk vdb by alias ua-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:40:25.625637 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9e5fb7fd-95ba-4d87-bab4-ae6981cfe0e9 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Attempting to detach device vdb from instance b32b8038-72c4-443c-aea3-07cd61ad67f6 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:40:25.625825 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-9e5fb7fd-95ba-4d87-bab4-ae6981cfe0e9 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:40:25.625825 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:40:25.625825 np0000001025 nova-compute[97981]:   <alias name="ua-c6c2c4b5-04b6-4084-ab2f-2487d1148c47"/>
May 19 04:40:25.625825 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-1"/>
May 19 04:40:25.625825 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:40:25.625825 np0000001025 nova-compute[97981]:   <serial>c6c2c4b5-04b6-4084-ab2f-2487d1148c47</serial>
May 19 04:40:25.625825 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:40:25.625825 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:40:25.625825 np0000001025 nova-compute[97981]: </disk>
May 19 04:40:25.625825 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:40:25.632798 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9e5fb7fd-95ba-4d87-bab4-ae6981cfe0e9 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully detached device vdb from instance b32b8038-72c4-443c-aea3-07cd61ad67f6 from the persistent domain config.
May 19 04:40:25.632898 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9e5fb7fd-95ba-4d87-bab4-ae6981cfe0e9 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] (1/8): Attempting to detach device vdb with device alias ua-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 from instance b32b8038-72c4-443c-aea3-07cd61ad67f6 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:40:25.633091 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-9e5fb7fd-95ba-4d87-bab4-ae6981cfe0e9 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:40:25.633091 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:40:25.633091 np0000001025 nova-compute[97981]:   <alias name="ua-c6c2c4b5-04b6-4084-ab2f-2487d1148c47"/>
May 19 04:40:25.633091 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-1"/>
May 19 04:40:25.633091 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:40:25.633091 np0000001025 nova-compute[97981]:   <serial>c6c2c4b5-04b6-4084-ab2f-2487d1148c47</serial>
May 19 04:40:25.633091 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:40:25.633091 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:40:25.633091 np0000001025 nova-compute[97981]: </disk>
May 19 04:40:25.633091 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:40:25.832503 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:40:26.012676 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:26.013714 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:26.013864 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:26.013986 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name vdd, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:26.015319 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:26.015484 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No VIF found with MAC fa:16:3e:3c:c4:ae, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:40:26.205704 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165626.2050586, b32b8038-72c4-443c-aea3-07cd61ad67f6 => ua-c6c2c4b5-04b6-4084-ab2f-2487d1148c47> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:40:26.206615 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9e5fb7fd-95ba-4d87-bab4-ae6981cfe0e9 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 for instance b32b8038-72c4-443c-aea3-07cd61ad67f6 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:40:26.208525 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9e5fb7fd-95ba-4d87-bab4-ae6981cfe0e9 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully detached device vdb from instance b32b8038-72c4-443c-aea3-07cd61ad67f6 from the live domain config.
May 19 04:40:26.739788 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9e5fb7fd-95ba-4d87-bab4-ae6981cfe0e9 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Detected multiple connections on this host for volume: c6c2c4b5-04b6-4084-ab2f-2487d1148c47, skipping target disconnect.
May 19 04:40:26.847407 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Found WWN 330000000b0c2b96e for multipath device dm-10 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:40:26.849147 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:26.849147 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] <== connect_volume: return (5045ms) {'type': 'block', 'scsi_wwn': '330000000b0c2b96e', 'path': '/dev/dm-10', 'multipath_id': '330000000b0c2b96e'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:26.849147 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b0c2b96e', 'path': '/dev/dm-10', 'multipath_id': '330000000b0c2b96e'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:40:26.849147 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.177s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:26.849147 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:40:26.849147 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:26.892729 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', '68'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '71'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', '72'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', '73'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', '78'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '81'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '83')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', '69')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', '68')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185018cfe0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9'): ({'sdn'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Removing multipathed devices sdm, sdn {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:40:26.892729 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flush multipath device 3300000004eff2e31 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:40:26.960838 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:40:27.021683 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:40:27.068915 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Checking to see if SCSI volumes sdm, sdn have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:40:27.069676 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] SCSI volumes sdm, sdn have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:40:27.072600 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Checking to see if device paths {'sdm', 'sdn'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:40:27.085777 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Device paths {'sdm', 'sdn'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:40:27.085777 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:40:27.097532 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:27.147531 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9, portal: 192.168.40.100,3260]
May 19 04:40:27.147531 np0000001025 nova-compute[97981]: Logout of [sid: 69, target: iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9, portal: 192.168.40.100,3260] successful.
May 19 04:40:27.147531 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:27.176184 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:27.190032 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:27.238519 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9, portal: 192.168.50.100,3260]
May 19 04:40:27.238519 np0000001025 nova-compute[97981]: Logout of [sid: 68, target: iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9, portal: 192.168.50.100,3260] successful.
May 19 04:40:27.238519 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:27.278876 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:27.279347 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:27.279672 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== disconnect_volume: return (3607ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:27.280525 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:40:27.281443 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.803s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:27.281737 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '48aece7a-6fef-499d-ac1b-f3aa37ac8b16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:40:27.282867 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:40:27.285233 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Start _get_guest_xml network_info=[{"id": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "address": "fa:16:3e:e2:ca:8e", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80a69f3-5d", "ovs_interfaceid": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '5f55d44b-2c98-4a64-81f9-2887b18eb3d9', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, 'status': 'reserved', 'instance': '57adc083-429a-4f23-9154-7de8b6e74d8a', 'attached_at': '', 'detached_at': '', 'volume_id': 'ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'serial': 'ce533ab0-3286-48fd-9b76-1009e42dd4d9'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:40:27.289555 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:40:27.289555 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-844446081', uuid='57adc083-429a-4f23-9154-7de8b6e74d8a'), owner=OwnerMeta(userid='5c46088fb3e74b819bb456461716a801', username='tempest-TestVolumeBootPattern-1071176852-project-member', projectid='28b3c0fa8f894ed2a7c3bcfac99ce74c', projectname='tempest-TestVolumeBootPattern-1071176852'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "address": "fa:16:3e:e2:ca:8e", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80a69f3-5d", "ovs_interfaceid": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165627.289151) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:40:27.290665 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:40:27.291065 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:40:27.291855 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:40:27.292085 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:40:27.294726 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:40:27.294726 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:40:27.294726 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:40:27.294726 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:40:27.294726 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:40:27.294726 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:40:27.294726 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:40:27.294726 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:40:27.294726 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:40:27.294726 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:40:27.294726 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:40:27.294726 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:40:27.294726 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'vcpu_model' on Instance uuid 57adc083-429a-4f23-9154-7de8b6e74d8a {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:27.298414 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-9e5fb7fd-95ba-4d87-bab4-ae6981cfe0e9 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'flavor' on Instance uuid b32b8038-72c4-443c-aea3-07cd61ad67f6 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:27.321319 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:27.321319 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:27.321319 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:27.321319 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:27.321319 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:27.321319 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:27.321319 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:27.321319 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:27.321319 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:27.321319 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:27.321319 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:27.321319 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:27.321319 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:27.321319 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:27.321319 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:27.321319 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:27.321319 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:27.321319 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:27.321319 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:27.321727 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:27.321727 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:27.321727 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:27.321727 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:27.321727 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:27.321727 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:27.321727 np0000001025 nova-compute[97981]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:27.321727 np0000001025 nova-compute[97981]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16 (non-flash)
May 19 04:40:27.321727 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:27.321727 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:27.321727 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:27.321727 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:27.321727 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:27.321727 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:27.321727 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:27.321727 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:27.321727 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:27.321727 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:27.321727 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:27.321727 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '71'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', '72'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', '73'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', '78'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '81'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '83')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:40:27.322071 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', '73')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:27.323585 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16', '72')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:27.325329 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185012c180>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16'): ({'sdq'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16'): ({'sdp'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:40:27.325542 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Removing multipathed devices sdq, sdp {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:40:27.325751 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Flush multipath device 3300000000053c6c9 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:40:27.357342 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:40:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-985806649',display_name='tempest-ServerActionsTestOtherA-server-985806649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serveractionstestothera-server-985806649',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqj+0kbBWHZ0D/eo4rT8/WyGDsPmK39aJPuM7kZk3S1G8n90+lv56y6gVhWC3CbNq9VY5ET/dAXNaLkqY+SWcJuj+SOKIN1mmus3K/MEswW9TbpiRqq7lxkb6x7vjc6rQ==',key_name='tempest-keypair-762825136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='336d55ae51114828ba5ad8c0ac87ca9b',ramdisk_id='',reservation_id='r-47cr4ojc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-281327203',owner_user_name='tempest-ServerActionsTestOtherA-281327203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:40:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6374f2e55af946f9abf35d0c8a1cd206',uuid=f6207103-8a47-4cc8-b1e0-c0ffd79e0173,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "address": "fa:16:3e:91:89:b7", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cbdb78-cc", "ovs_interfaceid": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:40:27.357342 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converting VIF {"id": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "address": "fa:16:3e:91:89:b7", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cbdb78-cc", "ovs_interfaceid": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:40:27.357342 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:89:b7,bridge_name='br-int',has_traffic_filtering=True,id=37cbdb78-cc1c-48e2-879d-959cb26c29f9,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cbdb78-cc') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:40:27.357342 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lazy-loading 'pci_devices' on Instance uuid f6207103-8a47-4cc8-b1e0-c0ffd79e0173 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:27.379578 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:40:27.437284 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:40:27.489746 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Checking to see if SCSI volumes sdq, sdp have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:40:27.489892 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] SCSI volumes sdq, sdp have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:40:27.492479 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Checking to see if device paths {'sdq', 'sdp'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:40:27.506691 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Device paths {'sdq', 'sdp'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:40:27.506860 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:40:27.513334 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:27.513539 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:27.522745 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:27.559006 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 73, target: iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16, portal: 192.168.40.100,3260]
May 19 04:40:27.559006 np0000001025 nova-compute[97981]: Logout of [sid: 73, target: iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16, portal: 192.168.40.100,3260] successful.
May 19 04:40:27.559006 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:27.566318 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2cd726ad-c821-4072-89ec-9a9d18878383 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.520s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:27.584895 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:27.596666 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:27.641083 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 72, target: iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16, portal: 192.168.50.100,3260]
May 19 04:40:27.641083 np0000001025 nova-compute[97981]: Logout of [sid: 72, target: iqn.2023-03.storpool.com:os--volume-48aece7a-6fef-499d-ac1b-f3aa37ac8b16, portal: 192.168.50.100,3260] successful.
May 19 04:40:27.641083 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:27.665505 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:27.665729 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:27.665842 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] <== disconnect_volume: return (3187ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:27.665973 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:40:27.796631 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Object Instance<57adc083-429a-4f23-9154-7de8b6e74d8a> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:40:27.808439 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57adc083-429a-4f23-9154-7de8b6e74d8a/disk.config --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:27.861222 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] End _get_guest_xml xml=<domain type="qemu">
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:   <uuid>f6207103-8a47-4cc8-b1e0-c0ffd79e0173</uuid>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:   <name>instance-00000022</name>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServerActionsTestOtherA-server-985806649</nova:name>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:40:21</nova:creationTime>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:         <nova:user uuid="6374f2e55af946f9abf35d0c8a1cd206">tempest-ServerActionsTestOtherA-281327203-project-member</nova:user>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:         <nova:project uuid="336d55ae51114828ba5ad8c0ac87ca9b">tempest-ServerActionsTestOtherA-281327203</nova:project>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:         <nova:port uuid="37cbdb78-cc1c-48e2-879d-959cb26c29f9">
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     <system>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <entry name="serial">f6207103-8a47-4cc8-b1e0-c0ffd79e0173</entry>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <entry name="uuid">f6207103-8a47-4cc8-b1e0-c0ffd79e0173</entry>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     </system>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:   <os>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:   </os>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:   <features>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:   </features>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:   <devices>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/f6207103-8a47-4cc8-b1e0-c0ffd79e0173/disk.config"/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     </disk>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <alias name="ua-aed1b29d-163e-4ba7-b0b8-8576d4be428a"/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-10"/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <serial>aed1b29d-163e-4ba7-b0b8-8576d4be428a</serial>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     </disk>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:91:89:b7"/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <target dev="tap37cbdb78-cc"/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     </interface>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/f6207103-8a47-4cc8-b1e0-c0ffd79e0173/console.log" append="off"/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     </serial>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     <video>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     </video>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     </rng>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:   </devices>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]: </domain>
May 19 04:40:27.861222 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:40:27.863349 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Preparing to wait for external event network-vif-plugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:40:27.863349 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:27.863349 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:27.863349 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:27.864355 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:40:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-985806649',display_name='tempest-ServerActionsTestOtherA-server-985806649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serveractionstestothera-server-985806649',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqj+0kbBWHZ0D/eo4rT8/WyGDsPmK39aJPuM7kZk3S1G8n90+lv56y6gVhWC3CbNq9VY5ET/dAXNaLkqY+SWcJuj+SOKIN1mmus3K/MEswW9TbpiRqq7lxkb6x7vjc6rQ==',key_name='tempest-keypair-762825136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='336d55ae51114828ba5ad8c0ac87ca9b',ramdisk_id='',reservation_id='r-47cr4ojc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-281327203',owner_user_name='tempest-ServerActionsTestOtherA-281327203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:40:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6374f2e55af946f9abf35d0c8a1cd206',uuid=f6207103-8a47-4cc8-b1e0-c0ffd79e0173,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "address": "fa:16:3e:91:89:b7", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cbdb78-cc", "ovs_interfaceid": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:40:27.864355 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converting VIF {"id": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "address": "fa:16:3e:91:89:b7", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cbdb78-cc", "ovs_interfaceid": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:40:27.864732 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:89:b7,bridge_name='br-int',has_traffic_filtering=True,id=37cbdb78-cc1c-48e2-879d-959cb26c29f9,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cbdb78-cc') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:40:27.865039 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:89:b7,bridge_name='br-int',has_traffic_filtering=True,id=37cbdb78-cc1c-48e2-879d-959cb26c29f9,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cbdb78-cc') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:40:27.865635 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:27.866252 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:27.866652 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:40:27.868056 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:27.868291 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4bcb9dd-b909-5b57-bc36-fdecc76be37f', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:27.869542 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:27.870464 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:27.871011 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:27.873273 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:27.873441 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37cbdb78-cc, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:27.873955 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37cbdb78-cc, col_values=(('qos', UUID('3c895851-ba24-48f2-8e6d-66834f95d35c')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:27.874099 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37cbdb78-cc, col_values=(('external_ids', {'iface-id': '37cbdb78-cc1c-48e2-879d-959cb26c29f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:89:b7', 'vm-uuid': 'f6207103-8a47-4cc8-b1e0-c0ffd79e0173'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:27.876615 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:27.880764 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:27.881985 np0000001025 nova-compute[97981]: INFO os_vif [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:89:b7,bridge_name='br-int',has_traffic_filtering=True,id=37cbdb78-cc1c-48e2-879d-959cb26c29f9,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cbdb78-cc')
May 19 04:40:27.902157 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57adc083-429a-4f23-9154-7de8b6e74d8a/disk.config --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:27.902903 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "/opt/stack/data/nova/instances/57adc083-429a-4f23-9154-7de8b6e74d8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:27.903131 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "/opt/stack/data/nova/instances/57adc083-429a-4f23-9154-7de8b6e74d8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:27.903728 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "/opt/stack/data/nova/instances/57adc083-429a-4f23-9154-7de8b6e74d8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:27.904125 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:40:27.904630 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:27.904823 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:27.905304 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:27.905593 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:40:27.921432 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:27.921992 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:27.922280 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:40:27.923238 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:27.926008 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:27.926309 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:40:27.939568 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:40:27.939568 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:27.945084 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:40:27.945084 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:27.958467 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9] added
May 19 04:40:27.958467 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:40:27.958467 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:27.958467 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:27.958467 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:27.958467 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:27.958467 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:27.958687 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:40:27.958849 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0366(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:40:27.959008 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:40:27.963123 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9] added
May 19 04:40:27.963123 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:40:27.963123 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:27.963123 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:27.963123 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:27.963123 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:27.963123 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:27.963589 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:40:27.963589 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0372(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:40:27.963789 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:40:28.015876 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:40:28.206184 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:28.214564 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lazy-loading 'flavor' on Instance uuid 87e8e02e-e385-418c-be0c-bb25a377d081 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:28.319840 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9e5fb7fd-95ba-4d87-bab4-ae6981cfe0e9 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.254s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:28.578018 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:28.578236 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:28.581306 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:40:28.581436 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Claim successful on node np0000001025
May 19 04:40:28.608998 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:28.609267 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:28.960055 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:40:28.964630 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:40:28.978432 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:40:28.978432 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:40:28.986548 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:40:28.986548 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:28.995857 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:29.007988 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:29.023153 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:29.023153 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:29.023153 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:29.023153 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:29.023153 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:29.023153 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:29.023153 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:29.023153 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:29.023153 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:29.023153 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:29.023153 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:29.023153 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:29.023153 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:29.023153 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:29.023153 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:29.023153 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:29.023153 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:29.023715 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:29.023715 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:29.023715 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:29.023715 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:29.023715 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:29.023715 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:29.023715 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:29.023715 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:29.023715 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:29.023715 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:29.023715 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:29.023715 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:29.023715 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:29.023715 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:29.023715 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:29.023715 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:29.023715 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:29.031520 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:29.031520 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:29.031520 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:29.031520 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:29.031520 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:29.031520 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:29.031520 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:29.031520 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:29.031520 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:29.031520 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:29.031520 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:29.031520 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:29.031520 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:29.031520 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:29.031520 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:29.031520 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:29.031520 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:29.032389 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:29.032389 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:29.032389 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:29.032389 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:29.032389 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:29.032389 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:29.032389 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:29.032389 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:29.032389 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:29.032389 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:29.032389 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:29.032389 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:29.032389 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:29.032389 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:29.032389 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:29.032389 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:29.032389 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:29.094144 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9, portal: 192.168.40.100,3260]
May 19 04:40:29.094144 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9, portal: 192.168.40.100,3260] successful.
May 19 04:40:29.094144 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:29.102789 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9, portal: 192.168.50.100,3260]
May 19 04:40:29.102789 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9, portal: 192.168.50.100,3260] successful.
May 19 04:40:29.102789 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:29.112664 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Detaching volume c6c2c4b5-04b6-4084-ab2f-2487d1148c47
May 19 04:40:29.117098 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:29.121988 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:29.143650 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:29.143650 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:29.143650 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:29.143650 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:29.143650 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:29.143650 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:29.143650 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:29.143650 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:29.143650 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:29.143650 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:29.143650 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:29.143650 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:29.143650 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:29.143650 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:29.143650 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:29.143650 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:29.143650 np0000001025 nova-compute[97981]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:29.143650 np0000001025 nova-compute[97981]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:29.143650 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:29.144345 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:29.144345 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:29.144345 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:29.144345 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:29.144345 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:29.144345 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:29.144345 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:29.144345 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:29.144345 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:29.144345 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:29.144345 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:29.144345 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:29.144345 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:29.144345 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:29.144345 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:29.144345 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:29.144345 np0000001025 nova-compute[97981]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:29.144345 np0000001025 nova-compute[97981]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:29.144345 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:29.144345 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.222s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:29.144345 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:40:29.146060 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] HCTL ('18', '-', '-', 0) found on session 84 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:40:29.146211 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:40:29.157486 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:29.157486 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:29.157486 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:29.157486 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:29.157486 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:29.157486 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:29.157486 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:29.157486 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:29.157486 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:29.157486 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:29.157486 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:29.157486 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:29.157486 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:29.157486 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:29.157486 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:29.157486 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:29.157486 np0000001025 nova-compute[97981]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:29.157486 np0000001025 nova-compute[97981]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:29.157486 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:29.158182 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:29.158182 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:29.158182 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:29.158182 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:29.158182 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:29.158182 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:29.158182 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:29.158182 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:29.158182 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:29.158182 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:29.158182 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:29.158182 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:29.158182 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:29.158182 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:29.158182 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:29.158182 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:29.158182 np0000001025 nova-compute[97981]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:29.158182 np0000001025 nova-compute[97981]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:29.158182 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:29.158182 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.232s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:29.158916 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:40:29.160073 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] HCTL ('19', '-', '-', 0) found on session 85 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:40:29.161605 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:40:29.170565 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching for a device in session 84 and hctl ['18', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:40:29.182953 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching for a device in session 85 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:40:29.182953 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:40:29.202086 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Attempting to driver detach volume c6c2c4b5-04b6-4084-ab2f-2487d1148c47 from mountpoint /dev/vdb
May 19 04:40:29.212417 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Found disk vdb by alias ua-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:40:29.213971 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Found disk vdb by alias ua-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:40:29.214302 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Attempting to detach device vdb from instance e644a772-cf7c-4b15-b21b-ea54e773a1f9 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:40:29.214668 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:40:29.214668 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:40:29.214668 np0000001025 nova-compute[97981]:   <alias name="ua-c6c2c4b5-04b6-4084-ab2f-2487d1148c47"/>
May 19 04:40:29.214668 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-1"/>
May 19 04:40:29.214668 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:40:29.214668 np0000001025 nova-compute[97981]:   <serial>c6c2c4b5-04b6-4084-ab2f-2487d1148c47</serial>
May 19 04:40:29.214668 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:40:29.214668 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:40:29.214668 np0000001025 nova-compute[97981]: </disk>
May 19 04:40:29.214668 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:40:29.223158 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully detached device vdb from instance e644a772-cf7c-4b15-b21b-ea54e773a1f9 from the persistent domain config.
May 19 04:40:29.223158 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] (1/8): Attempting to detach device vdb with device alias ua-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 from instance e644a772-cf7c-4b15-b21b-ea54e773a1f9 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:40:29.223334 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:40:29.223334 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:40:29.223334 np0000001025 nova-compute[97981]:   <alias name="ua-c6c2c4b5-04b6-4084-ab2f-2487d1148c47"/>
May 19 04:40:29.223334 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-1"/>
May 19 04:40:29.223334 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:40:29.223334 np0000001025 nova-compute[97981]:   <serial>c6c2c4b5-04b6-4084-ab2f-2487d1148c47</serial>
May 19 04:40:29.223334 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:40:29.223334 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:40:29.223334 np0000001025 nova-compute[97981]: </disk>
May 19 04:40:29.223334 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:40:29.224283 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d7794924-0904-48ab-9c11-e0007f0aaddd tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "87e8e02e-e385-418c-be0c-bb25a377d081" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.991s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:29.405749 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:29.405897 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:29.405971 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] No VIF found with MAC fa:16:3e:91:89:b7, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:40:29.406473 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Using config drive
May 19 04:40:29.616847 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:40:29.617301 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:40:29.617895 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:40:29.915761 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:30.083321 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Creating config drive at /opt/stack/data/nova/instances/f6207103-8a47-4cc8-b1e0-c0ffd79e0173/disk.config
May 19 04:40:30.091130 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f6207103-8a47-4cc8-b1e0-c0ffd79e0173/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw7r_32dn {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:30.140764 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f6207103-8a47-4cc8-b1e0-c0ffd79e0173/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw7r_32dn" returned: 0 in 0.049s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:30.142456 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:40:30.143079 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:40:30.171364 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching for a device in session 84 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:40:30.171597 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:40:30.357514 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:30.357842 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:30.562857 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:30.564972 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:30.586253 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:30.611536 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:40:30.611998 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:40:30.614875 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:40:30.615127 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:40:30.646358 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:40:30.678290 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:30.694021 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:30.696024 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:30.751269 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6decdac0-c00d-48b1-be5a-6a31bef3d041 req-9a0549dd-d3ad-44b0-a8ba-1958ed9f48fc service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Received event network-vif-plugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:30.751497 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6decdac0-c00d-48b1-be5a-6a31bef3d041 req-9a0549dd-d3ad-44b0-a8ba-1958ed9f48fc service nova] Acquiring lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:30.751654 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6decdac0-c00d-48b1-be5a-6a31bef3d041 req-9a0549dd-d3ad-44b0-a8ba-1958ed9f48fc service nova] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:30.751797 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6decdac0-c00d-48b1-be5a-6a31bef3d041 req-9a0549dd-d3ad-44b0-a8ba-1958ed9f48fc service nova] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:30.751919 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6decdac0-c00d-48b1-be5a-6a31bef3d041 req-9a0549dd-d3ad-44b0-a8ba-1958ed9f48fc service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Processing event network-vif-plugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:40:30.859969 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:40:30.941452 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Found WWN 3300000004eff2e31 for multipath device dm-11 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:40:30.941452 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:30.941648 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000004eff2e31', 'path': '/dev/dm-11', 'multipath_id': '3300000004eff2e31'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:30.941813 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004eff2e31', 'path': '/dev/dm-11', 'multipath_id': '3300000004eff2e31'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:40:31.154834 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.576s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:31.155225 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:40:31.331674 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165631.3313003, f6207103-8a47-4cc8-b1e0-c0ffd79e0173 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:40:31.331790 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] VM Started (Lifecycle Event)
May 19 04:40:31.333003 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:40:31.335326 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:40:31.337434 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Instance spawned successfully.
May 19 04:40:31.337753 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:40:31.413375 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:31.413784 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:31.417602 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:40:31.418454 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Claim successful on node np0000001025
May 19 04:40:31.447312 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-844446081',display_name='tempest-TestVolumeBootPattern-server-844446081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-844446081',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxOKS9yEjObdHLZH1HI2bMkXDqbbhfdJb44v4wqJB4om8oUnQbceKvRmo5zkW64bMRcZfWY0eLqrWurjfNHYBjiuL8Xlu0w3AcYixWZlDbIAggkM7Ws8vQ5t98+fmLn7g==',key_name='tempest-keypair-1937042662',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:39:36Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-naev0poy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:40:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c46088fb3e74b819bb456461716a801',uuid=57adc083-429a-4f23-9154-7de8b6e74d8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "address": "fa:16:3e:e2:ca:8e", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80a69f3-5d", "ovs_interfaceid": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:40:31.447532 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "address": "fa:16:3e:e2:ca:8e", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80a69f3-5d", "ovs_interfaceid": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:40:31.448168 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ca:8e,bridge_name='br-int',has_traffic_filtering=True,id=a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80a69f3-5d') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:40:31.448790 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'pci_devices' on Instance uuid 57adc083-429a-4f23-9154-7de8b6e74d8a {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:31.531257 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.000389930999972421 future=<Future at 0x72183443fe30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:31.534428 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Emitting event <LifecycleEvent: 1779165616.5307739, 57adc083-429a-4f23-9154-7de8b6e74d8a => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:40:31.534881 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:31.535150 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] VM Stopped (Lifecycle Event)
May 19 04:40:31.536268 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=1.3704631079999672 future=<Future at 0x7218501887d0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:31.536397 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=1.3703067950000332 future=<Future at 0x7218501887d0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:31.660199 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:40:31.660927 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:40:31.661373 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:31.661722 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:31.739928 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7955853f574d42e58ba89f18ed109760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3dfff83ce24e619f87507f951f6c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:40:31.834086 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:31.836436 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:40:31.845612 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:31.845813 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:31.846171 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:31.846444 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:31.846768 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:31.847035 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:31.950526 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Object Instance<57adc083-429a-4f23-9154-7de8b6e74d8a> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:40:31.951800 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] End _get_guest_xml xml=<domain type="qemu">
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:   <uuid>57adc083-429a-4f23-9154-7de8b6e74d8a</uuid>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:   <name>instance-0000001e</name>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestVolumeBootPattern-server-844446081</nova:name>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:40:27</nova:creationTime>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:           <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:           <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:         <nova:user uuid="5c46088fb3e74b819bb456461716a801">tempest-TestVolumeBootPattern-1071176852-project-member</nova:user>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:         <nova:project uuid="28b3c0fa8f894ed2a7c3bcfac99ce74c">tempest-TestVolumeBootPattern-1071176852</nova:project>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:         <nova:port uuid="a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b">
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     <system>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <entry name="serial">57adc083-429a-4f23-9154-7de8b6e74d8a</entry>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <entry name="uuid">57adc083-429a-4f23-9154-7de8b6e74d8a</entry>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     </system>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:   <os>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:   </os>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:   <features>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:   </features>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:   <devices>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/57adc083-429a-4f23-9154-7de8b6e74d8a/disk.config"/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     </disk>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <alias name="ua-ce533ab0-3286-48fd-9b76-1009e42dd4d9"/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-11"/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <serial>ce533ab0-3286-48fd-9b76-1009e42dd4d9</serial>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     </disk>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:e2:ca:8e"/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <target dev="tapa80a69f3-5d"/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     </interface>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/57adc083-429a-4f23-9154-7de8b6e74d8a/console.log" append="off"/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     </serial>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     <video>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     </video>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     </rng>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:   </devices>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]: </domain>
May 19 04:40:31.951800 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:40:31.953629 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] skipping disk /dev/dm-11 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:40:31.953629 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-844446081',display_name='tempest-TestVolumeBootPattern-server-844446081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-844446081',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxOKS9yEjObdHLZH1HI2bMkXDqbbhfdJb44v4wqJB4om8oUnQbceKvRmo5zkW64bMRcZfWY0eLqrWurjfNHYBjiuL8Xlu0w3AcYixWZlDbIAggkM7Ws8vQ5t98+fmLn7g==',key_name='tempest-keypair-1937042662',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:39:36Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-naev0poy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:40:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c46088fb3e74b819bb456461716a801',uuid=57adc083-429a-4f23-9154-7de8b6e74d8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "address": "fa:16:3e:e2:ca:8e", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80a69f3-5d", "ovs_interfaceid": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:40:31.953629 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "address": "fa:16:3e:e2:ca:8e", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80a69f3-5d", "ovs_interfaceid": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:40:31.953812 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ca:8e,bridge_name='br-int',has_traffic_filtering=True,id=a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80a69f3-5d') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:40:31.954589 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ca:8e,bridge_name='br-int',has_traffic_filtering=True,id=a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80a69f3-5d') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:40:31.954589 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:31.954589 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:31.954589 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:40:31.955193 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:31.955307 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '703bc732-1645-5ca1-a752-43756597687a', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:31.957230 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:31.957761 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:31.958370 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:31.960982 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:31.961096 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa80a69f3-5d, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:31.961386 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa80a69f3-5d, col_values=(('qos', UUID('eeb4a7c5-6150-49d6-9e0b-5fe66cb3c778')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:31.961530 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa80a69f3-5d, col_values=(('external_ids', {'iface-id': 'a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:ca:8e', 'vm-uuid': '57adc083-429a-4f23-9154-7de8b6e74d8a'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:31.962283 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:31.963309 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:31.970356 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:31.971077 np0000001025 nova-compute[97981]: INFO os_vif [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ca:8e,bridge_name='br-int',has_traffic_filtering=True,id=a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80a69f3-5d')
May 19 04:40:32.037974 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7e38e435-49ed-4c71-b388-dbee570b6821 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:32.166772 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:40:32.238234 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Successfully created port: 7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:40:32.338832 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:40:32.339175 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165632.338908, f6207103-8a47-4cc8-b1e0-c0ffd79e0173 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:40:32.339350 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] VM Paused (Lifecycle Event)
May 19 04:40:32.353680 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Took 10.58 seconds to spawn the instance on the hypervisor.
May 19 04:40:32.354516 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:32.461777 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 for instance e644a772-cf7c-4b15-b21b-ea54e773a1f9 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:40:32.574410 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:32.606489 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:32.671711 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:40:32.744261 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:32.844067 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:32.845928 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165632.8456666, f6207103-8a47-4cc8-b1e0-c0ffd79e0173 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:40:32.846080 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] VM Resumed (Lifecycle Event)
May 19 04:40:32.852866 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-feb6fd84-6ee5-4bb9-8fde-514017dd5f0e req-e32ce210-f86b-41a4-847b-8b159f3b12b2 service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Received event network-vif-plugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:32.852866 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-feb6fd84-6ee5-4bb9-8fde-514017dd5f0e req-e32ce210-f86b-41a4-847b-8b159f3b12b2 service nova] Acquiring lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:32.855209 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-feb6fd84-6ee5-4bb9-8fde-514017dd5f0e req-e32ce210-f86b-41a4-847b-8b159f3b12b2 service nova] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:32.855576 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-feb6fd84-6ee5-4bb9-8fde-514017dd5f0e req-e32ce210-f86b-41a4-847b-8b159f3b12b2 service nova] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:32.855576 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-feb6fd84-6ee5-4bb9-8fde-514017dd5f0e req-e32ce210-f86b-41a4-847b-8b159f3b12b2 service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] No waiting events found dispatching network-vif-plugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:40:32.855670 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-feb6fd84-6ee5-4bb9-8fde-514017dd5f0e req-e32ce210-f86b-41a4-847b-8b159f3b12b2 service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Received unexpected event network-vif-plugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 for instance with vm_state active and task_state None.
May 19 04:40:32.869895 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Took 18.01 seconds to build instance.
May 19 04:40:32.901173 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-78dbcca7-15a4-4aa3-bec1-b81d369d86cd req-eceafcab-f61a-4846-a52f-a2cb8926599b service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Received event network-vif-plugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:32.903289 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-78dbcca7-15a4-4aa3-bec1-b81d369d86cd req-eceafcab-f61a-4846-a52f-a2cb8926599b service nova] Acquiring lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:32.903687 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-78dbcca7-15a4-4aa3-bec1-b81d369d86cd req-eceafcab-f61a-4846-a52f-a2cb8926599b service nova] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:32.903687 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-78dbcca7-15a4-4aa3-bec1-b81d369d86cd req-eceafcab-f61a-4846-a52f-a2cb8926599b service nova] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:32.903925 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-78dbcca7-15a4-4aa3-bec1-b81d369d86cd req-eceafcab-f61a-4846-a52f-a2cb8926599b service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] No waiting events found dispatching network-vif-plugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:40:32.904009 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-78dbcca7-15a4-4aa3-bec1-b81d369d86cd req-eceafcab-f61a-4846-a52f-a2cb8926599b service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Received unexpected event network-vif-plugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b for instance with vm_state stopped and task_state powering-on.
May 19 04:40:32.909404 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0026704780000272876 future=<Future at 0x7218501887d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:32.909522 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:32.910773 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Emitting event <LifecycleEvent: 1779165617.9066415, e415a06a-1c69-49b7-9bd3-f68ce343b0b7 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:40:32.910956 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] VM Stopped (Lifecycle Event)
May 19 04:40:32.918559 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Successfully updated port: 7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:40:32.971726 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:32.976319 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:33.006036 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:33.006161 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a1b21653-d001-441e-8e74-11763ed6b973 req-b75665c4-2ccb-4053-8347-1be54b20fc94 service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Received event network-changed-7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:33.009191 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a1b21653-d001-441e-8e74-11763ed6b973 req-b75665c4-2ccb-4053-8347-1be54b20fc94 service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Refreshing instance network info cache due to event network-changed-7aa25728-c226-4d2c-ac7a-d5a1edf94739. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:40:33.010675 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a1b21653-d001-441e-8e74-11763ed6b973 req-b75665c4-2ccb-4053-8347-1be54b20fc94 service nova] Acquiring lock "refresh_cache-15f0abbc-b8de-4d77-88c4-e5c0e54d691f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:40:33.010675 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a1b21653-d001-441e-8e74-11763ed6b973 req-b75665c4-2ccb-4053-8347-1be54b20fc94 service nova] Acquired lock "refresh_cache-15f0abbc-b8de-4d77-88c4-e5c0e54d691f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:40:33.010675 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a1b21653-d001-441e-8e74-11763ed6b973 req-b75665c4-2ccb-4053-8347-1be54b20fc94 service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Refreshing network info cache for port 7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:40:33.138786 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:40:33.139022 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:40:33.208263 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:33.357571 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:33.361138 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:40:33.373380 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.516s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:33.413692 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-84242ee4-3509-4390-b248-2de25f9a8ebb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e415a06a-1c69-49b7-9bd3-f68ce343b0b7] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:33.423722 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "refresh_cache-15f0abbc-b8de-4d77-88c4-e5c0e54d691f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:40:33.514775 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-a1b21653-d001-441e-8e74-11763ed6b973 req-b75665c4-2ccb-4053-8347-1be54b20fc94 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:33.542334 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Instance event wait completed in 0 seconds for  {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:40:33.551477 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Instance rebooted successfully.
May 19 04:40:33.607731 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a1b21653-d001-441e-8e74-11763ed6b973 req-b75665c4-2ccb-4053-8347-1be54b20fc94 service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:40:33.615017 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:40:33.615353 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:40:33.642577 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:40:33.692266 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:40:33.693278 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:40:33.693544 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Creating image(s)
May 19 04:40:33.693985 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "/opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:33.695321 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "/opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:33.696287 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "/opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:33.696851 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:40:33.705281 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:40:33.707310 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:33.810585 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.103s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:33.811121 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:33.811615 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:33.812124 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:40:33.817192 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:40:33.817295 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:33.841726 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a1b21653-d001-441e-8e74-11763ed6b973 req-b75665c4-2ccb-4053-8347-1be54b20fc94 service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:33.863986 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165633.8635473, e644a772-cf7c-4b15-b21b-ea54e773a1f9 => ua-c6c2c4b5-04b6-4084-ab2f-2487d1148c47> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:40:33.866138 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165633.8644078, 57adc083-429a-4f23-9154-7de8b6e74d8a => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:40:33.866138 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] VM Resumed (Lifecycle Event)
May 19 04:40:33.869899 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully detached device vdb from instance e644a772-cf7c-4b15-b21b-ea54e773a1f9 from the live domain config.
May 19 04:40:33.914459 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:40:33.915138 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.097s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:33.915281 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:33.915662 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:33.915847 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:33.916341 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:33.916656 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:40:33.929898 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:40:33.977056 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:33.977056 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:33.977056 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:33.977056 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:33.977056 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:33.977056 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:33.977056 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:33.977056 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:33.977056 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:33.977056 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:33.977056 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:33.977056 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:33.977056 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:33.977056 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:33.977056 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:33.977056 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:33.977056 np0000001025 nova-compute[97981]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:33.977056 np0000001025 nova-compute[97981]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:33.977056 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:33.977656 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:33.977656 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:33.977656 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:33.977656 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:33.977656 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:33.977656 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:33.977656 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:33.977656 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:33.977656 np0000001025 nova-compute[97981]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:33.977656 np0000001025 nova-compute[97981]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47 (non-flash)
May 19 04:40:33.977656 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:33.977656 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:33.977656 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:33.977656 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:33.977656 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:33.977656 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:33.977656 np0000001025 nova-compute[97981]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:33.977656 np0000001025 nova-compute[97981]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:33.977656 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:33.977656 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', '78'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '81'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', '85')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:40:33.978245 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', '76')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:33.979074 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk 1073741824" returned: 0 in 0.063s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:33.980623 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.169s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:33.981878 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:33.999994 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47', '77')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:33.999994 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185013b600>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47'): ({'sde'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:40:33.999994 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Removing multipathed devices sde, sdd {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:40:34.000258 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Flush multipath device 330000000de3b6c24 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:40:34.030467 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:40:34.084990 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:40:34.088088 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.107s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:34.088455 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:40:34.088848 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:34.135087 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:40:34.135087 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:40:34.136882 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:40:34.152219 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.738s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:34.152845 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:40:34.156485 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:40:34.158589 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:40:34.175912 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:34.191769 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:34.191769 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Cannot resize image /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:40:34.192031 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:40:34.192190 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Ensure instance console log exists: /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:40:34.192428 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:34.192616 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:34.193965 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:34.226911 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 76, target: iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47, portal: 192.168.40.100,3260]
May 19 04:40:34.226911 np0000001025 nova-compute[97981]: Logout of [sid: 76, target: iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47, portal: 192.168.40.100,3260] successful.
May 19 04:40:34.226911 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:34.260060 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:34.272439 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:34.328009 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 77, target: iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47, portal: 192.168.50.100,3260]
May 19 04:40:34.328009 np0000001025 nova-compute[97981]: Logout of [sid: 77, target: iqn.2023-03.storpool.com:os--volume-c6c2c4b5-04b6-4084-ab2f-2487d1148c47, portal: 192.168.50.100,3260] successful.
May 19 04:40:34.328009 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:34.345540 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a1b21653-d001-441e-8e74-11763ed6b973 req-b75665c4-2ccb-4053-8347-1be54b20fc94 service nova] Releasing lock "refresh_cache-15f0abbc-b8de-4d77-88c4-e5c0e54d691f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:40:34.346060 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquired lock "refresh_cache-15f0abbc-b8de-4d77-88c4-e5c0e54d691f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:40:34.346374 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:40:34.354090 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:34.354396 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.438s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:34.354563 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] <== disconnect_volume: return (438ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:34.354705 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:40:34.369941 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:34.372723 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:40:34.449232 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "87e8e02e-e385-418c-be0c-bb25a377d081" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:34.449392 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "87e8e02e-e385-418c-be0c-bb25a377d081" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:34.471413 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "93c62882-ef27-41d5-8178-e1ccc945fe1d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:34.471848 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "93c62882-ef27-41d5-8178-e1ccc945fe1d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:34.663892 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:40:34.664437 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:40:34.664587 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:34.664818 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:34.744993 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93a5d16bed8c474fa58e1982fa784db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0c7a19a41a44fba4c0fca71022a5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:40:34.874085 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] During sync_power_state the instance has a pending task (powering-on). Skip.
May 19 04:40:34.874374 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165634.8741574, 57adc083-429a-4f23-9154-7de8b6e74d8a => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:40:34.874504 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] VM Started (Lifecycle Event)
May 19 04:40:34.921483 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'flavor' on Instance uuid e644a772-cf7c-4b15-b21b-ea54e773a1f9 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:34.935073 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-68feaccf-da2e-4c38-ad7d-47bff068ae3d req-e56bb462-f351-4b8c-b1c3-9b2f79743dbd service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Received event network-changed-198ee052-a44f-474c-87e1-409937e2e3c2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:34.935073 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-68feaccf-da2e-4c38-ad7d-47bff068ae3d req-e56bb462-f351-4b8c-b1c3-9b2f79743dbd service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Refreshing instance network info cache due to event network-changed-198ee052-a44f-474c-87e1-409937e2e3c2. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:40:34.935073 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-68feaccf-da2e-4c38-ad7d-47bff068ae3d req-e56bb462-f351-4b8c-b1c3-9b2f79743dbd service nova] Acquiring lock "refresh_cache-5951341b-0ad5-4fb0-82ad-b464c081f37f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:40:34.935073 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-68feaccf-da2e-4c38-ad7d-47bff068ae3d req-e56bb462-f351-4b8c-b1c3-9b2f79743dbd service nova] Acquired lock "refresh_cache-5951341b-0ad5-4fb0-82ad-b464c081f37f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:40:34.935073 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-68feaccf-da2e-4c38-ad7d-47bff068ae3d req-e56bb462-f351-4b8c-b1c3-9b2f79743dbd service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Refreshing network info cache for port 198ee052-a44f-474c-87e1-409937e2e3c2 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:40:34.953451 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Detaching volume 3d33411d-7cc5-4e9d-a217-fd0909091806
May 19 04:40:34.960842 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:40:34.974764 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lazy-loading 'flavor' on Instance uuid 93c62882-ef27-41d5-8178-e1ccc945fe1d {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:34.987259 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-15555197-7676-4122-97f7-913befd4b661 req-25aeb839-b5e5-4d85-99e2-3a5840479ab6 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Received event network-vif-plugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:34.987365 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-15555197-7676-4122-97f7-913befd4b661 req-25aeb839-b5e5-4d85-99e2-3a5840479ab6 service nova] Acquiring lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:34.987506 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-15555197-7676-4122-97f7-913befd4b661 req-25aeb839-b5e5-4d85-99e2-3a5840479ab6 service nova] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:34.987665 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-15555197-7676-4122-97f7-913befd4b661 req-25aeb839-b5e5-4d85-99e2-3a5840479ab6 service nova] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:34.987735 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-15555197-7676-4122-97f7-913befd4b661 req-25aeb839-b5e5-4d85-99e2-3a5840479ab6 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] No waiting events found dispatching network-vif-plugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:40:34.989386 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-15555197-7676-4122-97f7-913befd4b661 req-25aeb839-b5e5-4d85-99e2-3a5840479ab6 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Received unexpected event network-vif-plugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b for instance with vm_state stopped and task_state powering-on.
May 19 04:40:35.012661 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Attempting to driver detach volume 3d33411d-7cc5-4e9d-a217-fd0909091806 from mountpoint /dev/vdc
May 19 04:40:35.019523 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Found disk vdc by alias ua-3d33411d-7cc5-4e9d-a217-fd0909091806 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:40:35.020790 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Found disk vdc by alias ua-3d33411d-7cc5-4e9d-a217-fd0909091806 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:40:35.020908 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Attempting to detach device vdc from instance 87e8e02e-e385-418c-be0c-bb25a377d081 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:40:35.021343 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:40:35.021343 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:40:35.021343 np0000001025 nova-compute[97981]:   <alias name="ua-3d33411d-7cc5-4e9d-a217-fd0909091806"/>
May 19 04:40:35.021343 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-5"/>
May 19 04:40:35.021343 np0000001025 nova-compute[97981]:   <target dev="vdc" bus="virtio"/>
May 19 04:40:35.021343 np0000001025 nova-compute[97981]:   <serial>3d33411d-7cc5-4e9d-a217-fd0909091806</serial>
May 19 04:40:35.021343 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 19 04:40:35.021343 np0000001025 nova-compute[97981]: </disk>
May 19 04:40:35.021343 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:40:35.032250 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Successfully detached device vdc from instance 87e8e02e-e385-418c-be0c-bb25a377d081 from the persistent domain config.
May 19 04:40:35.032360 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] (1/8): Attempting to detach device vdc with device alias ua-3d33411d-7cc5-4e9d-a217-fd0909091806 from instance 87e8e02e-e385-418c-be0c-bb25a377d081 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:40:35.032698 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:40:35.032698 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:40:35.032698 np0000001025 nova-compute[97981]:   <alias name="ua-3d33411d-7cc5-4e9d-a217-fd0909091806"/>
May 19 04:40:35.032698 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-5"/>
May 19 04:40:35.032698 np0000001025 nova-compute[97981]:   <target dev="vdc" bus="virtio"/>
May 19 04:40:35.032698 np0000001025 nova-compute[97981]:   <serial>3d33411d-7cc5-4e9d-a217-fd0909091806</serial>
May 19 04:40:35.032698 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 19 04:40:35.032698 np0000001025 nova-compute[97981]: </disk>
May 19 04:40:35.032698 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:40:35.063774 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:35.063941 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:35.064003 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No VIF found with MAC fa:16:3e:e2:ca:8e, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:40:35.064378 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-bb066ac2-9ddb-4916-90ca-77b311db9730 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:35.156559 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:35.167270 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:40:35.279362 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Successfully created port: 6b74663e-9ccd-4251-97fd-0eca225719e2 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:40:35.352536 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Updating instance_info_cache with network_info: [{"id": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "address": "fa:16:3e:19:0f:7d", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa25728-c2", "ovs_interfaceid": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:35.376703 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:35.379089 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:40:35.439905 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-68feaccf-da2e-4c38-ad7d-47bff068ae3d req-e56bb462-f351-4b8c-b1c3-9b2f79743dbd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:35.478587 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Ignoring supplied device name: /dev/vdb
May 19 04:40:35.510435 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Stashing vm_state: active {{(pid=97981) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 19 04:40:35.593419 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-3d33411d-7cc5-4e9d-a217-fd0909091806 for instance 87e8e02e-e385-418c-be0c-bb25a377d081 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:40:35.614917 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:40:35.615330 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:40:35.677152 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:40:35.796171 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-68feaccf-da2e-4c38-ad7d-47bff068ae3d req-e56bb462-f351-4b8c-b1c3-9b2f79743dbd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:35.804581 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Successfully updated port: 6b74663e-9ccd-4251-97fd-0eca225719e2 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:40:35.854692 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Releasing lock "refresh_cache-15f0abbc-b8de-4d77-88c4-e5c0e54d691f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:40:35.855027 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Instance network_info: |[{"id": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "address": "fa:16:3e:19:0f:7d", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa25728-c2", "ovs_interfaceid": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:40:35.857686 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Start _get_guest_xml network_info=[{"id": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "address": "fa:16:3e:19:0f:7d", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa25728-c2", "ovs_interfaceid": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:40:35.859687 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:40:35.860758 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-395626849', uuid='15f0abbc-b8de-4d77-88c4-e5c0e54d691f'), owner=OwnerMeta(userid='7955853f574d42e58ba89f18ed109760', username='tempest-AttachVolumeShelveTestJSON-51274594-project-member', projectid='8a3dfff83ce24e619f87507f951f6c69', projectname='tempest-AttachVolumeShelveTestJSON-51274594'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "address": "fa:16:3e:19:0f:7d", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa25728-c2", "ovs_interfaceid": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165635.8604522) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:40:35.861731 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:40:35.862027 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:40:35.862721 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:40:35.862868 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:40:35.863713 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:40:35.864016 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:40:35.864195 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:40:35.864307 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:40:35.864527 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:40:35.864577 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:40:35.864690 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:40:35.864869 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:40:35.864994 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:40:35.865158 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:40:35.865280 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:40:35.865454 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:40:35.882182 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165635.881722, 87e8e02e-e385-418c-be0c-bb25a377d081 => ua-3d33411d-7cc5-4e9d-a217-fd0909091806> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:40:35.886643 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:40:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-395626849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumeshelvetestjson-server-395626849',id=35,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrCQLYSDh4BSAKuJQO3lgIeQcxBF4rxRleMAE4CBnW4YvXO/MjPLM9cnsN7Cu0cFPOG4awlQsAI62nW05tLJ3lA9gst1KdtxXP1kupL4rfaIsrpVkX58JAXH5lwrYvyBw==',key_name='tempest-keypair-802114952',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a3dfff83ce24e619f87507f951f6c69',ramdisk_id='',reservation_id='r-43nv4a6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-51274594',owner_user_name='tempest-AttachVolumeShelveTestJSON-51274594-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:40:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7955853f574d42e58ba89f18ed109760',uuid=15f0abbc-b8de-4d77-88c4-e5c0e54d691f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "address": "fa:16:3e:19:0f:7d", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa25728-c2", "ovs_interfaceid": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:40:35.886643 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converting VIF {"id": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "address": "fa:16:3e:19:0f:7d", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa25728-c2", "ovs_interfaceid": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:40:35.886643 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:0f:7d,bridge_name='br-int',has_traffic_filtering=True,id=7aa25728-c226-4d2c-ac7a-d5a1edf94739,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa25728-c2') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:40:35.886643 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'pci_devices' on Instance uuid 15f0abbc-b8de-4d77-88c4-e5c0e54d691f {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:35.888304 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Successfully detached device vdc from instance 87e8e02e-e385-418c-be0c-bb25a377d081 from the live domain config.
May 19 04:40:35.889325 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:40:35.889660 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3d33411d-7cc5-4e9d-a217-fd0909091806', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:35.889804 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:35.890950 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:35.890950 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3d33411d-7cc5-4e9d-a217-fd0909091806', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:40:35.890950 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:40:35.926967 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:35.926967 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:35.926967 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:35.926967 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:35.926967 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:35.926967 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:35.926967 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:35.926967 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:35.926967 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:35.926967 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:35.926967 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:35.926967 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:35.926967 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:35.926967 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:35.926967 np0000001025 nova-compute[97981]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:35.926967 np0000001025 nova-compute[97981]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:35.926967 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:35.927433 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:35.927433 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:35.927433 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:35.927433 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:35.927433 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:35.927433 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:35.927433 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:35.927433 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:35.927433 np0000001025 nova-compute[97981]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:35.927433 np0000001025 nova-compute[97981]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806 (non-flash)
May 19 04:40:35.927433 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:35.927433 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:35.927433 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:35.927433 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:35.927433 np0000001025 nova-compute[97981]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:35.927433 np0000001025 nova-compute[97981]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:35.927433 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:35.927433 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', '78'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '81'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', '85')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:40:35.927433 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', '78')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:35.928710 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806', '79')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:35.929804 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721834316a20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806'): ({'sdr'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806'): ({'sds'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:40:35.929983 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Removing multipathed devices sdr, sds {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:40:35.930198 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Flush multipath device 3300000009cc8910f {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:40:35.930526 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e1b2f7c5-2cf7-4e35-950a-ade58c5505e8 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.321s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:35.951525 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-68feaccf-da2e-4c38-ad7d-47bff068ae3d req-e56bb462-f351-4b8c-b1c3-9b2f79743dbd service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Updated VIF entry in instance network info cache for port 198ee052-a44f-474c-87e1-409937e2e3c2. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:40:35.951986 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-68feaccf-da2e-4c38-ad7d-47bff068ae3d req-e56bb462-f351-4b8c-b1c3-9b2f79743dbd service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Updating instance_info_cache with network_info: [{"id": "198ee052-a44f-474c-87e1-409937e2e3c2", "address": "fa:16:3e:bc:20:08", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap198ee052-a4", "ovs_interfaceid": "198ee052-a44f-474c-87e1-409937e2e3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:35.973010 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Remove SCSI device /dev/sdr with /sys/block/sdr/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:40:35.981409 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "93c62882-ef27-41d5-8178-e1ccc945fe1d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:35.999886 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-32888280-342e-4df8-8f58-4e4884dae949 req-b367f484-efdd-4e1b-8bf4-cbf13df792a1 service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Received event network-changed-6b74663e-9ccd-4251-97fd-0eca225719e2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:36.000013 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-32888280-342e-4df8-8f58-4e4884dae949 req-b367f484-efdd-4e1b-8bf4-cbf13df792a1 service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Refreshing instance network info cache due to event network-changed-6b74663e-9ccd-4251-97fd-0eca225719e2. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:40:36.000184 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-32888280-342e-4df8-8f58-4e4884dae949 req-b367f484-efdd-4e1b-8bf4-cbf13df792a1 service nova] Acquiring lock "refresh_cache-0dbaac9f-71f1-4cb6-837c-cafc38f94f11" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:40:36.000279 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-32888280-342e-4df8-8f58-4e4884dae949 req-b367f484-efdd-4e1b-8bf4-cbf13df792a1 service nova] Acquired lock "refresh_cache-0dbaac9f-71f1-4cb6-837c-cafc38f94f11" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:40:36.000386 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-32888280-342e-4df8-8f58-4e4884dae949 req-b367f484-efdd-4e1b-8bf4-cbf13df792a1 service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Refreshing network info cache for port 6b74663e-9ccd-4251-97fd-0eca225719e2 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:40:36.021040 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Remove SCSI device /dev/sds with /sys/block/sds/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:40:36.024607 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-b7f8a433-fc44-433a-99ec-1e888db86cb0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Get console output
May 19 04:40:36.062526 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:36.062813 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:36.074916 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Checking to see if SCSI volumes sdr, sds have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:40:36.075258 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] SCSI volumes sdr, sds have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:40:36.078349 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Checking to see if device paths {'sdr', 'sds'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:40:36.088417 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Device paths {'sdr', 'sds'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:40:36.088871 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:40:36.100589 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:36.108879 np0000001025 nova-compute[97981]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 19 04:40:36.149352 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 78, target: iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806, portal: 192.168.40.100,3260]
May 19 04:40:36.149352 np0000001025 nova-compute[97981]: Logout of [sid: 78, target: iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806, portal: 192.168.40.100,3260] successful.
May 19 04:40:36.149352 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:36.172157 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:36.184228 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:36.230777 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 79, target: iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806, portal: 192.168.50.100,3260]
May 19 04:40:36.230777 np0000001025 nova-compute[97981]: Logout of [sid: 79, target: iqn.2023-03.storpool.com:os--volume-3d33411d-7cc5-4e9d-a217-fd0909091806, portal: 192.168.50.100,3260] successful.
May 19 04:40:36.230777 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:36.258093 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:36.258358 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:36.258526 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] <== disconnect_volume: return (368ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:36.258675 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:40:36.306373 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "refresh_cache-0dbaac9f-71f1-4cb6-837c-cafc38f94f11" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:40:36.390133 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] End _get_guest_xml xml=<domain type="qemu">
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:   <uuid>15f0abbc-b8de-4d77-88c4-e5c0e54d691f</uuid>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:   <name>instance-00000023</name>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-395626849</nova:name>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:40:35</nova:creationTime>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:         <nova:user uuid="7955853f574d42e58ba89f18ed109760">tempest-AttachVolumeShelveTestJSON-51274594-project-member</nova:user>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:         <nova:project uuid="8a3dfff83ce24e619f87507f951f6c69">tempest-AttachVolumeShelveTestJSON-51274594</nova:project>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:         <nova:port uuid="7aa25728-c226-4d2c-ac7a-d5a1edf94739">
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     <system>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <entry name="serial">15f0abbc-b8de-4d77-88c4-e5c0e54d691f</entry>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <entry name="uuid">15f0abbc-b8de-4d77-88c4-e5c0e54d691f</entry>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     </system>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:   <os>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:   </os>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:   <features>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:   </features>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:   <devices>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk"/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     </disk>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk.config"/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     </disk>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:19:0f:7d"/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <target dev="tap7aa25728-c2"/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     </interface>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/console.log" append="off"/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     </serial>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     <video>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     </video>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     </rng>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:   </devices>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]: </domain>
May 19 04:40:36.390133 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:40:36.390133 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Preparing to wait for external event network-vif-plugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:40:36.390133 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:36.390133 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:36.390133 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:36.392007 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:40:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-395626849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumeshelvetestjson-server-395626849',id=35,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrCQLYSDh4BSAKuJQO3lgIeQcxBF4rxRleMAE4CBnW4YvXO/MjPLM9cnsN7Cu0cFPOG4awlQsAI62nW05tLJ3lA9gst1KdtxXP1kupL4rfaIsrpVkX58JAXH5lwrYvyBw==',key_name='tempest-keypair-802114952',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a3dfff83ce24e619f87507f951f6c69',ramdisk_id='',reservation_id='r-43nv4a6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-51274594',owner_user_name='tempest-AttachVolumeShelveTestJSON-51274594-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:40:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7955853f574d42e58ba89f18ed109760',uuid=15f0abbc-b8de-4d77-88c4-e5c0e54d691f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "address": "fa:16:3e:19:0f:7d", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa25728-c2", "ovs_interfaceid": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:40:36.392007 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converting VIF {"id": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "address": "fa:16:3e:19:0f:7d", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa25728-c2", "ovs_interfaceid": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:40:36.392007 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:0f:7d,bridge_name='br-int',has_traffic_filtering=True,id=7aa25728-c226-4d2c-ac7a-d5a1edf94739,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa25728-c2') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:40:36.395537 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:0f:7d,bridge_name='br-int',has_traffic_filtering=True,id=7aa25728-c226-4d2c-ac7a-d5a1edf94739,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa25728-c2') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:40:36.395537 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:36.395537 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:36.395537 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:40:36.395537 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:36.395537 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0bf164c-a09e-507e-b628-9d0aac6bfd3b', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:36.395697 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:36.396845 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:36.397747 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:36.402042 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:36.402645 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7aa25728-c2, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:36.403123 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7aa25728-c2, col_values=(('qos', UUID('1ba659ac-adcc-45c3-8043-55bc5a832515')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:36.403354 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7aa25728-c2, col_values=(('external_ids', {'iface-id': '7aa25728-c226-4d2c-ac7a-d5a1edf94739', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:0f:7d', 'vm-uuid': '15f0abbc-b8de-4d77-88c4-e5c0e54d691f'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:36.407022 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:36.408652 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:36.412246 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:36.413253 np0000001025 nova-compute[97981]: INFO os_vif [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:0f:7d,bridge_name='br-int',has_traffic_filtering=True,id=7aa25728-c226-4d2c-ac7a-d5a1edf94739,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa25728-c2')
May 19 04:40:36.453951 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-68feaccf-da2e-4c38-ad7d-47bff068ae3d req-e56bb462-f351-4b8c-b1c3-9b2f79743dbd service nova] Releasing lock "refresh_cache-5951341b-0ad5-4fb0-82ad-b464c081f37f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:40:36.454171 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-68feaccf-da2e-4c38-ad7d-47bff068ae3d req-e56bb462-f351-4b8c-b1c3-9b2f79743dbd service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Received event network-changed-37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:36.454330 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-68feaccf-da2e-4c38-ad7d-47bff068ae3d req-e56bb462-f351-4b8c-b1c3-9b2f79743dbd service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Refreshing instance network info cache due to event network-changed-37cbdb78-cc1c-48e2-879d-959cb26c29f9. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:40:36.454505 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-68feaccf-da2e-4c38-ad7d-47bff068ae3d req-e56bb462-f351-4b8c-b1c3-9b2f79743dbd service nova] Acquiring lock "refresh_cache-f6207103-8a47-4cc8-b1e0-c0ffd79e0173" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:40:36.454635 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-68feaccf-da2e-4c38-ad7d-47bff068ae3d req-e56bb462-f351-4b8c-b1c3-9b2f79743dbd service nova] Acquired lock "refresh_cache-f6207103-8a47-4cc8-b1e0-c0ffd79e0173" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:40:36.454812 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-68feaccf-da2e-4c38-ad7d-47bff068ae3d req-e56bb462-f351-4b8c-b1c3-9b2f79743dbd service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Refreshing network info cache for port 37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:40:36.502933 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-32888280-342e-4df8-8f58-4e4884dae949 req-b367f484-efdd-4e1b-8bf4-cbf13df792a1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:36.570993 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:40:36.570993 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Claim successful on node np0000001025
May 19 04:40:36.596151 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-32888280-342e-4df8-8f58-4e4884dae949 req-b367f484-efdd-4e1b-8bf4-cbf13df792a1 service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:40:36.614954 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:40:36.685598 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:40:36.687628 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:40:36.687628 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Creating image(s)
May 19 04:40:36.687628 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "/opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:36.687628 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "/opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:36.687628 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "/opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:36.688259 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:40:36.690839 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:40:36.692324 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:36.773913 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.082s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:36.774372 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:36.775260 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:36.775731 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:40:36.778326 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:40:36.778658 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:36.813514 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-32888280-342e-4df8-8f58-4e4884dae949 req-b367f484-efdd-4e1b-8bf4-cbf13df792a1 service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:36.827971 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lazy-loading 'flavor' on Instance uuid 87e8e02e-e385-418c-be0c-bb25a377d081 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:36.868588 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.090s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:36.868966 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:36.927977 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk 1073741824" returned: 0 in 0.059s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:36.928746 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.153s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:36.929166 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:36.957902 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-68feaccf-da2e-4c38-ad7d-47bff068ae3d req-e56bb462-f351-4b8c-b1c3-9b2f79743dbd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:37.005046 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "6f26313e-2659-4687-84da-96cf2da9a4e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:37.005320 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:37.020773 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.092s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:37.021207 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:40:37.021637 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:37.078571 np0000001025 nova-compute[97981]: INFO nova.compute.resource_tracker [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Updating resource usage from migration 924dbb37-1046-4d89-8be8-3be585934dcc
May 19 04:40:37.121310 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:37.123170 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:37.123458 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Cannot resize image /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:40:37.123839 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:40:37.124025 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Ensure instance console log exists: /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:40:37.124420 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:37.124675 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:37.124854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:37.169317 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "93c62882-ef27-41d5-8178-e1ccc945fe1d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:37.169625 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "93c62882-ef27-41d5-8178-e1ccc945fe1d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:37.169746 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Attaching volume a7faf4e4-0f15-4992-8e8b-12efa20286d6 to /dev/vdb
May 19 04:40:37.226900 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:37.237923 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:40:37.261176 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:37.298145 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:40:37.302372 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:40:37.310562 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:40:37.311874 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:fe16:6b7e', 'fe80::6898:26ff:fe86:46b0', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fef1:293e', 'fe80::8849:6dff:fe86:4a4b', 'fe80::fc16:3eff:fea1:aa43', 'fe80::fc16:3eff:fe91:89b7', 'fe80::fc16:3eff:fee2:ca8e', 'fe80::bc20:d2ff:fef5:7278'] 
May 19 04:40:37.312026 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:40:37.312179 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:40:37.312433 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:37.312669 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Updating existing volume attachment record: cf82055d-5738-4ce6-bafb-2ac5766bfaa4 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:40:37.319377 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-32888280-342e-4df8-8f58-4e4884dae949 req-b367f484-efdd-4e1b-8bf4-cbf13df792a1 service nova] Releasing lock "refresh_cache-0dbaac9f-71f1-4cb6-837c-cafc38f94f11" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:40:37.321117 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquired lock "refresh_cache-0dbaac9f-71f1-4cb6-837c-cafc38f94f11" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:40:37.321359 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:40:37.344242 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-68feaccf-da2e-4c38-ad7d-47bff068ae3d req-e56bb462-f351-4b8c-b1c3-9b2f79743dbd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:37.515905 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-68feaccf-da2e-4c38-ad7d-47bff068ae3d req-e56bb462-f351-4b8c-b1c3-9b2f79743dbd service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Updated VIF entry in instance network info cache for port 37cbdb78-cc1c-48e2-879d-959cb26c29f9. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:40:37.516384 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-68feaccf-da2e-4c38-ad7d-47bff068ae3d req-e56bb462-f351-4b8c-b1c3-9b2f79743dbd service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Updating instance_info_cache with network_info: [{"id": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "address": "fa:16:3e:91:89:b7", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cbdb78-cc", "ovs_interfaceid": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:37.518496 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:40:37.836544 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fdd97f0b-01fd-47e0-802b-fc69d095c29f tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "87e8e02e-e385-418c-be0c-bb25a377d081" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.387s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:37.877919 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:40:37.878271 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7faf4e4-0f15-4992-8e8b-12efa20286d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:37.878413 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:37.878897 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:37.879081 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7faf4e4-0f15-4992-8e8b-12efa20286d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:40:37.882509 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:40:37.883130 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:40:37.894600 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:37.895225 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:37.896544 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:37.896841 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:40:37.898493 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:37.898752 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:40:37.910311 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:40:37.912747 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:40:37.912747 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:37.918193 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:40:37.918193 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:37.928870 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6] added
May 19 04:40:37.928870 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:40:37.928870 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:37.928870 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:37.928870 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:37.928870 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:37.928870 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:37.929318 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:40:37.929703 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0328(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:40:37.930370 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:40:37.934984 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:37.935898 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6] added
May 19 04:40:37.935898 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:40:37.935898 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:37.935898 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:37.935898 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:37.935898 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:37.935898 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:37.936293 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:40:37.936293 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0375(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:40:37.936581 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:37.936865 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:40:37.937352 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] No VIF found with MAC fa:16:3e:19:0f:7d, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:40:37.938340 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Using config drive
May 19 04:40:38.021280 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-68feaccf-da2e-4c38-ad7d-47bff068ae3d req-e56bb462-f351-4b8c-b1c3-9b2f79743dbd service nova] Releasing lock "refresh_cache-f6207103-8a47-4cc8-b1e0-c0ffd79e0173" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:40:38.099854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:38.135777 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:38.209641 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:38.212468 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "57adc083-429a-4f23-9154-7de8b6e74d8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:38.212762 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:38.212951 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:38.213728 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:38.213820 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:38.216217 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Terminating instance
May 19 04:40:38.314866 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Updating instance_info_cache with network_info: [{"id": "6b74663e-9ccd-4251-97fd-0eca225719e2", "address": "fa:16:3e:19:9d:73", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74663e-9c", "ovs_interfaceid": "6b74663e-9ccd-4251-97fd-0eca225719e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:38.386195 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:40:38.445022 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:38.477181 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ea45cba5-52c2-4bbf-a01f-03a92d50fd47 req-a259e793-d426-4f77-a054-6ea52c70c4e8 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Received event network-changed-3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:38.477508 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ea45cba5-52c2-4bbf-a01f-03a92d50fd47 req-a259e793-d426-4f77-a054-6ea52c70c4e8 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Refreshing instance network info cache due to event network-changed-3587c521-ddbe-4301-84ca-17721980c57a. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:40:38.478219 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ea45cba5-52c2-4bbf-a01f-03a92d50fd47 req-a259e793-d426-4f77-a054-6ea52c70c4e8 service nova] Acquiring lock "refresh_cache-87e8e02e-e385-418c-be0c-bb25a377d081" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:40:38.478362 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ea45cba5-52c2-4bbf-a01f-03a92d50fd47 req-a259e793-d426-4f77-a054-6ea52c70c4e8 service nova] Acquired lock "refresh_cache-87e8e02e-e385-418c-be0c-bb25a377d081" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:40:38.478444 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-ea45cba5-52c2-4bbf-a01f-03a92d50fd47 req-a259e793-d426-4f77-a054-6ea52c70c4e8 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Refreshing network info cache for port 3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:40:38.578644 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Creating config drive at /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk.config
May 19 04:40:38.582889 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxa0g8fp_ {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:38.638587 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxa0g8fp_" returned: 0 in 0.055s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:38.726128 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:40:38.751260 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:38.756522 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:38.780045 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:38.795083 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:38.817636 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Releasing lock "refresh_cache-0dbaac9f-71f1-4cb6-837c-cafc38f94f11" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:40:38.818068 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Instance network_info: |[{"id": "6b74663e-9ccd-4251-97fd-0eca225719e2", "address": "fa:16:3e:19:9d:73", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74663e-9c", "ovs_interfaceid": "6b74663e-9ccd-4251-97fd-0eca225719e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:40:38.821885 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Start _get_guest_xml network_info=[{"id": "6b74663e-9ccd-4251-97fd-0eca225719e2", "address": "fa:16:3e:19:9d:73", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74663e-9c", "ovs_interfaceid": "6b74663e-9ccd-4251-97fd-0eca225719e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:40:38.827415 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:38.834697 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:40:38.837355 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1934719110', uuid='0dbaac9f-71f1-4cb6-837c-cafc38f94f11'), owner=OwnerMeta(userid='93a5d16bed8c474fa58e1982fa784db9', username='tempest-VolumeMultiattachTests-1349332830-project-member', projectid='7e0c7a19a41a44fba4c0fca71022a5a1', projectname='tempest-VolumeMultiattachTests-1349332830'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6b74663e-9ccd-4251-97fd-0eca225719e2", "address": "fa:16:3e:19:9d:73", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74663e-9c", "ovs_interfaceid": "6b74663e-9ccd-4251-97fd-0eca225719e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165638.8368092) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:40:38.839490 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:40:38.839849 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:40:38.843559 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:40:38.843774 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:40:38.844781 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:40:38.845178 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:40:38.845372 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:40:38.847703 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:40:38.847921 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:40:38.848066 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:40:38.848228 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:40:38.848731 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:40:38.848875 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:40:38.849188 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:40:38.849248 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:40:38.849368 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:40:38.868309 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1934719110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumemultiattachtests-server-1934719110',id=36,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhD1xUGbzXEFTpwLqV7IdahQdRsxUTWfjsap1G2V5FlaOoCCsM3NvS7ZgZ3Tks73vH5y6V2PuKxg4zJpt6nENVtmQis2Ldrn3RUIJ9Ob13Jj154qwicTD8P/PfTnb2SSg==',key_name='tempest-keypair-883733818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e0c7a19a41a44fba4c0fca71022a5a1',ramdisk_id='',reservation_id='r-l7fo2szi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1349332830',owner_user_name='tempest-VolumeMultiattachTests-1349332830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:40:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93a5d16bed8c474fa58e1982fa784db9',uuid=0dbaac9f-71f1-4cb6-837c-cafc38f94f11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b74663e-9ccd-4251-97fd-0eca225719e2", "address": "fa:16:3e:19:9d:73", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74663e-9c", "ovs_interfaceid": "6b74663e-9ccd-4251-97fd-0eca225719e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:40:38.868470 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Converting VIF {"id": "6b74663e-9ccd-4251-97fd-0eca225719e2", "address": "fa:16:3e:19:9d:73", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74663e-9c", "ovs_interfaceid": "6b74663e-9ccd-4251-97fd-0eca225719e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:40:38.869032 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:9d:73,bridge_name='br-int',has_traffic_filtering=True,id=6b74663e-9ccd-4251-97fd-0eca225719e2,network=Network(c948b992-32a1-4652-a328-d2d326ea9148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b74663e-9c') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:40:38.869529 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dbaac9f-71f1-4cb6-837c-cafc38f94f11 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:38.892854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.830s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:38.893341 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.770s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:38.894886 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Migrating
May 19 04:40:38.894956 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:38.895282 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.796s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:38.895484 np0000001025 nova-compute[97981]: DEBUG nova.compute.rpcapi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97981) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 19 04:40:38.901165 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:40:38.911573 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:40:38.911573 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Claim successful on node np0000001025
May 19 04:40:38.931798 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:40:38.940732 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:40:38.952175 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:40:38.952175 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:40:38.964270 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:40:38.964270 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:38.973564 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:38.980810 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-ea45cba5-52c2-4bbf-a01f-03a92d50fd47 req-a259e793-d426-4f77-a054-6ea52c70c4e8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:38.986651 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:38.998845 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:38.998845 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:38.998845 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:38.998845 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:38.998845 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:38.998845 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:38.998845 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:38.998845 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:38.998845 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:38.998845 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:38.998845 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:38.998845 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:38.998845 np0000001025 nova-compute[97981]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:38.998845 np0000001025 nova-compute[97981]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:38.998845 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:38.999563 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:38.999563 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:38.999563 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:38.999563 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:38.999563 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:38.999563 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:38.999563 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:38.999563 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:38.999563 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:38.999563 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:38.999563 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:38.999563 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:38.999563 np0000001025 nova-compute[97981]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:38.999563 np0000001025 nova-compute[97981]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:38.999563 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:39.015958 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:39.015958 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:39.015958 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:39.015958 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:39.015958 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:39.015958 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:39.015958 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:39.015958 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:39.015958 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:39.015958 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:39.015958 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:39.015958 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:39.015958 np0000001025 nova-compute[97981]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:39.015958 np0000001025 nova-compute[97981]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:39.015958 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:39.016340 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:39.016340 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:39.016340 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:39.016340 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:39.016340 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:39.016340 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:39.016340 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:39.016340 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:39.016340 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:39.016340 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:39.016340 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:39.016340 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:39.016340 np0000001025 nova-compute[97981]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:39.016340 np0000001025 nova-compute[97981]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:39.016340 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:39.061488 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9788c668-ecdb-46ff-a941-197c2a2a0da2 req-5571a599-3f76-47d8-a78d-de40b3582ff9 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Received event network-changed-3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:39.061488 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9788c668-ecdb-46ff-a941-197c2a2a0da2 req-5571a599-3f76-47d8-a78d-de40b3582ff9 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Refreshing instance network info cache due to event network-changed-3587c521-ddbe-4301-84ca-17721980c57a. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:40:39.061973 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9788c668-ecdb-46ff-a941-197c2a2a0da2 req-5571a599-3f76-47d8-a78d-de40b3582ff9 service nova] Acquiring lock "refresh_cache-87e8e02e-e385-418c-be0c-bb25a377d081" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:40:39.070304 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6, portal: 192.168.50.100,3260]
May 19 04:40:39.070304 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6, portal: 192.168.50.100,3260] successful.
May 19 04:40:39.070304 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:39.082903 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6, portal: 192.168.40.100,3260]
May 19 04:40:39.082903 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6, portal: 192.168.40.100,3260] successful.
May 19 04:40:39.082903 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:39.089830 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:39.114759 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:39.117473 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:39.117473 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:39.117473 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:39.117473 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:39.117473 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:39.117473 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:39.117473 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:39.117473 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:39.117473 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:39.117473 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:39.117473 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:39.117473 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:39.117473 np0000001025 nova-compute[97981]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:39.117473 np0000001025 nova-compute[97981]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:39.117473 np0000001025 nova-compute[97981]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:39.117473 np0000001025 nova-compute[97981]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:39.117473 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:39.118192 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:39.118192 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:39.118192 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:39.118192 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:39.118192 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:39.118192 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:39.118192 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:39.118192 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:39.118192 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:39.118192 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:39.118192 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:39.118192 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:39.118192 np0000001025 nova-compute[97981]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:39.118192 np0000001025 nova-compute[97981]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:39.118192 np0000001025 nova-compute[97981]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:39.118192 np0000001025 nova-compute[97981]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:39.118192 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:39.118192 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.222s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:39.118885 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:40:39.119793 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] HCTL ('9', '-', '-', 0) found on session 86 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:40:39.119922 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:40:39.154710 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Searching for a device in session 86 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:40:39.154710 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a7faf4e4-0f15-4992-8e8b-12efa20286d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:39.163808 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.265s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:39.163808 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:40:39.165519 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] HCTL ('10', '-', '-', 0) found on session 87 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:40:39.165672 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:40:39.192357 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Searching for a device in session 87 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:40:39.192741 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7faf4e4-0f15-4992-8e8b-12efa20286d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:40:39.281430 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999588423999967 future=<Future at 0x72185030a810 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:39.295316 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.987225886000033 future=<Future at 0x72185030a810 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:39.295316 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.987059345000034 future=<Future at 0x72185030a810 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:39.307319 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:39.311102 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Instance destroyed successfully.
May 19 04:40:39.312321 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'resources' on Instance uuid 57adc083-429a-4f23-9154-7de8b6e74d8a {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:39.327646 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:39.336597 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:39.375324 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] End _get_guest_xml xml=<domain type="qemu">
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:   <uuid>0dbaac9f-71f1-4cb6-837c-cafc38f94f11</uuid>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:   <name>instance-00000024</name>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <nova:name>tempest-VolumeMultiattachTests-server-1934719110</nova:name>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:40:38</nova:creationTime>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:         <nova:user uuid="93a5d16bed8c474fa58e1982fa784db9">tempest-VolumeMultiattachTests-1349332830-project-member</nova:user>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:         <nova:project uuid="7e0c7a19a41a44fba4c0fca71022a5a1">tempest-VolumeMultiattachTests-1349332830</nova:project>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:         <nova:port uuid="6b74663e-9ccd-4251-97fd-0eca225719e2">
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     <system>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <entry name="serial">0dbaac9f-71f1-4cb6-837c-cafc38f94f11</entry>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <entry name="uuid">0dbaac9f-71f1-4cb6-837c-cafc38f94f11</entry>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     </system>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:   <os>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:   </os>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:   <features>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:   </features>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:   <devices>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk"/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     </disk>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk.config"/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     </disk>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:19:9d:73"/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <target dev="tap6b74663e-9c"/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     </interface>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/console.log" append="off"/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     </serial>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     <video>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     </video>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     </rng>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:   </devices>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]: </domain>
May 19 04:40:39.375324 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:40:39.378691 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Preparing to wait for external event network-vif-plugged-6b74663e-9ccd-4251-97fd-0eca225719e2 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:40:39.378691 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:39.378691 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:39.378691 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:39.378691 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1934719110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumemultiattachtests-server-1934719110',id=36,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhD1xUGbzXEFTpwLqV7IdahQdRsxUTWfjsap1G2V5FlaOoCCsM3NvS7ZgZ3Tks73vH5y6V2PuKxg4zJpt6nENVtmQis2Ldrn3RUIJ9Ob13Jj154qwicTD8P/PfTnb2SSg==',key_name='tempest-keypair-883733818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e0c7a19a41a44fba4c0fca71022a5a1',ramdisk_id='',reservation_id='r-l7fo2szi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1349332830',owner_user_name='tempest-VolumeMultiattachTests-1349332830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:40:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93a5d16bed8c474fa58e1982fa784db9',uuid=0dbaac9f-71f1-4cb6-837c-cafc38f94f11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b74663e-9ccd-4251-97fd-0eca225719e2", "address": "fa:16:3e:19:9d:73", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74663e-9c", "ovs_interfaceid": "6b74663e-9ccd-4251-97fd-0eca225719e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:40:39.378691 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Converting VIF {"id": "6b74663e-9ccd-4251-97fd-0eca225719e2", "address": "fa:16:3e:19:9d:73", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74663e-9c", "ovs_interfaceid": "6b74663e-9ccd-4251-97fd-0eca225719e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:40:39.378691 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:9d:73,bridge_name='br-int',has_traffic_filtering=True,id=6b74663e-9ccd-4251-97fd-0eca225719e2,network=Network(c948b992-32a1-4652-a328-d2d326ea9148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b74663e-9c') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:40:39.379654 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:9d:73,bridge_name='br-int',has_traffic_filtering=True,id=6b74663e-9ccd-4251-97fd-0eca225719e2,network=Network(c948b992-32a1-4652-a328-d2d326ea9148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b74663e-9c') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:40:39.381522 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:39.382152 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:39.382152 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:40:39.388136 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:39.388136 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0ac7ccf-1ccb-5592-91cb-b9296a770343', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:39.388136 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:39.388136 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:39.398162 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:39.405661 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:39.405661 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b74663e-9c, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:39.405661 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b74663e-9c, col_values=(('qos', UUID('588b93bd-795c-490a-9396-0180fd1b0335')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:39.405661 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b74663e-9c, col_values=(('external_ids', {'iface-id': '6b74663e-9ccd-4251-97fd-0eca225719e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:9d:73', 'vm-uuid': '0dbaac9f-71f1-4cb6-837c-cafc38f94f11'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:39.406917 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:39.408174 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:39.428653 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:39.432605 np0000001025 nova-compute[97981]: INFO os_vif [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:9d:73,bridge_name='br-int',has_traffic_filtering=True,id=6b74663e-9ccd-4251-97fd-0eca225719e2,network=Network(c948b992-32a1-4652-a328-d2d326ea9148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b74663e-9c')
May 19 04:40:39.435269 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "refresh_cache-f6207103-8a47-4cc8-b1e0-c0ffd79e0173" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:40:39.435413 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquired lock "refresh_cache-f6207103-8a47-4cc8-b1e0-c0ffd79e0173" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:40:39.436397 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:40:39.485670 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:39.610165 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "87e8e02e-e385-418c-be0c-bb25a377d081" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:39.610165 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "87e8e02e-e385-418c-be0c-bb25a377d081" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:39.610165 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "87e8e02e-e385-418c-be0c-bb25a377d081-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:39.610165 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "87e8e02e-e385-418c-be0c-bb25a377d081-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:39.610165 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "87e8e02e-e385-418c-be0c-bb25a377d081-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:39.616179 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Terminating instance
May 19 04:40:39.632150 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-ea45cba5-52c2-4bbf-a01f-03a92d50fd47 req-a259e793-d426-4f77-a054-6ea52c70c4e8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:39.636354 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-dc407561-9d94-45e2-9e42-e18256194aa7 req-aedf6a5e-e09b-4f80-b089-7eca48576d52 service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Received event network-vif-plugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:39.636773 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-dc407561-9d94-45e2-9e42-e18256194aa7 req-aedf6a5e-e09b-4f80-b089-7eca48576d52 service nova] Acquiring lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:39.636925 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-dc407561-9d94-45e2-9e42-e18256194aa7 req-aedf6a5e-e09b-4f80-b089-7eca48576d52 service nova] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:39.637060 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-dc407561-9d94-45e2-9e42-e18256194aa7 req-aedf6a5e-e09b-4f80-b089-7eca48576d52 service nova] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:39.637216 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-dc407561-9d94-45e2-9e42-e18256194aa7 req-aedf6a5e-e09b-4f80-b089-7eca48576d52 service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Processing event network-vif-plugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:40:39.700532 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:39.715665 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:39.721906 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:39.756512 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:39.769678 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:39.816604 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-844446081',display_name='tempest-TestVolumeBootPattern-server-844446081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-844446081',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxOKS9yEjObdHLZH1HI2bMkXDqbbhfdJb44v4wqJB4om8oUnQbceKvRmo5zkW64bMRcZfWY0eLqrWurjfNHYBjiuL8Xlu0w3AcYixWZlDbIAggkM7Ws8vQ5t98+fmLn7g==',key_name='tempest-keypair-1937042662',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:39:36Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-naev0poy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:40:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c46088fb3e74b819bb456461716a801',uuid=57adc083-429a-4f23-9154-7de8b6e74d8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "address": "fa:16:3e:e2:ca:8e", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80a69f3-5d", "ovs_interfaceid": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:40:39.816838 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "address": "fa:16:3e:e2:ca:8e", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80a69f3-5d", "ovs_interfaceid": "a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:40:39.817456 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ca:8e,bridge_name='br-int',has_traffic_filtering=True,id=a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80a69f3-5d') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:40:39.817705 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ca:8e,bridge_name='br-int',has_traffic_filtering=True,id=a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80a69f3-5d') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:40:39.819595 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:39.819815 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa80a69f3-5d, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:39.820779 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:39.821556 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:39.829135 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:39.831949 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:39.832146 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eeb4a7c5-6150-49d6-9e0b-5fe66cb3c778) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:39.832876 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:39.833754 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:39.837549 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-ea45cba5-52c2-4bbf-a01f-03a92d50fd47 req-a259e793-d426-4f77-a054-6ea52c70c4e8 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Updated VIF entry in instance network info cache for port 3587c521-ddbe-4301-84ca-17721980c57a. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:40:39.837901 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-ea45cba5-52c2-4bbf-a01f-03a92d50fd47 req-a259e793-d426-4f77-a054-6ea52c70c4e8 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Updating instance_info_cache with network_info: [{"id": "3587c521-ddbe-4301-84ca-17721980c57a", "address": "fa:16:3e:16:6b:7e", "network": {"id": "c2482d3a-1a67-42d2-92b3-13ee3ae383c7", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-380374163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49561da7541f44898968cb455fb3e6bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3587c521-dd", "ovs_interfaceid": "3587c521-ddbe-4301-84ca-17721980c57a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:39.841752 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:39.844224 np0000001025 nova-compute[97981]: INFO os_vif [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ca:8e,bridge_name='br-int',has_traffic_filtering=True,id=a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80a69f3-5d')
May 19 04:40:39.846529 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:40:39.846800 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:39.847004 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:39.902865 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:40:39.939311 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:40.134224 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:40:40.164799 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:40.167703 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:40.193296 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:40.204478 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:40.218943 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:40.228475 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:40.280707 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165640.2802992, 15f0abbc-b8de-4d77-88c4-e5c0e54d691f => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:40:40.281286 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:40:40.282496 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] VM Started (Lifecycle Event)
May 19 04:40:40.287444 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:40:40.291894 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Instance spawned successfully.
May 19 04:40:40.292444 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:40:40.340750 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ea45cba5-52c2-4bbf-a01f-03a92d50fd47 req-a259e793-d426-4f77-a054-6ea52c70c4e8 service nova] Releasing lock "refresh_cache-87e8e02e-e385-418c-be0c-bb25a377d081" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:40:40.343127 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9788c668-ecdb-46ff-a941-197c2a2a0da2 req-5571a599-3f76-47d8-a78d-de40b3582ff9 service nova] Acquired lock "refresh_cache-87e8e02e-e385-418c-be0c-bb25a377d081" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:40:40.345844 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-9788c668-ecdb-46ff-a941-197c2a2a0da2 req-5571a599-3f76-47d8-a78d-de40b3582ff9 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Refreshing network info cache for port 3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:40:40.355287 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:40.475697 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Instance destroyed successfully.
May 19 04:40:40.476314 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lazy-loading 'resources' on Instance uuid 87e8e02e-e385-418c-be0c-bb25a377d081 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:40.556575 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Updating instance_info_cache with network_info: [{"id": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "address": "fa:16:3e:91:89:b7", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cbdb78-cc", "ovs_interfaceid": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:40.573300 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Received event network-vif-unplugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:40.573519 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] Acquiring lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:40.575362 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:40.575519 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:40.575684 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] No waiting events found dispatching network-vif-unplugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:40:40.576880 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Received event network-vif-unplugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:40:40.577047 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Received event network-vif-unplugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:40.577375 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] Acquiring lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:40.577585 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:40.577749 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:40.577914 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] No waiting events found dispatching network-vif-unplugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:40:40.578181 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Received event network-vif-unplugged-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:40:40.578344 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Received event network-vif-unplugged-3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:40.578629 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] Acquiring lock "87e8e02e-e385-418c-be0c-bb25a377d081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:40.578817 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] Lock "87e8e02e-e385-418c-be0c-bb25a377d081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:40.578976 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] Lock "87e8e02e-e385-418c-be0c-bb25a377d081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:40.579143 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] No waiting events found dispatching network-vif-unplugged-3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:40:40.579545 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Received event network-vif-unplugged-3587c521-ddbe-4301-84ca-17721980c57a for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:40:40.580076 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Received event network-vif-unplugged-3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:40.580258 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] Acquiring lock "87e8e02e-e385-418c-be0c-bb25a377d081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:40.580446 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] Lock "87e8e02e-e385-418c-be0c-bb25a377d081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:40.580584 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] Lock "87e8e02e-e385-418c-be0c-bb25a377d081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:40.580729 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] No waiting events found dispatching network-vif-unplugged-3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:40:40.580867 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cc0314b8-dcb8-4c8a-86ad-4e2d60c358de req-10a3b8f2-043e-4ef2-81f6-7becfb94b003 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Received event network-vif-unplugged-3587c521-ddbe-4301-84ca-17721980c57a for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:40:40.657191 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:40.760013 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:40.760695 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:40.794424 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:40.794857 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:40:40.795344 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:40:40.807661 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:40:40.813424 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:40.813424 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:40.813820 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:40.814099 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:40.814409 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:40.815319 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:40.850580 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-9788c668-ecdb-46ff-a941-197c2a2a0da2 req-5571a599-3f76-47d8-a78d-de40b3582ff9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:40.876923 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:40.877415 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-14 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:40:40.877491 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-0 (vdc) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:40:40.877584 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-6 (vdd) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:40:40.880348 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:40.928053 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Found WWN 3300000001a23af13 for multipath device dm-1 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:40:40.928845 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.050s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:40.930525 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] <== connect_volume: return (3050ms) {'type': 'block', 'scsi_wwn': '3300000001a23af13', 'path': '/dev/dm-1', 'multipath_id': '3300000001a23af13'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:40.930525 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001a23af13', 'path': '/dev/dm-1', 'multipath_id': '3300000001a23af13'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:40:40.930525 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.083s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:40.931652 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ce533ab0-3286-48fd-9b76-1009e42dd4d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:40:40.931935 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:40:40.933786 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lazy-loading 'flavor' on Instance uuid 93c62882-ef27-41d5-8178-e1ccc945fe1d {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:40.964444 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:40.964587 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:40.965093 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No VIF found with MAC fa:16:3e:19:9d:73, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:40:40.965239 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Using config drive
May 19 04:40:40.975134 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:40.975134 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:40.975134 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:40.975134 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:40.975134 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:40.975134 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:40.975134 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:40.975134 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:40.975134 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:40.975134 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:40.975134 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:40.975134 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:40.975134 np0000001025 nova-compute[97981]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:40.975134 np0000001025 nova-compute[97981]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:40.975134 np0000001025 nova-compute[97981]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:40.975134 np0000001025 nova-compute[97981]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:40.975134 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:40.975644 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:40.975644 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:40.975644 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:40.975644 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:40.975644 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:40.975644 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:40.975644 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:40.975644 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:40.975644 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:40.975644 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:40.975644 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:40.975644 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:40.975644 np0000001025 nova-compute[97981]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:40.975644 np0000001025 nova-compute[97981]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9 (non-flash)
May 19 04:40:40.975644 np0000001025 nova-compute[97981]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:40.975644 np0000001025 nova-compute[97981]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:40.975644 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:40.975644 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '75'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '81'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', '87')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:40:40.976018 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', '84')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:40.977707 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:40.977960 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:40.979011 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:38:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-2097951664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testinstanceswithcindervolumes-server-2097951664',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDys8kZ8GSlPlg14lt3R+yQZ5b9y4aStMqqbMzrUHV4yGfbqNZ7bAcEfosY6Qz7abVnl9kdBTekBYcX1xF/v+nQ9Q5E+cGgCcntwl/ULjaoOkU5Odi6+UrT58NDQ6WLChw==',key_name='tempest-TestInstancesWithCinderVolumes-220059066',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:39:10Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49561da7541f44898968cb455fb3e6bd',ramdisk_id='',reservation_id='r-dsqglhdr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-TestInstancesWithCinderVolumes-1156876148',owner_user_name='tempest-TestInstancesWithCinderVolumes-1156876148-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:39:11Z,user_data=None,user_id='85bb755af78441a09efcb1f00474515e',uuid=87e8e02e-e385-418c-be0c-bb25a377d081,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3587c521-ddbe-4301-84ca-17721980c57a", "address": "fa:16:3e:16:6b:7e", "network": {"id": "c2482d3a-1a67-42d2-92b3-13ee3ae383c7", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-380374163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49561da7541f44898968cb455fb3e6bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3587c521-dd", "ovs_interfaceid": "3587c521-ddbe-4301-84ca-17721980c57a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:40:40.979366 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Converting VIF {"id": "3587c521-ddbe-4301-84ca-17721980c57a", "address": "fa:16:3e:16:6b:7e", "network": {"id": "c2482d3a-1a67-42d2-92b3-13ee3ae383c7", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-380374163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49561da7541f44898968cb455fb3e6bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3587c521-dd", "ovs_interfaceid": "3587c521-ddbe-4301-84ca-17721980c57a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:40:40.980151 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:6b:7e,bridge_name='br-int',has_traffic_filtering=True,id=3587c521-ddbe-4301-84ca-17721980c57a,network=Network(c2482d3a-1a67-42d2-92b3-13ee3ae383c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3587c521-dd') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:40:40.980428 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:6b:7e,bridge_name='br-int',has_traffic_filtering=True,id=3587c521-ddbe-4301-84ca-17721980c57a,network=Network(c2482d3a-1a67-42d2-92b3-13ee3ae383c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3587c521-dd') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:40:40.999344 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:41.000438 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3587c521-dd, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:41.006226 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:41.008966 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9', '85')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:41.010040 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:41.011554 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:41.011737 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e864569-559e-45aa-9ad0-2c53f85011db) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:41.014274 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:41.015499 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218503fd580>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9'): ({'sdn'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:40:41.015499 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Removing multipathed devices sdm, sdn {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:40:41.015697 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flush multipath device 3300000004eff2e31 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:40:41.021427 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:41.023935 np0000001025 nova-compute[97981]: INFO os_vif [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:6b:7e,bridge_name='br-int',has_traffic_filtering=True,id=3587c521-ddbe-4301-84ca-17721980c57a,network=Network(c2482d3a-1a67-42d2-92b3-13ee3ae383c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3587c521-dd')
May 19 04:40:41.026458 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:40:41.027067 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '676791bb-a268-438c-8db2-e4e5a9014ea5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:41.027647 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:41.061378 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Releasing lock "refresh_cache-f6207103-8a47-4cc8-b1e0-c0ffd79e0173" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:40:41.072629 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:40:41.073431 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:41.076356 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:41.130835 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:40:41.191142 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:41.191383 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:41.216794 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Checking to see if SCSI volumes sdm, sdn have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:40:41.217187 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] SCSI volumes sdm, sdn have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:40:41.220852 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Checking to see if device paths {'sdm', 'sdn'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:40:41.239134 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Device paths {'sdm', 'sdn'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:40:41.239562 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:40:41.251691 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:41.289163 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-9788c668-ecdb-46ff-a941-197c2a2a0da2 req-5571a599-3f76-47d8-a78d-de40b3582ff9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:41.291334 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:41.294889 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:40:41.296498 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:41.296846 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 84, target: iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9, portal: 192.168.40.100,3260]
May 19 04:40:41.296846 np0000001025 nova-compute[97981]: Logout of [sid: 84, target: iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9, portal: 192.168.40.100,3260] successful.
May 19 04:40:41.296846 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:41.319718 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:40:41.320830 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:40:41.335281 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Took 7.63 seconds to spawn the instance on the hypervisor.
May 19 04:40:41.339643 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165641.32858, 15f0abbc-b8de-4d77-88c4-e5c0e54d691f => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:40:41.340072 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] VM Paused (Lifecycle Event)
May 19 04:40:41.341651 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:41.345223 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:41.362664 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:41.406704 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 85, target: iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9, portal: 192.168.50.100,3260]
May 19 04:40:41.406704 np0000001025 nova-compute[97981]: Logout of [sid: 85, target: iqn.2023-03.storpool.com:os--volume-ce533ab0-3286-48fd-9b76-1009e42dd4d9, portal: 192.168.50.100,3260] successful.
May 19 04:40:41.406704 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:41.407706 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:41.408362 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:41.430827 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:41.431748 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.501s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:41.433580 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.405s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:41.434609 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== disconnect_volume: return (1586ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:41.434976 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '676791bb-a268-438c-8db2-e4e5a9014ea5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:40:41.435309 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:40:41.435643 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:40:41.436187 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Deleting instance files /opt/stack/data/nova/instances/57adc083-429a-4f23-9154-7de8b6e74d8a_del
May 19 04:40:41.437488 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Deletion of /opt/stack/data/nova/instances/57adc083-429a-4f23-9154-7de8b6e74d8a_del complete
May 19 04:40:41.451593 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Attempting to attach volume a7faf4e4-0f15-4992-8e8b-12efa20286d6 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:40:41.462359 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:40:41.462359 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:40:41.462359 np0000001025 nova-compute[97981]:   <alias name="ua-a7faf4e4-0f15-4992-8e8b-12efa20286d6"/>
May 19 04:40:41.462359 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-1"/>
May 19 04:40:41.462359 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:40:41.462359 np0000001025 nova-compute[97981]:   <serial>a7faf4e4-0f15-4992-8e8b-12efa20286d6</serial>
May 19 04:40:41.462359 np0000001025 nova-compute[97981]: </disk>
May 19 04:40:41.462359 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:40:41.472203 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:41.481776 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:41.481776 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:41.481776 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:41.481776 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:41.481776 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:41.481776 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:41.481776 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:41.481776 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:41.481776 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:41.481776 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:41.481776 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:41.481776 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:41.481776 np0000001025 nova-compute[97981]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:41.481776 np0000001025 nova-compute[97981]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:41.481776 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:41.482423 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsi session list stdout=tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:41.482423 np0000001025 nova-compute[97981]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5 (non-flash)
May 19 04:40:41.482423 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:41.482423 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:41.482423 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:41.482423 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:41.482423 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:41.482423 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:41.482423 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:41.482423 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:41.482423 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:41.482423 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:41.482423 np0000001025 nova-compute[97981]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:41.482423 np0000001025 nova-compute[97981]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:41.482423 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:41.482423 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '75'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '81'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', '87')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:40:41.482423 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '55')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:41.483958 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5', '56')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:41.486744 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721834487740>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5'): ({'sdg'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:40:41.487002 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Removing multipathed devices sdf, sdg {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:40:41.487242 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Flush multipath device 33000000053f24c3a {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:40:41.536763 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-9788c668-ecdb-46ff-a941-197c2a2a0da2 req-5571a599-3f76-47d8-a78d-de40b3582ff9 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Updated VIF entry in instance network info cache for port 3587c521-ddbe-4301-84ca-17721980c57a. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:40:41.537417 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-9788c668-ecdb-46ff-a941-197c2a2a0da2 req-5571a599-3f76-47d8-a78d-de40b3582ff9 service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Updating instance_info_cache with network_info: [{"id": "3587c521-ddbe-4301-84ca-17721980c57a", "address": "fa:16:3e:16:6b:7e", "network": {"id": "c2482d3a-1a67-42d2-92b3-13ee3ae383c7", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-380374163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49561da7541f44898968cb455fb3e6bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3587c521-dd", "ovs_interfaceid": "3587c521-ddbe-4301-84ca-17721980c57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:41.538885 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:41.544949 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:40:41.550796 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:40:41.551144 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-10 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:40:41.555810 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:41.595362 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:40:41.643242 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Creating config drive at /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk.config
May 19 04:40:41.648890 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0o5x1g7i {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:41.665704 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:40:41.666122 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:40:41.671175 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:41.671175 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:41.704615 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:40:41.706208 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0o5x1g7i" returned: 0 in 0.056s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:41.716886 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:40:41.717195 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:40:41.730755 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:41.738572 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d8e342a4-aaa1-4dff-9673-8009567320fc req-60a0f787-a9d0-484b-b2d1-4cd4b43ec4a4 service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Received event network-vif-plugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:41.739615 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d8e342a4-aaa1-4dff-9673-8009567320fc req-60a0f787-a9d0-484b-b2d1-4cd4b43ec4a4 service nova] Acquiring lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:41.739908 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d8e342a4-aaa1-4dff-9673-8009567320fc req-60a0f787-a9d0-484b-b2d1-4cd4b43ec4a4 service nova] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:41.740147 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d8e342a4-aaa1-4dff-9673-8009567320fc req-60a0f787-a9d0-484b-b2d1-4cd4b43ec4a4 service nova] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:41.740345 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d8e342a4-aaa1-4dff-9673-8009567320fc req-60a0f787-a9d0-484b-b2d1-4cd4b43ec4a4 service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] No waiting events found dispatching network-vif-plugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:40:41.740595 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-d8e342a4-aaa1-4dff-9673-8009567320fc req-60a0f787-a9d0-484b-b2d1-4cd4b43ec4a4 service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Received unexpected event network-vif-plugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 for instance with vm_state active and task_state None.
May 19 04:40:41.785824 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5, portal: 192.168.40.100,3260]
May 19 04:40:41.785824 np0000001025 nova-compute[97981]: Logout of [sid: 55, target: iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5, portal: 192.168.40.100,3260] successful.
May 19 04:40:41.785824 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:41.793595 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:41.797720 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c62882-ef27-41d5-8178-e1ccc945fe1d/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:41.817539 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:41.833251 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:41.843585 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.949s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:41.844867 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:40:41.852210 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:41.859310 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165641.8584614, 15f0abbc-b8de-4d77-88c4-e5c0e54d691f => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:40:41.859310 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] VM Resumed (Lifecycle Event)
May 19 04:40:41.867160 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Took 13.35 seconds to build instance.
May 19 04:40:41.870441 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5, portal: 192.168.50.100,3260]
May 19 04:40:41.870441 np0000001025 nova-compute[97981]: Logout of [sid: 56, target: iqn.2023-03.storpool.com:os--volume-676791bb-a268-438c-8db2-e4e5a9014ea5, portal: 192.168.50.100,3260] successful.
May 19 04:40:41.870441 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:41.898133 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:41.898133 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.464s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:41.898133 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] <== disconnect_volume: return (869ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:41.898133 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:40:41.898133 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Deleting instance files /opt/stack/data/nova/instances/87e8e02e-e385-418c-be0c-bb25a377d081_del
May 19 04:40:41.900094 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Deletion of /opt/stack/data/nova/instances/87e8e02e-e385-418c-be0c-bb25a377d081_del complete
May 19 04:40:41.905471 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c62882-ef27-41d5-8178-e1ccc945fe1d/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:41.906261 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c62882-ef27-41d5-8178-e1ccc945fe1d/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:41.968249 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Took 3.24 seconds to destroy the instance on the hypervisor.
May 19 04:40:41.970153 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:40:41.970536 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:40:41.970704 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:40:41.972244 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:42.005502 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c62882-ef27-41d5-8178-e1ccc945fe1d/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:42.006940 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:40:42.009625 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Error from libvirt while getting description of instance-0000001e: [Error Code 42] Domain not found: no domain with matching uuid '57adc083-429a-4f23-9154-7de8b6e74d8a' (instance-0000001e): libvirt.libvirtError: Domain not found: no domain with matching uuid '57adc083-429a-4f23-9154-7de8b6e74d8a' (instance-0000001e)
May 19 04:40:42.040017 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9788c668-ecdb-46ff-a941-197c2a2a0da2 req-5571a599-3f76-47d8-a78d-de40b3582ff9 service nova] Releasing lock "refresh_cache-87e8e02e-e385-418c-be0c-bb25a377d081" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:40:42.049795 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:42.266909 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:42.298028 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:42.363788 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:40:42.363788 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:40:42.363788 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:42.363788 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:42.365716 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:42.370760 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:40:42.373337 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.859s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:42.392232 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:42.417543 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:42.419683 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:42.446955 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Took 2.31 seconds to destroy the instance on the hypervisor.
May 19 04:40:42.450700 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:40:42.451935 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:40:42.452298 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:42.452436 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:40:42.452700 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:42.477569 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa432d60cb324c6d87818107e05e0053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490151decdde445593a86a16976f6b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:40:42.556959 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:42.557756 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:42.579256 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:42.603090 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Starting migrate_disk_and_power_off {{(pid=97981) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 19 04:40:42.640406 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:42.643085 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:42.645967 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e2b68157-66d2-489e-8eba-7472a85b4be8 req-89f70203-a6f5-48ec-b27a-aaffbb606e29 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Received event network-vif-deleted-a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:42.647169 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-e2b68157-66d2-489e-8eba-7472a85b4be8 req-89f70203-a6f5-48ec-b27a-aaffbb606e29 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Neutron deleted interface a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b; detaching it from the instance and deleting it from the info cache
May 19 04:40:42.647169 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e2b68157-66d2-489e-8eba-7472a85b4be8 req-89f70203-a6f5-48ec-b27a-aaffbb606e29 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:42.658753 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:42.662284 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:40:42.664152 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:42.681301 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:42.721596 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.057s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:42.723655 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=11532MB free_disk=73.21427154541016GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:40:42.723655 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:42.723655 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:42.804419 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:42.812920 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:42.865133 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:40:42.874798 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999680815000147 future=<Future at 0x7218342ca6c0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:42.976021 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999539065999898 future=<Future at 0x72185027eb70 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:42.978824 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Instance destroyed successfully.
May 19 04:40:42.980655 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:40:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-985806649',display_name='tempest-ServerActionsTestOtherA-server-985806649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serveractionstestothera-server-985806649',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqj+0kbBWHZ0D/eo4rT8/WyGDsPmK39aJPuM7kZk3S1G8n90+lv56y6gVhWC3CbNq9VY5ET/dAXNaLkqY+SWcJuj+SOKIN1mmus3K/MEswW9TbpiRqq7lxkb6x7vjc6rQ==',key_name='tempest-keypair-762825136',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:40:32Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='336d55ae51114828ba5ad8c0ac87ca9b',ramdisk_id='',reservation_id='r-47cr4ojc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-281327203',owner_user_name='tempest-ServerActionsTestOtherA-281327203-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:40:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6374f2e55af946f9abf35d0c8a1cd206',uuid=f6207103-8a47-4cc8-b1e0-c0ffd79e0173,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "address": "fa:16:3e:91:89:b7", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-906047595-network", "vif_mac": "fa:16:3e:91:89:b7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cbdb78-cc", "ovs_interfaceid": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:40:42.980944 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converting VIF {"id": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "address": "fa:16:3e:91:89:b7", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-906047595-network", "vif_mac": "fa:16:3e:91:89:b7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cbdb78-cc", "ovs_interfaceid": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:40:42.981689 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:89:b7,bridge_name='br-int',has_traffic_filtering=True,id=37cbdb78-cc1c-48e2-879d-959cb26c29f9,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cbdb78-cc') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:40:42.982296 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:89:b7,bridge_name='br-int',has_traffic_filtering=True,id=37cbdb78-cc1c-48e2-879d-959cb26c29f9,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cbdb78-cc') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:40:42.988133 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:42.988133 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37cbdb78-cc, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:42.989207 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:42.992063 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:42.994473 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:42.994473 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c895851-ba24-48f2-8e6d-66834f95d35c) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:42.995247 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:42.998790 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:43.005220 np0000001025 nova-compute[97981]: INFO os_vif [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:89:b7,bridge_name='br-int',has_traffic_filtering=True,id=37cbdb78-cc1c-48e2-879d-959cb26c29f9,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cbdb78-cc')
May 19 04:40:43.008010 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:40:43.008010 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:43.008010 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:43.090764 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:43.120637 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:43.120782 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:43.121187 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:43.121297 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] No VIF found with MAC fa:16:3e:f1:29:3e, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:40:43.154343 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e2b68157-66d2-489e-8eba-7472a85b4be8 req-89f70203-a6f5-48ec-b27a-aaffbb606e29 service nova] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Detach interface failed, port_id=a80a69f3-5d68-4fd9-90d3-ef8c9e1d207b, reason: Instance 57adc083-429a-4f23-9154-7de8b6e74d8a could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:40:43.177398 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Successfully created port: 9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:40:43.215128 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:43.276751 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c75059af-68f5-4c47-a319-a80615d86a47 req-ef2e5156-ed6e-43b0-ae40-afab9fa1f1e4 service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Received event network-vif-plugged-6b74663e-9ccd-4251-97fd-0eca225719e2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:43.277557 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c75059af-68f5-4c47-a319-a80615d86a47 req-ef2e5156-ed6e-43b0-ae40-afab9fa1f1e4 service nova] Acquiring lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:43.277734 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c75059af-68f5-4c47-a319-a80615d86a47 req-ef2e5156-ed6e-43b0-ae40-afab9fa1f1e4 service nova] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:43.277908 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c75059af-68f5-4c47-a319-a80615d86a47 req-ef2e5156-ed6e-43b0-ae40-afab9fa1f1e4 service nova] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:43.280802 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c75059af-68f5-4c47-a319-a80615d86a47 req-ef2e5156-ed6e-43b0-ae40-afab9fa1f1e4 service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Processing event network-vif-plugged-6b74663e-9ccd-4251-97fd-0eca225719e2 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:40:43.299020 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165643.2986104, 0dbaac9f-71f1-4cb6-837c-cafc38f94f11 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:40:43.300304 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] VM Started (Lifecycle Event)
May 19 04:40:43.301751 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:40:43.309738 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:40:43.312489 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Instance spawned successfully.
May 19 04:40:43.314659 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:40:43.369689 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:40:43.584304 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:43.597742 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Took 1.63 seconds to deallocate network for instance.
May 19 04:40:43.739951 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Applying migration context for instance f6207103-8a47-4cc8-b1e0-c0ffd79e0173 as it has an incoming, in-progress migration 924dbb37-1046-4d89-8be8-3be585934dcc. Migration status is migrating {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 19 04:40:43.744192 np0000001025 nova-compute[97981]: INFO nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Updating resource usage from migration 924dbb37-1046-4d89-8be8-3be585934dcc
May 19 04:40:43.780100 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Successfully updated port: 9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:40:43.803918 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:43.808082 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:40:43.813065 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 5951341b-0ad5-4fb0-82ad-b464c081f37f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:40:43.814307 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 87e8e02e-e385-418c-be0c-bb25a377d081 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:40:43.814487 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance aa2cdf1d-65ef-4cf4-b742-72ae783cde27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:40:43.814957 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 32cc5240-7a56-4cee-9b41-54e17386b39f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:40:43.815123 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 57adc083-429a-4f23-9154-7de8b6e74d8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:40:43.815259 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance b32b8038-72c4-443c-aea3-07cd61ad67f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:40:43.815391 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 93c62882-ef27-41d5-8178-e1ccc945fe1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:40:43.815576 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance e644a772-cf7c-4b15-b21b-ea54e773a1f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:40:43.815775 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 15f0abbc-b8de-4d77-88c4-e5c0e54d691f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:40:43.815901 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 0dbaac9f-71f1-4cb6-837c-cafc38f94f11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:40:43.816104 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Migration 924dbb37-1046-4d89-8be8-3be585934dcc is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 19 04:40:43.816338 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance f6207103-8a47-4cc8-b1e0-c0ffd79e0173 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:40:43.816466 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 6f26313e-2659-4687-84da-96cf2da9a4e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:40:43.816723 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:40:43.816893 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=3072MB phys_disk=95GB used_disk=8GB total_vcpus=12 used_vcpus=13 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:40:42 up 31 min,  2 users,  load average: 7.35, 6.59, 3.60\n', 'num_instances': '12', 'num_vm_active': '10', 'num_task_None': '7', 'num_os_type_None': '12', 'num_proj_336d55ae51114828ba5ad8c0ac87ca9b': '2', 'io_workload': '3', 'num_task_deleting': '2', 'num_proj_49561da7541f44898968cb455fb3e6bd': '1', 'num_proj_7e0c7a19a41a44fba4c0fca71022a5a1': '2', 'num_proj_490151decdde445593a86a16976f6b34': '4', 'num_proj_28b3c0fa8f894ed2a7c3bcfac99ce74c': '1', 'num_proj_529ec00acc80453dbe8d6a1295e9eb13': '1', 'num_task_resize_migrating': '1', 'num_proj_8a3dfff83ce24e619f87507f951f6c69': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_task_networking': '1'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:40:43.826198 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:43.826198 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:43.826198 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:43.826198 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:43.826198 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:43.826198 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:44.086237 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Took 1.63 seconds to deallocate network for instance.
May 19 04:40:44.167043 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Took 0.57 seconds to detach 1 volumes for instance.
May 19 04:40:44.284065 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:40:44.284065 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquired lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:40:44.284065 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:40:44.310774 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:40:44.311194 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165644.3108578, 0dbaac9f-71f1-4cb6-837c-cafc38f94f11 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:40:44.311350 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] VM Paused (Lifecycle Event)
May 19 04:40:44.333731 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Took 7.65 seconds to spawn the instance on the hypervisor.
May 19 04:40:44.337901 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:44.388369 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:40:44.389728 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:40:44.390083 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Creating image(s)
May 19 04:40:44.390809 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:44.391213 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "/opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:44.391830 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "/opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:44.392519 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:40:44.397395 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:40:44.399065 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:44.512564 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.113s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:44.513042 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:44.513498 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:44.513970 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:40:44.516882 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:40:44.517256 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:44.570121 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:40:44.570471 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:40:44.616133 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.099s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:44.616973 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:44.659098 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Took 0.57 seconds to detach 1 volumes for instance.
May 19 04:40:44.674211 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk 1073741824" returned: 0 in 0.057s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:44.674877 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.161s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:44.675244 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:44.695274 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:44.700124 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-845899bd-36fa-4407-8f4f-aee72e7d8680 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "93c62882-ef27-41d5-8178-e1ccc945fe1d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.530s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:44.756005 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d148e672-8862-4c34-96ba-8b185754bcb7 req-3d4c00e7-897e-4e55-b275-511770952bea service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Received event network-vif-unplugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:44.756005 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d148e672-8862-4c34-96ba-8b185754bcb7 req-3d4c00e7-897e-4e55-b275-511770952bea service nova] Acquiring lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:44.756136 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d148e672-8862-4c34-96ba-8b185754bcb7 req-3d4c00e7-897e-4e55-b275-511770952bea service nova] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:44.756247 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d148e672-8862-4c34-96ba-8b185754bcb7 req-3d4c00e7-897e-4e55-b275-511770952bea service nova] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:44.756435 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d148e672-8862-4c34-96ba-8b185754bcb7 req-3d4c00e7-897e-4e55-b275-511770952bea service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] No waiting events found dispatching network-vif-unplugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:40:44.756622 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-d148e672-8862-4c34-96ba-8b185754bcb7 req-3d4c00e7-897e-4e55-b275-511770952bea service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Received unexpected event network-vif-unplugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 for instance with vm_state active and task_state resize_migrating.
May 19 04:40:44.756784 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d148e672-8862-4c34-96ba-8b185754bcb7 req-3d4c00e7-897e-4e55-b275-511770952bea service nova] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Received event network-vif-deleted-3587c521-ddbe-4301-84ca-17721980c57a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:44.756945 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d148e672-8862-4c34-96ba-8b185754bcb7 req-3d4c00e7-897e-4e55-b275-511770952bea service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Received event network-vif-unplugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:44.757246 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d148e672-8862-4c34-96ba-8b185754bcb7 req-3d4c00e7-897e-4e55-b275-511770952bea service nova] Acquiring lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:44.757429 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d148e672-8862-4c34-96ba-8b185754bcb7 req-3d4c00e7-897e-4e55-b275-511770952bea service nova] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:44.757861 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d148e672-8862-4c34-96ba-8b185754bcb7 req-3d4c00e7-897e-4e55-b275-511770952bea service nova] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:44.758217 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d148e672-8862-4c34-96ba-8b185754bcb7 req-3d4c00e7-897e-4e55-b275-511770952bea service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] No waiting events found dispatching network-vif-unplugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:40:44.758376 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-d148e672-8862-4c34-96ba-8b185754bcb7 req-3d4c00e7-897e-4e55-b275-511770952bea service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Received unexpected event network-vif-unplugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 for instance with vm_state active and task_state resize_migrating.
May 19 04:40:44.758547 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d148e672-8862-4c34-96ba-8b185754bcb7 req-3d4c00e7-897e-4e55-b275-511770952bea service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Received event network-changed-9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:44.758678 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d148e672-8862-4c34-96ba-8b185754bcb7 req-3d4c00e7-897e-4e55-b275-511770952bea service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Refreshing instance network info cache due to event network-changed-9791a107-963b-4608-9092-2df622d06125. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:40:44.758842 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d148e672-8862-4c34-96ba-8b185754bcb7 req-3d4c00e7-897e-4e55-b275-511770952bea service nova] Acquiring lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:40:44.778889 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.104s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:44.779292 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:40:44.779626 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:44.819125 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:44.823411 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165644.8230944, 0dbaac9f-71f1-4cb6-837c-cafc38f94f11 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:40:44.823772 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] VM Resumed (Lifecycle Event)
May 19 04:40:44.853752 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Took 13.49 seconds to build instance.
May 19 04:40:44.866018 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:44.866517 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Cannot resize image /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:40:44.866769 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:40:44.866969 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Ensure instance console log exists: /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:40:44.867854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:44.867854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:44.868068 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:44.874346 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:40:45.065127 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:45.068216 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.060s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:45.068664 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:40:45.068818 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:40:45.073923 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-958818ac-ad38-4102-97cc-6f000d3a1c65 (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-958818ac-ad38-4102-97cc-6f000d3a1c65 (non-flash)
May 19 04:40:45.104205 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '75'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '81'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', '87'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-958818ac-ad38-4102-97cc-6f000d3a1c65', '88')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:40:45.104205 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '82')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:45.105600 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '83')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:45.105825 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218342791c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a'): ({'sdt'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a'): ({'sdu'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:40:45.105991 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Removing multipathed devices sdt, sdu {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:40:45.106293 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Flush multipath device 330000000b0c2b96e {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:40:45.163986 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Remove SCSI device /dev/sdt with /sys/block/sdt/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:40:45.169127 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:45.207018 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Remove SCSI device /dev/sdu with /sys/block/sdu/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:40:45.231030 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Updating instance_info_cache with network_info: [{"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:45.258714 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Checking to see if SCSI volumes sdt, sdu have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:40:45.258922 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] SCSI volumes sdt, sdu have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:40:45.260309 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Checking to see if device paths {'sdt', 'sdu'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:40:45.270937 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Device paths {'sdt', 'sdu'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:40:45.271192 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:40:45.285088 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:45.329374 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:45.332956 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 82, target: iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a, portal: 192.168.40.100,3260]
May 19 04:40:45.332956 np0000001025 nova-compute[97981]: Logout of [sid: 82, target: iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a, portal: 192.168.40.100,3260] successful.
May 19 04:40:45.332956 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:45.338923 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:40:45.355563 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.998s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:45.359469 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:45.374808 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:45.380002 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fa7da087-744e-4274-a42a-6d0e32e21b9e req-4abd4b68-6ba7-4e57-b74f-cf4676506406 service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Received event network-vif-plugged-6b74663e-9ccd-4251-97fd-0eca225719e2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:45.381204 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fa7da087-744e-4274-a42a-6d0e32e21b9e req-4abd4b68-6ba7-4e57-b74f-cf4676506406 service nova] Acquiring lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:45.382266 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fa7da087-744e-4274-a42a-6d0e32e21b9e req-4abd4b68-6ba7-4e57-b74f-cf4676506406 service nova] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:45.382842 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fa7da087-744e-4274-a42a-6d0e32e21b9e req-4abd4b68-6ba7-4e57-b74f-cf4676506406 service nova] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:45.385122 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fa7da087-744e-4274-a42a-6d0e32e21b9e req-4abd4b68-6ba7-4e57-b74f-cf4676506406 service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] No waiting events found dispatching network-vif-plugged-6b74663e-9ccd-4251-97fd-0eca225719e2 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:40:45.386770 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-fa7da087-744e-4274-a42a-6d0e32e21b9e req-4abd4b68-6ba7-4e57-b74f-cf4676506406 service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Received unexpected event network-vif-plugged-6b74663e-9ccd-4251-97fd-0eca225719e2 for instance with vm_state active and task_state None.
May 19 04:40:45.387361 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fa7da087-744e-4274-a42a-6d0e32e21b9e req-4abd4b68-6ba7-4e57-b74f-cf4676506406 service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Received event network-changed-7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:45.387511 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fa7da087-744e-4274-a42a-6d0e32e21b9e req-4abd4b68-6ba7-4e57-b74f-cf4676506406 service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Refreshing instance network info cache due to event network-changed-7aa25728-c226-4d2c-ac7a-d5a1edf94739. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:40:45.387692 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fa7da087-744e-4274-a42a-6d0e32e21b9e req-4abd4b68-6ba7-4e57-b74f-cf4676506406 service nova] Acquiring lock "refresh_cache-15f0abbc-b8de-4d77-88c4-e5c0e54d691f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:40:45.388067 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fa7da087-744e-4274-a42a-6d0e32e21b9e req-4abd4b68-6ba7-4e57-b74f-cf4676506406 service nova] Acquired lock "refresh_cache-15f0abbc-b8de-4d77-88c4-e5c0e54d691f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:40:45.388067 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-fa7da087-744e-4274-a42a-6d0e32e21b9e req-4abd4b68-6ba7-4e57-b74f-cf4676506406 service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Refreshing network info cache for port 7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:40:45.412592 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 83, target: iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a, portal: 192.168.50.100,3260]
May 19 04:40:45.412592 np0000001025 nova-compute[97981]: Logout of [sid: 83, target: iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a, portal: 192.168.50.100,3260] successful.
May 19 04:40:45.412592 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:45.436445 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:45.436725 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:45.436883 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] <== disconnect_volume: return (2429ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:45.437035 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:40:45.442128 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] skipping disk /dev/dm-10 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:40:45.442128 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/f6207103-8a47-4cc8-b1e0-c0ffd79e0173_resize/disk.config /opt/stack/data/nova/instances/f6207103-8a47-4cc8-b1e0-c0ffd79e0173/disk.config {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:45.484896 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "cp -r /opt/stack/data/nova/instances/f6207103-8a47-4cc8-b1e0-c0ffd79e0173_resize/disk.config /opt/stack/data/nova/instances/f6207103-8a47-4cc8-b1e0-c0ffd79e0173/disk.config" returned: 0 in 0.044s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:45.581539 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:40:45.581765 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.859s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:45.582118 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:40:45.582445 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.888s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:45.735481 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Releasing lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:40:45.735481 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Instance network_info: |[{"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:40:45.738650 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d148e672-8862-4c34-96ba-8b185754bcb7 req-3d4c00e7-897e-4e55-b275-511770952bea service nova] Acquired lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:40:45.738820 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d148e672-8862-4c34-96ba-8b185754bcb7 req-3d4c00e7-897e-4e55-b275-511770952bea service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Refreshing network info cache for port 9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:40:45.741744 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Start _get_guest_xml network_info=[{"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:40:45.747236 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:40:45.748439 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='6f26313e-2659-4687-84da-96cf2da9a4e2'), owner=OwnerMeta(userid='aa432d60cb324c6d87818107e05e0053', username='tempest-AttachVolumeMultiAttachTest-1659172696-project-member', projectid='490151decdde445593a86a16976f6b34', projectname='tempest-AttachVolumeMultiAttachTest-1659172696'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165645.748046) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:40:45.754032 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:40:45.754970 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:40:45.755397 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:40:45.755616 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:40:45.756746 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:40:45.757527 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:40:45.757527 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:40:45.757527 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:40:45.757719 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:40:45.757802 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:40:45.757940 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:40:45.758189 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:40:45.758544 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:40:45.758787 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:40:45.758945 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:40:45.759102 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:40:45.775720 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='multiattach-server-0',id=37,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9kq9UfoFPrqlSUYASLa2M8/KXwpiWIksTRz6r+vXFFf5G7djO79flSW+4jvUEBmYvioxzxvTch1hKVIwlMIaMSuT3AyUPlX/5ZPn59wF6pdcyyqAHuNzAVPjAjiGd+6A==',key_name='tempest-keypair-818275091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-ksq0p58y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:40:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa432d60cb324c6d87818107e05e0053',uuid=6f26313e-2659-4687-84da-96cf2da9a4e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:40:45.775923 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:40:45.776716 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:d4:f0,bridge_name='br-int',has_traffic_filtering=True,id=9791a107-963b-4608-9092-2df622d06125,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9791a107-96') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:40:45.777474 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f26313e-2659-4687-84da-96cf2da9a4e2 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:45.892905 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-fa7da087-744e-4274-a42a-6d0e32e21b9e req-4abd4b68-6ba7-4e57-b74f-cf4676506406 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:46.243324 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-d148e672-8862-4c34-96ba-8b185754bcb7 req-3d4c00e7-897e-4e55-b275-511770952bea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:46.282371 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] End _get_guest_xml xml=<domain type="qemu">
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:   <uuid>6f26313e-2659-4687-84da-96cf2da9a4e2</uuid>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:   <name>instance-00000025</name>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <nova:name>multiattach-server-0</nova:name>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:40:45</nova:creationTime>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:         <nova:user uuid="aa432d60cb324c6d87818107e05e0053">tempest-AttachVolumeMultiAttachTest-1659172696-project-member</nova:user>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:         <nova:project uuid="490151decdde445593a86a16976f6b34">tempest-AttachVolumeMultiAttachTest-1659172696</nova:project>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:         <nova:port uuid="9791a107-963b-4608-9092-2df622d06125">
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     <system>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <entry name="serial">6f26313e-2659-4687-84da-96cf2da9a4e2</entry>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <entry name="uuid">6f26313e-2659-4687-84da-96cf2da9a4e2</entry>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     </system>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:   <os>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:   </os>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:   <features>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:   </features>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:   <devices>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk"/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     </disk>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk.config"/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     </disk>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:fa:d4:f0"/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <target dev="tap9791a107-96"/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     </interface>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/console.log" append="off"/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     </serial>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     <video>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     </video>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     </rng>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:   </devices>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]: </domain>
May 19 04:40:46.282371 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:40:46.284602 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Preparing to wait for external event network-vif-plugged-9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:40:46.284602 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:46.284602 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:46.284602 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:46.284602 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='multiattach-server-0',id=37,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9kq9UfoFPrqlSUYASLa2M8/KXwpiWIksTRz6r+vXFFf5G7djO79flSW+4jvUEBmYvioxzxvTch1hKVIwlMIaMSuT3AyUPlX/5ZPn59wF6pdcyyqAHuNzAVPjAjiGd+6A==',key_name='tempest-keypair-818275091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-ksq0p58y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:40:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa432d60cb324c6d87818107e05e0053',uuid=6f26313e-2659-4687-84da-96cf2da9a4e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:40:46.284602 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:40:46.285008 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:d4:f0,bridge_name='br-int',has_traffic_filtering=True,id=9791a107-963b-4608-9092-2df622d06125,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9791a107-96') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:40:46.285258 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:d4:f0,bridge_name='br-int',has_traffic_filtering=True,id=9791a107-963b-4608-9092-2df622d06125,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9791a107-96') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:40:46.289151 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:46.289151 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:46.289151 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:40:46.290603 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:46.290603 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dfa44868-5d55-5b96-bf58-0256ee942c6f', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:46.291137 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:46.291855 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:46.299933 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:46.299933 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9791a107-96, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:46.299933 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9791a107-96, col_values=(('qos', UUID('b33104e9-a511-4097-b92b-19a674c61ab9')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:46.299933 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9791a107-96, col_values=(('external_ids', {'iface-id': '9791a107-963b-4608-9092-2df622d06125', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:d4:f0', 'vm-uuid': '6f26313e-2659-4687-84da-96cf2da9a4e2'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:46.300359 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:46.301759 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:46.316273 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:46.317032 np0000001025 nova-compute[97981]: INFO os_vif [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:d4:f0,bridge_name='br-int',has_traffic_filtering=True,id=9791a107-963b-4608-9092-2df622d06125,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9791a107-96')
May 19 04:40:46.326056 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-fa7da087-744e-4274-a42a-6d0e32e21b9e req-4abd4b68-6ba7-4e57-b74f-cf4676506406 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:46.371726 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:40:46.372581 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:40:46.501324 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-fa7da087-744e-4274-a42a-6d0e32e21b9e req-4abd4b68-6ba7-4e57-b74f-cf4676506406 service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Updated VIF entry in instance network info cache for port 7aa25728-c226-4d2c-ac7a-d5a1edf94739. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:40:46.501728 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-fa7da087-744e-4274-a42a-6d0e32e21b9e req-4abd4b68-6ba7-4e57-b74f-cf4676506406 service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Updating instance_info_cache with network_info: [{"id": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "address": "fa:16:3e:19:0f:7d", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa25728-c2", "ovs_interfaceid": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:46.580967 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-d148e672-8862-4c34-96ba-8b185754bcb7 req-3d4c00e7-897e-4e55-b275-511770952bea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:46.582577 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:40:46.583232 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:40:46.583472 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 39.03 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:40:46.647310 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:46.648051 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:46.727381 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d148e672-8862-4c34-96ba-8b185754bcb7 req-3d4c00e7-897e-4e55-b275-511770952bea service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Updated VIF entry in instance network info cache for port 9791a107-963b-4608-9092-2df622d06125. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:40:46.727603 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d148e672-8862-4c34-96ba-8b185754bcb7 req-3d4c00e7-897e-4e55-b275-511770952bea service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Updating instance_info_cache with network_info: [{"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:46.764736 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Port 37cbdb78-cc1c-48e2-879d-959cb26c29f9 binding to destination host np0000001025 is already ACTIVE {{(pid=97981) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}}
May 19 04:40:46.875581 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:40:47.003845 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fa7da087-744e-4274-a42a-6d0e32e21b9e req-4abd4b68-6ba7-4e57-b74f-cf4676506406 service nova] Releasing lock "refresh_cache-15f0abbc-b8de-4d77-88c4-e5c0e54d691f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:40:47.004013 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fa7da087-744e-4274-a42a-6d0e32e21b9e req-4abd4b68-6ba7-4e57-b74f-cf4676506406 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Received event network-vif-unplugged-9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:47.004193 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fa7da087-744e-4274-a42a-6d0e32e21b9e req-4abd4b68-6ba7-4e57-b74f-cf4676506406 service nova] Acquiring lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:47.004339 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fa7da087-744e-4274-a42a-6d0e32e21b9e req-4abd4b68-6ba7-4e57-b74f-cf4676506406 service nova] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:47.004439 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fa7da087-744e-4274-a42a-6d0e32e21b9e req-4abd4b68-6ba7-4e57-b74f-cf4676506406 service nova] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:47.004570 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fa7da087-744e-4274-a42a-6d0e32e21b9e req-4abd4b68-6ba7-4e57-b74f-cf4676506406 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] No event matching network-vif-unplugged-9791a107-963b-4608-9092-2df622d06125 in dict_keys([('network-vif-plugged', '9791a107-963b-4608-9092-2df622d06125')]) {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 19 04:40:47.004686 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-fa7da087-744e-4274-a42a-6d0e32e21b9e req-4abd4b68-6ba7-4e57-b74f-cf4676506406 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Received unexpected event network-vif-unplugged-9791a107-963b-4608-9092-2df622d06125 for instance with vm_state building and task_state spawning.
May 19 04:40:47.229522 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d148e672-8862-4c34-96ba-8b185754bcb7 req-3d4c00e7-897e-4e55-b275-511770952bea service nova] Releasing lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:40:47.385210 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.803s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:47.387064 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.218s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:47.459074 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Deleted allocations for instance 57adc083-429a-4f23-9154-7de8b6e74d8a
May 19 04:40:47.478583 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e103ca83-bba6-459b-9fbd-6b891eddfcd0 req-d604f8d8-fee4-46dd-af2d-184a573f974f service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Received event network-changed-2f49d1e8-3715-4f15-8d97-10c3446283ad {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:47.478747 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e103ca83-bba6-459b-9fbd-6b891eddfcd0 req-d604f8d8-fee4-46dd-af2d-184a573f974f service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Refreshing instance network info cache due to event network-changed-2f49d1e8-3715-4f15-8d97-10c3446283ad. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:40:47.481939 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e103ca83-bba6-459b-9fbd-6b891eddfcd0 req-d604f8d8-fee4-46dd-af2d-184a573f974f service nova] Acquiring lock "refresh_cache-aa2cdf1d-65ef-4cf4-b742-72ae783cde27" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:40:47.482222 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e103ca83-bba6-459b-9fbd-6b891eddfcd0 req-d604f8d8-fee4-46dd-af2d-184a573f974f service nova] Acquired lock "refresh_cache-aa2cdf1d-65ef-4cf4-b742-72ae783cde27" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:40:47.483066 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e103ca83-bba6-459b-9fbd-6b891eddfcd0 req-d604f8d8-fee4-46dd-af2d-184a573f974f service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Refreshing network info cache for port 2f49d1e8-3715-4f15-8d97-10c3446283ad {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:40:47.773173 np0000001025 nova-compute[97981]: DEBUG nova.compute.rpcapi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97981) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 19 04:40:47.783562 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:47.788924 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:47.788924 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:47.841529 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:47.841680 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:47.841832 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No VIF found with MAC fa:16:3e:fa:d4:f0, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:40:47.842343 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Using config drive
May 19 04:40:47.987129 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-e103ca83-bba6-459b-9fbd-6b891eddfcd0 req-d604f8d8-fee4-46dd-af2d-184a573f974f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:48.171975 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:40:48.172181 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:40:48.214033 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:48.328127 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-e103ca83-bba6-459b-9fbd-6b891eddfcd0 req-d604f8d8-fee4-46dd-af2d-184a573f974f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:48.347693 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:48.470960 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e103ca83-bba6-459b-9fbd-6b891eddfcd0 req-d604f8d8-fee4-46dd-af2d-184a573f974f service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Updated VIF entry in instance network info cache for port 2f49d1e8-3715-4f15-8d97-10c3446283ad. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:40:48.470960 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e103ca83-bba6-459b-9fbd-6b891eddfcd0 req-d604f8d8-fee4-46dd-af2d-184a573f974f service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Updating instance_info_cache with network_info: [{"id": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "address": "fa:16:3e:3c:c4:ae", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f49d1e8-37", "ovs_interfaceid": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:48.471448 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-93c7905d-d24a-4fb4-ad38-2aacda5e6121 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "57adc083-429a-4f23-9154-7de8b6e74d8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.259s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:48.483643 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Creating config drive at /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk.config
May 19 04:40:48.489646 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9xxcnxx5 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:48.541168 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9xxcnxx5" returned: 0 in 0.051s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:48.685328 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:40:48.793393 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:48.940452 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "refresh_cache-f6207103-8a47-4cc8-b1e0-c0ffd79e0173" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:40:48.940618 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquired lock "refresh_cache-f6207103-8a47-4cc8-b1e0-c0ffd79e0173" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:40:48.940824 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:40:48.975131 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e103ca83-bba6-459b-9fbd-6b891eddfcd0 req-d604f8d8-fee4-46dd-af2d-184a573f974f service nova] Releasing lock "refresh_cache-aa2cdf1d-65ef-4cf4-b742-72ae783cde27" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:40:48.975131 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e103ca83-bba6-459b-9fbd-6b891eddfcd0 req-d604f8d8-fee4-46dd-af2d-184a573f974f service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Received event network-changed-6b74663e-9ccd-4251-97fd-0eca225719e2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:48.975131 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e103ca83-bba6-459b-9fbd-6b891eddfcd0 req-d604f8d8-fee4-46dd-af2d-184a573f974f service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Refreshing instance network info cache due to event network-changed-6b74663e-9ccd-4251-97fd-0eca225719e2. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:40:48.975131 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e103ca83-bba6-459b-9fbd-6b891eddfcd0 req-d604f8d8-fee4-46dd-af2d-184a573f974f service nova] Acquiring lock "refresh_cache-0dbaac9f-71f1-4cb6-837c-cafc38f94f11" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:40:48.975131 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e103ca83-bba6-459b-9fbd-6b891eddfcd0 req-d604f8d8-fee4-46dd-af2d-184a573f974f service nova] Acquired lock "refresh_cache-0dbaac9f-71f1-4cb6-837c-cafc38f94f11" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:40:48.975131 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e103ca83-bba6-459b-9fbd-6b891eddfcd0 req-d604f8d8-fee4-46dd-af2d-184a573f974f service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Refreshing network info cache for port 6b74663e-9ccd-4251-97fd-0eca225719e2 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:40:49.034378 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:49.037835 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:49.067047 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:49.158149 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:49.197670 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:49.197670 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:49.197670 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.810s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:49.258345 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Deleted allocations for instance 87e8e02e-e385-418c-be0c-bb25a377d081
May 19 04:40:49.446146 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:49.477068 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-e103ca83-bba6-459b-9fbd-6b891eddfcd0 req-d604f8d8-fee4-46dd-af2d-184a573f974f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:49.541406 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b892ea20-4dd7-4820-ae67-24ea7646206d req-bbd2e815-a823-45a6-8334-9e9d5aab0926 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Received event network-vif-plugged-9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:49.541641 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b892ea20-4dd7-4820-ae67-24ea7646206d req-bbd2e815-a823-45a6-8334-9e9d5aab0926 service nova] Acquiring lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:49.541929 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b892ea20-4dd7-4820-ae67-24ea7646206d req-bbd2e815-a823-45a6-8334-9e9d5aab0926 service nova] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:49.541929 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b892ea20-4dd7-4820-ae67-24ea7646206d req-bbd2e815-a823-45a6-8334-9e9d5aab0926 service nova] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:49.542063 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b892ea20-4dd7-4820-ae67-24ea7646206d req-bbd2e815-a823-45a6-8334-9e9d5aab0926 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Processing event network-vif-plugged-9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:40:49.542207 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b892ea20-4dd7-4820-ae67-24ea7646206d req-bbd2e815-a823-45a6-8334-9e9d5aab0926 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Received event network-vif-plugged-9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:49.542387 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b892ea20-4dd7-4820-ae67-24ea7646206d req-bbd2e815-a823-45a6-8334-9e9d5aab0926 service nova] Acquiring lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:49.542525 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b892ea20-4dd7-4820-ae67-24ea7646206d req-bbd2e815-a823-45a6-8334-9e9d5aab0926 service nova] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:49.545294 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b892ea20-4dd7-4820-ae67-24ea7646206d req-bbd2e815-a823-45a6-8334-9e9d5aab0926 service nova] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:49.545905 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b892ea20-4dd7-4820-ae67-24ea7646206d req-bbd2e815-a823-45a6-8334-9e9d5aab0926 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] No waiting events found dispatching network-vif-plugged-9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:40:49.549510 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-b892ea20-4dd7-4820-ae67-24ea7646206d req-bbd2e815-a823-45a6-8334-9e9d5aab0926 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Received unexpected event network-vif-plugged-9791a107-963b-4608-9092-2df622d06125 for instance with vm_state building and task_state spawning.
May 19 04:40:49.842968 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-e103ca83-bba6-459b-9fbd-6b891eddfcd0 req-d604f8d8-fee4-46dd-af2d-184a573f974f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:49.847472 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:50.020009 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Updating instance_info_cache with network_info: [{"id": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "address": "fa:16:3e:91:89:b7", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cbdb78-cc", "ovs_interfaceid": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:50.026309 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165650.0258865, 6f26313e-2659-4687-84da-96cf2da9a4e2 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:40:50.028529 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:40:50.028529 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] VM Started (Lifecycle Event)
May 19 04:40:50.030741 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:40:50.032791 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Instance spawned successfully.
May 19 04:40:50.033224 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:40:50.055343 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e103ca83-bba6-459b-9fbd-6b891eddfcd0 req-d604f8d8-fee4-46dd-af2d-184a573f974f service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Updated VIF entry in instance network info cache for port 6b74663e-9ccd-4251-97fd-0eca225719e2. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:40:50.055706 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e103ca83-bba6-459b-9fbd-6b891eddfcd0 req-d604f8d8-fee4-46dd-af2d-184a573f974f service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Updating instance_info_cache with network_info: [{"id": "6b74663e-9ccd-4251-97fd-0eca225719e2", "address": "fa:16:3e:19:9d:73", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74663e-9c", "ovs_interfaceid": "6b74663e-9ccd-4251-97fd-0eca225719e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:50.270488 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac5fbc2-5c95-4099-bd69-2c28b9333ce0 tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Lock "87e8e02e-e385-418c-be0c-bb25a377d081" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.661s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:50.522359 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Releasing lock "refresh_cache-f6207103-8a47-4cc8-b1e0-c0ffd79e0173" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:40:50.531157 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:50.534891 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:40:50.544810 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:50.544810 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:50.544810 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:50.545237 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:50.545371 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:50.545676 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:40:50.559733 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e103ca83-bba6-459b-9fbd-6b891eddfcd0 req-d604f8d8-fee4-46dd-af2d-184a573f974f service nova] Releasing lock "refresh_cache-0dbaac9f-71f1-4cb6-837c-cafc38f94f11" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:40:51.033152 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:51.040821 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:40:51.041167 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165651.0409114, 6f26313e-2659-4687-84da-96cf2da9a4e2 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:40:51.041263 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] VM Paused (Lifecycle Event)
May 19 04:40:51.046614 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:40:51.057295 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Took 6.66 seconds to spawn the instance on the hypervisor.
May 19 04:40:51.057295 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:51.078072 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:51.139430 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:40:51.140138 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:40:51.149853 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:40:51.151383 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fef1:293e', 'fe80::8849:6dff:fe86:4a4b', 'fe80::fc16:3eff:fea1:aa43', 'fe80::fc16:3eff:fe19:f7d', 'fe80::946f:41ff:fe06:ab72', 'fe80::fc16:3eff:fe19:9d73', 'fe80::fc16:3eff:fefa:d4f0'] 
May 19 04:40:51.151633 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:40:51.151876 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:40:51.152190 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:51.303128 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:51.622392 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:51.628944 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Took 13.60 seconds to build instance.
May 19 04:40:51.636545 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165651.634297, 6f26313e-2659-4687-84da-96cf2da9a4e2 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:40:51.636545 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] VM Resumed (Lifecycle Event)
May 19 04:40:51.818201 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "93c62882-ef27-41d5-8178-e1ccc945fe1d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:51.818988 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "93c62882-ef27-41d5-8178-e1ccc945fe1d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:52.128313 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "93c62882-ef27-41d5-8178-e1ccc945fe1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:52.134251 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.128s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:52.141798 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:52.143896 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:40:52.281900 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Starting finish_migration {{(pid=97981) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 19 04:40:52.282867 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Instance directory exists: not creating {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 19 04:40:52.282951 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Creating image(s)
May 19 04:40:52.283430 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:40:52.283430 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Ensure instance console log exists: /opt/stack/data/nova/instances/f6207103-8a47-4cc8-b1e0-c0ffd79e0173/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:40:52.283687 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:52.284058 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:52.284263 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:52.284843 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Start _get_guest_xml network_info=[{"id": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "address": "fa:16:3e:91:89:b7", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-906047595-network", "vif_mac": "fa:16:3e:91:89:b7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cbdb78-cc", "ovs_interfaceid": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'e00ae8bb-8315-4472-8280-52e2f44aafb4', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'f6207103-8a47-4cc8-b1e0-c0ffd79e0173', 'attached_at': '2026-05-19T04:40:51.000000', 'detached_at': '', 'volume_id': 'aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'serial': 'aed1b29d-163e-4ba7-b0b8-8576d4be428a'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:40:52.287899 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:40:52.288927 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-985806649', uuid='f6207103-8a47-4cc8-b1e0-c0ffd79e0173'), owner=OwnerMeta(userid='6374f2e55af946f9abf35d0c8a1cd206', username='tempest-ServerActionsTestOtherA-281327203-project-member', projectid='336d55ae51114828ba5ad8c0ac87ca9b', projectname='tempest-ServerActionsTestOtherA-281327203'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "address": "fa:16:3e:91:89:b7", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-906047595-network", "vif_mac": "fa:16:3e:91:89:b7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cbdb78-cc", "ovs_interfaceid": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165652.2886326) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:40:52.290292 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:40:52.290687 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:40:52.291482 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:40:52.291650 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:40:52.293198 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:40:52.293490 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:40:52.293632 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:40:52.293713 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:40:52.293838 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:40:52.293941 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:40:52.294036 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:40:52.297341 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:40:52.297580 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:40:52.297720 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:40:52.297824 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:40:52.297957 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:40:52.315936 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6207103-8a47-4cc8-b1e0-c0ffd79e0173/disk.config --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:40:52.334548 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Detaching volume a7faf4e4-0f15-4992-8e8b-12efa20286d6
May 19 04:40:52.393088 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Attempting to driver detach volume a7faf4e4-0f15-4992-8e8b-12efa20286d6 from mountpoint /dev/vdb
May 19 04:40:52.400089 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Found disk vdb by alias ua-a7faf4e4-0f15-4992-8e8b-12efa20286d6 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:40:52.401532 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Found disk vdb by alias ua-a7faf4e4-0f15-4992-8e8b-12efa20286d6 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:40:52.401753 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Attempting to detach device vdb from instance 93c62882-ef27-41d5-8178-e1ccc945fe1d from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:40:52.402150 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:40:52.402150 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:40:52.402150 np0000001025 nova-compute[97981]:   <alias name="ua-a7faf4e4-0f15-4992-8e8b-12efa20286d6"/>
May 19 04:40:52.402150 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-1"/>
May 19 04:40:52.402150 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:40:52.402150 np0000001025 nova-compute[97981]:   <serial>a7faf4e4-0f15-4992-8e8b-12efa20286d6</serial>
May 19 04:40:52.402150 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:40:52.402150 np0000001025 nova-compute[97981]: </disk>
May 19 04:40:52.402150 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:40:52.410558 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Successfully detached device vdb from instance 93c62882-ef27-41d5-8178-e1ccc945fe1d from the persistent domain config.
May 19 04:40:52.410782 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] (1/8): Attempting to detach device vdb with device alias ua-a7faf4e4-0f15-4992-8e8b-12efa20286d6 from instance 93c62882-ef27-41d5-8178-e1ccc945fe1d from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:40:52.411166 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:40:52.411166 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:40:52.411166 np0000001025 nova-compute[97981]:   <alias name="ua-a7faf4e4-0f15-4992-8e8b-12efa20286d6"/>
May 19 04:40:52.411166 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-1"/>
May 19 04:40:52.411166 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:40:52.411166 np0000001025 nova-compute[97981]:   <serial>a7faf4e4-0f15-4992-8e8b-12efa20286d6</serial>
May 19 04:40:52.411166 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:40:52.411166 np0000001025 nova-compute[97981]: </disk>
May 19 04:40:52.411166 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:40:52.426492 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6207103-8a47-4cc8-b1e0-c0ffd79e0173/disk.config --force-share --output=json" returned: 0 in 0.111s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:40:52.426922 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6207103-8a47-4cc8-b1e0-c0ffd79e0173/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:52.427183 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "/opt/stack/data/nova/instances/f6207103-8a47-4cc8-b1e0-c0ffd79e0173/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:52.427810 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "/opt/stack/data/nova/instances/f6207103-8a47-4cc8-b1e0-c0ffd79e0173/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:52.428098 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:40:52.428555 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:52.428737 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:52.429173 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:52.429400 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:40:52.444695 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:52.445231 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:52.445418 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:40:52.445843 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:52.446077 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:52.446258 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:40:52.459208 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:40:52.459208 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:52.465693 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:40:52.465693 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:52.474715 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a] added
May 19 04:40:52.474715 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:40:52.474715 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:52.474715 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:52.474715 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:52.474715 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:52.474715 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:52.475020 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:40:52.475020 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0296(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:40:52.475479 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:40:52.477039 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a] added
May 19 04:40:52.477039 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:40:52.477039 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:52.477039 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:52.477039 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:40:52.477039 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:40:52.477039 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:52.477457 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:40:52.477457 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0311(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:40:52.477457 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:40:52.955233 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165652.9548209, 93c62882-ef27-41d5-8178-e1ccc945fe1d => ua-a7faf4e4-0f15-4992-8e8b-12efa20286d6> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:40:52.956581 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a7faf4e4-0f15-4992-8e8b-12efa20286d6 for instance 93c62882-ef27-41d5-8178-e1ccc945fe1d {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:40:52.960403 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Successfully detached device vdb from instance 93c62882-ef27-41d5-8178-e1ccc945fe1d from the live domain config.
May 19 04:40:52.961374 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:40:52.961713 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7faf4e4-0f15-4992-8e8b-12efa20286d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:52.961894 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:53.086270 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-33093d03-648d-48f9-8318-ffcc9b2fb30d req-a9a892c0-61e1-48dc-b91d-7c5a46f40c2c service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Received event network-changed-451d5caa-1b64-4a79-8aea-b1fa65cf3131 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:53.086419 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-33093d03-648d-48f9-8318-ffcc9b2fb30d req-a9a892c0-61e1-48dc-b91d-7c5a46f40c2c service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Refreshing instance network info cache due to event network-changed-451d5caa-1b64-4a79-8aea-b1fa65cf3131. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:40:53.086624 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-33093d03-648d-48f9-8318-ffcc9b2fb30d req-a9a892c0-61e1-48dc-b91d-7c5a46f40c2c service nova] Acquiring lock "refresh_cache-e644a772-cf7c-4b15-b21b-ea54e773a1f9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:40:53.086720 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-33093d03-648d-48f9-8318-ffcc9b2fb30d req-a9a892c0-61e1-48dc-b91d-7c5a46f40c2c service nova] Acquired lock "refresh_cache-e644a772-cf7c-4b15-b21b-ea54e773a1f9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:40:53.086839 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-33093d03-648d-48f9-8318-ffcc9b2fb30d req-a9a892c0-61e1-48dc-b91d-7c5a46f40c2c service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Refreshing network info cache for port 451d5caa-1b64-4a79-8aea-b1fa65cf3131 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:40:53.217084 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:53.475859 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:40:53.478572 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:40:53.490075 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:40:53.490075 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:40:53.498993 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:40:53.498993 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:53.505893 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:53.514690 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:53.531336 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:53.531336 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:53.531336 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:53.531336 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:53.531336 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:53.531336 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:53.531336 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:53.531336 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:53.531336 np0000001025 nova-compute[97981]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:53.531336 np0000001025 nova-compute[97981]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:53.531336 np0000001025 nova-compute[97981]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-958818ac-ad38-4102-97cc-6f000d3a1c65 (non-flash)
May 19 04:40:53.531336 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:53.531827 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:53.531827 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:53.531827 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:53.531827 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:53.531827 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:53.531827 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:53.531827 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:53.531827 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:53.531827 np0000001025 nova-compute[97981]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:53.531827 np0000001025 nova-compute[97981]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:53.531827 np0000001025 nova-compute[97981]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-958818ac-ad38-4102-97cc-6f000d3a1c65 (non-flash)
May 19 04:40:53.531827 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:53.541235 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:53.541235 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:53.541235 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:53.541235 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:53.541235 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:53.541235 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:53.541235 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:53.541235 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:53.541235 np0000001025 nova-compute[97981]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:53.541235 np0000001025 nova-compute[97981]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:53.541235 np0000001025 nova-compute[97981]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-958818ac-ad38-4102-97cc-6f000d3a1c65 (non-flash)
May 19 04:40:53.541235 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:53.541235 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:53.541235 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:53.541235 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:53.541235 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:53.541235 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:53.541235 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:53.541235 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:53.541235 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:53.541235 np0000001025 nova-compute[97981]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:53.541235 np0000001025 nova-compute[97981]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:53.541235 np0000001025 nova-compute[97981]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-958818ac-ad38-4102-97cc-6f000d3a1c65 (non-flash)
May 19 04:40:53.541235 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:53.592909 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-33093d03-648d-48f9-8318-ffcc9b2fb30d req-a9a892c0-61e1-48dc-b91d-7c5a46f40c2c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:53.596073 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a, portal: 192.168.50.100,3260]
May 19 04:40:53.596073 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a, portal: 192.168.50.100,3260] successful.
May 19 04:40:53.596073 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:53.603531 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a, portal: 192.168.40.100,3260]
May 19 04:40:53.603531 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a, portal: 192.168.40.100,3260] successful.
May 19 04:40:53.603531 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:53.616898 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:53.626419 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-958818ac-ad38-4102-97cc-6f000d3a1c65 (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-958818ac-ad38-4102-97cc-6f000d3a1c65 (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:53.647157 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:53.647865 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:53.647865 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:40:53.650133 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] HCTL ('12', '-', '-', 0) found on session 89 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:40:53.650133 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:40:53.657762 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:53.657762 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:53.657762 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:53.657762 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:53.657762 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:53.657762 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:53.657762 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:53.657762 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:53.657762 np0000001025 nova-compute[97981]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:53.657762 np0000001025 nova-compute[97981]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:53.657762 np0000001025 nova-compute[97981]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-958818ac-ad38-4102-97cc-6f000d3a1c65 (non-flash)
May 19 04:40:53.657762 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:53.657762 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:53.657762 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:53.658218 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:53.658218 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:53.658218 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:53.658218 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:53.658218 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:53.658218 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:53.658218 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:53.658218 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:53.658218 np0000001025 nova-compute[97981]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:53.658218 np0000001025 nova-compute[97981]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:53.658218 np0000001025 nova-compute[97981]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-958818ac-ad38-4102-97cc-6f000d3a1c65 (non-flash)
May 19 04:40:53.658218 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:53.658218 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:53.658218 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:53.658591 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.213s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:53.658591 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:40:53.660213 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] HCTL ('18', '-', '-', 0) found on session 90 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:40:53.660213 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:40:53.674208 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Searching for a device in session 89 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:40:53.674208 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:40:53.683393 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Searching for a device in session 90 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:40:53.683643 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:40:54.099660 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-33093d03-648d-48f9-8318-ffcc9b2fb30d req-a9a892c0-61e1-48dc-b91d-7c5a46f40c2c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:54.243840 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-33093d03-648d-48f9-8318-ffcc9b2fb30d req-a9a892c0-61e1-48dc-b91d-7c5a46f40c2c service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Updated VIF entry in instance network info cache for port 451d5caa-1b64-4a79-8aea-b1fa65cf3131. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:40:54.243840 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-33093d03-648d-48f9-8318-ffcc9b2fb30d req-a9a892c0-61e1-48dc-b91d-7c5a46f40c2c service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Updating instance_info_cache with network_info: [{"id": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "address": "fa:16:3e:a1:aa:43", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap451d5caa-1b", "ovs_interfaceid": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:54.283390 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.002337884999860762 future=<Future at 0x72185030a810 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:54.284041 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] Emitting event <LifecycleEvent: 1779165639.2808938, 57adc083-429a-4f23-9154-7de8b6e74d8a => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:40:54.284041 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] VM Stopped (Lifecycle Event)
May 19 04:40:54.285623 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:54.285623 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=3.5867349360000844 future=<Future at 0x7218342ca6c0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:54.285623 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=3.5866467170001215 future=<Future at 0x7218342ca6c0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:54.344152 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:54.447314 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:40:54.579768 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "417861ee-dcf2-458b-8782-2ec22d2f5421" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:54.580013 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:54.612487 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "9fca60a6-f506-4f7f-a987-62c44e75f78f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:54.612658 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "9fca60a6-f506-4f7f-a987-62c44e75f78f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:54.745428 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-33093d03-648d-48f9-8318-ffcc9b2fb30d req-a9a892c0-61e1-48dc-b91d-7c5a46f40c2c service nova] Releasing lock "refresh_cache-e644a772-cf7c-4b15-b21b-ea54e773a1f9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:40:54.778315 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:54.791049 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4262dd68-5069-40ab-865f-9fe061fac1cb tempest-ServersNegativeTestJSON-1193290315 tempest-ServersNegativeTestJSON-1193290315-project-member] [instance: 57adc083-429a-4f23-9154-7de8b6e74d8a] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:55.085556 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:40:55.121976 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:40:55.181128 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fdcc3c24-0537-461e-8fc2-dcf73cf28a65 req-b54e45f2-ed17-4b84-a7a2-49662350eb2c service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Received event network-changed-9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:55.184570 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fdcc3c24-0537-461e-8fc2-dcf73cf28a65 req-b54e45f2-ed17-4b84-a7a2-49662350eb2c service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Refreshing instance network info cache due to event network-changed-9791a107-963b-4608-9092-2df622d06125. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:40:55.185181 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fdcc3c24-0537-461e-8fc2-dcf73cf28a65 req-b54e45f2-ed17-4b84-a7a2-49662350eb2c service nova] Acquiring lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:40:55.185632 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fdcc3c24-0537-461e-8fc2-dcf73cf28a65 req-b54e45f2-ed17-4b84-a7a2-49662350eb2c service nova] Acquired lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:40:55.185814 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-fdcc3c24-0537-461e-8fc2-dcf73cf28a65 req-b54e45f2-ed17-4b84-a7a2-49662350eb2c service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Refreshing network info cache for port 9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:40:55.468713 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Found WWN 330000000b0c2b96e for multipath device dm-2 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:40:55.469700 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:55.469700 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '330000000b0c2b96e', 'path': '/dev/dm-2', 'multipath_id': '330000000b0c2b96e'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:55.469700 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b0c2b96e', 'path': '/dev/dm-2', 'multipath_id': '330000000b0c2b96e'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:40:55.469878 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.508s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:55.470467 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7faf4e4-0f15-4992-8e8b-12efa20286d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:40:55.470467 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-958818ac-ad38-4102-97cc-6f000d3a1c65 (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6 (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-958818ac-ad38-4102-97cc-6f000d3a1c65 (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:55.505937 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '75'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '81'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', '87'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-958818ac-ad38-4102-97cc-6f000d3a1c65', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '90')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:40:55.505937 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', '87')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:55.518331 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', '86')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:55.518331 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721850107420>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6'): ({'sdd'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:40:55.518331 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Removing multipathed devices sdd, sde {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:40:55.518331 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Flush multipath device 3300000001a23af13 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:40:55.580356 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:40:55.622095 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:40:55.676985 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:55.676985 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:55.680050 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:40:55.680600 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:40:55.682144 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Claim successful on node np0000001025
May 19 04:40:55.683497 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] SCSI volumes sdd, sde have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:40:55.686718 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:55.688385 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:40:55.692251 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-fdcc3c24-0537-461e-8fc2-dcf73cf28a65 req-b54e45f2-ed17-4b84-a7a2-49662350eb2c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:55.708047 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:40:55.708270 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:40:55.724245 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:55.773401 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 87, target: iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6, portal: 192.168.40.100,3260]
May 19 04:40:55.773401 np0000001025 nova-compute[97981]: Logout of [sid: 87, target: iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6, portal: 192.168.40.100,3260] successful.
May 19 04:40:55.773401 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:55.794173 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:55.806611 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:55.850143 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 86, target: iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6, portal: 192.168.50.100,3260]
May 19 04:40:55.850143 np0000001025 nova-compute[97981]: Logout of [sid: 86, target: iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6, portal: 192.168.50.100,3260] successful.
May 19 04:40:55.850143 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:55.872332 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:40:55.872586 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:55.872734 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] <== disconnect_volume: return (2911ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:55.872880 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:40:55.984854 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:40:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-985806649',display_name='tempest-ServerActionsTestOtherA-server-985806649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001025',hostname='tempest-serveractionstestothera-server-985806649',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqj+0kbBWHZ0D/eo4rT8/WyGDsPmK39aJPuM7kZk3S1G8n90+lv56y6gVhWC3CbNq9VY5ET/dAXNaLkqY+SWcJuj+SOKIN1mmus3K/MEswW9TbpiRqq7lxkb6x7vjc6rQ==',key_name='tempest-keypair-762825136',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:40:32Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001025',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='336d55ae51114828ba5ad8c0ac87ca9b',ramdisk_id='',reservation_id='r-47cr4ojc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-281327203',owner_user_name='tempest-ServerActionsTestOtherA-281327203-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:40:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6374f2e55af946f9abf35d0c8a1cd206',uuid=f6207103-8a47-4cc8-b1e0-c0ffd79e0173,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "address": "fa:16:3e:91:89:b7", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-906047595-network", "vif_mac": "fa:16:3e:91:89:b7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cbdb78-cc", "ovs_interfaceid": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:40:55.985144 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converting VIF {"id": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "address": "fa:16:3e:91:89:b7", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-906047595-network", "vif_mac": "fa:16:3e:91:89:b7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cbdb78-cc", "ovs_interfaceid": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:40:55.985751 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:89:b7,bridge_name='br-int',has_traffic_filtering=True,id=37cbdb78-cc1c-48e2-879d-959cb26c29f9,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cbdb78-cc') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:40:55.987667 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] End _get_guest_xml xml=<domain type="qemu">
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:   <uuid>f6207103-8a47-4cc8-b1e0-c0ffd79e0173</uuid>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:   <name>instance-00000022</name>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:   <memory>262144</memory>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServerActionsTestOtherA-server-985806649</nova:name>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:40:52</nova:creationTime>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.micro" id="84">
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:         <nova:memory>256</nova:memory>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:           <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:           <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:         <nova:user uuid="6374f2e55af946f9abf35d0c8a1cd206">tempest-ServerActionsTestOtherA-281327203-project-member</nova:user>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:         <nova:project uuid="336d55ae51114828ba5ad8c0ac87ca9b">tempest-ServerActionsTestOtherA-281327203</nova:project>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:         <nova:port uuid="37cbdb78-cc1c-48e2-879d-959cb26c29f9">
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     <system>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <entry name="serial">f6207103-8a47-4cc8-b1e0-c0ffd79e0173</entry>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <entry name="uuid">f6207103-8a47-4cc8-b1e0-c0ffd79e0173</entry>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     </system>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:   <os>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:   </os>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:   <features>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:   </features>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:   <devices>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/f6207103-8a47-4cc8-b1e0-c0ffd79e0173/disk.config"/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     </disk>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <alias name="ua-aed1b29d-163e-4ba7-b0b8-8576d4be428a"/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-2"/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <serial>aed1b29d-163e-4ba7-b0b8-8576d4be428a</serial>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     </disk>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:91:89:b7"/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <target dev="tap37cbdb78-cc"/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     </interface>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/f6207103-8a47-4cc8-b1e0-c0ffd79e0173/console.log" append="off"/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     </serial>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     <video>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     </video>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     </rng>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:   </devices>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]: </domain>
May 19 04:40:55.987667 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:40:55.990789 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:40:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-985806649',display_name='tempest-ServerActionsTestOtherA-server-985806649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001025',hostname='tempest-serveractionstestothera-server-985806649',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqj+0kbBWHZ0D/eo4rT8/WyGDsPmK39aJPuM7kZk3S1G8n90+lv56y6gVhWC3CbNq9VY5ET/dAXNaLkqY+SWcJuj+SOKIN1mmus3K/MEswW9TbpiRqq7lxkb6x7vjc6rQ==',key_name='tempest-keypair-762825136',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:40:32Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001025',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='336d55ae51114828ba5ad8c0ac87ca9b',ramdisk_id='',reservation_id='r-47cr4ojc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-281327203',owner_user_name='tempest-ServerActionsTestOtherA-281327203-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:40:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6374f2e55af946f9abf35d0c8a1cd206',uuid=f6207103-8a47-4cc8-b1e0-c0ffd79e0173,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "address": "fa:16:3e:91:89:b7", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-906047595-network", "vif_mac": "fa:16:3e:91:89:b7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cbdb78-cc", "ovs_interfaceid": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:40:55.990789 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converting VIF {"id": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "address": "fa:16:3e:91:89:b7", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-906047595-network", "vif_mac": "fa:16:3e:91:89:b7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cbdb78-cc", "ovs_interfaceid": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:40:55.990789 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:89:b7,bridge_name='br-int',has_traffic_filtering=True,id=37cbdb78-cc1c-48e2-879d-959cb26c29f9,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cbdb78-cc') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:40:55.990789 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:89:b7,bridge_name='br-int',has_traffic_filtering=True,id=37cbdb78-cc1c-48e2-879d-959cb26c29f9,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cbdb78-cc') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:40:55.990789 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:55.990789 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:55.990789 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:40:55.991747 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:55.991961 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4bcb9dd-b909-5b57-bc36-fdecc76be37f', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:55.993266 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:55.993937 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:55.994301 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:55.996825 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:55.999742 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:55.999931 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37cbdb78-cc, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:56.000334 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37cbdb78-cc, col_values=(('qos', UUID('ac7ef7ef-6845-4750-9451-672172c85a08')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:56.000507 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37cbdb78-cc, col_values=(('external_ids', {'iface-id': '37cbdb78-cc1c-48e2-879d-959cb26c29f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:89:b7', 'vm-uuid': 'f6207103-8a47-4cc8-b1e0-c0ffd79e0173'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:56.001431 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:56.002714 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:56.009238 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:56.013134 np0000001025 nova-compute[97981]: INFO os_vif [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:89:b7,bridge_name='br-int',has_traffic_filtering=True,id=37cbdb78-cc1c-48e2-879d-959cb26c29f9,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cbdb78-cc')
May 19 04:40:56.077459 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-fdcc3c24-0537-461e-8fc2-dcf73cf28a65 req-b54e45f2-ed17-4b84-a7a2-49662350eb2c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:56.247990 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-fdcc3c24-0537-461e-8fc2-dcf73cf28a65 req-b54e45f2-ed17-4b84-a7a2-49662350eb2c service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Updated VIF entry in instance network info cache for port 9791a107-963b-4608-9092-2df622d06125. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:40:56.248434 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-fdcc3c24-0537-461e-8fc2-dcf73cf28a65 req-b54e45f2-ed17-4b84-a7a2-49662350eb2c service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Updating instance_info_cache with network_info: [{"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:40:56.433865 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lazy-loading 'flavor' on Instance uuid 93c62882-ef27-41d5-8178-e1ccc945fe1d {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:56.750552 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fdcc3c24-0537-461e-8fc2-dcf73cf28a65 req-b54e45f2-ed17-4b84-a7a2-49662350eb2c service nova] Releasing lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:40:57.000419 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:57.439860 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dd209f06-22bd-4de1-bfdd-ac5ae4a8d8f4 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "93c62882-ef27-41d5-8178-e1ccc945fe1d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.621s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:57.441175 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "93c62882-ef27-41d5-8178-e1ccc945fe1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 5.312s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:57.441175 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "93c62882-ef27-41d5-8178-e1ccc945fe1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:57.442947 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "93c62882-ef27-41d5-8178-e1ccc945fe1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:57.442947 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "93c62882-ef27-41d5-8178-e1ccc945fe1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:57.445007 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Terminating instance
May 19 04:40:57.493794 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:40:57.494008 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:40:57.539514 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:57.539514 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:40:57.539514 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] No VIF found with MAC fa:16:3e:91:89:b7, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:40:57.539514 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Using config drive
May 19 04:40:57.872764 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0003562959998362203 future=<Future at 0x7218342ca6c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:57.873180 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:57.873314 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=0.10222836000002644 future=<Future at 0x72185027eb70 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:57.873423 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=0.10211360799985414 future=<Future at 0x72185027eb70 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:57.873785 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Emitting event <LifecycleEvent: 1779165642.8722193, 87e8e02e-e385-418c-be0c-bb25a377d081 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:40:57.873946 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] VM Stopped (Lifecycle Event)
May 19 04:40:57.950471 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:40:57.975860 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00029760500001430046 future=<Future at 0x72185027eb70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:57.976251 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Emitting event <LifecycleEvent: 1779165642.9754727, f6207103-8a47-4cc8-b1e0-c0ffd79e0173 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:40:57.976374 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:57.976510 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] VM Stopped (Lifecycle Event)
May 19 04:40:57.977589 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:57.983903 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:57.997194 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:40:58.010886 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:58.044077 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:58.060798 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:58.098910 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:58.183524 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:58.218011 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:58.233925 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-34a5f4c3-bcc3-43f2-adb6-dd198dcc423c req-9f0e6f01-dd84-4e06-9360-b16338fdc3dd service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Received event network-vif-unplugged-7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:40:58.237490 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-34a5f4c3-bcc3-43f2-adb6-dd198dcc423c req-9f0e6f01-dd84-4e06-9360-b16338fdc3dd service nova] Acquiring lock "93c62882-ef27-41d5-8178-e1ccc945fe1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:40:58.237710 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-34a5f4c3-bcc3-43f2-adb6-dd198dcc423c req-9f0e6f01-dd84-4e06-9360-b16338fdc3dd service nova] Lock "93c62882-ef27-41d5-8178-e1ccc945fe1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:58.237911 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-34a5f4c3-bcc3-43f2-adb6-dd198dcc423c req-9f0e6f01-dd84-4e06-9360-b16338fdc3dd service nova] Lock "93c62882-ef27-41d5-8178-e1ccc945fe1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:58.238039 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-34a5f4c3-bcc3-43f2-adb6-dd198dcc423c req-9f0e6f01-dd84-4e06-9360-b16338fdc3dd service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] No waiting events found dispatching network-vif-unplugged-7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:40:58.238169 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-34a5f4c3-bcc3-43f2-adb6-dd198dcc423c req-9f0e6f01-dd84-4e06-9360-b16338fdc3dd service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Received event network-vif-unplugged-7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:40:58.262241 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:58.271079 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:58.328427 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999614828999938 future=<Future at 0x7218345e6270 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:58.328695 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999291704999905 future=<Future at 0x7218345e6270 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:58.328859 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999123042999827 future=<Future at 0x7218345e6270 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:40:58.331094 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Instance destroyed successfully.
May 19 04:40:58.331561 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lazy-loading 'resources' on Instance uuid 93c62882-ef27-41d5-8178-e1ccc945fe1d {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:40:58.378662 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 87e8e02e-e385-418c-be0c-bb25a377d081] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:58.481048 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:58.516127 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.839s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:40:58.516960 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.830s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:40:58.517177 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:40:58.521608 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:40:58.521777 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Claim successful on node np0000001025
May 19 04:40:58.834050 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:39:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1445499294',display_name='tempest-VolumesSnapshotTestJSON-instance-1445499294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumessnapshottestjson-instance-1445499294',id=32,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOfx03V3DO1gmslCMTV5n44+8Uj4/GhVidcn6x+Lexj/PUPq1y/PZH7HmlaxNmkcPHmBrzZpJZN0qOhTDBSo5AHAoBYGySFBAf/ghc8Yovo7ZoNfOmhi+b8oKV2di+ELg==',key_name='tempest-keypair-983319923',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:39:56Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='529ec00acc80453dbe8d6a1295e9eb13',ramdisk_id='',reservation_id='r-hy19v7eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-492014726',owner_user_name='tempest-VolumesSnapshotTestJSON-492014726-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:39:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f331813eed6416a9bfa432c8b3ed42a',uuid=93c62882-ef27-41d5-8178-e1ccc945fe1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3", "address": "fa:16:3e:f1:29:3e", "network": {"id": "3f564857-63e6-46af-9e0f-3a2de30297d4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-951031274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "529ec00acc80453dbe8d6a1295e9eb13", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1bbc34-ba", "ovs_interfaceid": "7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:40:58.834376 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Converting VIF {"id": "7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3", "address": "fa:16:3e:f1:29:3e", "network": {"id": "3f564857-63e6-46af-9e0f-3a2de30297d4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-951031274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "529ec00acc80453dbe8d6a1295e9eb13", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1bbc34-ba", "ovs_interfaceid": "7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:40:58.835125 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:29:3e,bridge_name='br-int',has_traffic_filtering=True,id=7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3,network=Network(3f564857-63e6-46af-9e0f-3a2de30297d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1bbc34-ba') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:40:58.835419 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:29:3e,bridge_name='br-int',has_traffic_filtering=True,id=7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3,network=Network(3f564857-63e6-46af-9e0f-3a2de30297d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1bbc34-ba') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:40:58.836835 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:58.837058 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d1bbc34-ba, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:58.845506 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:58.847199 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:58.847852 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:40:58.847993 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c8ab86d-5f9b-4921-839b-56d87abd25fa) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:40:58.849674 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:40:58.851254 np0000001025 nova-compute[97981]: INFO os_vif [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:29:3e,bridge_name='br-int',has_traffic_filtering=True,id=7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3,network=Network(3f564857-63e6-46af-9e0f-3a2de30297d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1bbc34-ba')
May 19 04:40:58.852982 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:40:58.853325 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7faf4e4-0f15-4992-8e8b-12efa20286d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:40:58.853502 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:40:58.853847 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:40:58.854176 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7faf4e4-0f15-4992-8e8b-12efa20286d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:40:58.854331 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:40:58.887736 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:58.887736 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:58.887736 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:58.887736 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:58.887736 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:58.887736 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:58.887736 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:58.887736 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:58.887736 np0000001025 nova-compute[97981]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-958818ac-ad38-4102-97cc-6f000d3a1c65 (non-flash)
May 19 04:40:58.887736 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:58.887736 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:58.887736 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:40:58.888091 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:58.888091 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:40:58.888091 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:58.888091 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:40:58.888091 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:58.888091 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:40:58.888091 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:58.888091 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:40:58.888091 np0000001025 nova-compute[97981]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-958818ac-ad38-4102-97cc-6f000d3a1c65 (non-flash)
May 19 04:40:58.888091 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:58.888091 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:40:58.888091 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:40:58.888434 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '75'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '81'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-958818ac-ad38-4102-97cc-6f000d3a1c65', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '90')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:40:58.888557 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6, 0): [] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:58.888688 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6') {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 19 04:40:58.888777 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6, 0): [] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:40:58.888860 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7faf4e4-0f15-4992-8e8b-12efa20286d6') {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 19 04:40:58.888940 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721834317ec0>, {}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:40:58.889060 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Disconnecting from: [] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:40:58.889305 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.035s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:40:58.889404 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] <== disconnect_volume: return (35ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:40:58.889503 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:40:58.889762 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Deleting instance files /opt/stack/data/nova/instances/93c62882-ef27-41d5-8178-e1ccc945fe1d_del
May 19 04:40:58.890518 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Deletion of /opt/stack/data/nova/instances/93c62882-ef27-41d5-8178-e1ccc945fe1d_del complete
May 19 04:40:59.034833 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:40:59.035311 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:40:59.035882 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:59.036196 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:59.120962 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Instance event wait completed in 0 seconds for  {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:40:59.124073 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165659.1209745, f6207103-8a47-4cc8-b1e0-c0ffd79e0173 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:40:59.124357 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] VM Resumed (Lifecycle Event)
May 19 04:40:59.125856 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa432d60cb324c6d87818107e05e0053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490151decdde445593a86a16976f6b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:40:59.134972 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Instance running successfully.
May 19 04:40:59.136517 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Failed to set time: agent not configured {{(pid=97981) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 19 04:40:59.136736 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6cbd7576-967f-4cb4-b511-23d6bf500c35 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] finish_migration finished successfully. {{(pid=97981) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 19 04:40:59.397351 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Took 1.45 seconds to destroy the instance on the hypervisor.
May 19 04:40:59.397994 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:40:59.398206 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:40:59.398340 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:40:59.398577 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:59.535807 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:40:59.546429 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:40:59.632283 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:40:59.639666 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:40:59.763399 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Successfully created port: d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:41:00.047897 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:41:00.142220 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 19 04:41:00.142944 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165660.1426587, f6207103-8a47-4cc8-b1e0-c0ffd79e0173 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:41:00.143155 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] VM Started (Lifecycle Event)
May 19 04:41:00.340276 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:41:00.340609 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:41:00.352120 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f10ad429-b4a6-4ab0-85a5-fc7388b5d838 req-92004acb-f412-4883-8009-083518edbfc0 service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Received event network-vif-unplugged-7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:00.353319 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f10ad429-b4a6-4ab0-85a5-fc7388b5d838 req-92004acb-f412-4883-8009-083518edbfc0 service nova] Acquiring lock "93c62882-ef27-41d5-8178-e1ccc945fe1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:00.353516 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f10ad429-b4a6-4ab0-85a5-fc7388b5d838 req-92004acb-f412-4883-8009-083518edbfc0 service nova] Lock "93c62882-ef27-41d5-8178-e1ccc945fe1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:00.353632 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f10ad429-b4a6-4ab0-85a5-fc7388b5d838 req-92004acb-f412-4883-8009-083518edbfc0 service nova] Lock "93c62882-ef27-41d5-8178-e1ccc945fe1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:00.353746 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f10ad429-b4a6-4ab0-85a5-fc7388b5d838 req-92004acb-f412-4883-8009-083518edbfc0 service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] No waiting events found dispatching network-vif-unplugged-7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:41:00.353906 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f10ad429-b4a6-4ab0-85a5-fc7388b5d838 req-92004acb-f412-4883-8009-083518edbfc0 service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Received event network-vif-unplugged-7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:41:00.354033 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f10ad429-b4a6-4ab0-85a5-fc7388b5d838 req-92004acb-f412-4883-8009-083518edbfc0 service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Received event network-vif-plugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:00.354333 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f10ad429-b4a6-4ab0-85a5-fc7388b5d838 req-92004acb-f412-4883-8009-083518edbfc0 service nova] Acquiring lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:00.354512 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f10ad429-b4a6-4ab0-85a5-fc7388b5d838 req-92004acb-f412-4883-8009-083518edbfc0 service nova] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:00.354651 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f10ad429-b4a6-4ab0-85a5-fc7388b5d838 req-92004acb-f412-4883-8009-083518edbfc0 service nova] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:00.354757 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f10ad429-b4a6-4ab0-85a5-fc7388b5d838 req-92004acb-f412-4883-8009-083518edbfc0 service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] No waiting events found dispatching network-vif-plugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:41:00.355021 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-f10ad429-b4a6-4ab0-85a5-fc7388b5d838 req-92004acb-f412-4883-8009-083518edbfc0 service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Received unexpected event network-vif-plugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 for instance with vm_state resized and task_state None.
May 19 04:41:00.355290 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f10ad429-b4a6-4ab0-85a5-fc7388b5d838 req-92004acb-f412-4883-8009-083518edbfc0 service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Received event network-vif-plugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:00.355482 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f10ad429-b4a6-4ab0-85a5-fc7388b5d838 req-92004acb-f412-4883-8009-083518edbfc0 service nova] Acquiring lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:00.355543 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f10ad429-b4a6-4ab0-85a5-fc7388b5d838 req-92004acb-f412-4883-8009-083518edbfc0 service nova] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:00.355648 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f10ad429-b4a6-4ab0-85a5-fc7388b5d838 req-92004acb-f412-4883-8009-083518edbfc0 service nova] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:00.355744 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f10ad429-b4a6-4ab0-85a5-fc7388b5d838 req-92004acb-f412-4883-8009-083518edbfc0 service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] No waiting events found dispatching network-vif-plugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:41:00.355915 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-f10ad429-b4a6-4ab0-85a5-fc7388b5d838 req-92004acb-f412-4883-8009-083518edbfc0 service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Received unexpected event network-vif-plugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 for instance with vm_state resized and task_state None.
May 19 04:41:00.355963 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f10ad429-b4a6-4ab0-85a5-fc7388b5d838 req-92004acb-f412-4883-8009-083518edbfc0 service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Received event network-vif-deleted-7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:00.356082 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-f10ad429-b4a6-4ab0-85a5-fc7388b5d838 req-92004acb-f412-4883-8009-083518edbfc0 service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Neutron deleted interface 7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3; detaching it from the instance and deleting it from the info cache
May 19 04:41:00.356213 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-f10ad429-b4a6-4ab0-85a5-fc7388b5d838 req-92004acb-f412-4883-8009-083518edbfc0 service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:00.457058 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Successfully updated port: d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:41:00.504153 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b9fc5252-6d47-4bbe-b6d1-30691a6f3551 req-c4785807-4b06-4cc2-a698-de0b6751931f service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Received event network-changed-d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:00.504285 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b9fc5252-6d47-4bbe-b6d1-30691a6f3551 req-c4785807-4b06-4cc2-a698-de0b6751931f service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Refreshing instance network info cache due to event network-changed-d51c757a-3333-4e40-8d5f-3c2d35a128b2. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:41:00.504588 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b9fc5252-6d47-4bbe-b6d1-30691a6f3551 req-c4785807-4b06-4cc2-a698-de0b6751931f service nova] Acquiring lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:41:00.504683 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b9fc5252-6d47-4bbe-b6d1-30691a6f3551 req-c4785807-4b06-4cc2-a698-de0b6751931f service nova] Acquired lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:41:00.504813 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-b9fc5252-6d47-4bbe-b6d1-30691a6f3551 req-c4785807-4b06-4cc2-a698-de0b6751931f service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Refreshing network info cache for port d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:41:00.581865 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:00.647572 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:00.649422 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:41:00.843284 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:41:00.860573 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f10ad429-b4a6-4ab0-85a5-fc7388b5d838 req-92004acb-f412-4883-8009-083518edbfc0 service nova] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Detach interface failed, port_id=7d1bbc34-ba4f-4cf9-b35d-2fcf16296bf3, reason: Instance 93c62882-ef27-41d5-8178-e1ccc945fe1d could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:41:00.960284 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:41:01.006653 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-b9fc5252-6d47-4bbe-b6d1-30691a6f3551 req-c4785807-4b06-4cc2-a698-de0b6751931f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:01.061969 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:41:01.063287 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:41:01.063576 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Creating image(s)
May 19 04:41:01.064030 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "/opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:01.064233 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "/opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:01.066402 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "/opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:01.067014 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:41:01.076826 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:41:01.081099 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:01.094653 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Took 1.70 seconds to deallocate network for instance.
May 19 04:41:01.111618 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-b9fc5252-6d47-4bbe-b6d1-30691a6f3551 req-c4785807-4b06-4cc2-a698-de0b6751931f service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:41:01.138363 np0000001025 nova-compute[97981]: WARNING nova.volume.cinder [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Attachment cf82055d-5738-4ce6-bafb-2ac5766bfaa4 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = cf82055d-5738-4ce6-bafb-2ac5766bfaa4. (HTTP 404) (Request-ID: req-11413c71-53eb-4f31-b2ad-be096483a9d1)
May 19 04:41:01.138710 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Took 0.04 seconds to detach 1 volumes for instance.
May 19 04:41:01.186310 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.105s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:01.187377 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:01.187927 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:01.189422 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:41:01.193677 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:41:01.194199 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:01.299912 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.105s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:01.300442 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:01.321567 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-b9fc5252-6d47-4bbe-b6d1-30691a6f3551 req-c4785807-4b06-4cc2-a698-de0b6751931f service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:01.353155 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.836s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:01.353155 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:41:01.369478 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk 1073741824" returned: 0 in 0.069s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:01.373272 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:01.373272 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:01.493173 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.122s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:01.493492 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Checking if we can resize image /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:41:01.493723 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:01.584755 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:01.585746 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Cannot resize image /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:41:01.587034 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:41:01.587034 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Ensure instance console log exists: /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:41:01.587034 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:01.587034 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:01.587034 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:01.652688 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:01.653395 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:01.672194 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-96184b54-099f-4a2f-b0dc-8f8fd1a3b52f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:01.672388 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-96184b54-099f-4a2f-b0dc-8f8fd1a3b52f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:01.672543 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-96184b54-099f-4a2f-b0dc-8f8fd1a3b52f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Going to confirm migration 2 {{(pid=97981) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 19 04:41:01.676241 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:01.826977 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b9fc5252-6d47-4bbe-b6d1-30691a6f3551 req-c4785807-4b06-4cc2-a698-de0b6751931f service nova] Releasing lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:41:01.827825 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquired lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:41:01.828388 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:41:01.863204 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:41:01.863783 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:41:01.864257 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:01.864657 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:01.982228 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c46088fb3e74b819bb456461716a801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b3c0fa8f894ed2a7c3bcfac99ce74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:41:02.186251 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-96184b54-099f-4a2f-b0dc-8f8fd1a3b52f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:02.347677 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-96184b54-099f-4a2f-b0dc-8f8fd1a3b52f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:02.347982 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-96184b54-099f-4a2f-b0dc-8f8fd1a3b52f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "refresh_cache-f6207103-8a47-4cc8-b1e0-c0ffd79e0173" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:41:02.348087 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-96184b54-099f-4a2f-b0dc-8f8fd1a3b52f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquired lock "refresh_cache-f6207103-8a47-4cc8-b1e0-c0ffd79e0173" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:41:02.348251 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-96184b54-099f-4a2f-b0dc-8f8fd1a3b52f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:41:02.348394 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-96184b54-099f-4a2f-b0dc-8f8fd1a3b52f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lazy-loading 'info_cache' on Instance uuid f6207103-8a47-4cc8-b1e0-c0ffd79e0173 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:02.366997 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:41:02.406848 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:41:02.407464 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:41:02.445458 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:41:02.686726 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:02.814620 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Successfully created port: 5e2f9712-ec5f-4c22-9bc5-f828919648ed {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:41:02.823494 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Updating instance_info_cache with network_info: [{"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:02.872303 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:41:02.911620 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:41:03.220150 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:03.323387 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Releasing lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:41:03.323666 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Instance network_info: |[{"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:41:03.325505 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Start _get_guest_xml network_info=[{"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:41:03.328749 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:41:03.329973 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='417861ee-dcf2-458b-8782-2ec22d2f5421'), owner=OwnerMeta(userid='aa432d60cb324c6d87818107e05e0053', username='tempest-AttachVolumeMultiAttachTest-1659172696-project-member', projectid='490151decdde445593a86a16976f6b34', projectname='tempest-AttachVolumeMultiAttachTest-1659172696'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165663.329619) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:41:03.331200 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:41:03.331567 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:41:03.332452 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:41:03.332602 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:41:03.333462 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:41:03.333906 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:41:03.333906 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:41:03.334586 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:41:03.334586 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:41:03.334586 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:41:03.334586 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:41:03.334793 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:41:03.334793 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:41:03.334943 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:41:03.334943 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:41:03.335085 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:41:03.349631 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='multiattach-server-1',id=38,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9kq9UfoFPrqlSUYASLa2M8/KXwpiWIksTRz6r+vXFFf5G7djO79flSW+4jvUEBmYvioxzxvTch1hKVIwlMIaMSuT3AyUPlX/5ZPn59wF6pdcyyqAHuNzAVPjAjiGd+6A==',key_name='tempest-keypair-818275091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-56qgb0gs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:41:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa432d60cb324c6d87818107e05e0053',uuid=417861ee-dcf2-458b-8782-2ec22d2f5421,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:41:03.349855 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:41:03.350758 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:9e:6f,bridge_name='br-int',has_traffic_filtering=True,id=d51c757a-3333-4e40-8d5f-3c2d35a128b2,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51c757a-33') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:41:03.351021 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'pci_devices' on Instance uuid 417861ee-dcf2-458b-8782-2ec22d2f5421 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:03.358837 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-96184b54-099f-4a2f-b0dc-8f8fd1a3b52f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:03.374410 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Booting with volume snapshot d3f81447-bcd2-462e-9088-46f7174dda9f at /dev/vda
May 19 04:41:03.417862 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.765s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:03.492652 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Deleted allocations for instance 93c62882-ef27-41d5-8178-e1ccc945fe1d
May 19 04:41:03.596937 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:03.806266 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Successfully updated port: 5e2f9712-ec5f-4c22-9bc5-f828919648ed {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:41:03.849929 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:03.856643 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] End _get_guest_xml xml=<domain type="qemu">
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:   <uuid>417861ee-dcf2-458b-8782-2ec22d2f5421</uuid>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:   <name>instance-00000026</name>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <nova:name>multiattach-server-1</nova:name>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:41:03</nova:creationTime>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:         <nova:user uuid="aa432d60cb324c6d87818107e05e0053">tempest-AttachVolumeMultiAttachTest-1659172696-project-member</nova:user>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:         <nova:project uuid="490151decdde445593a86a16976f6b34">tempest-AttachVolumeMultiAttachTest-1659172696</nova:project>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:         <nova:port uuid="d51c757a-3333-4e40-8d5f-3c2d35a128b2">
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     <system>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <entry name="serial">417861ee-dcf2-458b-8782-2ec22d2f5421</entry>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <entry name="uuid">417861ee-dcf2-458b-8782-2ec22d2f5421</entry>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     </system>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:   <os>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:   </os>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:   <features>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:   </features>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:   <devices>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk"/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     </disk>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk.config"/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     </disk>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:b0:9e:6f"/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <target dev="tapd51c757a-33"/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     </interface>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/console.log" append="off"/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     </serial>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     <video>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     </video>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     </rng>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:   </devices>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]: </domain>
May 19 04:41:03.856643 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:41:03.859548 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Preparing to wait for external event network-vif-plugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:41:03.859548 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:03.859548 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:03.859548 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:03.859548 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='multiattach-server-1',id=38,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9kq9UfoFPrqlSUYASLa2M8/KXwpiWIksTRz6r+vXFFf5G7djO79flSW+4jvUEBmYvioxzxvTch1hKVIwlMIaMSuT3AyUPlX/5ZPn59wF6pdcyyqAHuNzAVPjAjiGd+6A==',key_name='tempest-keypair-818275091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-56qgb0gs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:41:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa432d60cb324c6d87818107e05e0053',uuid=417861ee-dcf2-458b-8782-2ec22d2f5421,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:41:03.859548 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:41:03.859548 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:9e:6f,bridge_name='br-int',has_traffic_filtering=True,id=d51c757a-3333-4e40-8d5f-3c2d35a128b2,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51c757a-33') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:41:03.859548 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:9e:6f,bridge_name='br-int',has_traffic_filtering=True,id=d51c757a-3333-4e40-8d5f-3c2d35a128b2,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51c757a-33') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:41:03.861823 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:03.861823 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:03.861823 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:41:03.861823 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:03.861985 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d380807-505f-5f42-895e-d45e443fa6f8', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:03.863089 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:03.863771 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:41:03.867682 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:03.868652 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd51c757a-33, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:03.870599 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd51c757a-33, col_values=(('qos', UUID('7e7bd3bf-417c-429a-a0b4-352b6cbbbb3c')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:03.870599 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd51c757a-33, col_values=(('external_ids', {'iface-id': 'd51c757a-3333-4e40-8d5f-3c2d35a128b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:9e:6f', 'vm-uuid': '417861ee-dcf2-458b-8782-2ec22d2f5421'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:03.874070 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a4d81a00-2193-4f54-b4c3-8f34d44b5c41 req-eb29c3f1-e170-4f5b-9510-62081cc683c5 service nova] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Received event network-changed-5e2f9712-ec5f-4c22-9bc5-f828919648ed {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:03.874451 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a4d81a00-2193-4f54-b4c3-8f34d44b5c41 req-eb29c3f1-e170-4f5b-9510-62081cc683c5 service nova] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Refreshing instance network info cache due to event network-changed-5e2f9712-ec5f-4c22-9bc5-f828919648ed. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:41:03.874649 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:03.878407 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a4d81a00-2193-4f54-b4c3-8f34d44b5c41 req-eb29c3f1-e170-4f5b-9510-62081cc683c5 service nova] Acquiring lock "refresh_cache-9fca60a6-f506-4f7f-a987-62c44e75f78f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:41:03.881129 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a4d81a00-2193-4f54-b4c3-8f34d44b5c41 req-eb29c3f1-e170-4f5b-9510-62081cc683c5 service nova] Acquired lock "refresh_cache-9fca60a6-f506-4f7f-a987-62c44e75f78f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:41:03.881129 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:41:03.881129 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a4d81a00-2193-4f54-b4c3-8f34d44b5c41 req-eb29c3f1-e170-4f5b-9510-62081cc683c5 service nova] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Refreshing network info cache for port 5e2f9712-ec5f-4c22-9bc5-f828919648ed {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:41:03.881129 np0000001025 nova-compute[97981]: INFO os_vif [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:9e:6f,bridge_name='br-int',has_traffic_filtering=True,id=d51c757a-3333-4e40-8d5f-3c2d35a128b2,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51c757a-33')
May 19 04:41:04.073769 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-96184b54-099f-4a2f-b0dc-8f8fd1a3b52f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:04.239538 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-96184b54-099f-4a2f-b0dc-8f8fd1a3b52f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Updating instance_info_cache with network_info: [{"id": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "address": "fa:16:3e:91:89:b7", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cbdb78-cc", "ovs_interfaceid": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:04.308594 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "refresh_cache-9fca60a6-f506-4f7f-a987-62c44e75f78f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:41:04.382363 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-a4d81a00-2193-4f54-b4c3-8f34d44b5c41 req-eb29c3f1-e170-4f5b-9510-62081cc683c5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:04.478014 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a4d81a00-2193-4f54-b4c3-8f34d44b5c41 req-eb29c3f1-e170-4f5b-9510-62081cc683c5 service nova] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:41:04.508216 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ba9a286a-213a-4df6-966f-4f6d3da96b9c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "93c62882-ef27-41d5-8178-e1ccc945fe1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.068s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:05.605854 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a4d81a00-2193-4f54-b4c3-8f34d44b5c41 req-eb29c3f1-e170-4f5b-9510-62081cc683c5 service nova] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:05.605854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-96184b54-099f-4a2f-b0dc-8f8fd1a3b52f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Releasing lock "refresh_cache-f6207103-8a47-4cc8-b1e0-c0ffd79e0173" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:41:05.605854 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-96184b54-099f-4a2f-b0dc-8f8fd1a3b52f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lazy-loading 'migration_context' on Instance uuid f6207103-8a47-4cc8-b1e0-c0ffd79e0173 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:05.605854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a4d81a00-2193-4f54-b4c3-8f34d44b5c41 req-eb29c3f1-e170-4f5b-9510-62081cc683c5 service nova] Releasing lock "refresh_cache-9fca60a6-f506-4f7f-a987-62c44e75f78f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:41:05.605854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquired lock "refresh_cache-9fca60a6-f506-4f7f-a987-62c44e75f78f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:41:05.605854 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:41:05.605854 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-96184b54-099f-4a2f-b0dc-8f8fd1a3b52f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Object Instance<f6207103-8a47-4cc8-b1e0-c0ffd79e0173> lazy-loaded attributes: info_cache,migration_context {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:41:05.605854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-96184b54-099f-4a2f-b0dc-8f8fd1a3b52f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:05.605854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-96184b54-099f-4a2f-b0dc-8f8fd1a3b52f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:05.605854 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:41:05.605854 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:41:05.605854 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No VIF found with MAC fa:16:3e:b0:9e:6f, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:41:05.605854 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Using config drive
May 19 04:41:05.767474 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:41:05.914329 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:05.949306 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:06.112359 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Creating config drive at /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk.config
May 19 04:41:06.117629 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnzat49qd {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:06.151896 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Updating instance_info_cache with network_info: [{"id": "5e2f9712-ec5f-4c22-9bc5-f828919648ed", "address": "fa:16:3e:9d:5a:e8", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e2f9712-ec", "ovs_interfaceid": "5e2f9712-ec5f-4c22-9bc5-f828919648ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:06.180522 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnzat49qd" returned: 0 in 0.063s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:06.509313 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-96184b54-099f-4a2f-b0dc-8f8fd1a3b52f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:41:06.509612 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-96184b54-099f-4a2f-b0dc-8f8fd1a3b52f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:41:06.646215 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:06.658180 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Releasing lock "refresh_cache-9fca60a6-f506-4f7f-a987-62c44e75f78f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:41:06.658637 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Instance network_info: |[{"id": "5e2f9712-ec5f-4c22-9bc5-f828919648ed", "address": "fa:16:3e:9d:5a:e8", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e2f9712-ec", "ovs_interfaceid": "5e2f9712-ec5f-4c22-9bc5-f828919648ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:41:06.677474 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:06.679535 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:06.818143 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:06.830086 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:06.832073 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:06.910782 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4562444d-2f4b-4cca-8493-70313f56c333 req-89be6134-2525-4876-8ece-03f5cecdc42d service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Received event network-vif-plugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:06.913753 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4562444d-2f4b-4cca-8493-70313f56c333 req-89be6134-2525-4876-8ece-03f5cecdc42d service nova] Acquiring lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:06.913941 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4562444d-2f4b-4cca-8493-70313f56c333 req-89be6134-2525-4876-8ece-03f5cecdc42d service nova] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:06.914098 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4562444d-2f4b-4cca-8493-70313f56c333 req-89be6134-2525-4876-8ece-03f5cecdc42d service nova] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:06.914372 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4562444d-2f4b-4cca-8493-70313f56c333 req-89be6134-2525-4876-8ece-03f5cecdc42d service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Processing event network-vif-plugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:41:06.972287 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:41:06.985696 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:41:07.011637 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:07.026299 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-96184b54-099f-4a2f-b0dc-8f8fd1a3b52f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:41:07.054813 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:41:07.055221 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:41:07.063849 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:41:07.065558 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fea1:aa43', 'fe80::fc16:3eff:fe19:f7d', 'fe80::946f:41ff:fe06:ab72', 'fe80::fc16:3eff:fe19:9d73', 'fe80::fc16:3eff:fefa:d4f0', 'fe80::fc16:3eff:fe91:89b7', 'fe80::fc16:3eff:feb0:9e6f'] 
May 19 04:41:07.065995 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:41:07.066126 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:41:07.066377 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:41:07.066604 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Updating existing volume attachment record: ca7c14c3-a03d-4ce3-a9af-6d960ba1b9c3 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:41:07.557333 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:41:07.558610 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165667.5582588, 417861ee-dcf2-458b-8782-2ec22d2f5421 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:41:07.558782 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] VM Started (Lifecycle Event)
May 19 04:41:07.563858 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:41:07.569759 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Instance spawned successfully.
May 19 04:41:07.570294 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:41:08.049166 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-96184b54-099f-4a2f-b0dc-8f8fd1a3b52f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.803s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:08.062445 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:08.064528 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:41:08.078784 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:41:08.079017 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:41:08.079540 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:41:08.079912 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:41:08.080288 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:41:08.080650 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:41:08.222079 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:08.569796 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:41:08.571707 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165668.571429, 417861ee-dcf2-458b-8782-2ec22d2f5421 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:41:08.571889 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] VM Paused (Lifecycle Event)
May 19 04:41:08.590338 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Took 7.53 seconds to spawn the instance on the hypervisor.
May 19 04:41:08.590579 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:08.726881 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-96184b54-099f-4a2f-b0dc-8f8fd1a3b52f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Deleted allocation for migration 924dbb37-1046-4d89-8be8-3be585934dcc
May 19 04:41:08.883806 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:09.013487 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a9f49d43-defa-4f48-9a58-809ec80a843a req-e997d123-c3a6-4c5c-838b-f6d11e244d93 service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Received event network-vif-plugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:09.013823 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a9f49d43-defa-4f48-9a58-809ec80a843a req-e997d123-c3a6-4c5c-838b-f6d11e244d93 service nova] Acquiring lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:09.014005 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a9f49d43-defa-4f48-9a58-809ec80a843a req-e997d123-c3a6-4c5c-838b-f6d11e244d93 service nova] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:09.014400 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a9f49d43-defa-4f48-9a58-809ec80a843a req-e997d123-c3a6-4c5c-838b-f6d11e244d93 service nova] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:09.014400 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a9f49d43-defa-4f48-9a58-809ec80a843a req-e997d123-c3a6-4c5c-838b-f6d11e244d93 service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] No waiting events found dispatching network-vif-plugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:41:09.014400 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-a9f49d43-defa-4f48-9a58-809ec80a843a req-e997d123-c3a6-4c5c-838b-f6d11e244d93 service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Received unexpected event network-vif-plugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 for instance with vm_state active and task_state None.
May 19 04:41:09.077086 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:09.087215 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165669.0869033, 417861ee-dcf2-458b-8782-2ec22d2f5421 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:41:09.089411 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] VM Resumed (Lifecycle Event)
May 19 04:41:09.109069 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Took 13.52 seconds to build instance.
May 19 04:41:09.205042 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:41:09.210682 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:41:09.211032 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Creating image(s)
May 19 04:41:09.211511 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:41:09.211695 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Ensure instance console log exists: /opt/stack/data/nova/instances/9fca60a6-f506-4f7f-a987-62c44e75f78f/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:41:09.211981 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:09.212229 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:09.212371 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:09.212951 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Start _get_guest_xml network_info=[{"id": "5e2f9712-ec5f-4c22-9bc5-f828919648ed", "address": "fa:16:3e:9d:5a:e8", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e2f9712-ec", "ovs_interfaceid": "5e2f9712-ec5f-4c22-9bc5-f828919648ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'ca7c14c3-a03d-4ce3-a9af-6d960ba1b9c3', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a', 'iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2d84fa8e-7186-4e1a-afc8-82b4275af30a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9fca60a6-f506-4f7f-a987-62c44e75f78f', 'attached_at': '', 'detached_at': '', 'volume_id': '2d84fa8e-7186-4e1a-afc8-82b4275af30a', 'serial': '2d84fa8e-7186-4e1a-afc8-82b4275af30a'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:41:09.216716 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:41:09.221325 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-547159623', uuid='9fca60a6-f506-4f7f-a987-62c44e75f78f'), owner=OwnerMeta(userid='5c46088fb3e74b819bb456461716a801', username='tempest-TestVolumeBootPattern-1071176852-project-member', projectid='28b3c0fa8f894ed2a7c3bcfac99ce74c', projectname='tempest-TestVolumeBootPattern-1071176852'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5e2f9712-ec5f-4c22-9bc5-f828919648ed", "address": "fa:16:3e:9d:5a:e8", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e2f9712-ec", "ovs_interfaceid": "5e2f9712-ec5f-4c22-9bc5-f828919648ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165669.2184596) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:41:09.223329 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:41:09.223688 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:41:09.225067 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:41:09.225696 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:41:09.227176 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:41:09.228682 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:41:09.228682 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:41:09.228682 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:41:09.228682 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:41:09.228682 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:41:09.228682 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:41:09.228682 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:41:09.228682 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:41:09.228682 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:41:09.229180 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:41:09.229180 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:41:09.237970 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-96184b54-099f-4a2f-b0dc-8f8fd1a3b52f tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 7.565s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:09.251663 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:41:09.251663 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a', 'iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2d84fa8e-7186-4e1a-afc8-82b4275af30a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:41:09.251663 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:41:09.251908 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:41:09.252183 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a', 'iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2d84fa8e-7186-4e1a-afc8-82b4275af30a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:41:09.271465 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:41:09.272322 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:41:09.273290 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:41:09.273585 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:41:09.276816 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:41:09.276816 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:41:09.295534 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:41:09.295534 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:09.303312 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:41:09.303312 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:09.312244 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:09.314669 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-abb99b0d-fbb8-4ddd-8762-177b94607fd3 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Get console output
May 19 04:41:09.317501 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a] added
May 19 04:41:09.317501 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:41:09.317501 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:41:09.317501 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:41:09.317501 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:41:09.317501 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:41:09.317501 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:09.320806 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:41:09.321399 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a] added
May 19 04:41:09.321399 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:41:09.321399 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:41:09.321399 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:41:09.321399 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:41:09.321399 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:41:09.321399 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:09.324257 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0441(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:41:09.324257 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:41:09.324870 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:41:09.325143 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0494(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:41:09.325367 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:41:09.325624 np0000001025 nova-compute[97981]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 19 04:41:09.594068 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:09.596102 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:41:09.611410 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.031s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:10.325771 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:41:10.326744 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:41:10.342058 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:41:10.342058 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:41:10.352822 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:41:10.352822 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:10.359642 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:10.369386 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:10.386621 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:10.386621 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:10.386621 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:10.386621 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:10.386621 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:10.386621 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:10.386621 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:10.386621 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:10.386621 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:10.386621 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:10.386621 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:41:10.387007 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:10.387007 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:10.387007 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:10.387007 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:10.387007 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:10.387007 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:10.387007 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:10.387007 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:10.387007 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:10.387007 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:10.387007 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:41:10.396991 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:10.396991 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:10.396991 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:10.396991 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:10.396991 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:10.396991 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:10.396991 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:10.396991 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:10.396991 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:10.396991 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:10.396991 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:41:10.397366 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:10.397366 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:10.397366 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:10.397366 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:10.397366 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:10.397366 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:10.397366 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:10.397366 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:10.397366 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:10.397366 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:10.397366 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:41:10.452679 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a, portal: 192.168.50.100,3260]
May 19 04:41:10.452679 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a, portal: 192.168.50.100,3260] successful.
May 19 04:41:10.452679 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:10.465724 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a, portal: 192.168.40.100,3260]
May 19 04:41:10.465724 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a, portal: 192.168.40.100,3260] successful.
May 19 04:41:10.465724 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:10.467911 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:10.480034 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:10.495212 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.220s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:41:10.495212 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] HCTL ('9', '-', '-', 0) found on session 91 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:41:10.496217 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:41:10.503224 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:10.503224 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:10.503224 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:10.503224 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:10.503224 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:10.503224 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:10.503224 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:10.503224 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:10.503224 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:10.503224 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:10.503224 np0000001025 nova-compute[97981]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:10.503224 np0000001025 nova-compute[97981]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:10.503224 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:41:10.503954 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:10.503954 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:10.503954 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:10.503954 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:10.503954 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:10.503954 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:10.503954 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:10.503954 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:10.503954 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:10.503954 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:10.503954 np0000001025 nova-compute[97981]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:10.503954 np0000001025 nova-compute[97981]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:10.503954 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:41:10.504861 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.228s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:41:10.505190 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:41:10.506952 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] HCTL ('10', '-', '-', 0) found on session 92 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:41:10.507249 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:41:10.520838 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching for a device in session 91 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:41:10.520838 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2d84fa8e-7186-4e1a-afc8-82b4275af30a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:41:10.532354 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching for a device in session 92 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:41:10.532354 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2d84fa8e-7186-4e1a-afc8-82b4275af30a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:41:11.087385 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-69fdb652-e7c1-47fe-8b7c-f399883d4fb3 req-39b790f1-9654-474f-ba30-47d1b3f67fad service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Received event network-changed-9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:11.087626 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-69fdb652-e7c1-47fe-8b7c-f399883d4fb3 req-39b790f1-9654-474f-ba30-47d1b3f67fad service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Refreshing instance network info cache due to event network-changed-9791a107-963b-4608-9092-2df622d06125. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:41:11.087841 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-69fdb652-e7c1-47fe-8b7c-f399883d4fb3 req-39b790f1-9654-474f-ba30-47d1b3f67fad service nova] Acquiring lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:41:11.087975 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-69fdb652-e7c1-47fe-8b7c-f399883d4fb3 req-39b790f1-9654-474f-ba30-47d1b3f67fad service nova] Acquired lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:41:11.088152 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-69fdb652-e7c1-47fe-8b7c-f399883d4fb3 req-39b790f1-9654-474f-ba30-47d1b3f67fad service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Refreshing network info cache for port 9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:41:11.274729 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:41:11.592652 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-69fdb652-e7c1-47fe-8b7c-f399883d4fb3 req-39b790f1-9654-474f-ba30-47d1b3f67fad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:11.932862 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-69fdb652-e7c1-47fe-8b7c-f399883d4fb3 req-39b790f1-9654-474f-ba30-47d1b3f67fad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:12.069417 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "6f26313e-2659-4687-84da-96cf2da9a4e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:12.070210 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:12.112654 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-69fdb652-e7c1-47fe-8b7c-f399883d4fb3 req-39b790f1-9654-474f-ba30-47d1b3f67fad service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Updated VIF entry in instance network info cache for port 9791a107-963b-4608-9092-2df622d06125. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:41:12.112654 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-69fdb652-e7c1-47fe-8b7c-f399883d4fb3 req-39b790f1-9654-474f-ba30-47d1b3f67fad service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Updating instance_info_cache with network_info: [{"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:12.291266 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Found WWN 330000000662747df for multipath device dm-1 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:41:12.291910 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:41:12.292089 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '330000000662747df', 'path': '/dev/dm-1', 'multipath_id': '330000000662747df'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:41:12.292231 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000662747df', 'path': '/dev/dm-1', 'multipath_id': '330000000662747df'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:41:12.576710 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'flavor' on Instance uuid 6f26313e-2659-4687-84da-96cf2da9a4e2 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:12.615289 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-69fdb652-e7c1-47fe-8b7c-f399883d4fb3 req-39b790f1-9654-474f-ba30-47d1b3f67fad service nova] Releasing lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:41:12.615289 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-69fdb652-e7c1-47fe-8b7c-f399883d4fb3 req-39b790f1-9654-474f-ba30-47d1b3f67fad service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Received event network-changed-d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:12.615289 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-69fdb652-e7c1-47fe-8b7c-f399883d4fb3 req-39b790f1-9654-474f-ba30-47d1b3f67fad service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Refreshing instance network info cache due to event network-changed-d51c757a-3333-4e40-8d5f-3c2d35a128b2. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:41:12.615289 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-69fdb652-e7c1-47fe-8b7c-f399883d4fb3 req-39b790f1-9654-474f-ba30-47d1b3f67fad service nova] Acquiring lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:41:12.615289 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-69fdb652-e7c1-47fe-8b7c-f399883d4fb3 req-39b790f1-9654-474f-ba30-47d1b3f67fad service nova] Acquired lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:41:12.615289 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-69fdb652-e7c1-47fe-8b7c-f399883d4fb3 req-39b790f1-9654-474f-ba30-47d1b3f67fad service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Refreshing network info cache for port d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:41:12.692313 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:12.692471 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:12.796979 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-547159623',display_name='tempest-TestVolumeBootPattern-server-547159623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-547159623',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-kkxxtza6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:41:03Z,user_data=None,user_id='5c46088fb3e74b819bb456461716a801',uuid=9fca60a6-f506-4f7f-a987-62c44e75f78f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e2f9712-ec5f-4c22-9bc5-f828919648ed", "address": "fa:16:3e:9d:5a:e8", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e2f9712-ec", "ovs_interfaceid": "5e2f9712-ec5f-4c22-9bc5-f828919648ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:41:12.797285 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "5e2f9712-ec5f-4c22-9bc5-f828919648ed", "address": "fa:16:3e:9d:5a:e8", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e2f9712-ec", "ovs_interfaceid": "5e2f9712-ec5f-4c22-9bc5-f828919648ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:41:12.797717 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:5a:e8,bridge_name='br-int',has_traffic_filtering=True,id=5e2f9712-ec5f-4c22-9bc5-f828919648ed,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e2f9712-ec') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:41:12.798239 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fca60a6-f506-4f7f-a987-62c44e75f78f {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:13.121129 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-69fdb652-e7c1-47fe-8b7c-f399883d4fb3 req-39b790f1-9654-474f-ba30-47d1b3f67fad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:13.194030 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:41:13.226205 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:13.303376 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] End _get_guest_xml xml=<domain type="qemu">
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:   <uuid>9fca60a6-f506-4f7f-a987-62c44e75f78f</uuid>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:   <name>instance-00000027</name>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestVolumeBootPattern-server-547159623</nova:name>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:41:09</nova:creationTime>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:         <nova:user uuid="5c46088fb3e74b819bb456461716a801">tempest-TestVolumeBootPattern-1071176852-project-member</nova:user>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:         <nova:project uuid="28b3c0fa8f894ed2a7c3bcfac99ce74c">tempest-TestVolumeBootPattern-1071176852</nova:project>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:         <nova:port uuid="5e2f9712-ec5f-4c22-9bc5-f828919648ed">
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     <system>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <entry name="serial">9fca60a6-f506-4f7f-a987-62c44e75f78f</entry>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <entry name="uuid">9fca60a6-f506-4f7f-a987-62c44e75f78f</entry>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     </system>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:   <os>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:   </os>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:   <features>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:   </features>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:   <devices>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/9fca60a6-f506-4f7f-a987-62c44e75f78f/disk.config"/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     </disk>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <alias name="ua-2d84fa8e-7186-4e1a-afc8-82b4275af30a"/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-1"/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <serial>2d84fa8e-7186-4e1a-afc8-82b4275af30a</serial>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     </disk>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:9d:5a:e8"/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <target dev="tap5e2f9712-ec"/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     </interface>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/9fca60a6-f506-4f7f-a987-62c44e75f78f/console.log" append="off"/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     </serial>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     <video>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     </video>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     </rng>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:   </devices>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]: </domain>
May 19 04:41:13.303376 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:41:13.303376 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Preparing to wait for external event network-vif-plugged-5e2f9712-ec5f-4c22-9bc5-f828919648ed {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:41:13.303376 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "9fca60a6-f506-4f7f-a987-62c44e75f78f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:13.303376 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "9fca60a6-f506-4f7f-a987-62c44e75f78f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:13.303376 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "9fca60a6-f506-4f7f-a987-62c44e75f78f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:13.306220 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-547159623',display_name='tempest-TestVolumeBootPattern-server-547159623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-547159623',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-kkxxtza6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:41:03Z,user_data=None,user_id='5c46088fb3e74b819bb456461716a801',uuid=9fca60a6-f506-4f7f-a987-62c44e75f78f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e2f9712-ec5f-4c22-9bc5-f828919648ed", "address": "fa:16:3e:9d:5a:e8", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e2f9712-ec", "ovs_interfaceid": "5e2f9712-ec5f-4c22-9bc5-f828919648ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:41:13.306220 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "5e2f9712-ec5f-4c22-9bc5-f828919648ed", "address": "fa:16:3e:9d:5a:e8", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e2f9712-ec", "ovs_interfaceid": "5e2f9712-ec5f-4c22-9bc5-f828919648ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:41:13.306220 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:5a:e8,bridge_name='br-int',has_traffic_filtering=True,id=5e2f9712-ec5f-4c22-9bc5-f828919648ed,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e2f9712-ec') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:41:13.306534 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:5a:e8,bridge_name='br-int',has_traffic_filtering=True,id=5e2f9712-ec5f-4c22-9bc5-f828919648ed,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e2f9712-ec') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:41:13.307555 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:13.307555 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:13.310900 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:41:13.310900 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:13.310900 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d196340-3a44-5b70-867a-c534162973ce', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:13.312858 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:13.313746 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:41:13.316604 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:13.320292 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:13.320445 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e2f9712-ec, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:13.320801 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e2f9712-ec, col_values=(('qos', UUID('e50a6aca-c24d-4e10-a97f-84998546c2f1')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:13.320913 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e2f9712-ec, col_values=(('external_ids', {'iface-id': '5e2f9712-ec5f-4c22-9bc5-f828919648ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:5a:e8', 'vm-uuid': '9fca60a6-f506-4f7f-a987-62c44e75f78f'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:13.323140 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:13.324238 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:41:13.329340 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0003115280001111387 future=<Future at 0x7218345e6270 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:13.329340 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:13.329340 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Emitting event <LifecycleEvent: 1779165658.3279142, 93c62882-ef27-41d5-8178-e1ccc945fe1d => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:41:13.329340 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] VM Stopped (Lifecycle Event)
May 19 04:41:13.330313 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:13.334077 np0000001025 nova-compute[97981]: INFO os_vif [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:5a:e8,bridge_name='br-int',has_traffic_filtering=True,id=5e2f9712-ec5f-4c22-9bc5-f828919648ed,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e2f9712-ec')
May 19 04:41:13.549355 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-69fdb652-e7c1-47fe-8b7c-f399883d4fb3 req-39b790f1-9654-474f-ba30-47d1b3f67fad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:13.582712 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:13.735681 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-69fdb652-e7c1-47fe-8b7c-f399883d4fb3 req-39b790f1-9654-474f-ba30-47d1b3f67fad service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Updated VIF entry in instance network info cache for port d51c757a-3333-4e40-8d5f-3c2d35a128b2. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:41:13.736041 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-69fdb652-e7c1-47fe-8b7c-f399883d4fb3 req-39b790f1-9654-474f-ba30-47d1b3f67fad service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Updating instance_info_cache with network_info: [{"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:13.754764 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:13.754958 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:13.757665 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:41:13.757923 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Claim successful on node np0000001025
May 19 04:41:13.832386 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3ef068b2-94ce-4951-9500-c455d0a0163c tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 93c62882-ef27-41d5-8178-e1ccc945fe1d] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:14.238238 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-69fdb652-e7c1-47fe-8b7c-f399883d4fb3 req-39b790f1-9654-474f-ba30-47d1b3f67fad service nova] Releasing lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:41:14.634777 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "6f26313e-2659-4687-84da-96cf2da9a4e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:14.634892 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:14.635029 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Attaching volume 405ea65f-8d17-42c7-922a-dac27a17a488 to /dev/vdb
May 19 04:41:14.689746 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:41:14.703546 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:41:14.729936 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:14.780792 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:41:14.782726 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:41:14.789939 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:41:14.792194 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fea1:aa43', 'fe80::fc16:3eff:fe19:f7d', 'fe80::946f:41ff:fe06:ab72', 'fe80::fc16:3eff:fe19:9d73', 'fe80::fc16:3eff:fefa:d4f0', 'fe80::fc16:3eff:fe91:89b7', 'fe80::fc16:3eff:feb0:9e6f'] 
May 19 04:41:14.792349 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:41:14.792404 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:41:14.792583 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:41:14.792767 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Updating existing volume attachment record: 70dc58a3-75ad-4784-9757-d7049aae26bf {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:41:14.851345 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:41:14.851453 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:41:14.851548 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No VIF found with MAC fa:16:3e:9d:5a:e8, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:41:14.852299 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Using config drive
May 19 04:41:15.357213 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:15.377236 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:41:15.377570 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '405ea65f-8d17-42c7-922a-dac27a17a488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:41:15.377708 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:41:15.379391 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:41:15.379592 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '405ea65f-8d17-42c7-922a-dac27a17a488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:41:15.394983 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:41:15.395849 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:41:15.395849 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:41:15.395849 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:41:15.396915 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:41:15.397096 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:41:15.415334 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:41:15.415334 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:15.424456 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:41:15.424456 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:15.434310 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488] added
May 19 04:41:15.434310 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:41:15.434310 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:41:15.434310 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:41:15.434310 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:41:15.434310 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:41:15.434310 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:15.434759 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:41:15.434759 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0381(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:41:15.434932 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:41:15.452890 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488] added
May 19 04:41:15.452890 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:41:15.452890 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:41:15.452890 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:41:15.452890 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:41:15.452890 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:41:15.452890 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:15.452890 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:41:15.452890 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0549(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:41:15.452890 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:41:15.505214 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:41:15.505426 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:41:15.567090 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Creating config drive at /opt/stack/data/nova/instances/9fca60a6-f506-4f7f-a987-62c44e75f78f/disk.config
May 19 04:41:15.573150 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9fca60a6-f506-4f7f-a987-62c44e75f78f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3favywap {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:15.638791 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9fca60a6-f506-4f7f-a987-62c44e75f78f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3favywap" returned: 0 in 0.067s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:16.009235 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:41:16.134192 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:16.167267 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:16.285413 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:16.349697 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4afb4b90-dae8-45f9-8859-be8d7cb6c98d req-d115db35-e263-4108-8d6c-5fb7b0a6b8b2 service nova] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Received event network-vif-plugged-5e2f9712-ec5f-4c22-9bc5-f828919648ed {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:16.350306 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4afb4b90-dae8-45f9-8859-be8d7cb6c98d req-d115db35-e263-4108-8d6c-5fb7b0a6b8b2 service nova] Acquiring lock "9fca60a6-f506-4f7f-a987-62c44e75f78f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:16.350427 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4afb4b90-dae8-45f9-8859-be8d7cb6c98d req-d115db35-e263-4108-8d6c-5fb7b0a6b8b2 service nova] Lock "9fca60a6-f506-4f7f-a987-62c44e75f78f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:16.350599 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4afb4b90-dae8-45f9-8859-be8d7cb6c98d req-d115db35-e263-4108-8d6c-5fb7b0a6b8b2 service nova] Lock "9fca60a6-f506-4f7f-a987-62c44e75f78f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:16.350794 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4afb4b90-dae8-45f9-8859-be8d7cb6c98d req-d115db35-e263-4108-8d6c-5fb7b0a6b8b2 service nova] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Processing event network-vif-plugged-5e2f9712-ec5f-4c22-9bc5-f828919648ed {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:41:16.435506 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:41:16.452678 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:41:16.454490 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:41:16.454490 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:41:16.468822 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:41:16.468822 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:16.474572 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:16.488558 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:16.501696 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:16.501696 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:16.501696 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:16.501696 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:16.501696 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:16.501696 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:16.501696 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:16.501696 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:16.501696 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:16.501696 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:16.501696 np0000001025 nova-compute[97981]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:16.501696 np0000001025 nova-compute[97981]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:16.501696 np0000001025 nova-compute[97981]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91938859-af6c-482c-b081-154f5b352833 (non-flash)
May 19 04:41:16.501696 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:41:16.501991 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:16.501991 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:16.501991 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:16.501991 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:16.501991 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:16.501991 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:16.501991 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:16.501991 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:16.501991 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:16.501991 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:16.501991 np0000001025 nova-compute[97981]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:16.501991 np0000001025 nova-compute[97981]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:16.501991 np0000001025 nova-compute[97981]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91938859-af6c-482c-b081-154f5b352833 (non-flash)
May 19 04:41:16.501991 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:41:16.520814 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:16.520814 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:16.520814 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:16.520814 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:16.520814 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:16.520814 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:16.520814 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:16.520814 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:16.520814 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:16.520814 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:16.520814 np0000001025 nova-compute[97981]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:16.520814 np0000001025 nova-compute[97981]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:16.520814 np0000001025 nova-compute[97981]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91938859-af6c-482c-b081-154f5b352833 (non-flash)
May 19 04:41:16.520814 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:41:16.521490 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:16.521490 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:16.521490 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:16.521490 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:16.521490 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:16.521490 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:16.521490 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:16.521490 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:16.521490 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:16.521490 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:16.521490 np0000001025 nova-compute[97981]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:16.521490 np0000001025 nova-compute[97981]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:16.521490 np0000001025 nova-compute[97981]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91938859-af6c-482c-b081-154f5b352833 (non-flash)
May 19 04:41:16.521490 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:41:16.522563 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.768s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:16.526823 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:41:16.537932 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:16.538609 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:16.545124 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:16.564720 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488, portal: 192.168.40.100,3260]
May 19 04:41:16.564720 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488, portal: 192.168.40.100,3260] successful.
May 19 04:41:16.564720 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:16.573299 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:16.578198 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:16.583802 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:16.605164 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488, portal: 192.168.50.100,3260]
May 19 04:41:16.605164 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488, portal: 192.168.50.100,3260] successful.
May 19 04:41:16.605164 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:16.617322 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91938859-af6c-482c-b081-154f5b352833 (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91938859-af6c-482c-b081-154f5b352833 (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:16.645990 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.248s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:41:16.645990 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91938859-af6c-482c-b081-154f5b352833 (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91938859-af6c-482c-b081-154f5b352833 (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:16.649852 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.251s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:41:16.649852 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:41:16.651597 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] HCTL ('21', '-', '-', 0) found on session 95 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:41:16.651597 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:41:16.652728 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] HCTL ('19', '-', '-', 0) found on session 94 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:41:16.652883 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:41:16.669703 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching for a device in session 95 and hctl ['21', '*', '*', 0] yield: sdn {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:41:16.669919 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '405ea65f-8d17-42c7-922a-dac27a17a488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:41:16.687957 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching for a device in session 94 and hctl ['19', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:41:17.041925 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:41:17.042457 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:41:17.042457 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:17.042706 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:17.083356 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:41:17.083356 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165677.0825052, 9fca60a6-f506-4f7f-a987-62c44e75f78f => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:41:17.083356 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] VM Started (Lifecycle Event)
May 19 04:41:17.085016 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:41:17.094588 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Instance spawned successfully.
May 19 04:41:17.096415 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:41:17.124082 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f331813eed6416a9bfa432c8b3ed42a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ec00acc80453dbe8d6a1295e9eb13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:41:17.547319 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:41:17.589744 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:17.593332 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:41:17.605854 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:41:17.606101 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:41:17.606804 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:41:17.606804 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:41:17.607375 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:41:17.608573 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:41:17.689290 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching for a device in session 94 and hctl ['19', '*', '*', 0] yield: sdp {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:41:17.689290 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '405ea65f-8d17-42c7-922a-dac27a17a488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:41:17.814860 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Successfully created port: f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:41:18.051213 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:41:18.096715 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:41:18.097047 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165678.0967915, 9fca60a6-f506-4f7f-a987-62c44e75f78f => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:41:18.097228 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] VM Paused (Lifecycle Event)
May 19 04:41:18.115840 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Took 8.91 seconds to spawn the instance on the hypervisor.
May 19 04:41:18.116307 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:18.227632 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:18.303715 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Successfully updated port: f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:41:18.323849 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:18.417217 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-82c2d1e8-4bc4-439c-a665-a5cd07ec08e8 req-3e2ec8e1-597f-4ed2-9e54-6996ca7283b0 service nova] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Received event network-vif-plugged-5e2f9712-ec5f-4c22-9bc5-f828919648ed {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:18.417996 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-82c2d1e8-4bc4-439c-a665-a5cd07ec08e8 req-3e2ec8e1-597f-4ed2-9e54-6996ca7283b0 service nova] Acquiring lock "9fca60a6-f506-4f7f-a987-62c44e75f78f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:18.419468 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-82c2d1e8-4bc4-439c-a665-a5cd07ec08e8 req-3e2ec8e1-597f-4ed2-9e54-6996ca7283b0 service nova] Lock "9fca60a6-f506-4f7f-a987-62c44e75f78f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:18.420801 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-82c2d1e8-4bc4-439c-a665-a5cd07ec08e8 req-3e2ec8e1-597f-4ed2-9e54-6996ca7283b0 service nova] Lock "9fca60a6-f506-4f7f-a987-62c44e75f78f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:18.421364 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Found WWN 3300000009f63224e for multipath device dm-11 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:41:18.421851 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-82c2d1e8-4bc4-439c-a665-a5cd07ec08e8 req-3e2ec8e1-597f-4ed2-9e54-6996ca7283b0 service nova] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] No waiting events found dispatching network-vif-plugged-5e2f9712-ec5f-4c22-9bc5-f828919648ed {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:41:18.422524 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:41:18.422820 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-82c2d1e8-4bc4-439c-a665-a5cd07ec08e8 req-3e2ec8e1-597f-4ed2-9e54-6996ca7283b0 service nova] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Received unexpected event network-vif-plugged-5e2f9712-ec5f-4c22-9bc5-f828919648ed for instance with vm_state active and task_state None.
May 19 04:41:18.423621 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] <== connect_volume: return (3045ms) {'type': 'block', 'scsi_wwn': '3300000009f63224e', 'path': '/dev/dm-11', 'multipath_id': '3300000009f63224e'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:41:18.423979 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-82c2d1e8-4bc4-439c-a665-a5cd07ec08e8 req-3e2ec8e1-597f-4ed2-9e54-6996ca7283b0 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Received event network-changed-f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:18.424297 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009f63224e', 'path': '/dev/dm-11', 'multipath_id': '3300000009f63224e'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:41:18.424506 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-82c2d1e8-4bc4-439c-a665-a5cd07ec08e8 req-3e2ec8e1-597f-4ed2-9e54-6996ca7283b0 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Refreshing instance network info cache due to event network-changed-f8804350-de17-488a-8b3a-f94271e358f5. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:41:18.424725 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-82c2d1e8-4bc4-439c-a665-a5cd07ec08e8 req-3e2ec8e1-597f-4ed2-9e54-6996ca7283b0 service nova] Acquiring lock "refresh_cache-3ad7c142-5f58-498e-b24c-ea7d4faa1d63" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:41:18.425307 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-82c2d1e8-4bc4-439c-a665-a5cd07ec08e8 req-3e2ec8e1-597f-4ed2-9e54-6996ca7283b0 service nova] Acquired lock "refresh_cache-3ad7c142-5f58-498e-b24c-ea7d4faa1d63" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:41:18.426648 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-82c2d1e8-4bc4-439c-a665-a5cd07ec08e8 req-3e2ec8e1-597f-4ed2-9e54-6996ca7283b0 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Refreshing network info cache for port f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:41:18.431279 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'flavor' on Instance uuid 6f26313e-2659-4687-84da-96cf2da9a4e2 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:18.599921 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:18.601414 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165678.6012368, 9fca60a6-f506-4f7f-a987-62c44e75f78f => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:41:18.601581 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] VM Resumed (Lifecycle Event)
May 19 04:41:18.628758 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Took 23.00 seconds to build instance.
May 19 04:41:18.806692 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "refresh_cache-3ad7c142-5f58-498e-b24c-ea7d4faa1d63" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:41:18.930044 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-82c2d1e8-4bc4-439c-a665-a5cd07ec08e8 req-3e2ec8e1-597f-4ed2-9e54-6996ca7283b0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:18.935117 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Attempting to attach volume 405ea65f-8d17-42c7-922a-dac27a17a488 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:41:18.938962 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:41:18.938962 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:41:18.938962 np0000001025 nova-compute[97981]:   <alias name="ua-405ea65f-8d17-42c7-922a-dac27a17a488"/>
May 19 04:41:18.938962 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-11"/>
May 19 04:41:18.938962 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:41:18.938962 np0000001025 nova-compute[97981]:   <serial>405ea65f-8d17-42c7-922a-dac27a17a488</serial>
May 19 04:41:18.938962 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:41:18.938962 np0000001025 nova-compute[97981]: </disk>
May 19 04:41:18.938962 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:41:19.015695 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-82c2d1e8-4bc4-439c-a665-a5cd07ec08e8 req-3e2ec8e1-597f-4ed2-9e54-6996ca7283b0 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:41:19.064555 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:41:19.065702 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:41:19.065871 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Creating image(s)
May 19 04:41:19.073146 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:19.073146 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "/opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:19.073146 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "/opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:19.074049 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:41:19.078513 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:41:19.083676 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:19.113948 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:19.123418 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:41:19.138326 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2ed5175c-8bec-4727-94b6-00ba78eba194 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "9fca60a6-f506-4f7f-a987-62c44e75f78f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.525s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:19.210058 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.126s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:19.210058 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:19.210058 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:19.211208 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:41:19.214304 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:41:19.214676 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:19.254223 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-82c2d1e8-4bc4-439c-a665-a5cd07ec08e8 req-3e2ec8e1-597f-4ed2-9e54-6996ca7283b0 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:19.335753 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.121s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:19.336346 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:19.415311 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/disk 1073741824" returned: 0 in 0.079s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:19.415997 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:19.416758 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:19.507346 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.090s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:19.507815 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:41:19.508071 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:19.605164 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:19.605674 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Cannot resize image /opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:41:19.606178 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:41:19.606407 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Ensure instance console log exists: /opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:41:19.606793 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:19.607076 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:19.607301 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:19.759958 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-82c2d1e8-4bc4-439c-a665-a5cd07ec08e8 req-3e2ec8e1-597f-4ed2-9e54-6996ca7283b0 service nova] Releasing lock "refresh_cache-3ad7c142-5f58-498e-b24c-ea7d4faa1d63" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:41:19.760369 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquired lock "refresh_cache-3ad7c142-5f58-498e-b24c-ea7d4faa1d63" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:41:19.760585 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:41:19.904666 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "9fca60a6-f506-4f7f-a987-62c44e75f78f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:19.905290 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "9fca60a6-f506-4f7f-a987-62c44e75f78f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:19.905644 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "9fca60a6-f506-4f7f-a987-62c44e75f78f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:19.906080 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "9fca60a6-f506-4f7f-a987-62c44e75f78f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:19.907205 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "9fca60a6-f506-4f7f-a987-62c44e75f78f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:19.908889 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Terminating instance
May 19 04:41:20.353102 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:41:20.415031 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:41:20.450095 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:20.455141 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:20.472812 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:20.476200 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:20.500625 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:20.504536 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:20.568526 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:20.598702 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ee93aaef-4e81-4ffd-b3ee-b97fd74a33de req-1667ac23-84c1-4518-ac51-5de036ca274a service nova] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Received event network-vif-unplugged-5e2f9712-ec5f-4c22-9bc5-f828919648ed {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:20.600458 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ee93aaef-4e81-4ffd-b3ee-b97fd74a33de req-1667ac23-84c1-4518-ac51-5de036ca274a service nova] Acquiring lock "9fca60a6-f506-4f7f-a987-62c44e75f78f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:20.600820 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ee93aaef-4e81-4ffd-b3ee-b97fd74a33de req-1667ac23-84c1-4518-ac51-5de036ca274a service nova] Lock "9fca60a6-f506-4f7f-a987-62c44e75f78f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:20.600955 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ee93aaef-4e81-4ffd-b3ee-b97fd74a33de req-1667ac23-84c1-4518-ac51-5de036ca274a service nova] Lock "9fca60a6-f506-4f7f-a987-62c44e75f78f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:20.601080 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ee93aaef-4e81-4ffd-b3ee-b97fd74a33de req-1667ac23-84c1-4518-ac51-5de036ca274a service nova] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] No waiting events found dispatching network-vif-unplugged-5e2f9712-ec5f-4c22-9bc5-f828919648ed {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:41:20.601256 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ee93aaef-4e81-4ffd-b3ee-b97fd74a33de req-1667ac23-84c1-4518-ac51-5de036ca274a service nova] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Received event network-vif-unplugged-5e2f9712-ec5f-4c22-9bc5-f828919648ed for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:41:20.641445 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:41:20.643137 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:41:20.643278 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:41:20.644244 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No VIF found with MAC fa:16:3e:fa:d4:f0, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:41:20.748076 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Updating instance_info_cache with network_info: [{"id": "f8804350-de17-488a-8b3a-f94271e358f5", "address": "fa:16:3e:0c:f0:96", "network": {"id": "3f564857-63e6-46af-9e0f-3a2de30297d4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-951031274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "529ec00acc80453dbe8d6a1295e9eb13", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8804350-de", "ovs_interfaceid": "f8804350-de17-488a-8b3a-f94271e358f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:20.758133 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999687314999846 future=<Future at 0x721834364560 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:20.759479 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.99830864899991 future=<Future at 0x721834364560 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:20.760062 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.998108429000013 future=<Future at 0x721834364560 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:20.765452 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Instance destroyed successfully.
May 19 04:41:20.765879 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'resources' on Instance uuid 9fca60a6-f506-4f7f-a987-62c44e75f78f {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:21.248527 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Releasing lock "refresh_cache-3ad7c142-5f58-498e-b24c-ea7d4faa1d63" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:41:21.248846 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Instance network_info: |[{"id": "f8804350-de17-488a-8b3a-f94271e358f5", "address": "fa:16:3e:0c:f0:96", "network": {"id": "3f564857-63e6-46af-9e0f-3a2de30297d4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-951031274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "529ec00acc80453dbe8d6a1295e9eb13", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8804350-de", "ovs_interfaceid": "f8804350-de17-488a-8b3a-f94271e358f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:41:21.250472 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Start _get_guest_xml network_info=[{"id": "f8804350-de17-488a-8b3a-f94271e358f5", "address": "fa:16:3e:0c:f0:96", "network": {"id": "3f564857-63e6-46af-9e0f-3a2de30297d4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-951031274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "529ec00acc80453dbe8d6a1295e9eb13", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8804350-de", "ovs_interfaceid": "f8804350-de17-488a-8b3a-f94271e358f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:41:21.252741 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:41:21.253982 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-838199839', uuid='3ad7c142-5f58-498e-b24c-ea7d4faa1d63'), owner=OwnerMeta(userid='1f331813eed6416a9bfa432c8b3ed42a', username='tempest-VolumesSnapshotTestJSON-492014726-project-member', projectid='529ec00acc80453dbe8d6a1295e9eb13', projectname='tempest-VolumesSnapshotTestJSON-492014726'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f8804350-de17-488a-8b3a-f94271e358f5", "address": "fa:16:3e:0c:f0:96", "network": {"id": "3f564857-63e6-46af-9e0f-3a2de30297d4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-951031274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "529ec00acc80453dbe8d6a1295e9eb13", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8804350-de", "ovs_interfaceid": "f8804350-de17-488a-8b3a-f94271e358f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165681.2536607) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:41:21.255014 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:41:21.255420 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:41:21.256295 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:41:21.256452 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:41:21.257406 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:41:21.257748 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:41:21.257925 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:41:21.258068 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:41:21.258322 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:41:21.258417 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:41:21.258495 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:41:21.258718 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:41:21.258855 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:41:21.259022 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:41:21.259197 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:41:21.259348 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:41:21.268993 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-547159623',display_name='tempest-TestVolumeBootPattern-server-547159623',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-547159623',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:41:18Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-kkxxtza6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:41:18Z,user_data=None,user_id='5c46088fb3e74b819bb456461716a801',uuid=9fca60a6-f506-4f7f-a987-62c44e75f78f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e2f9712-ec5f-4c22-9bc5-f828919648ed", "address": "fa:16:3e:9d:5a:e8", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e2f9712-ec", "ovs_interfaceid": "5e2f9712-ec5f-4c22-9bc5-f828919648ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:41:21.270771 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "5e2f9712-ec5f-4c22-9bc5-f828919648ed", "address": "fa:16:3e:9d:5a:e8", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e2f9712-ec", "ovs_interfaceid": "5e2f9712-ec5f-4c22-9bc5-f828919648ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:41:21.270771 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:5a:e8,bridge_name='br-int',has_traffic_filtering=True,id=5e2f9712-ec5f-4c22-9bc5-f828919648ed,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e2f9712-ec') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:41:21.270771 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:5a:e8,bridge_name='br-int',has_traffic_filtering=True,id=5e2f9712-ec5f-4c22-9bc5-f828919648ed,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e2f9712-ec') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:41:21.273445 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:21.274087 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e2f9712-ec, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:21.277396 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:41:21.278687 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:41:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-838199839',display_name='tempest-VolumesSnapshotTestJSON-instance-838199839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumessnapshottestjson-instance-838199839',id=40,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeoCBJycwqrGbVkEKjn5sJBRXKAobF0Zhv5k/tSP8lozrIb6Qx/VPrN7atxZUiwt0G0Lz2FhznMvf+stCri1+qhU0sdkHtnLdG9nWUn0LdNlIkN4MqlgvJIt1IF3PznaQ==',key_name='tempest-keypair-2144147369',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='529ec00acc80453dbe8d6a1295e9eb13',ramdisk_id='',reservation_id='r-fh2u1ufb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-492014726',owner_user_name='tempest-VolumesSnapshotTestJSON-492014726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:41:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f331813eed6416a9bfa432c8b3ed42a',uuid=3ad7c142-5f58-498e-b24c-ea7d4faa1d63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8804350-de17-488a-8b3a-f94271e358f5", "address": "fa:16:3e:0c:f0:96", "network": {"id": "3f564857-63e6-46af-9e0f-3a2de30297d4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-951031274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "529ec00acc80453dbe8d6a1295e9eb13", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8804350-de", "ovs_interfaceid": "f8804350-de17-488a-8b3a-f94271e358f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:41:21.278948 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Converting VIF {"id": "f8804350-de17-488a-8b3a-f94271e358f5", "address": "fa:16:3e:0c:f0:96", "network": {"id": "3f564857-63e6-46af-9e0f-3a2de30297d4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-951031274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "529ec00acc80453dbe8d6a1295e9eb13", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8804350-de", "ovs_interfaceid": "f8804350-de17-488a-8b3a-f94271e358f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:41:21.279523 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:f0:96,bridge_name='br-int',has_traffic_filtering=True,id=f8804350-de17-488a-8b3a-f94271e358f5,network=Network(3f564857-63e6-46af-9e0f-3a2de30297d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8804350-de') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:41:21.280766 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ad7c142-5f58-498e-b24c-ea7d4faa1d63 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:21.282338 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:21.282577 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e50a6aca-c24d-4e10-a97f-84998546c2f1) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:21.283358 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:21.283924 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:41:21.284332 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:21.286456 np0000001025 nova-compute[97981]: INFO os_vif [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:5a:e8,bridge_name='br-int',has_traffic_filtering=True,id=5e2f9712-ec5f-4c22-9bc5-f828919648ed,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e2f9712-ec')
May 19 04:41:21.287834 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:41:21.287834 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a', 'iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2d84fa8e-7186-4e1a-afc8-82b4275af30a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:41:21.287834 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:41:21.288415 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:41:21.288913 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a', 'iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2d84fa8e-7186-4e1a-afc8-82b4275af30a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:41:21.289218 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91938859-af6c-482c-b081-154f5b352833 (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91938859-af6c-482c-b081-154f5b352833 (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:21.330529 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '75'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '81'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-91938859-af6c-482c-b081-154f5b352833', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '95')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a', '92')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:41:21.330529 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a', '91')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:41:21.333167 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185025ec00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a'): ({'sdd'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:41:21.333621 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Removing multipathed devices sdd, sde {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:41:21.333978 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flush multipath device 330000000662747df {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:41:21.389494 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:41:21.448714 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:41:21.490006 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:41:21.490006 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] SCSI volumes sdd, sde have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:41:21.490006 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:41:21.510336 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:41:21.511056 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:41:21.527279 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:21.576624 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 92, target: iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a, portal: 192.168.40.100,3260]
May 19 04:41:21.576624 np0000001025 nova-compute[97981]: Logout of [sid: 92, target: iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a, portal: 192.168.40.100,3260] successful.
May 19 04:41:21.576624 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:21.597398 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:21.609335 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:21.654156 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 91, target: iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a, portal: 192.168.50.100,3260]
May 19 04:41:21.654156 np0000001025 nova-compute[97981]: Logout of [sid: 91, target: iqn.2023-03.storpool.com:os--volume-2d84fa8e-7186-4e1a-afc8-82b4275af30a, portal: 192.168.50.100,3260] successful.
May 19 04:41:21.654156 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:21.682002 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:21.682002 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:41:21.682002 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== disconnect_volume: return (391ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:41:21.682002 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:41:21.682002 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Deleting instance files /opt/stack/data/nova/instances/9fca60a6-f506-4f7f-a987-62c44e75f78f_del
May 19 04:41:21.682002 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Deletion of /opt/stack/data/nova/instances/9fca60a6-f506-4f7f-a987-62c44e75f78f_del complete
May 19 04:41:21.784931 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] End _get_guest_xml xml=<domain type="qemu">
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:   <uuid>3ad7c142-5f58-498e-b24c-ea7d4faa1d63</uuid>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:   <name>instance-00000028</name>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-838199839</nova:name>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:41:21</nova:creationTime>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:         <nova:user uuid="1f331813eed6416a9bfa432c8b3ed42a">tempest-VolumesSnapshotTestJSON-492014726-project-member</nova:user>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:         <nova:project uuid="529ec00acc80453dbe8d6a1295e9eb13">tempest-VolumesSnapshotTestJSON-492014726</nova:project>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:         <nova:port uuid="f8804350-de17-488a-8b3a-f94271e358f5">
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     <system>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <entry name="serial">3ad7c142-5f58-498e-b24c-ea7d4faa1d63</entry>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <entry name="uuid">3ad7c142-5f58-498e-b24c-ea7d4faa1d63</entry>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     </system>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:   <os>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:   </os>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:   <features>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:   </features>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:   <devices>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/disk"/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     </disk>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/disk.config"/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     </disk>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:0c:f0:96"/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <target dev="tapf8804350-de"/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     </interface>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/console.log" append="off"/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     </serial>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     <video>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     </video>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     </rng>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:   </devices>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]: </domain>
May 19 04:41:21.784931 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:41:21.787791 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Preparing to wait for external event network-vif-plugged-f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:41:21.787791 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:21.787791 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:21.787791 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:21.787791 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:41:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-838199839',display_name='tempest-VolumesSnapshotTestJSON-instance-838199839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumessnapshottestjson-instance-838199839',id=40,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeoCBJycwqrGbVkEKjn5sJBRXKAobF0Zhv5k/tSP8lozrIb6Qx/VPrN7atxZUiwt0G0Lz2FhznMvf+stCri1+qhU0sdkHtnLdG9nWUn0LdNlIkN4MqlgvJIt1IF3PznaQ==',key_name='tempest-keypair-2144147369',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='529ec00acc80453dbe8d6a1295e9eb13',ramdisk_id='',reservation_id='r-fh2u1ufb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-492014726',owner_user_name='tempest-VolumesSnapshotTestJSON-492014726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:41:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f331813eed6416a9bfa432c8b3ed42a',uuid=3ad7c142-5f58-498e-b24c-ea7d4faa1d63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8804350-de17-488a-8b3a-f94271e358f5", "address": "fa:16:3e:0c:f0:96", "network": {"id": "3f564857-63e6-46af-9e0f-3a2de30297d4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-951031274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "529ec00acc80453dbe8d6a1295e9eb13", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8804350-de", "ovs_interfaceid": "f8804350-de17-488a-8b3a-f94271e358f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:41:21.787791 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Converting VIF {"id": "f8804350-de17-488a-8b3a-f94271e358f5", "address": "fa:16:3e:0c:f0:96", "network": {"id": "3f564857-63e6-46af-9e0f-3a2de30297d4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-951031274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "529ec00acc80453dbe8d6a1295e9eb13", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8804350-de", "ovs_interfaceid": "f8804350-de17-488a-8b3a-f94271e358f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:41:21.787791 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:f0:96,bridge_name='br-int',has_traffic_filtering=True,id=f8804350-de17-488a-8b3a-f94271e358f5,network=Network(3f564857-63e6-46af-9e0f-3a2de30297d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8804350-de') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:41:21.787791 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:f0:96,bridge_name='br-int',has_traffic_filtering=True,id=f8804350-de17-488a-8b3a-f94271e358f5,network=Network(3f564857-63e6-46af-9e0f-3a2de30297d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8804350-de') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:41:21.788327 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:21.788327 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:21.788327 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:41:21.789213 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:21.789371 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1e9cf72-ee0f-539e-b866-2340700a578b', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:21.790698 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:21.791151 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:41:21.791209 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:21.792971 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:21.793224 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8804350-de, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:21.793513 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8804350-de, col_values=(('qos', UUID('393320d9-7b59-4f6c-86f0-e82d3a0032e1')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:21.793701 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8804350-de, col_values=(('external_ids', {'iface-id': 'f8804350-de17-488a-8b3a-f94271e358f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:f0:96', 'vm-uuid': '3ad7c142-5f58-498e-b24c-ea7d4faa1d63'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:21.795052 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:21.796374 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:41:21.803659 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:21.804303 np0000001025 nova-compute[97981]: INFO os_vif [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:f0:96,bridge_name='br-int',has_traffic_filtering=True,id=f8804350-de17-488a-8b3a-f94271e358f5,network=Network(3f564857-63e6-46af-9e0f-3a2de30297d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8804350-de')
May 19 04:41:22.191399 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Took 1.78 seconds to destroy the instance on the hypervisor.
May 19 04:41:22.191978 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:41:22.192236 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:41:22.192336 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:41:22.192566 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:22.211137 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e6c96b3c-2e3f-402c-82aa-f588ce30d51a tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.576s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:22.223879 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "417861ee-dcf2-458b-8782-2ec22d2f5421" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:22.224442 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:22.270959 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:22.668570 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-de0b06a8-c2ba-48ce-a802-f7d1ecfe2929 req-ebc5944e-0897-4754-af92-b06c79fed5e4 service nova] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Received event network-vif-unplugged-5e2f9712-ec5f-4c22-9bc5-f828919648ed {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:22.668570 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-de0b06a8-c2ba-48ce-a802-f7d1ecfe2929 req-ebc5944e-0897-4754-af92-b06c79fed5e4 service nova] Acquiring lock "9fca60a6-f506-4f7f-a987-62c44e75f78f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:22.668570 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-de0b06a8-c2ba-48ce-a802-f7d1ecfe2929 req-ebc5944e-0897-4754-af92-b06c79fed5e4 service nova] Lock "9fca60a6-f506-4f7f-a987-62c44e75f78f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:22.668570 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-de0b06a8-c2ba-48ce-a802-f7d1ecfe2929 req-ebc5944e-0897-4754-af92-b06c79fed5e4 service nova] Lock "9fca60a6-f506-4f7f-a987-62c44e75f78f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:22.668570 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-de0b06a8-c2ba-48ce-a802-f7d1ecfe2929 req-ebc5944e-0897-4754-af92-b06c79fed5e4 service nova] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] No waiting events found dispatching network-vif-unplugged-5e2f9712-ec5f-4c22-9bc5-f828919648ed {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:41:22.668570 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-de0b06a8-c2ba-48ce-a802-f7d1ecfe2929 req-ebc5944e-0897-4754-af92-b06c79fed5e4 service nova] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Received event network-vif-unplugged-5e2f9712-ec5f-4c22-9bc5-f828919648ed for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:41:22.672138 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e13bec37-1300-4997-9800-bc3f3c6a7f3a req-5684283e-9988-40b7-a518-d8613dd7ffaf service nova] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Received event network-vif-deleted-5e2f9712-ec5f-4c22-9bc5-f828919648ed {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:22.672138 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-e13bec37-1300-4997-9800-bc3f3c6a7f3a req-5684283e-9988-40b7-a518-d8613dd7ffaf service nova] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Neutron deleted interface 5e2f9712-ec5f-4c22-9bc5-f828919648ed; detaching it from the instance and deleting it from the info cache
May 19 04:41:22.672138 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e13bec37-1300-4997-9800-bc3f3c6a7f3a req-5684283e-9988-40b7-a518-d8613dd7ffaf service nova] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:22.727549 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'flavor' on Instance uuid 417861ee-dcf2-458b-8782-2ec22d2f5421 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:22.842490 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:22.842683 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:22.842850 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Shelving
May 19 04:41:22.980278 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:22.981519 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:23.038433 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:23.176816 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e13bec37-1300-4997-9800-bc3f3c6a7f3a req-5684283e-9988-40b7-a518-d8613dd7ffaf service nova] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Detach interface failed, port_id=5e2f9712-ec5f-4c22-9bc5-f828919648ed, reason: Instance 9fca60a6-f506-4f7f-a987-62c44e75f78f could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:41:23.229735 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:23.322271 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:41:23.322420 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:41:23.324180 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] No VIF found with MAC fa:16:3e:0c:f0:96, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:41:23.324180 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Using config drive
May 19 04:41:23.484432 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lazy-loading 'flavor' on Instance uuid 0dbaac9f-71f1-4cb6-837c-cafc38f94f11 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:23.540322 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Took 1.35 seconds to deallocate network for instance.
May 19 04:41:23.737402 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:23.827603 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:23.876152 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:23.881457 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:23.900623 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:23.903505 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:23.934353 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:24.017678 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Creating config drive at /opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/disk.config
May 19 04:41:24.022508 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpweqaa7ug {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:24.089042 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpweqaa7ug" returned: 0 in 0.066s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:24.113421 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Took 0.57 seconds to detach 1 volumes for instance.
May 19 04:41:24.116058 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Deleting volume: 2d84fa8e-7186-4e1a-afc8-82b4275af30a {{(pid=97981) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 19 04:41:24.280935 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999656404000007 future=<Future at 0x721850602180 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:24.286097 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Instance destroyed successfully.
May 19 04:41:24.286649 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'numa_topology' on Instance uuid 15f0abbc-b8de-4d77-88c4-e5c0e54d691f {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:24.491966 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:24.627225 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:24.662064 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:24.664996 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:24.676263 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:24.676490 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:24.776938 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:24.793099 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-16b4ae31-f5b2-48ff-954d-5d3132f64102 req-8b1b2290-d309-40aa-a550-5dd980c8970c service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Received event network-vif-unplugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:24.793099 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-16b4ae31-f5b2-48ff-954d-5d3132f64102 req-8b1b2290-d309-40aa-a550-5dd980c8970c service nova] Acquiring lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:24.793099 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-16b4ae31-f5b2-48ff-954d-5d3132f64102 req-8b1b2290-d309-40aa-a550-5dd980c8970c service nova] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:24.799280 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-16b4ae31-f5b2-48ff-954d-5d3132f64102 req-8b1b2290-d309-40aa-a550-5dd980c8970c service nova] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:24.800604 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-16b4ae31-f5b2-48ff-954d-5d3132f64102 req-8b1b2290-d309-40aa-a550-5dd980c8970c service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] No waiting events found dispatching network-vif-unplugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:41:24.800604 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-16b4ae31-f5b2-48ff-954d-5d3132f64102 req-8b1b2290-d309-40aa-a550-5dd980c8970c service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Received unexpected event network-vif-unplugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 for instance with vm_state active and task_state shelving.
May 19 04:41:24.800604 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-16b4ae31-f5b2-48ff-954d-5d3132f64102 req-8b1b2290-d309-40aa-a550-5dd980c8970c service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Received event network-vif-unplugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:24.800604 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-16b4ae31-f5b2-48ff-954d-5d3132f64102 req-8b1b2290-d309-40aa-a550-5dd980c8970c service nova] Acquiring lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:24.800604 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-16b4ae31-f5b2-48ff-954d-5d3132f64102 req-8b1b2290-d309-40aa-a550-5dd980c8970c service nova] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:24.800604 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-16b4ae31-f5b2-48ff-954d-5d3132f64102 req-8b1b2290-d309-40aa-a550-5dd980c8970c service nova] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:24.800604 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-16b4ae31-f5b2-48ff-954d-5d3132f64102 req-8b1b2290-d309-40aa-a550-5dd980c8970c service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] No waiting events found dispatching network-vif-unplugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:41:24.800604 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-16b4ae31-f5b2-48ff-954d-5d3132f64102 req-8b1b2290-d309-40aa-a550-5dd980c8970c service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Received unexpected event network-vif-unplugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 for instance with vm_state active and task_state shelving.
May 19 04:41:24.821382 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "417861ee-dcf2-458b-8782-2ec22d2f5421" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:24.821720 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:24.821950 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Attaching volume 405ea65f-8d17-42c7-922a-dac27a17a488 to /dev/vdb
May 19 04:41:24.878940 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:41:24.895467 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:41:24.929305 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:24.974119 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Beginning cold snapshot process
May 19 04:41:24.977232 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:41:24.977588 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:41:24.990129 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:41:24.990129 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fea1:aa43', 'fe80::fc16:3eff:fe19:9d73', 'fe80::fc16:3eff:fefa:d4f0', 'fe80::fc16:3eff:fe91:89b7', 'fe80::fc16:3eff:feb0:9e6f', 'fe80::fc16:3eff:fe0c:f096', 'fe80::8849:6dff:fe86:4a4b'] 
May 19 04:41:24.990129 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:41:24.990129 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:41:24.991182 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:41:24.991742 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Updating existing volume attachment record: e7d9f3e7-eb62-4ca1-9e87-d416368ba72f {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:41:25.060298 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:25.069353 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:25.097353 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:25.558166 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:41:25.558409 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:41:25.587323 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:41:25.587777 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '405ea65f-8d17-42c7-922a-dac27a17a488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:41:25.587917 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:41:25.588295 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:41:25.588469 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '405ea65f-8d17-42c7-922a-dac27a17a488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:41:25.599696 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:41:25.600433 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:41:25.600738 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:41:25.601121 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:41:25.601331 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:41:25.601557 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:41:25.615431 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.startup = automatic
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.scan = manual
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:41:25.616343 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:41:25.616343 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:25.618604 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Cleaning up deleted instances with incomplete migration  {{(pid=97981) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.startup = automatic
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.scan = manual
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:41:25.619648 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:41:25.619648 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:25.630880 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:25.631468 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:25.631799 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Attaching volume 82d50c4c-3f93-4fc1-adcd-170812ca09de to /dev/vdb
May 19 04:41:25.636387 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:25.645822 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:25.659890 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:25.659890 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:25.659890 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:25.659890 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:25.659890 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:25.659890 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:25.659890 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:25.659890 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:25.659890 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:25.659890 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:25.659890 np0000001025 nova-compute[97981]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91938859-af6c-482c-b081-154f5b352833 (non-flash)
May 19 04:41:25.659890 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:25.659890 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:25.659890 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:41:25.660386 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:25.660386 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:25.660386 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:25.660386 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:25.660386 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:25.660386 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:25.660386 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:25.660386 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:25.660386 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:25.660386 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:25.660386 np0000001025 nova-compute[97981]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91938859-af6c-482c-b081-154f5b352833 (non-flash)
May 19 04:41:25.660386 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:25.660386 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:25.660386 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:41:25.660847 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.060s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:41:25.660847 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:41:25.661751 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] HCTL ('19', '0', '0', 0) found on session 94 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:41:25.661925 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Scanning host 19 c: 0, t: 0, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:41:25.672146 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:25.672146 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:25.672146 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:25.672146 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:25.672146 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:25.672146 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:25.672146 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:25.672146 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:25.672146 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:25.672146 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:25.672146 np0000001025 nova-compute[97981]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91938859-af6c-482c-b081-154f5b352833 (non-flash)
May 19 04:41:25.672146 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:25.672146 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:25.672146 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:41:25.673009 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching for a device in session 94 and hctl ('19', '0', '0', 0) yield: sdp {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:41:25.673255 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:25.673255 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:25.673255 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:25.673255 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:25.673255 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:25.673255 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:25.673255 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:25.673255 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:25.673255 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:25.673255 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:25.673255 np0000001025 nova-compute[97981]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91938859-af6c-482c-b081-154f5b352833 (non-flash)
May 19 04:41:25.673255 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:25.673255 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:25.673255 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:41:25.673644 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '405ea65f-8d17-42c7-922a-dac27a17a488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:41:25.673924 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.073s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:41:25.674087 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:41:25.674984 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] HCTL ('21', '0', '0', 0) found on session 95 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:41:25.675260 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Scanning host 21 c: 0, t: 0, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:41:25.685237 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching for a device in session 95 and hctl ('21', '0', '0', 0) yield: sdn {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:41:25.685450 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '405ea65f-8d17-42c7-922a-dac27a17a488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:41:25.700716 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:41:25.709300 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165685.708946, 3ad7c142-5f58-498e-b24c-ea7d4faa1d63 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:41:25.709524 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] VM Started (Lifecycle Event)
May 19 04:41:25.716511 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:41:25.735139 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:25.785546 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:41:25.786065 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:41:25.795670 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:41:25.796945 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fea1:aa43', 'fe80::fc16:3eff:fe19:9d73', 'fe80::fc16:3eff:fefa:d4f0', 'fe80::fc16:3eff:fe91:89b7', 'fe80::fc16:3eff:feb0:9e6f', 'fe80::fc16:3eff:fe0c:f096', 'fe80::8849:6dff:fe86:4a4b'] 
May 19 04:41:25.797047 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:41:25.797162 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:41:25.797386 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:41:25.797649 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Updating existing volume attachment record: 93a46743-0234-4022-beb8-5eeb11c1c1a9 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:41:26.061441 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:41:26.121073 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:41:26.215167 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:26.216986 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165686.2167113, 3ad7c142-5f58-498e-b24c-ea7d4faa1d63 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:41:26.218336 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] VM Paused (Lifecycle Event)
May 19 04:41:26.346675 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:41:26.346996 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '82d50c4c-3f93-4fc1-adcd-170812ca09de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:41:26.347127 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:41:26.491278 np0000001025 nova-compute[97981]: DEBUG nova.privsep.utils [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97981) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 19 04:41:26.491519 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk /opt/stack/data/nova/instances/snapshots/tmpqoje_7sc/9c1f18673bf54de69bd1478a3a712c9f {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:26.569349 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.893s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:26.601331 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:41:26.622242 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Deleted allocations for instance 9fca60a6-f506-4f7f-a987-62c44e75f78f
May 19 04:41:26.720267 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:26.722733 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:41:26.728835 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk /opt/stack/data/nova/instances/snapshots/tmpqoje_7sc/9c1f18673bf54de69bd1478a3a712c9f" returned: 0 in 0.237s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:26.729700 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Snapshot extracted, beginning image upload
May 19 04:41:26.796048 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:26.872182 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-44892f87-350e-4d1f-bcfc-790132548d6e req-3dcbe7fb-785b-49f6-9dab-2b0b47058247 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Received event network-vif-plugged-f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:26.872330 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-44892f87-350e-4d1f-bcfc-790132548d6e req-3dcbe7fb-785b-49f6-9dab-2b0b47058247 service nova] Acquiring lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:26.872576 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-44892f87-350e-4d1f-bcfc-790132548d6e req-3dcbe7fb-785b-49f6-9dab-2b0b47058247 service nova] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:26.872732 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-44892f87-350e-4d1f-bcfc-790132548d6e req-3dcbe7fb-785b-49f6-9dab-2b0b47058247 service nova] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:26.873971 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-44892f87-350e-4d1f-bcfc-790132548d6e req-3dcbe7fb-785b-49f6-9dab-2b0b47058247 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Processing event network-vif-plugged-f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:41:26.873971 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-44892f87-350e-4d1f-bcfc-790132548d6e req-3dcbe7fb-785b-49f6-9dab-2b0b47058247 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Received event network-vif-plugged-f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:26.874099 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-44892f87-350e-4d1f-bcfc-790132548d6e req-3dcbe7fb-785b-49f6-9dab-2b0b47058247 service nova] Acquiring lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:26.874358 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-44892f87-350e-4d1f-bcfc-790132548d6e req-3dcbe7fb-785b-49f6-9dab-2b0b47058247 service nova] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:26.874804 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-44892f87-350e-4d1f-bcfc-790132548d6e req-3dcbe7fb-785b-49f6-9dab-2b0b47058247 service nova] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:26.874804 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-44892f87-350e-4d1f-bcfc-790132548d6e req-3dcbe7fb-785b-49f6-9dab-2b0b47058247 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] No waiting events found dispatching network-vif-plugged-f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:41:26.874804 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-44892f87-350e-4d1f-bcfc-790132548d6e req-3dcbe7fb-785b-49f6-9dab-2b0b47058247 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Received unexpected event network-vif-plugged-f8804350-de17-488a-8b3a-f94271e358f5 for instance with vm_state building and task_state spawning.
May 19 04:41:26.876064 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:41:26.880077 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:41:26.882728 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Instance spawned successfully.
May 19 04:41:26.882728 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:41:27.121368 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:41:27.121368 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Cleaning up deleted instances {{(pid=97981) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 19 04:41:27.225100 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:41:27.225833 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165687.2251368, 3ad7c142-5f58-498e-b24c-ea7d4faa1d63 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:41:27.225833 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] VM Resumed (Lifecycle Event)
May 19 04:41:27.392200 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:41:27.392366 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:41:27.392798 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:41:27.393157 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:41:27.394291 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:41:27.394765 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:41:27.624135 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Found WWN 3300000009f63224e for multipath device dm-11 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:41:27.624565 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.036s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:41:27.625052 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] <== connect_volume: return (2037ms) {'type': 'block', 'scsi_wwn': '3300000009f63224e', 'path': '/dev/dm-11', 'multipath_id': '3300000009f63224e'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:41:27.625855 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] There are 0 instances to clean {{(pid=97981) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 19 04:41:27.626609 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009f63224e', 'path': '/dev/dm-11', 'multipath_id': '3300000009f63224e'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:41:27.626669 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.279s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:41:27.627143 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '82d50c4c-3f93-4fc1-adcd-170812ca09de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:41:27.627490 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.49 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:41:27.630615 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'flavor' on Instance uuid 417861ee-dcf2-458b-8782-2ec22d2f5421 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:27.634879 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1b7a7ff1-812d-432e-98bf-a67b2eececd8 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "9fca60a6-f506-4f7f-a987-62c44e75f78f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.730s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:27.642270 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:41:27.642555 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:41:27.642745 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:41:27.646090 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:41:27.646090 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:41:27.646090 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.startup = automatic
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.scan = manual
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:41:27.658547 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:41:27.658547 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.startup = automatic
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.scan = manual
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:41:27.666190 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:41:27.666190 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:27.676543 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:27.689917 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:27.707647 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:27.707647 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:27.707647 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:27.707647 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:27.707647 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:27.707647 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:27.707647 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:27.707647 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:27.707647 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:27.707647 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:27.707647 np0000001025 nova-compute[97981]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91938859-af6c-482c-b081-154f5b352833 (non-flash)
May 19 04:41:27.707647 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:27.707647 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:27.707647 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:41:27.707981 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:27.707981 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:27.707981 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:27.707981 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:27.707981 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:27.707981 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:27.707981 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:27.707981 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:27.707981 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:27.707981 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:27.707981 np0000001025 nova-compute[97981]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91938859-af6c-482c-b081-154f5b352833 (non-flash)
May 19 04:41:27.707981 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:27.707981 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:27.707981 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:41:27.708251 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.066s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:41:27.708251 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:41:27.709014 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] HCTL ('17', '0', '0', 0) found on session 81 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:41:27.709149 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Scanning host 17 c: 0, t: 0, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:41:27.717654 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:27.717654 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:27.717654 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:27.717654 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:27.717654 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:27.717654 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:27.717654 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:27.717654 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:27.717654 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:27.717654 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:27.717654 np0000001025 nova-compute[97981]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91938859-af6c-482c-b081-154f5b352833 (non-flash)
May 19 04:41:27.717654 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:27.717654 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:27.717654 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:41:27.717962 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:27.717962 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:27.717962 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:27.717962 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:27.717962 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:27.717962 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:27.717962 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:27.717962 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:27.717962 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:27.717962 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:27.717962 np0000001025 nova-compute[97981]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91938859-af6c-482c-b081-154f5b352833 (non-flash)
May 19 04:41:27.717962 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:27.717962 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:27.717962 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:41:27.719085 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.075s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:41:27.719085 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:41:27.719085 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Searching for a device in session 81 and hctl ('17', '0', '0', 0) yield: sdl {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:41:27.719085 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '82d50c4c-3f93-4fc1-adcd-170812ca09de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:41:27.720136 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] HCTL ('16', '0', '0', 0) found on session 80 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:41:27.720136 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:41:27.727608 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:27.731114 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:41:27.732611 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Searching for a device in session 80 and hctl ('16', '0', '0', 0) yield: sdk {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:41:27.732775 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '82d50c4c-3f93-4fc1-adcd-170812ca09de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:41:27.902010 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Took 8.84 seconds to spawn the instance on the hypervisor.
May 19 04:41:27.902466 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:28.135914 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Attempting to attach volume 405ea65f-8d17-42c7-922a-dac27a17a488 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:41:28.138409 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:41:28.138409 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:41:28.138409 np0000001025 nova-compute[97981]:   <alias name="ua-405ea65f-8d17-42c7-922a-dac27a17a488"/>
May 19 04:41:28.138409 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-11"/>
May 19 04:41:28.138409 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:41:28.138409 np0000001025 nova-compute[97981]:   <serial>405ea65f-8d17-42c7-922a-dac27a17a488</serial>
May 19 04:41:28.138409 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:41:28.138409 np0000001025 nova-compute[97981]: </disk>
May 19 04:41:28.138409 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:41:28.233335 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:28.236676 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:41:28.416955 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Took 14.72 seconds to build instance.
May 19 04:41:28.646490 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:41:28.919077 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cbd03e6d-764e-435e-8148-75c33dfbb20d tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.226s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:29.669984 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Found WWN 3300000003578c8c9 for multipath device dm-6 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:41:29.670437 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.045s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:41:29.670683 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] <== connect_volume: return (3323ms) {'type': 'block', 'scsi_wwn': '3300000003578c8c9', 'path': '/dev/dm-6', 'multipath_id': '3300000003578c8c9'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:41:29.670904 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003578c8c9', 'path': '/dev/dm-6', 'multipath_id': '3300000003578c8c9'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:41:29.674739 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lazy-loading 'flavor' on Instance uuid 0dbaac9f-71f1-4cb6-837c-cafc38f94f11 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:29.676398 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Snapshot image upload complete
May 19 04:41:29.677134 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:29.811885 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:41:29.811885 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:41:29.811885 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:41:29.813408 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No VIF found with MAC fa:16:3e:b0:9e:6f, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:41:29.903366 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9d4f4292-2427-4ae3-9b56-3e81039c851f req-87046115-3751-464d-8cd9-3a95f8dac32c service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Received event network-changed-f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:29.903457 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9d4f4292-2427-4ae3-9b56-3e81039c851f req-87046115-3751-464d-8cd9-3a95f8dac32c service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Refreshing instance network info cache due to event network-changed-f8804350-de17-488a-8b3a-f94271e358f5. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:41:29.903626 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9d4f4292-2427-4ae3-9b56-3e81039c851f req-87046115-3751-464d-8cd9-3a95f8dac32c service nova] Acquiring lock "refresh_cache-3ad7c142-5f58-498e-b24c-ea7d4faa1d63" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:41:29.903712 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9d4f4292-2427-4ae3-9b56-3e81039c851f req-87046115-3751-464d-8cd9-3a95f8dac32c service nova] Acquired lock "refresh_cache-3ad7c142-5f58-498e-b24c-ea7d4faa1d63" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:41:29.905692 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-9d4f4292-2427-4ae3-9b56-3e81039c851f req-87046115-3751-464d-8cd9-3a95f8dac32c service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Refreshing network info cache for port f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:41:30.178822 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Attempting to attach volume 82d50c4c-3f93-4fc1-adcd-170812ca09de with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:41:30.181003 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:41:30.181003 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:41:30.181003 np0000001025 nova-compute[97981]:   <alias name="ua-82d50c4c-3f93-4fc1-adcd-170812ca09de"/>
May 19 04:41:30.181003 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-6"/>
May 19 04:41:30.181003 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:41:30.181003 np0000001025 nova-compute[97981]:   <serial>82d50c4c-3f93-4fc1-adcd-170812ca09de</serial>
May 19 04:41:30.181003 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:41:30.181003 np0000001025 nova-compute[97981]: </disk>
May 19 04:41:30.181003 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:41:30.187090 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Shelve offloading
May 19 04:41:30.408329 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-9d4f4292-2427-4ae3-9b56-3e81039c851f req-87046115-3751-464d-8cd9-3a95f8dac32c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:30.614466 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:30.614648 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:30.614867 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:30.615039 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:30.615174 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:30.617258 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Terminating instance
May 19 04:41:30.694843 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Instance destroyed successfully.
May 19 04:41:30.695591 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:30.696718 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "refresh_cache-15f0abbc-b8de-4d77-88c4-e5c0e54d691f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:41:30.697845 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquired lock "refresh_cache-15f0abbc-b8de-4d77-88c4-e5c0e54d691f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:41:30.697845 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:41:30.762285 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-9d4f4292-2427-4ae3-9b56-3e81039c851f req-87046115-3751-464d-8cd9-3a95f8dac32c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:30.908942 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-9d4f4292-2427-4ae3-9b56-3e81039c851f req-87046115-3751-464d-8cd9-3a95f8dac32c service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Updated VIF entry in instance network info cache for port f8804350-de17-488a-8b3a-f94271e358f5. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:41:30.909343 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-9d4f4292-2427-4ae3-9b56-3e81039c851f req-87046115-3751-464d-8cd9-3a95f8dac32c service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Updating instance_info_cache with network_info: [{"id": "f8804350-de17-488a-8b3a-f94271e358f5", "address": "fa:16:3e:0c:f0:96", "network": {"id": "3f564857-63e6-46af-9e0f-3a2de30297d4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-951031274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "529ec00acc80453dbe8d6a1295e9eb13", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8804350-de", "ovs_interfaceid": "f8804350-de17-488a-8b3a-f94271e358f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:31.120368 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:41:31.122137 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:41:31.122137 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:41:31.122137 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:41:31.122137 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:41:31.172302 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:31.176713 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:31.191034 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:31.200146 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:31.355460 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:31.368677 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:31.375768 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d9e5533-7cc0-4d68-8904-672cef9b323d tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.554s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:31.414466 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9d4f4292-2427-4ae3-9b56-3e81039c851f req-87046115-3751-464d-8cd9-3a95f8dac32c service nova] Releasing lock "refresh_cache-3ad7c142-5f58-498e-b24c-ea7d4faa1d63" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:41:31.420083 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8c24f9e1-de7f-461e-a1de-7c9f6f57908b req-b5e3cc49-6d4b-4b18-bf50-7f9897969f26 service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Received event network-vif-unplugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:31.420633 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8c24f9e1-de7f-461e-a1de-7c9f6f57908b req-b5e3cc49-6d4b-4b18-bf50-7f9897969f26 service nova] Acquiring lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:31.420865 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8c24f9e1-de7f-461e-a1de-7c9f6f57908b req-b5e3cc49-6d4b-4b18-bf50-7f9897969f26 service nova] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:31.421056 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8c24f9e1-de7f-461e-a1de-7c9f6f57908b req-b5e3cc49-6d4b-4b18-bf50-7f9897969f26 service nova] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:31.421220 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8c24f9e1-de7f-461e-a1de-7c9f6f57908b req-b5e3cc49-6d4b-4b18-bf50-7f9897969f26 service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] No waiting events found dispatching network-vif-unplugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:41:31.421377 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8c24f9e1-de7f-461e-a1de-7c9f6f57908b req-b5e3cc49-6d4b-4b18-bf50-7f9897969f26 service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Received event network-vif-unplugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:41:31.505087 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999495606999972 future=<Future at 0x721834335580 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:31.507067 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Instance destroyed successfully.
May 19 04:41:31.507680 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lazy-loading 'resources' on Instance uuid f6207103-8a47-4cc8-b1e0-c0ffd79e0173 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:31.610774 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:41:31.614173 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:41:31.744137 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:31.798977 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:31.840058 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:41:31.840695 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:41:31.840695 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:41:31.840695 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No VIF found with MAC fa:16:3e:19:9d:73, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:41:31.917375 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Updating instance_info_cache with network_info: [{"id": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "address": "fa:16:3e:19:0f:7d", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa25728-c2", "ovs_interfaceid": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:32.011589 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:40:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-985806649',display_name='tempest-ServerActionsTestOtherA-server-985806649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001025',hostname='tempest-serveractionstestothera-server-985806649',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqj+0kbBWHZ0D/eo4rT8/WyGDsPmK39aJPuM7kZk3S1G8n90+lv56y6gVhWC3CbNq9VY5ET/dAXNaLkqY+SWcJuj+SOKIN1mmus3K/MEswW9TbpiRqq7lxkb6x7vjc6rQ==',key_name='tempest-keypair-762825136',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:40:59Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='336d55ae51114828ba5ad8c0ac87ca9b',ramdisk_id='',reservation_id='r-47cr4ojc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-281327203',owner_user_name='tempest-ServerActionsTestOtherA-281327203-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:41:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6374f2e55af946f9abf35d0c8a1cd206',uuid=f6207103-8a47-4cc8-b1e0-c0ffd79e0173,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "address": "fa:16:3e:91:89:b7", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cbdb78-cc", "ovs_interfaceid": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:41:32.011812 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converting VIF {"id": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "address": "fa:16:3e:91:89:b7", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cbdb78-cc", "ovs_interfaceid": "37cbdb78-cc1c-48e2-879d-959cb26c29f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:41:32.012454 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:89:b7,bridge_name='br-int',has_traffic_filtering=True,id=37cbdb78-cc1c-48e2-879d-959cb26c29f9,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cbdb78-cc') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:41:32.012702 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:89:b7,bridge_name='br-int',has_traffic_filtering=True,id=37cbdb78-cc1c-48e2-879d-959cb26c29f9,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cbdb78-cc') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:41:32.014011 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:32.014383 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37cbdb78-cc, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:32.022558 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:32.023656 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:41:32.024554 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:32.024677 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac7ef7ef-6845-4750-9451-672172c85a08) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:32.025118 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:32.025824 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:41:32.031294 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:32.035944 np0000001025 nova-compute[97981]: INFO os_vif [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:89:b7,bridge_name='br-int',has_traffic_filtering=True,id=37cbdb78-cc1c-48e2-879d-959cb26c29f9,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cbdb78-cc')
May 19 04:41:32.037296 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:41:32.037629 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:41:32.037960 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:41:32.038148 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:41:32.038356 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aed1b29d-163e-4ba7-b0b8-8576d4be428a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:41:32.038524 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:41:32.082259 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:32.082259 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:32.082259 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:32.082259 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:32.082259 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:32.082259 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:32.082259 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:32.082259 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:32.082259 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:32.082259 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:32.082259 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:32.082259 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:32.082259 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:41:32.082547 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:32.082547 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:32.082547 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:32.082547 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:32.082547 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:32.082547 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:32.082547 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:32.082547 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:32.082547 np0000001025 nova-compute[97981]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:32.082547 np0000001025 nova-compute[97981]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a (non-flash)
May 19 04:41:32.082547 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:32.082547 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:32.082547 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:41:32.082761 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '75'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '81'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '95')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:41:32.082761 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '90')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:41:32.084899 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a', '89')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:41:32.084899 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721850741440>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a'): ({'sdg'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:41:32.084899 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Removing multipathed devices sdm, sdg {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:41:32.084899 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Flush multipath device 330000000b0c2b96e {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:41:32.151567 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:41:32.201833 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:41:32.247690 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Checking to see if SCSI volumes sdm, sdg have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:41:32.247867 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] SCSI volumes sdm, sdg have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:41:32.248925 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Checking to see if device paths {'sdm', 'sdg'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:41:32.260454 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Device paths {'sdm', 'sdg'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:41:32.260454 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:41:32.270867 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:32.318562 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 90, target: iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a, portal: 192.168.40.100,3260]
May 19 04:41:32.318562 np0000001025 nova-compute[97981]: Logout of [sid: 90, target: iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a, portal: 192.168.40.100,3260] successful.
May 19 04:41:32.318562 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:32.342038 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:32.352069 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:32.391447 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 89, target: iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a, portal: 192.168.50.100,3260]
May 19 04:41:32.391447 np0000001025 nova-compute[97981]: Logout of [sid: 89, target: iqn.2023-03.storpool.com:os--volume-aed1b29d-163e-4ba7-b0b8-8576d4be428a, portal: 192.168.50.100,3260] successful.
May 19 04:41:32.391447 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:32.410125 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:41:32.410371 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:41:32.410529 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] <== disconnect_volume: return (372ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:41:32.410657 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:41:32.410958 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Deleting instance files /opt/stack/data/nova/instances/f6207103-8a47-4cc8-b1e0-c0ffd79e0173_del
May 19 04:41:32.411867 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Deletion of /opt/stack/data/nova/instances/f6207103-8a47-4cc8-b1e0-c0ffd79e0173_del complete
May 19 04:41:32.419960 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Releasing lock "refresh_cache-15f0abbc-b8de-4d77-88c4-e5c0e54d691f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:41:32.420293 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:32.420547 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:32.921839 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Took 1.80 seconds to destroy the instance on the hypervisor.
May 19 04:41:32.922499 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:41:32.922677 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:41:32.923035 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:41:32.923035 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:32.981086 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:32.988627 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Instance destroyed successfully.
May 19 04:41:32.989253 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'resources' on Instance uuid 15f0abbc-b8de-4d77-88c4-e5c0e54d691f {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:33.030877 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d0a6f0d4-e4e1-44a3-baa6-7e8d35f696cb req-fb49f510-b023-4d7e-9c66-9b183973a3ff service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Received event network-changed-7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:33.030972 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d0a6f0d4-e4e1-44a3-baa6-7e8d35f696cb req-fb49f510-b023-4d7e-9c66-9b183973a3ff service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Refreshing instance network info cache due to event network-changed-7aa25728-c226-4d2c-ac7a-d5a1edf94739. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:41:33.031148 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d0a6f0d4-e4e1-44a3-baa6-7e8d35f696cb req-fb49f510-b023-4d7e-9c66-9b183973a3ff service nova] Acquiring lock "refresh_cache-15f0abbc-b8de-4d77-88c4-e5c0e54d691f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:41:33.032565 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d0a6f0d4-e4e1-44a3-baa6-7e8d35f696cb req-fb49f510-b023-4d7e-9c66-9b183973a3ff service nova] Acquired lock "refresh_cache-15f0abbc-b8de-4d77-88c4-e5c0e54d691f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:41:33.032917 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d0a6f0d4-e4e1-44a3-baa6-7e8d35f696cb req-fb49f510-b023-4d7e-9c66-9b183973a3ff service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Refreshing network info cache for port 7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:41:33.235415 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:33.404059 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-184f7ff4-b256-4314-8785-b53bbb503bb1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.773s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:33.408002 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Stashing vm_state: active {{(pid=97981) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 19 04:41:33.494082 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Object Instance<15f0abbc-b8de-4d77-88c4-e5c0e54d691f> lazy-loaded attributes: numa_topology,resources {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:41:33.494862 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:40:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-395626849',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumeshelvetestjson-server-395626849',id=35,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrCQLYSDh4BSAKuJQO3lgIeQcxBF4rxRleMAE4CBnW4YvXO/MjPLM9cnsN7Cu0cFPOG4awlQsAI62nW05tLJ3lA9gst1KdtxXP1kupL4rfaIsrpVkX58JAXH5lwrYvyBw==',key_name='tempest-keypair-802114952',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:40:41Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8a3dfff83ce24e619f87507f951f6c69',ramdisk_id='',reservation_id='r-43nv4a6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-51274594',owner_user_name='tempest-AttachVolumeShelveTestJSON-51274594-project-member',shelved_at='2026-05-19T04:41:29.676435',shelved_host='np0000001025',shelved_image_id='da23d3e3-0897-4260-901f-5bd9dcc3cce2'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:41:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7955853f574d42e58ba89f18ed109760',uuid=15f0abbc-b8de-4d77-88c4-e5c0e54d691f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "address": "fa:16:3e:19:0f:7d", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa25728-c2", "ovs_interfaceid": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:41:33.495197 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converting VIF {"id": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "address": "fa:16:3e:19:0f:7d", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa25728-c2", "ovs_interfaceid": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:41:33.495516 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:0f:7d,bridge_name='br-int',has_traffic_filtering=True,id=7aa25728-c226-4d2c-ac7a-d5a1edf94739,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa25728-c2') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:41:33.495745 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:0f:7d,bridge_name='br-int',has_traffic_filtering=True,id=7aa25728-c226-4d2c-ac7a-d5a1edf94739,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa25728-c2') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:41:33.496674 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:33.496882 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7aa25728-c2, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:33.498196 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:33.501886 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:41:33.503538 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:33.503844 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ba659ac-adcc-45c3-8043-55bc5a832515) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:33.506987 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:33.507898 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:41:33.509435 np0000001025 nova-compute[97981]: INFO os_vif [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:0f:7d,bridge_name='br-int',has_traffic_filtering=True,id=7aa25728-c226-4d2c-ac7a-d5a1edf94739,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa25728-c2')
May 19 04:41:33.509893 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Deleting instance files /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f_del
May 19 04:41:33.515010 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Deletion of /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f_del complete
May 19 04:41:33.535225 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-d0a6f0d4-e4e1-44a3-baa6-7e8d35f696cb req-fb49f510-b023-4d7e-9c66-9b183973a3ff service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:33.616656 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:41:33.650283 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6c454af8-ae35-40aa-b5c0-052fd27612f2 req-c5113134-6d3f-42a6-b4dc-1573be3ffc3c service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Received event network-vif-unplugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:33.651473 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6c454af8-ae35-40aa-b5c0-052fd27612f2 req-c5113134-6d3f-42a6-b4dc-1573be3ffc3c service nova] Acquiring lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:33.652002 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6c454af8-ae35-40aa-b5c0-052fd27612f2 req-c5113134-6d3f-42a6-b4dc-1573be3ffc3c service nova] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:33.652058 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6c454af8-ae35-40aa-b5c0-052fd27612f2 req-c5113134-6d3f-42a6-b4dc-1573be3ffc3c service nova] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:33.652557 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6c454af8-ae35-40aa-b5c0-052fd27612f2 req-c5113134-6d3f-42a6-b4dc-1573be3ffc3c service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] No waiting events found dispatching network-vif-unplugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:41:33.652557 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6c454af8-ae35-40aa-b5c0-052fd27612f2 req-c5113134-6d3f-42a6-b4dc-1573be3ffc3c service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Received event network-vif-unplugged-37cbdb78-cc1c-48e2-879d-959cb26c29f9 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:41:33.885837 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:33.886019 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:33.929945 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-d0a6f0d4-e4e1-44a3-baa6-7e8d35f696cb req-fb49f510-b023-4d7e-9c66-9b183973a3ff service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:33.972368 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:33.972573 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:34.103085 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d0a6f0d4-e4e1-44a3-baa6-7e8d35f696cb req-fb49f510-b023-4d7e-9c66-9b183973a3ff service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Updated VIF entry in instance network info cache for port 7aa25728-c226-4d2c-ac7a-d5a1edf94739. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:41:34.103438 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d0a6f0d4-e4e1-44a3-baa6-7e8d35f696cb req-fb49f510-b023-4d7e-9c66-9b183973a3ff service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Updating instance_info_cache with network_info: [{"id": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "address": "fa:16:3e:19:0f:7d", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7aa25728-c2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:34.107868 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Deleted allocations for instance 15f0abbc-b8de-4d77-88c4-e5c0e54d691f
May 19 04:41:34.128321 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:41:34.321733 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:34.390550 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:41:34.479068 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:41:34.479258 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Claim successful on node np0000001025
May 19 04:41:34.605335 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d0a6f0d4-e4e1-44a3-baa6-7e8d35f696cb req-fb49f510-b023-4d7e-9c66-9b183973a3ff service nova] Releasing lock "refresh_cache-15f0abbc-b8de-4d77-88c4-e5c0e54d691f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:41:34.614629 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:34.824620 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Took 1.90 seconds to deallocate network for instance.
May 19 04:41:34.942052 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:34.986467 np0000001025 nova-compute[97981]: INFO nova.compute.resource_tracker [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Updating resource usage from migration 764a078a-b090-4b69-b61b-fd2f0d233e5e
May 19 04:41:35.126719 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:41:35.127091 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.48 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:41:35.387465 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Took 0.56 seconds to detach 1 volumes for instance.
May 19 04:41:35.391334 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Deleting volume: aed1b29d-163e-4ba7-b0b8-8576d4be428a {{(pid=97981) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 19 04:41:35.611064 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:41:35.611064 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:41:35.616436 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:41:35.616718 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:41:35.758507 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-62d9a54e-5b19-4715-91bf-326db819a455 req-077a6d9d-208e-464e-8e03-6fb0c4fc3d1a service nova] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Received event network-vif-deleted-37cbdb78-cc1c-48e2-879d-959cb26c29f9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:35.760199 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0023701300001448544 future=<Future at 0x721834364560 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:35.760449 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:35.760620 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=3.5200019200001407 future=<Future at 0x721850602180 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:35.761479 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=3.519362542999943 future=<Future at 0x721850602180 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:35.762133 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Emitting event <LifecycleEvent: 1779165680.7576904, 9fca60a6-f506-4f7f-a987-62c44e75f78f => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:41:35.762401 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] VM Stopped (Lifecycle Event)
May 19 04:41:35.765150 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:41:35.765345 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:41:35.950535 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:36.181781 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-01c4403b-9bba-46ea-a2ad-f7b422a9962b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:36.182012 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-01c4403b-9bba-46ea-a2ad-f7b422a9962b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:36.268282 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 9fca60a6-f506-4f7f-a987-62c44e75f78f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:36.268975 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:41:36.684222 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-01c4403b-9bba-46ea-a2ad-f7b422a9962b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Detaching volume 82d50c4c-3f93-4fc1-adcd-170812ca09de
May 19 04:41:36.729674 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-01c4403b-9bba-46ea-a2ad-f7b422a9962b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Attempting to driver detach volume 82d50c4c-3f93-4fc1-adcd-170812ca09de from mountpoint /dev/vdb
May 19 04:41:36.736583 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-01c4403b-9bba-46ea-a2ad-f7b422a9962b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Found disk vdb by alias ua-82d50c4c-3f93-4fc1-adcd-170812ca09de {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:41:36.737749 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-01c4403b-9bba-46ea-a2ad-f7b422a9962b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Found disk vdb by alias ua-82d50c4c-3f93-4fc1-adcd-170812ca09de {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:41:36.737892 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-01c4403b-9bba-46ea-a2ad-f7b422a9962b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Attempting to detach device vdb from instance 0dbaac9f-71f1-4cb6-837c-cafc38f94f11 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:41:36.738215 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-01c4403b-9bba-46ea-a2ad-f7b422a9962b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:41:36.738215 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:41:36.738215 np0000001025 nova-compute[97981]:   <alias name="ua-82d50c4c-3f93-4fc1-adcd-170812ca09de"/>
May 19 04:41:36.738215 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-6"/>
May 19 04:41:36.738215 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:41:36.738215 np0000001025 nova-compute[97981]:   <serial>82d50c4c-3f93-4fc1-adcd-170812ca09de</serial>
May 19 04:41:36.738215 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:41:36.738215 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:41:36.738215 np0000001025 nova-compute[97981]: </disk>
May 19 04:41:36.738215 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:41:36.744028 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-01c4403b-9bba-46ea-a2ad-f7b422a9962b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Successfully detached device vdb from instance 0dbaac9f-71f1-4cb6-837c-cafc38f94f11 from the persistent domain config.
May 19 04:41:36.744285 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-01c4403b-9bba-46ea-a2ad-f7b422a9962b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] (1/8): Attempting to detach device vdb with device alias ua-82d50c4c-3f93-4fc1-adcd-170812ca09de from instance 0dbaac9f-71f1-4cb6-837c-cafc38f94f11 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:41:36.744476 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-01c4403b-9bba-46ea-a2ad-f7b422a9962b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:41:36.744476 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:41:36.744476 np0000001025 nova-compute[97981]:   <alias name="ua-82d50c4c-3f93-4fc1-adcd-170812ca09de"/>
May 19 04:41:36.744476 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-6"/>
May 19 04:41:36.744476 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:41:36.744476 np0000001025 nova-compute[97981]:   <serial>82d50c4c-3f93-4fc1-adcd-170812ca09de</serial>
May 19 04:41:36.744476 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:41:36.744476 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:41:36.744476 np0000001025 nova-compute[97981]: </disk>
May 19 04:41:36.744476 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:41:36.776594 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.804s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:36.778279 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Migrating
May 19 04:41:36.778279 np0000001025 nova-compute[97981]: DEBUG nova.compute.rpcapi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97981) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 19 04:41:36.783740 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.169s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:37.308946 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:41:37.308946 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquired lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:41:37.308946 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:41:37.352238 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165697.3514998, 0dbaac9f-71f1-4cb6-837c-cafc38f94f11 => ua-82d50c4c-3f93-4fc1-adcd-170812ca09de> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:41:37.352503 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-01c4403b-9bba-46ea-a2ad-f7b422a9962b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-82d50c4c-3f93-4fc1-adcd-170812ca09de for instance 0dbaac9f-71f1-4cb6-837c-cafc38f94f11 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:41:37.355179 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-01c4403b-9bba-46ea-a2ad-f7b422a9962b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Successfully detached device vdb from instance 0dbaac9f-71f1-4cb6-837c-cafc38f94f11 from the live domain config.
May 19 04:41:37.420174 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:41:37.420401 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:41:37.504381 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:37.614865 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:41:37.615098 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:41:37.615254 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:41:37.756462 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:37.813259 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:37.922804 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-01c4403b-9bba-46ea-a2ad-f7b422a9962b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Detected multiple connections on this host for volume: 82d50c4c-3f93-4fc1-adcd-170812ca09de, skipping target disconnect.
May 19 04:41:37.924690 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:41:38.126173 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:38.236498 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:38.238221 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:38.413789 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Updating instance_info_cache with network_info: [{"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:38.443233 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.659s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:38.447382 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.502s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:38.454882 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:41:38.454882 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Claim successful on node np0000001025
May 19 04:41:38.504083 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-01c4403b-9bba-46ea-a2ad-f7b422a9962b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lazy-loading 'flavor' on Instance uuid 0dbaac9f-71f1-4cb6-837c-cafc38f94f11 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:38.508368 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:38.917135 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Releasing lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:41:38.952322 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d32d1a3-541c-41f7-ae83-37aa5f6968d2 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 16.110s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:38.954667 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 1.198s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:38.954893 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Unshelving
May 19 04:41:39.281387 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00079360299992004 future=<Future at 0x721850602180 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:39.281483 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:39.281551 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=7.222516499999983 future=<Future at 0x721834335580 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:39.281625 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=7.222420499999998 future=<Future at 0x721834335580 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:39.282772 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Emitting event <LifecycleEvent: 1779165684.2804763, 15f0abbc-b8de-4d77-88c4-e5c0e54d691f => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:41:39.282945 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] VM Stopped (Lifecycle Event)
May 19 04:41:39.291714 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:39.484955 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:39.511681 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-01c4403b-9bba-46ea-a2ad-f7b422a9962b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.330s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:39.513079 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.027s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:39.513408 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:39.513613 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:39.513777 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:39.516063 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Terminating instance
May 19 04:41:39.785663 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:40.023489 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:41:40.035819 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:40.047397 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:40.055136 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:40.077070 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:40.152524 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:41:40.152749 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:41:40.189449 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:40.194632 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:40.354919 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999707200000103 future=<Future at 0x721850735af0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:40.361937 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Instance destroyed successfully.
May 19 04:41:40.361937 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lazy-loading 'resources' on Instance uuid 0dbaac9f-71f1-4cb6-837c-cafc38f94f11 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:40.432093 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Starting migrate_disk_and_power_off {{(pid=97981) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 19 04:41:40.456728 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:40.464810 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:40.485402 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:40.592536 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:40.602395 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:40.655026 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:41:40.769263 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999737180000011 future=<Future at 0x7218344d85c0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:40.769786 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Instance destroyed successfully.
May 19 04:41:40.770819 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='multiattach-server-0',id=37,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9kq9UfoFPrqlSUYASLa2M8/KXwpiWIksTRz6r+vXFFf5G7djO79flSW+4jvUEBmYvioxzxvTch1hKVIwlMIaMSuT3AyUPlX/5ZPn59wF6pdcyyqAHuNzAVPjAjiGd+6A==',key_name='tempest-keypair-818275091',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:40:51Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-ksq0p58y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:41:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa432d60cb324c6d87818107e05e0053',uuid=6f26313e-2659-4687-84da-96cf2da9a4e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "vif_mac": "fa:16:3e:fa:d4:f0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:41:40.772148 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "vif_mac": "fa:16:3e:fa:d4:f0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:41:40.772148 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:d4:f0,bridge_name='br-int',has_traffic_filtering=True,id=9791a107-963b-4608-9092-2df622d06125,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9791a107-96') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:41:40.772148 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:d4:f0,bridge_name='br-int',has_traffic_filtering=True,id=9791a107-963b-4608-9092-2df622d06125,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9791a107-96') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:41:40.772992 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:40.773211 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9791a107-96, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:40.774966 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:40.776418 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:41:40.779706 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:40.780806 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:40.781043 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b33104e9-a511-4097-b92b-19a674c61ab9) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:40.782424 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:41:40.786917 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:40.789171 np0000001025 nova-compute[97981]: INFO os_vif [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:d4:f0,bridge_name='br-int',has_traffic_filtering=True,id=9791a107-963b-4608-9092-2df622d06125,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9791a107-96')
May 19 04:41:40.868316 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1934719110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumemultiattachtests-server-1934719110',id=36,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhD1xUGbzXEFTpwLqV7IdahQdRsxUTWfjsap1G2V5FlaOoCCsM3NvS7ZgZ3Tks73vH5y6V2PuKxg4zJpt6nENVtmQis2Ldrn3RUIJ9Ob13Jj154qwicTD8P/PfTnb2SSg==',key_name='tempest-keypair-883733818',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:40:44Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e0c7a19a41a44fba4c0fca71022a5a1',ramdisk_id='',reservation_id='r-l7fo2szi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1349332830',owner_user_name='tempest-VolumeMultiattachTests-1349332830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:40:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93a5d16bed8c474fa58e1982fa784db9',uuid=0dbaac9f-71f1-4cb6-837c-cafc38f94f11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b74663e-9ccd-4251-97fd-0eca225719e2", "address": "fa:16:3e:19:9d:73", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74663e-9c", "ovs_interfaceid": "6b74663e-9ccd-4251-97fd-0eca225719e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:41:40.868316 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Converting VIF {"id": "6b74663e-9ccd-4251-97fd-0eca225719e2", "address": "fa:16:3e:19:9d:73", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74663e-9c", "ovs_interfaceid": "6b74663e-9ccd-4251-97fd-0eca225719e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:41:40.868316 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:9d:73,bridge_name='br-int',has_traffic_filtering=True,id=6b74663e-9ccd-4251-97fd-0eca225719e2,network=Network(c948b992-32a1-4652-a328-d2d326ea9148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b74663e-9c') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:41:40.868316 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:9d:73,bridge_name='br-int',has_traffic_filtering=True,id=6b74663e-9ccd-4251-97fd-0eca225719e2,network=Network(c948b992-32a1-4652-a328-d2d326ea9148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b74663e-9c') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:41:40.868316 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:40.868316 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b74663e-9c, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:40.869185 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:40.870189 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:41:40.871356 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:40.872463 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:40.872667 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=588b93bd-795c-490a-9396-0180fd1b0335) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:40.875188 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:41:40.878350 np0000001025 nova-compute[97981]: INFO os_vif [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:9d:73,bridge_name='br-int',has_traffic_filtering=True,id=6b74663e-9ccd-4251-97fd-0eca225719e2,network=Network(c948b992-32a1-4652-a328-d2d326ea9148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b74663e-9c')
May 19 04:41:40.913176 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:41:40.915813 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '82d50c4c-3f93-4fc1-adcd-170812ca09de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:41:40.915813 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:41:40.915813 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:41:40.915813 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '82d50c4c-3f93-4fc1-adcd-170812ca09de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:41:40.915813 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:41:40.934799 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e45a35b5-6128-4eed-9e3d-9489dded5193 req-88d9cb10-a1a3-4648-b7b6-90b7e901ad35 service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Received event network-vif-unplugged-6b74663e-9ccd-4251-97fd-0eca225719e2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:40.935748 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e45a35b5-6128-4eed-9e3d-9489dded5193 req-88d9cb10-a1a3-4648-b7b6-90b7e901ad35 service nova] Acquiring lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:40.935748 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e45a35b5-6128-4eed-9e3d-9489dded5193 req-88d9cb10-a1a3-4648-b7b6-90b7e901ad35 service nova] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:40.935748 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e45a35b5-6128-4eed-9e3d-9489dded5193 req-88d9cb10-a1a3-4648-b7b6-90b7e901ad35 service nova] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:40.935748 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e45a35b5-6128-4eed-9e3d-9489dded5193 req-88d9cb10-a1a3-4648-b7b6-90b7e901ad35 service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] No waiting events found dispatching network-vif-unplugged-6b74663e-9ccd-4251-97fd-0eca225719e2 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:41:40.935748 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e45a35b5-6128-4eed-9e3d-9489dded5193 req-88d9cb10-a1a3-4648-b7b6-90b7e901ad35 service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Received event network-vif-unplugged-6b74663e-9ccd-4251-97fd-0eca225719e2 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:41:40.949140 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:40.949140 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:40.949140 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:40.949140 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:40.949140 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:40.949140 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:40.949140 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:40.949140 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:40.949140 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:40.949140 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:40.949140 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:41:40.949140 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:41:40.949661 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:40.949661 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:41:40.949661 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:40.949661 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:41:40.949661 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:40.949661 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:41:40.949661 np0000001025 nova-compute[97981]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:40.949661 np0000001025 nova-compute[97981]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de (non-flash)
May 19 04:41:40.949661 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:40.949661 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:41:40.949661 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:41:40.949661 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:41:40.949661 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '75'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '81'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f', '96')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:41:40.949661 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '81')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:41:40.951068 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', '80')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:41:40.951914 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185025de40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de'): ({'sdk'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:41:40.952145 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Removing multipathed devices sdk, sdl {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:41:40.952391 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Flush multipath device 3300000003578c8c9 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:41:41.163391 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.720s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:41.164273 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 5.213s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:41.164528 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:41:41.168728 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.005s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:41.170720 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 3.045s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:41.171031 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:41.171249 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:41:41.171879 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.138s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:41.173866 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'pci_requests' on Instance uuid 15f0abbc-b8de-4d77-88c4-e5c0e54d691f {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:41.254292 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Deleted allocations for instance f6207103-8a47-4cc8-b1e0-c0ffd79e0173
May 19 04:41:41.324914 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Detected multiple connections on this host for volume: 405ea65f-8d17-42c7-922a-dac27a17a488, skipping target disconnect.
May 19 04:41:41.327702 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:41.438878 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:41.443656 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:41.540288 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:41.540686 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:41:41.541269 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2_resize/disk /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:41.641842 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "cp -r /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2_resize/disk /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk" returned: 0 in 0.100s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:41.642568 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2_resize/disk.config /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk.config {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:41.677049 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:41:41.680782 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:41:41.680782 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:41.680782 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:41.686405 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'numa_topology' on Instance uuid 15f0abbc-b8de-4d77-88c4-e5c0e54d691f {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:41.693640 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "cp -r /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2_resize/disk.config /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk.config" returned: 0 in 0.051s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:41.694075 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2_resize/disk.info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk.info {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:41.746456 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "cp -r /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2_resize/disk.info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk.info" returned: 0 in 0.052s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:41.784866 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c46088fb3e74b819bb456461716a801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b3c0fa8f894ed2a7c3bcfac99ce74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:41:42.195008 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:41:42.199057 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:41:42.199257 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Claim successful on node np0000001025
May 19 04:41:42.230522 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:42.252454 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Successfully created port: b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:41:42.271992 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-167a09d9-e077-4701-921e-472efc440906 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "f6207103-8a47-4cc8-b1e0-c0ffd79e0173" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.657s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:42.347861 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:42.348277 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:42.438750 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:42.439390 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-14 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:41:42.439675 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-0 (vdc) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:41:42.440555 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-6 (vdd) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:41:42.447128 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:42.485336 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:42.537357 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:42.538586 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:42.647416 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:42.652405 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:41:42.654590 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:42.703375 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:41:42.769033 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:42.769704 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:42.823399 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Successfully updated port: b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:41:42.874206 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:42.881206 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:42.913470 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:42.914087 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:42.999805 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:43.000245 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:43.024410 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Port 9791a107-963b-4608-9092-2df622d06125 binding to destination host np0000001025 is already ACTIVE {{(pid=97981) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}}
May 19 04:41:43.041337 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Received event network-vif-unplugged-6b74663e-9ccd-4251-97fd-0eca225719e2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:43.050429 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] Acquiring lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:43.052162 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:43.052289 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:43.053271 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] No waiting events found dispatching network-vif-unplugged-6b74663e-9ccd-4251-97fd-0eca225719e2 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:41:43.053464 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Received event network-vif-unplugged-6b74663e-9ccd-4251-97fd-0eca225719e2 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:41:43.053629 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Received event network-vif-unplugged-9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:43.053855 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] Acquiring lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:43.053942 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:43.054082 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:43.055274 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] No waiting events found dispatching network-vif-unplugged-9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:41:43.055487 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Received unexpected event network-vif-unplugged-9791a107-963b-4608-9092-2df622d06125 for instance with vm_state active and task_state resize_migrating.
May 19 04:41:43.055717 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Received event network-vif-unplugged-9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:43.056525 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] Acquiring lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:43.056525 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:43.056525 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:43.056525 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] No waiting events found dispatching network-vif-unplugged-9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:41:43.056525 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Received unexpected event network-vif-unplugged-9791a107-963b-4608-9092-2df622d06125 for instance with vm_state active and task_state resize_migrating.
May 19 04:41:43.056525 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Received event network-changed-b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:43.057019 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Refreshing instance network info cache due to event network-changed-b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:41:43.057019 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] Acquiring lock "refresh_cache-54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:41:43.057019 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] Acquired lock "refresh_cache-54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:41:43.057019 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Refreshing network info cache for port b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:41:43.106316 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:43.106641 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:41:43.109943 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:43.203915 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:43.204398 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:43.223060 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Booting with volume 97cb7b11-9118-4b51-9829-98f5aa82dbfd at /dev/vda
May 19 04:41:43.240381 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:43.277964 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:41:43.290129 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:41:43.298914 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:43.299368 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:41:43.303257 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:43.325234 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:43.327624 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "refresh_cache-54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:41:43.371565 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:41:43.373168 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:41:43.381643 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:41:43.383124 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:febc:2008', 'fe80::b033:dbff:fe9c:82c1', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fea1:aa43', 'fe80::fc16:3eff:feb0:9e6f', 'fe80::fc16:3eff:fe0c:f096', 'fe80::8849:6dff:fe86:4a4b'] 
May 19 04:41:43.383321 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:41:43.383499 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:41:43.383817 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:41:43.384118 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Updating existing volume attachment record: 96bbfe6e-1a57-4be6-b15a-072689350b12 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:41:43.397180 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:43.398070 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:43.490894 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:43.494986 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:43.561524 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:43.597140 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:43.598067 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:43.692981 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:41:43.704790 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:43.708621 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:43.808130 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:43.808593 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:43.914942 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:43.918778 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:41:43.920448 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:43.953955 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:43.980807 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.060s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:43.981599 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=11376MB free_disk=73.10749816894531GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:41:43.981599 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:44.040642 np0000001025 nova-compute[97981]: DEBUG nova.compute.rpcapi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97981) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 19 04:41:44.063821 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:44.063821 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:44.064059 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:44.247321 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:41:44.247727 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:41:44.462794 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-93906c00-155a-4b5c-af90-ba88fa9c5dd0 req-5fce0849-518d-49f0-9ba6-8a7d1bc5c618 service nova] Releasing lock "refresh_cache-54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:41:44.463377 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquired lock "refresh_cache-54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:41:44.463548 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:41:44.697488 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "5951341b-0ad5-4fb0-82ad-b464c081f37f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:44.699617 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "5951341b-0ad5-4fb0-82ad-b464c081f37f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:44.699617 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "5951341b-0ad5-4fb0-82ad-b464c081f37f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:44.699617 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "5951341b-0ad5-4fb0-82ad-b464c081f37f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:44.699617 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "5951341b-0ad5-4fb0-82ad-b464c081f37f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:44.701635 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Terminating instance
May 19 04:41:44.753135 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:41:45.034668 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:41:45.076688 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:45.130432 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:45.151537 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:41:45.151691 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquired lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:41:45.151818 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:41:45.205568 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:41:45.229884 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:45.233455 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:45.263883 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 4.092s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:45.264612 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:45.270020 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.288s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:45.270020 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:45.278839 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:45.290813 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:45.294850 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:45.353289 np0000001025 nova-compute[97981]: INFO nova.network.neutron [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Updating port 7aa25728-c226-4d2c-ac7a-d5a1edf94739 with attributes {'binding:host_id': 'np0000001025', 'device_owner': 'compute:nova'}
May 19 04:41:45.458834 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Updating instance_info_cache with network_info: [{"id": "b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de", "address": "fa:16:3e:b6:da:78", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3cbfbfe-4f", "ovs_interfaceid": "b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:45.514892 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:41:45.517363 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:41:45.517363 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Creating image(s)
May 19 04:41:45.517363 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:41:45.518009 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Ensure instance console log exists: /opt/stack/data/nova/instances/54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:41:45.518355 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:45.519087 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:45.519332 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:45.529721 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999692162999963 future=<Future at 0x721850655ca0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:45.531376 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Instance destroyed successfully.
May 19 04:41:45.531810 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lazy-loading 'resources' on Instance uuid 5951341b-0ad5-4fb0-82ad-b464c081f37f {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:45.656532 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:45.838188 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "refresh_cache-15f0abbc-b8de-4d77-88c4-e5c0e54d691f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:41:45.838343 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquired lock "refresh_cache-15f0abbc-b8de-4d77-88c4-e5c0e54d691f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:41:45.838399 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:41:45.873889 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:45.887003 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4271dc88-f751-4d0f-adc5-fa23ad21b696 req-a86b7982-6961-4972-b7e9-369561175e2c service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Received event network-changed-7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:45.888342 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4271dc88-f751-4d0f-adc5-fa23ad21b696 req-a86b7982-6961-4972-b7e9-369561175e2c service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Refreshing instance network info cache due to event network-changed-7aa25728-c226-4d2c-ac7a-d5a1edf94739. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:41:45.888342 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4271dc88-f751-4d0f-adc5-fa23ad21b696 req-a86b7982-6961-4972-b7e9-369561175e2c service nova] Acquiring lock "refresh_cache-15f0abbc-b8de-4d77-88c4-e5c0e54d691f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:41:45.921102 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:45.961500 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Releasing lock "refresh_cache-54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:41:45.961629 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Instance network_info: |[{"id": "b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de", "address": "fa:16:3e:b6:da:78", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3cbfbfe-4f", "ovs_interfaceid": "b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:41:45.962228 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Start _get_guest_xml network_info=[{"id": "b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de", "address": "fa:16:3e:b6:da:78", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3cbfbfe-4f", "ovs_interfaceid": "b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '96bbfe6e-1a57-4be6-b15a-072689350b12', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97cb7b11-9118-4b51-9829-98f5aa82dbfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8', 'attached_at': '', 'detached_at': '', 'volume_id': '97cb7b11-9118-4b51-9829-98f5aa82dbfd', 'serial': '97cb7b11-9118-4b51-9829-98f5aa82dbfd'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:41:45.963961 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:41:45.964944 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-volume-backed-server-900232716', uuid='54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8'), owner=OwnerMeta(userid='5c46088fb3e74b819bb456461716a801', username='tempest-TestVolumeBootPattern-1071176852-project-member', projectid='28b3c0fa8f894ed2a7c3bcfac99ce74c', projectname='tempest-TestVolumeBootPattern-1071176852'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de", "address": "fa:16:3e:b6:da:78", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3cbfbfe-4f", "ovs_interfaceid": "b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165705.9646635) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:41:45.965923 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:41:45.966258 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:41:45.966965 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:41:45.967171 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:41:45.968041 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:41:45.968438 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:41:45.968438 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:41:45.968537 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:41:45.968643 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:41:45.968718 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:41:45.968803 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:41:45.968941 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:41:45.969049 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:41:45.969166 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:41:45.969265 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:41:45.969370 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:41:45.982604 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:41:45.983103 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97cb7b11-9118-4b51-9829-98f5aa82dbfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:41:45.983296 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:41:46.036194 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-907040062',display_name='tempest-ServerActionsTestOtherA-server-907040062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serveractionstestothera-server-907040062',id=18,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqj+0kbBWHZ0D/eo4rT8/WyGDsPmK39aJPuM7kZk3S1G8n90+lv56y6gVhWC3CbNq9VY5ET/dAXNaLkqY+SWcJuj+SOKIN1mmus3K/MEswW9TbpiRqq7lxkb6x7vjc6rQ==',key_name='tempest-keypair-762825136',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:37:13Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='336d55ae51114828ba5ad8c0ac87ca9b',ramdisk_id='',reservation_id='r-vmxfumpp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-281327203',owner_user_name='tempest-ServerActionsTestOtherA-281327203-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:37:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6374f2e55af946f9abf35d0c8a1cd206',uuid=5951341b-0ad5-4fb0-82ad-b464c081f37f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "198ee052-a44f-474c-87e1-409937e2e3c2", "address": "fa:16:3e:bc:20:08", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap198ee052-a4", "ovs_interfaceid": "198ee052-a44f-474c-87e1-409937e2e3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:41:46.036405 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converting VIF {"id": "198ee052-a44f-474c-87e1-409937e2e3c2", "address": "fa:16:3e:bc:20:08", "network": {"id": "79d15fc0-0627-47d2-8b8e-3c4f198a07e8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-906047595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "336d55ae51114828ba5ad8c0ac87ca9b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap198ee052-a4", "ovs_interfaceid": "198ee052-a44f-474c-87e1-409937e2e3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:41:46.037136 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:20:08,bridge_name='br-int',has_traffic_filtering=True,id=198ee052-a44f-474c-87e1-409937e2e3c2,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap198ee052-a4') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:41:46.037343 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:20:08,bridge_name='br-int',has_traffic_filtering=True,id=198ee052-a44f-474c-87e1-409937e2e3c2,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap198ee052-a4') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:41:46.038556 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:46.038817 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap198ee052-a4, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:46.040843 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:46.042221 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:41:46.042356 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:46.043894 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:46.043894 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88210ff4-9050-4cb2-84fe-0738a49b4160) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:46.045941 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Updating instance_info_cache with network_info: [{"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:46.047252 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:41:46.049068 np0000001025 nova-compute[97981]: INFO os_vif [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:20:08,bridge_name='br-int',has_traffic_filtering=True,id=198ee052-a44f-474c-87e1-409937e2e3c2,network=Network(79d15fc0-0627-47d2-8b8e-3c4f198a07e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap198ee052-a4')
May 19 04:41:46.049352 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Deleting instance files /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f_del
May 19 04:41:46.050058 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Deletion of /opt/stack/data/nova/instances/5951341b-0ad5-4fb0-82ad-b464c081f37f_del complete
May 19 04:41:46.285502 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Applying migration context for instance 6f26313e-2659-4687-84da-96cf2da9a4e2 as it has an incoming, in-progress migration 764a078a-b090-4b69-b61b-fd2f0d233e5e. Migration status is post-migrating {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 19 04:41:46.286771 np0000001025 nova-compute[97981]: INFO nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Updating resource usage from migration 764a078a-b090-4b69-b61b-fd2f0d233e5e
May 19 04:41:46.330841 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 5951341b-0ad5-4fb0-82ad-b464c081f37f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:41:46.332156 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance aa2cdf1d-65ef-4cf4-b742-72ae783cde27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:41:46.332156 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 32cc5240-7a56-4cee-9b41-54e17386b39f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:41:46.332156 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance b32b8038-72c4-443c-aea3-07cd61ad67f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:41:46.332156 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance e644a772-cf7c-4b15-b21b-ea54e773a1f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:41:46.332156 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 0dbaac9f-71f1-4cb6-837c-cafc38f94f11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:41:46.332156 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 417861ee-dcf2-458b-8782-2ec22d2f5421 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:41:46.332156 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 3ad7c142-5f58-498e-b24c-ea7d4faa1d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:41:46.332156 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Migration 764a078a-b090-4b69-b61b-fd2f0d233e5e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 19 04:41:46.332457 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 6f26313e-2659-4687-84da-96cf2da9a4e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:41:46.332457 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:41:46.332597 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 15f0abbc-b8de-4d77-88c4-e5c0e54d691f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:41:46.332875 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:41:46.333079 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=2880MB phys_disk=95GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:41:43 up 32 min,  2 users,  load average: 6.73, 6.57, 3.79\n', 'num_instances': '11', 'num_vm_active': '9', 'num_task_deleting': '2', 'num_os_type_None': '11', 'num_proj_336d55ae51114828ba5ad8c0ac87ca9b': '1', 'io_workload': '1', 'num_task_None': '6', 'num_proj_7e0c7a19a41a44fba4c0fca71022a5a1': '2', 'num_proj_490151decdde445593a86a16976f6b34': '5', 'num_vm_shelved_offloaded': '1', 'num_task_spawning': '2', 'num_proj_8a3dfff83ce24e619f87507f951f6c69': '1', 'num_task_resize_migrated': '1', 'num_proj_529ec00acc80453dbe8d6a1295e9eb13': '1', 'num_vm_building': '1', 'num_proj_28b3c0fa8f894ed2a7c3bcfac99ce74c': '1'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:41:46.340423 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:46.397001 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Refreshing inventories for resource provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 19 04:41:46.452209 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Updating ProviderTree inventory for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 19 04:41:46.452336 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Updating inventory in ProviderTree for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 19 04:41:46.502516 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Refreshing aggregate associations for resource provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6, aggregates: None {{(pid=97981) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 19 04:41:46.504590 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0004798510001364775 future=<Future at 0x721834335580 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:46.505234 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Emitting event <LifecycleEvent: 1779165691.503985, f6207103-8a47-4cc8-b1e0-c0ffd79e0173 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:41:46.505535 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] VM Stopped (Lifecycle Event)
May 19 04:41:46.507462 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:46.507994 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=8.846730750999996 future=<Future at 0x721850735af0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:46.507994 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=8.846616366000035 future=<Future at 0x721850735af0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:46.548256 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Releasing lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:41:46.558534 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Took 1.35 seconds to destroy the instance on the hypervisor.
May 19 04:41:46.559246 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:41:46.559623 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:41:46.559828 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:41:46.560123 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:46.570486 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Refreshing trait associations for resource provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6, traits: COMPUTE_SOUND_MODEL_AC97,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ARCH_S390X,COMPUTE_SOUND_MODEL_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SOUND_MODEL_ICH9,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ARCH_MIPSEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_SOUND_MODEL_ICH6,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIF_MODEL_IGB,HW_ARCH_X86_64,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ARCH_X86_64,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ARCH_RISCV64,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_ARCH_AARCH64,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_STORAGE_VIRTIO_FS {{(pid=97981) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 19 04:41:46.675758 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:46.695031 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:46.871379 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Updating instance_info_cache with network_info: [{"id": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "address": "fa:16:3e:19:0f:7d", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa25728-c2", "ovs_interfaceid": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:46.977416 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-056fd05b-7534-47c7-9ec3-34b67e1d9452 req-8bfdab67-5394-4589-a33a-6ca4c291bd48 service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Received event network-vif-deleted-198ee052-a44f-474c-87e1-409937e2e3c2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:46.977677 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-056fd05b-7534-47c7-9ec3-34b67e1d9452 req-8bfdab67-5394-4589-a33a-6ca4c291bd48 service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Neutron deleted interface 198ee052-a44f-474c-87e1-409937e2e3c2; detaching it from the instance and deleting it from the info cache
May 19 04:41:46.977908 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-056fd05b-7534-47c7-9ec3-34b67e1d9452 req-8bfdab67-5394-4589-a33a-6ca4c291bd48 service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:47.008100 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-42f38dfa-dad8-44f0-88f7-7cc867ba2644 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] [instance: f6207103-8a47-4cc8-b1e0-c0ffd79e0173] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:47.059691 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:41:47.070751 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:41:47.088433 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:47.125986 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:41:47.126739 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:41:47.135280 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:41:47.136344 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fea1:aa43', 'fe80::fc16:3eff:feb0:9e6f', 'fe80::fc16:3eff:fe0c:f096', 'fe80::8849:6dff:fe86:4a4b'] 
May 19 04:41:47.136467 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:41:47.136556 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:41:47.136766 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] <== get_connector_properties: return (77ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:41:47.199459 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:41:47.199639 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:41:47.373587 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Releasing lock "refresh_cache-15f0abbc-b8de-4d77-88c4-e5c0e54d691f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:41:47.374869 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:41:47.375406 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4271dc88-f751-4d0f-adc5-fa23ad21b696 req-a86b7982-6961-4972-b7e9-369561175e2c service nova] Acquired lock "refresh_cache-15f0abbc-b8de-4d77-88c4-e5c0e54d691f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:41:47.375881 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Creating image(s)
May 19 04:41:47.376538 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4271dc88-f751-4d0f-adc5-fa23ad21b696 req-a86b7982-6961-4972-b7e9-369561175e2c service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Refreshing network info cache for port 7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:41:47.380538 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "/opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:47.380767 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "/opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:47.381843 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "/opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:47.382068 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'trusted_certs' on Instance uuid 15f0abbc-b8de-4d77-88c4-e5c0e54d691f {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:47.432080 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:47.481465 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-056fd05b-7534-47c7-9ec3-34b67e1d9452 req-8bfdab67-5394-4589-a33a-6ca4c291bd48 service nova] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Detach interface failed, port_id=198ee052-a44f-474c-87e1-409937e2e3c2, reason: Instance 5951341b-0ad5-4fb0-82ad-b464c081f37f could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:41:47.702918 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:41:47.819378 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "0b156bbc-f85d-4739-bf88-bc609d4f8052" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:47.819597 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:47.882371 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-4271dc88-f751-4d0f-adc5-fa23ad21b696 req-a86b7982-6961-4972-b7e9-369561175e2c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:47.884051 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Object Instance<15f0abbc-b8de-4d77-88c4-e5c0e54d691f> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:41:47.885602 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "0772a98ff494cb622057303a00a718ac70450f82" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:47.886008 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "0772a98ff494cb622057303a00a718ac70450f82" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:47.934893 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Took 1.37 seconds to deallocate network for instance.
May 19 04:41:48.193137 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-4271dc88-f751-4d0f-adc5-fa23ad21b696 req-a86b7982-6961-4972-b7e9-369561175e2c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:48.210498 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:41:48.210657 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.942s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:48.210929 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 42.74 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:41:48.241780 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:48.262887 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Starting finish_migration {{(pid=97981) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 19 04:41:48.264070 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Instance directory exists: not creating {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 19 04:41:48.264378 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Creating image(s)
May 19 04:41:48.265557 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:48.322157 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:41:48.360560 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4271dc88-f751-4d0f-adc5-fa23ad21b696 req-a86b7982-6961-4972-b7e9-369561175e2c service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Updated VIF entry in instance network info cache for port 7aa25728-c226-4d2c-ac7a-d5a1edf94739. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:41:48.360965 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4271dc88-f751-4d0f-adc5-fa23ad21b696 req-a86b7982-6961-4972-b7e9-369561175e2c service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Updating instance_info_cache with network_info: [{"id": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "address": "fa:16:3e:19:0f:7d", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa25728-c2", "ovs_interfaceid": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:48.375556 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.110s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:48.377438 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:41:48.379416 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:48.445186 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:48.445186 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:48.482082 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:48.482613 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Cannot resize image /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:41:48.721752 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:41:48.724207 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:41:48.724526 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0772a98ff494cb622057303a00a718ac70450f82.part --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:48.810652 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0772a98ff494cb622057303a00a718ac70450f82.part --force-share --output=json" returned: 0 in 0.086s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:48.811236 np0000001025 nova-compute[97981]: DEBUG nova.virt.images [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] da23d3e3-0897-4260-901f-5bd9dcc3cce2 was qcow2, converting to raw {{(pid=97981) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 19 04:41:48.811995 np0000001025 nova-compute[97981]: DEBUG nova.privsep.utils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97981) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 19 04:41:48.812389 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0772a98ff494cb622057303a00a718ac70450f82.part /opt/stack/data/nova/instances/_base/0772a98ff494cb622057303a00a718ac70450f82.converted {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:48.865094 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4271dc88-f751-4d0f-adc5-fa23ad21b696 req-a86b7982-6961-4972-b7e9-369561175e2c service nova] Releasing lock "refresh_cache-15f0abbc-b8de-4d77-88c4-e5c0e54d691f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:41:48.891034 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:48.981568 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0772a98ff494cb622057303a00a718ac70450f82.part /opt/stack/data/nova/instances/_base/0772a98ff494cb622057303a00a718ac70450f82.converted" returned: 0 in 0.169s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:48.987470 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:41:48.987470 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Ensure instance console log exists: /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:41:48.987470 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:48.987470 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:48.987470 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:48.988596 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Start _get_guest_xml network_info=[{"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "vif_mac": "fa:16:3e:fa:d4:f0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '33874a65-784f-4e5f-97e6-6bd81826810e', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '405ea65f-8d17-42c7-922a-dac27a17a488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '6f26313e-2659-4687-84da-96cf2da9a4e2', 'attached_at': '2026-05-19T04:41:47.000000', 'detached_at': '', 'volume_id': '405ea65f-8d17-42c7-922a-dac27a17a488', 'multiattach': True, 'serial': '405ea65f-8d17-42c7-922a-dac27a17a488'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:41:48.993685 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:41:48.994849 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='6f26313e-2659-4687-84da-96cf2da9a4e2'), owner=OwnerMeta(userid='aa432d60cb324c6d87818107e05e0053', username='tempest-AttachVolumeMultiAttachTest-1659172696-project-member', projectid='490151decdde445593a86a16976f6b34', projectname='tempest-AttachVolumeMultiAttachTest-1659172696'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "vif_mac": "fa:16:3e:fa:d4:f0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165708.994504) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:41:48.995772 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0772a98ff494cb622057303a00a718ac70450f82.converted --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:49.019805 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:41:49.020649 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:41:49.021909 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:41:49.022159 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:41:49.025278 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:41:49.025935 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:41:49.026120 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:41:49.026235 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:41:49.026399 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:41:49.026484 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:41:49.026608 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:41:49.026831 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:41:49.026938 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:41:49.027096 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:41:49.027239 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:41:49.027390 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:41:49.038563 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk.config --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:49.077530 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0772a98ff494cb622057303a00a718ac70450f82.converted --force-share --output=json" returned: 0 in 0.082s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:49.078229 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "0772a98ff494cb622057303a00a718ac70450f82" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.192s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:49.078655 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:41:49.081988 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:41:49.084049 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0772a98ff494cb622057303a00a718ac70450f82 --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:49.129371 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk.config --force-share --output=json" returned: 0 in 0.091s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:49.129833 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:49.130083 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "/opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:49.130784 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "/opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:49.131137 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:41:49.131530 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '405ea65f-8d17-42c7-922a-dac27a17a488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:41:49.131676 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:41:49.136060 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:41:49.136376 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:41:49.169920 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0772a98ff494cb622057303a00a718ac70450f82 --force-share --output=json" returned: 0 in 0.086s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:49.170243 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "0772a98ff494cb622057303a00a718ac70450f82" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:49.170595 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "0772a98ff494cb622057303a00a718ac70450f82" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:49.171002 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:41:49.173441 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:41:49.173692 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0772a98ff494cb622057303a00a718ac70450f82 --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:49.257546 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0772a98ff494cb622057303a00a718ac70450f82 --force-share --output=json" returned: 0 in 0.083s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:49.258193 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0772a98ff494cb622057303a00a718ac70450f82,backing_fmt=raw /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:49.311581 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0772a98ff494cb622057303a00a718ac70450f82,backing_fmt=raw /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk 1073741824" returned: 0 in 0.053s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:49.312023 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "0772a98ff494cb622057303a00a718ac70450f82" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.141s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:49.312446 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0772a98ff494cb622057303a00a718ac70450f82 --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:49.398712 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0772a98ff494cb622057303a00a718ac70450f82 --force-share --output=json" returned: 0 in 0.086s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:49.399332 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'migration_context' on Instance uuid 15f0abbc-b8de-4d77-88c4-e5c0e54d691f {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:49.640307 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:41:49.902199 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Object Instance<15f0abbc-b8de-4d77-88c4-e5c0e54d691f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:41:49.902655 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Rebasing disk image.
May 19 04:41:49.902919 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:49.985394 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.082s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:49.986129 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c -F raw /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:50.149139 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.704s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:50.153058 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.261s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:50.157355 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:41:50.157773 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Claim successful on node np0000001025
May 19 04:41:50.203602 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Deleted allocations for instance 5951341b-0ad5-4fb0-82ad-b464c081f37f
May 19 04:41:50.821264 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c -F raw /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk" returned: 0 in 0.835s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:50.821719 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:41:50.821885 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Ensure instance console log exists: /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:41:50.822075 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:50.822289 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:50.822402 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:50.823811 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Start _get_guest_xml network_info=[{"id": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "address": "fa:16:3e:19:0f:7d", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa25728-c2", "ovs_interfaceid": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='7d6d62cef20cb48f443592b96cf436bf',container_format='bare',created_at=2026-05-19T04:41:22Z,direct_url=<?>,disk_format='qcow2',id=da23d3e3-0897-4260-901f-5bd9dcc3cce2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-395626849-shelved',owner='8a3dfff83ce24e619f87507f951f6c69',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-19T04:41:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:41:50.825504 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:41:50.826591 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-395626849', uuid='15f0abbc-b8de-4d77-88c4-e5c0e54d691f'), owner=OwnerMeta(userid='7955853f574d42e58ba89f18ed109760', username='tempest-AttachVolumeShelveTestJSON-51274594-project-member', projectid='8a3dfff83ce24e619f87507f951f6c69', projectname='tempest-AttachVolumeShelveTestJSON-51274594'), image=ImageMeta(id='da23d3e3-0897-4260-901f-5bd9dcc3cce2', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "address": "fa:16:3e:19:0f:7d", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa25728-c2", "ovs_interfaceid": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165710.8262827) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:41:50.827315 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:41:50.827648 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:41:50.828473 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:41:50.828629 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:41:50.829888 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:41:50.830170 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7d6d62cef20cb48f443592b96cf436bf',container_format='bare',created_at=2026-05-19T04:41:22Z,direct_url=<?>,disk_format='qcow2',id=da23d3e3-0897-4260-901f-5bd9dcc3cce2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-395626849-shelved',owner='8a3dfff83ce24e619f87507f951f6c69',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-19T04:41:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:41:50.830297 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:41:50.830378 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:41:50.830491 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:41:50.830579 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:41:50.830664 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:41:50.830802 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:41:50.830908 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:41:50.831015 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:41:50.831115 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:41:50.831235 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:41:50.831370 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'vcpu_model' on Instance uuid 15f0abbc-b8de-4d77-88c4-e5c0e54d691f {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:50.870153 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:41:51.044575 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:51.214120 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-812104bc-2160-46f3-9415-06c8a593e414 tempest-ServerActionsTestOtherA-281327203 tempest-ServerActionsTestOtherA-281327203-project-member] Lock "5951341b-0ad5-4fb0-82ad-b464c081f37f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.516s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:51.333858 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Object Instance<15f0abbc-b8de-4d77-88c4-e5c0e54d691f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:41:51.357518 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-19T04:40:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-395626849',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumeshelvetestjson-server-395626849',id=35,image_ref='da23d3e3-0897-4260-901f-5bd9dcc3cce2',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-802114952',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:40:41Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8a3dfff83ce24e619f87507f951f6c69',ramdisk_id='',reservation_id='r-43nv4a6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-51274594',owner_user_name='tempest-AttachVolumeShelveTestJSON-51274594-project-member',shelved_at='2026-05-19T04:41:29.676435',shelved_host='np0000001025',shelved_image_id='da23d3e3-0897-4260-901f-5bd9dcc3cce2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:41:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7955853f574d42e58ba89f18ed109760',uuid=15f0abbc-b8de-4d77-88c4-e5c0e54d691f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "address": "fa:16:3e:19:0f:7d", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa25728-c2", "ovs_interfaceid": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:41:51.357831 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converting VIF {"id": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "address": "fa:16:3e:19:0f:7d", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa25728-c2", "ovs_interfaceid": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:41:51.358453 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:0f:7d,bridge_name='br-int',has_traffic_filtering=True,id=7aa25728-c226-4d2c-ac7a-d5a1edf94739,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa25728-c2') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:41:51.359047 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'pci_devices' on Instance uuid 15f0abbc-b8de-4d77-88c4-e5c0e54d691f {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:51.747051 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:41:51.747273 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:41:51.862369 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Object Instance<15f0abbc-b8de-4d77-88c4-e5c0e54d691f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:41:51.863235 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] End _get_guest_xml xml=<domain type="qemu">
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:   <uuid>15f0abbc-b8de-4d77-88c4-e5c0e54d691f</uuid>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:   <name>instance-00000023</name>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-395626849</nova:name>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:41:50</nova:creationTime>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:           <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:           <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:         <nova:user uuid="7955853f574d42e58ba89f18ed109760">tempest-AttachVolumeShelveTestJSON-51274594-project-member</nova:user>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:         <nova:project uuid="8a3dfff83ce24e619f87507f951f6c69">tempest-AttachVolumeShelveTestJSON-51274594</nova:project>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:         <nova:port uuid="7aa25728-c226-4d2c-ac7a-d5a1edf94739">
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     <system>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <entry name="serial">15f0abbc-b8de-4d77-88c4-e5c0e54d691f</entry>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <entry name="uuid">15f0abbc-b8de-4d77-88c4-e5c0e54d691f</entry>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     </system>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:   <os>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:   </os>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:   <features>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:   </features>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:   <devices>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk"/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     </disk>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk.config"/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     </disk>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:19:0f:7d"/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <target dev="tap7aa25728-c2"/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     </interface>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/console.log" append="off"/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     </serial>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     <video>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     </video>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     </rng>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:   </devices>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]: </domain>
May 19 04:41:51.863235 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:41:51.866577 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Preparing to wait for external event network-vif-plugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:41:51.866577 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:51.866577 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:51.866577 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:51.866577 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-19T04:40:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-395626849',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumeshelvetestjson-server-395626849',id=35,image_ref='da23d3e3-0897-4260-901f-5bd9dcc3cce2',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-802114952',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:40:41Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8a3dfff83ce24e619f87507f951f6c69',ramdisk_id='',reservation_id='r-43nv4a6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-51274594',owner_user_name='tempest-AttachVolumeShelveTestJSON-51274594-project-member',shelved_at='2026-05-19T04:41:29.676435',shelved_host='np0000001025',shelved_image_id='da23d3e3-0897-4260-901f-5bd9dcc3cce2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:41:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7955853f574d42e58ba89f18ed109760',uuid=15f0abbc-b8de-4d77-88c4-e5c0e54d691f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "address": "fa:16:3e:19:0f:7d", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa25728-c2", "ovs_interfaceid": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:41:51.866577 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converting VIF {"id": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "address": "fa:16:3e:19:0f:7d", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa25728-c2", "ovs_interfaceid": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:41:51.866577 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:0f:7d,bridge_name='br-int',has_traffic_filtering=True,id=7aa25728-c226-4d2c-ac7a-d5a1edf94739,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa25728-c2') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:41:51.866577 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:0f:7d,bridge_name='br-int',has_traffic_filtering=True,id=7aa25728-c226-4d2c-ac7a-d5a1edf94739,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa25728-c2') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:41:51.866577 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:51.866577 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:51.866577 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:41:51.868351 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:51.868351 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0bf164c-a09e-507e-b628-9d0aac6bfd3b', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:51.868351 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:51.868852 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:41:51.869135 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:51.871170 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:51.871327 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7aa25728-c2, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:51.871705 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7aa25728-c2, col_values=(('qos', UUID('a541d314-a095-48e6-8fa4-c51bdbed5a2b')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:51.871896 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7aa25728-c2, col_values=(('external_ids', {'iface-id': '7aa25728-c226-4d2c-ac7a-d5a1edf94739', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:0f:7d', 'vm-uuid': '15f0abbc-b8de-4d77-88c4-e5c0e54d691f'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:51.872723 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:51.873786 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:41:51.877445 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:51.878236 np0000001025 nova-compute[97981]: INFO os_vif [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:0f:7d,bridge_name='br-int',has_traffic_filtering=True,id=7aa25728-c226-4d2c-ac7a-d5a1edf94739,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa25728-c2')
May 19 04:41:52.250880 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:41:52.761751 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.610s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:52.762763 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:41:53.122938 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:53.244258 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:53.268035 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:41:53.268624 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:41:53.269915 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:53.270213 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:53.350298 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2bee156928644e1a450ae7c480d04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39155484b40c4c4fb5906c33b2682b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:41:53.397787 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:41:53.397944 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:41:53.398080 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] No VIF found with MAC fa:16:3e:19:0f:7d, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:41:53.398665 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Using config drive
May 19 04:41:53.773561 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:41:53.870995 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Successfully created port: 0b031766-34d0-453f-b350-2582e74d0600 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:41:53.901647 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'ec2_ids' on Instance uuid 15f0abbc-b8de-4d77-88c4-e5c0e54d691f {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:54.277342 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:41:54.307422 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Successfully updated port: 0b031766-34d0-453f-b350-2582e74d0600 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:41:54.354402 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a686b1f0-3c9c-44de-bfbc-2357811814b8 req-f7c5e6db-c571-466b-b602-b9c0ecc53948 service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Received event network-changed-0b031766-34d0-453f-b350-2582e74d0600 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:54.354785 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a686b1f0-3c9c-44de-bfbc-2357811814b8 req-f7c5e6db-c571-466b-b602-b9c0ecc53948 service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Refreshing instance network info cache due to event network-changed-0b031766-34d0-453f-b350-2582e74d0600. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:41:54.355117 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a686b1f0-3c9c-44de-bfbc-2357811814b8 req-f7c5e6db-c571-466b-b602-b9c0ecc53948 service nova] Acquiring lock "refresh_cache-0b156bbc-f85d-4739-bf88-bc609d4f8052" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:41:54.355117 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a686b1f0-3c9c-44de-bfbc-2357811814b8 req-f7c5e6db-c571-466b-b602-b9c0ecc53948 service nova] Acquired lock "refresh_cache-0b156bbc-f85d-4739-bf88-bc609d4f8052" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:41:54.355399 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a686b1f0-3c9c-44de-bfbc-2357811814b8 req-f7c5e6db-c571-466b-b602-b9c0ecc53948 service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Refreshing network info cache for port 0b031766-34d0-453f-b350-2582e74d0600 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:41:54.405939 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Object Instance<15f0abbc-b8de-4d77-88c4-e5c0e54d691f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:41:54.406214 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'keypairs' on Instance uuid 15f0abbc-b8de-4d77-88c4-e5c0e54d691f {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:54.559004 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:54.809638 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "refresh_cache-0b156bbc-f85d-4739-bf88-bc609d4f8052" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:41:54.858012 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-a686b1f0-3c9c-44de-bfbc-2357811814b8 req-f7c5e6db-c571-466b-b602-b9c0ecc53948 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:54.909487 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Object Instance<15f0abbc-b8de-4d77-88c4-e5c0e54d691f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:41:54.912789 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:54.925332 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a686b1f0-3c9c-44de-bfbc-2357811814b8 req-f7c5e6db-c571-466b-b602-b9c0ecc53948 service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:41:55.040259 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Creating config drive at /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk.config
May 19 04:41:55.044468 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpv_lwfddk {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:55.082958 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a686b1f0-3c9c-44de-bfbc-2357811814b8 req-f7c5e6db-c571-466b-b602-b9c0ecc53948 service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:55.100280 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpv_lwfddk" returned: 0 in 0.056s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:55.289502 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:41:55.289878 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:41:55.289878 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Creating image(s)
May 19 04:41:55.290383 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:55.290579 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "/opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:55.291082 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "/opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:55.291629 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:41:55.294768 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:41:55.296049 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:55.355392 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0007204519999959302 future=<Future at 0x721850735af0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:55.356190 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] Emitting event <LifecycleEvent: 1779165700.3545372, 0dbaac9f-71f1-4cb6-837c-cafc38f94f11 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:41:55.356466 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:55.356642 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=0.4123257150001791 future=<Future at 0x7218344d85c0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:55.356740 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=0.4122083429999748 future=<Future at 0x7218344d85c0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:55.356937 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] VM Stopped (Lifecycle Event)
May 19 04:41:55.392785 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.097s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:55.393292 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:55.393766 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:55.396865 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:41:55.403078 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:41:55.403650 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:55.500960 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.097s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:55.501445 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:55.552499 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:55.559932 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk 1073741824" returned: 0 in 0.058s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:55.564854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.170s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:55.564854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:55.587734 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:55.591831 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a686b1f0-3c9c-44de-bfbc-2357811814b8 req-f7c5e6db-c571-466b-b602-b9c0ecc53948 service nova] Releasing lock "refresh_cache-0b156bbc-f85d-4739-bf88-bc609d4f8052" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:41:55.596670 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquired lock "refresh_cache-0b156bbc-f85d-4739-bf88-bc609d4f8052" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:41:55.596992 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:41:55.669888 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.106s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:55.670443 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:41:55.670715 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:55.684297 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:55.760462 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:41:55.763088 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Cannot resize image /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:41:55.763088 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:41:55.763088 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Ensure instance console log exists: /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:41:55.763088 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:55.763088 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:55.763088 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:55.771711 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0026996449998932803 future=<Future at 0x7218344d85c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:55.772488 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Emitting event <LifecycleEvent: 1779165700.7689052, 6f26313e-2659-4687-84da-96cf2da9a4e2 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:41:55.772707 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:55.772962 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] VM Stopped (Lifecycle Event)
May 19 04:41:55.776854 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=4.752570373000026 future=<Future at 0x721850655ca0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:55.776987 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=4.75238408600012 future=<Future at 0x721850655ca0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:41:55.863359 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:55.867992 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 4 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:41:55.871012 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:55.873768 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:55.875855 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:55.898777 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:55.899046 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:56.173151 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:41:56.276260 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:56.278818 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:41:56.327227 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165716.3268476, 15f0abbc-b8de-4d77-88c4-e5c0e54d691f => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:41:56.330086 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] VM Started (Lifecycle Event)
May 19 04:41:56.367235 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:56.372518 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-00633092-7eb3-4fd2-b92b-2a066c48028e tempest-TestInstancesWithCinderVolumes-1156876148 tempest-TestInstancesWithCinderVolumes-1156876148-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] During sync_power_state the instance has a pending task (deleting). Skip.
May 19 04:41:56.445136 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-66d22538-8a8a-4079-9ff1-efbb9755bc81 req-02fc4989-b7d7-4b6e-814d-5e5525731d6e service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Received event network-vif-plugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:56.445136 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-66d22538-8a8a-4079-9ff1-efbb9755bc81 req-02fc4989-b7d7-4b6e-814d-5e5525731d6e service nova] Acquiring lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:56.445136 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-66d22538-8a8a-4079-9ff1-efbb9755bc81 req-02fc4989-b7d7-4b6e-814d-5e5525731d6e service nova] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:56.445136 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-66d22538-8a8a-4079-9ff1-efbb9755bc81 req-02fc4989-b7d7-4b6e-814d-5e5525731d6e service nova] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:56.445136 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-66d22538-8a8a-4079-9ff1-efbb9755bc81 req-02fc4989-b7d7-4b6e-814d-5e5525731d6e service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Processing event network-vif-plugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:41:56.445136 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-66d22538-8a8a-4079-9ff1-efbb9755bc81 req-02fc4989-b7d7-4b6e-814d-5e5525731d6e service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Received event network-vif-plugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:41:56.445136 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-66d22538-8a8a-4079-9ff1-efbb9755bc81 req-02fc4989-b7d7-4b6e-814d-5e5525731d6e service nova] Acquiring lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:56.445136 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-66d22538-8a8a-4079-9ff1-efbb9755bc81 req-02fc4989-b7d7-4b6e-814d-5e5525731d6e service nova] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:56.445136 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-66d22538-8a8a-4079-9ff1-efbb9755bc81 req-02fc4989-b7d7-4b6e-814d-5e5525731d6e service nova] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:56.445136 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-66d22538-8a8a-4079-9ff1-efbb9755bc81 req-02fc4989-b7d7-4b6e-814d-5e5525731d6e service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] No waiting events found dispatching network-vif-plugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:41:56.445136 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-66d22538-8a8a-4079-9ff1-efbb9755bc81 req-02fc4989-b7d7-4b6e-814d-5e5525731d6e service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Received unexpected event network-vif-plugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 for instance with vm_state shelved_offloaded and task_state spawning.
May 19 04:41:56.445726 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:41:56.448493 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:41:56.452766 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Instance spawned successfully.
May 19 04:41:56.507278 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Updating instance_info_cache with network_info: [{"id": "0b031766-34d0-453f-b350-2582e74d0600", "address": "fa:16:3e:1d:f0:b2", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b031766-34", "ovs_interfaceid": "0b031766-34d0-453f-b350-2582e74d0600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:41:56.780891 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 19 04:41:56.831653 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:56.835195 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:41:56.875001 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:56.884338 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:57.008431 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Releasing lock "refresh_cache-0b156bbc-f85d-4739-bf88-bc609d4f8052" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:41:57.008785 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Instance network_info: |[{"id": "0b031766-34d0-453f-b350-2582e74d0600", "address": "fa:16:3e:1d:f0:b2", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b031766-34", "ovs_interfaceid": "0b031766-34d0-453f-b350-2582e74d0600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:41:57.010534 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Start _get_guest_xml network_info=[{"id": "0b031766-34d0-453f-b350-2582e74d0600", "address": "fa:16:3e:1d:f0:b2", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b031766-34", "ovs_interfaceid": "0b031766-34d0-453f-b350-2582e74d0600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:41:57.018334 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:41:57.019496 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-1597235226', uuid='0b156bbc-f85d-4739-bf88-bc609d4f8052'), owner=OwnerMeta(userid='a2bee156928644e1a450ae7c480d04d0', username='tempest-TestStampPattern-1526088943-project-member', projectid='39155484b40c4c4fb5906c33b2682b3d', projectname='tempest-TestStampPattern-1526088943'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0b031766-34d0-453f-b350-2582e74d0600", "address": "fa:16:3e:1d:f0:b2", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b031766-34", "ovs_interfaceid": "0b031766-34d0-453f-b350-2582e74d0600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165717.0191746) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:41:57.021140 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:41:57.021140 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:41:57.021619 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:41:57.021771 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:41:57.022665 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:41:57.022963 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:41:57.023122 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:41:57.023277 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:41:57.023453 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:41:57.023571 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:41:57.023696 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:41:57.023873 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:41:57.024007 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:41:57.024177 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:41:57.024311 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:41:57.024470 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:41:57.035627 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:41:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1597235226',display_name='tempest-TestStampPattern-server-1597235226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-teststamppattern-server-1597235226',id=42,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKU2n0VcX8xMH+sW7ZCTVd5WzR5Ckycn9oGpkVd3uX9291bcgn3KJ8WDVGgJl9FiOS6puDyqsoALPmLm1PDDqcos+J/7xzJXkaCOlPt64B9ufpXMvpZcYNFqFdKYfiUbJw==',key_name='tempest-TestStampPattern-1529897663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39155484b40c4c4fb5906c33b2682b3d',ramdisk_id='',reservation_id='r-1ooanmzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1526088943',owner_user_name='tempest-TestStampPattern-1526088943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:41:54Z,user_data=None,user_id='a2bee156928644e1a450ae7c480d04d0',uuid=0b156bbc-f85d-4739-bf88-bc609d4f8052,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b031766-34d0-453f-b350-2582e74d0600", "address": "fa:16:3e:1d:f0:b2", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b031766-34", "ovs_interfaceid": "0b031766-34d0-453f-b350-2582e74d0600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:41:57.035855 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Converting VIF {"id": "0b031766-34d0-453f-b350-2582e74d0600", "address": "fa:16:3e:1d:f0:b2", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b031766-34", "ovs_interfaceid": "0b031766-34d0-453f-b350-2582e74d0600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:41:57.037237 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f0:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b031766-34d0-453f-b350-2582e74d0600,network=Network(61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b031766-34') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:41:57.037237 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b156bbc-f85d-4739-bf88-bc609d4f8052 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:41:57.178439 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:57.337677 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:41:57.338164 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165717.3376274, 15f0abbc-b8de-4d77-88c4-e5c0e54d691f => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:41:57.338164 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] VM Paused (Lifecycle Event)
May 19 04:41:57.394483 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe20b9ee-e053-4db7-b8f8-c9d666d814c9 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.439s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:57.540803 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] End _get_guest_xml xml=<domain type="qemu">
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:   <uuid>0b156bbc-f85d-4739-bf88-bc609d4f8052</uuid>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:   <name>instance-0000002a</name>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestStampPattern-server-1597235226</nova:name>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:41:57</nova:creationTime>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:         <nova:user uuid="a2bee156928644e1a450ae7c480d04d0">tempest-TestStampPattern-1526088943-project-member</nova:user>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:         <nova:project uuid="39155484b40c4c4fb5906c33b2682b3d">tempest-TestStampPattern-1526088943</nova:project>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:         <nova:port uuid="0b031766-34d0-453f-b350-2582e74d0600">
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     <system>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <entry name="serial">0b156bbc-f85d-4739-bf88-bc609d4f8052</entry>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <entry name="uuid">0b156bbc-f85d-4739-bf88-bc609d4f8052</entry>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     </system>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:   <os>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:   </os>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:   <features>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:   </features>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:   <devices>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk"/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     </disk>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk.config"/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     </disk>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:1d:f0:b2"/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <target dev="tap0b031766-34"/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     </interface>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/console.log" append="off"/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     </serial>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     <video>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     </video>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     </rng>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:   </devices>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]: </domain>
May 19 04:41:57.540803 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:41:57.540803 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Preparing to wait for external event network-vif-plugged-0b031766-34d0-453f-b350-2582e74d0600 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:41:57.540803 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "0b156bbc-f85d-4739-bf88-bc609d4f8052-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:41:57.540803 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:41:57.540803 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:41:57.543718 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:41:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1597235226',display_name='tempest-TestStampPattern-server-1597235226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-teststamppattern-server-1597235226',id=42,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKU2n0VcX8xMH+sW7ZCTVd5WzR5Ckycn9oGpkVd3uX9291bcgn3KJ8WDVGgJl9FiOS6puDyqsoALPmLm1PDDqcos+J/7xzJXkaCOlPt64B9ufpXMvpZcYNFqFdKYfiUbJw==',key_name='tempest-TestStampPattern-1529897663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39155484b40c4c4fb5906c33b2682b3d',ramdisk_id='',reservation_id='r-1ooanmzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1526088943',owner_user_name='tempest-TestStampPattern-1526088943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:41:54Z,user_data=None,user_id='a2bee156928644e1a450ae7c480d04d0',uuid=0b156bbc-f85d-4739-bf88-bc609d4f8052,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b031766-34d0-453f-b350-2582e74d0600", "address": "fa:16:3e:1d:f0:b2", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b031766-34", "ovs_interfaceid": "0b031766-34d0-453f-b350-2582e74d0600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:41:57.543718 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Converting VIF {"id": "0b031766-34d0-453f-b350-2582e74d0600", "address": "fa:16:3e:1d:f0:b2", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b031766-34", "ovs_interfaceid": "0b031766-34d0-453f-b350-2582e74d0600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:41:57.543718 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f0:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b031766-34d0-453f-b350-2582e74d0600,network=Network(61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b031766-34') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:41:57.543718 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f0:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b031766-34d0-453f-b350-2582e74d0600,network=Network(61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b031766-34') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:41:57.545507 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:57.545713 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:57.545943 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:41:57.546822 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:57.546980 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c332ed69-7cde-53ac-875b-83af5bef0662', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:57.547641 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:57.548261 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:41:57.548814 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:57.551244 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:57.552725 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b031766-34, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:57.552725 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b031766-34, col_values=(('qos', UUID('02e0ec15-88ac-4a9b-9daf-2c702dff3785')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:57.552725 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b031766-34, col_values=(('external_ids', {'iface-id': '0b031766-34d0-453f-b350-2582e74d0600', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:f0:b2', 'vm-uuid': '0b156bbc-f85d-4739-bf88-bc609d4f8052'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:41:57.553342 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:57.554860 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:41:57.559036 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:57.560254 np0000001025 nova-compute[97981]: INFO os_vif [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f0:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b031766-34d0-453f-b350-2582e74d0600,network=Network(61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b031766-34')
May 19 04:41:57.840521 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:57.842352 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165717.8420432, 15f0abbc-b8de-4d77-88c4-e5c0e54d691f => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:41:57.842544 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] VM Resumed (Lifecycle Event)
May 19 04:41:58.244787 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:58.344909 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:41:58.347368 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:41:58.684147 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:41:59.083463 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:41:59.083656 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:41:59.083840 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] No VIF found with MAC fa:16:3e:1d:f0:b2, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:41:59.084248 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Using config drive
May 19 04:41:59.588763 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:41:59.730790 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Creating config drive at /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk.config
May 19 04:41:59.733939 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqjvgw12l {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:41:59.791206 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqjvgw12l" returned: 0 in 0.057s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:00.224034 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:00.229348 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:00.229587 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:00.237652 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:00.320329 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:00.408967 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-10b679b5-8090-4dc4-896f-26d7111f0623 req-eb42afb2-aa9b-4bc0-91d5-e0ef8c1637d4 service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Received event network-vif-plugged-0b031766-34d0-453f-b350-2582e74d0600 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:42:00.409984 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-10b679b5-8090-4dc4-896f-26d7111f0623 req-eb42afb2-aa9b-4bc0-91d5-e0ef8c1637d4 service nova] Acquiring lock "0b156bbc-f85d-4739-bf88-bc609d4f8052-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:00.409984 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-10b679b5-8090-4dc4-896f-26d7111f0623 req-eb42afb2-aa9b-4bc0-91d5-e0ef8c1637d4 service nova] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:00.409984 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-10b679b5-8090-4dc4-896f-26d7111f0623 req-eb42afb2-aa9b-4bc0-91d5-e0ef8c1637d4 service nova] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:00.409984 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-10b679b5-8090-4dc4-896f-26d7111f0623 req-eb42afb2-aa9b-4bc0-91d5-e0ef8c1637d4 service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Processing event network-vif-plugged-0b031766-34d0-453f-b350-2582e74d0600 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:42:00.521442 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:00.522975 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:00.524628 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:00.529702 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0003005629998824588 future=<Future at 0x721850655ca0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:42:00.530076 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Emitting event <LifecycleEvent: 1779165705.5293074, 5951341b-0ad5-4fb0-82ad-b464c081f37f => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:42:00.530227 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:42:00.530357 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] VM Stopped (Lifecycle Event)
May 19 04:42:00.545623 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:00.732191 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:42:00.925505 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165720.9251845, 0b156bbc-f85d-4739-bf88-bc609d4f8052 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:42:00.925703 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] VM Started (Lifecycle Event)
May 19 04:42:00.926856 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:42:00.930507 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:42:00.933781 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Instance spawned successfully.
May 19 04:42:00.934189 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:42:01.032849 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-538c1da3-7704-4f7c-a3f0-e9eac4b9bc46 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 5951341b-0ad5-4fb0-82ad-b464c081f37f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:42:01.294669 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:01.295180 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:01.298244 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:42:01.298408 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Claim successful on node np0000001025
May 19 04:42:01.427846 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:42:01.430447 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:42:01.445125 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:01.445192 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:01.445544 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:01.445927 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:01.446423 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:01.446742 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:01.935131 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:42:01.935131 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165721.9325297, 0b156bbc-f85d-4739-bf88-bc609d4f8052 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:42:01.935131 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] VM Paused (Lifecycle Event)
May 19 04:42:01.950850 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Took 6.66 seconds to spawn the instance on the hypervisor.
May 19 04:42:01.950984 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:42:02.434933 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:42:02.437452 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165722.4372237, 0b156bbc-f85d-4739-bf88-bc609d4f8052 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:42:02.437580 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] VM Resumed (Lifecycle Event)
May 19 04:42:02.459955 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Took 13.63 seconds to build instance.
May 19 04:42:02.491141 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-bf9d2018-a541-4cd0-bf3c-eca64b1c1b11 req-1d17ded2-acae-4654-bec7-1f29bc0d8b34 service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Received event network-vif-plugged-0b031766-34d0-453f-b350-2582e74d0600 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:42:02.491738 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bf9d2018-a541-4cd0-bf3c-eca64b1c1b11 req-1d17ded2-acae-4654-bec7-1f29bc0d8b34 service nova] Acquiring lock "0b156bbc-f85d-4739-bf88-bc609d4f8052-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:02.491919 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bf9d2018-a541-4cd0-bf3c-eca64b1c1b11 req-1d17ded2-acae-4654-bec7-1f29bc0d8b34 service nova] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:02.492044 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bf9d2018-a541-4cd0-bf3c-eca64b1c1b11 req-1d17ded2-acae-4654-bec7-1f29bc0d8b34 service nova] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:02.492184 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-bf9d2018-a541-4cd0-bf3c-eca64b1c1b11 req-1d17ded2-acae-4654-bec7-1f29bc0d8b34 service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] No waiting events found dispatching network-vif-plugged-0b031766-34d0-453f-b350-2582e74d0600 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:42:02.492297 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-bf9d2018-a541-4cd0-bf3c-eca64b1c1b11 req-1d17ded2-acae-4654-bec7-1f29bc0d8b34 service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Received unexpected event network-vif-plugged-0b031766-34d0-453f-b350-2582e74d0600 for instance with vm_state active and task_state None.
May 19 04:42:02.554565 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:02.898917 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:42:02.899196 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:42:02.940040 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:42:02.941382 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:42:02.962630 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.143s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:03.246940 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:03.401933 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:42:03.907908 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.613s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:03.908284 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:42:04.325291 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3d86185d-9493-4fcd-aca5-aad1e2a0668b req-6d1335b1-f6b3-400f-9045-6d364a745db0 service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Received event network-changed-0b031766-34d0-453f-b350-2582e74d0600 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:42:04.325769 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3d86185d-9493-4fcd-aca5-aad1e2a0668b req-6d1335b1-f6b3-400f-9045-6d364a745db0 service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Refreshing instance network info cache due to event network-changed-0b031766-34d0-453f-b350-2582e74d0600. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:42:04.325880 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3d86185d-9493-4fcd-aca5-aad1e2a0668b req-6d1335b1-f6b3-400f-9045-6d364a745db0 service nova] Acquiring lock "refresh_cache-0b156bbc-f85d-4739-bf88-bc609d4f8052" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:42:04.325880 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3d86185d-9493-4fcd-aca5-aad1e2a0668b req-6d1335b1-f6b3-400f-9045-6d364a745db0 service nova] Acquired lock "refresh_cache-0b156bbc-f85d-4739-bf88-bc609d4f8052" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:42:04.326031 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3d86185d-9493-4fcd-aca5-aad1e2a0668b req-6d1335b1-f6b3-400f-9045-6d364a745db0 service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Refreshing network info cache for port 0b031766-34d0-453f-b350-2582e74d0600 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:42:04.413848 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:42:04.416491 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:42:04.416491 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:04.416491 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:04.489897 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5885f1561f394d46bd4c1b48e7323c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7465b5668be4eb9b75c1ddc876e7eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:42:04.828978 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-3d86185d-9493-4fcd-aca5-aad1e2a0668b req-6d1335b1-f6b3-400f-9045-6d364a745db0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:04.862090 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Successfully created port: d7084fd1-d136-4a21-81fc-df65be57d7ca {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:42:04.917122 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:42:05.130349 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-3d86185d-9493-4fcd-aca5-aad1e2a0668b req-6d1335b1-f6b3-400f-9045-6d364a745db0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:05.271497 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3d86185d-9493-4fcd-aca5-aad1e2a0668b req-6d1335b1-f6b3-400f-9045-6d364a745db0 service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Updated VIF entry in instance network info cache for port 0b031766-34d0-453f-b350-2582e74d0600. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:42:05.271770 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3d86185d-9493-4fcd-aca5-aad1e2a0668b req-6d1335b1-f6b3-400f-9045-6d364a745db0 service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Updating instance_info_cache with network_info: [{"id": "0b031766-34d0-453f-b350-2582e74d0600", "address": "fa:16:3e:1d:f0:b2", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b031766-34", "ovs_interfaceid": "0b031766-34d0-453f-b350-2582e74d0600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:42:05.365952 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Successfully updated port: d7084fd1-d136-4a21-81fc-df65be57d7ca {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:42:05.420600 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:42:05.773691 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3d86185d-9493-4fcd-aca5-aad1e2a0668b req-6d1335b1-f6b3-400f-9045-6d364a745db0 service nova] Releasing lock "refresh_cache-0b156bbc-f85d-4739-bf88-bc609d4f8052" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:42:05.867772 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "refresh_cache-a73d6831-b1cd-4d69-a78c-16d3ac8010c7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:42:05.867918 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquired lock "refresh_cache-a73d6831-b1cd-4d69-a78c-16d3ac8010c7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:42:05.867969 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:42:06.081685 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:06.082070 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:06.377324 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f5e3fdef-eede-4529-abc4-c83cbec46a74 req-4cb101d2-b4df-479d-831f-4d4f1f82f3a7 service nova] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Received event network-changed-d7084fd1-d136-4a21-81fc-df65be57d7ca {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:42:06.377661 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f5e3fdef-eede-4529-abc4-c83cbec46a74 req-4cb101d2-b4df-479d-831f-4d4f1f82f3a7 service nova] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Refreshing instance network info cache due to event network-changed-d7084fd1-d136-4a21-81fc-df65be57d7ca. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:42:06.377661 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f5e3fdef-eede-4529-abc4-c83cbec46a74 req-4cb101d2-b4df-479d-831f-4d4f1f82f3a7 service nova] Acquiring lock "refresh_cache-a73d6831-b1cd-4d69-a78c-16d3ac8010c7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:42:06.428745 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:42:06.431012 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:42:06.432092 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:42:06.432475 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Creating image(s)
May 19 04:42:06.432894 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "/opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:06.433030 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "/opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:06.433476 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "/opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:06.434346 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:42:06.436836 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:42:06.438068 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:06.528131 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.088s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:06.528131 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:06.528131 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:06.528131 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:42:06.531010 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:42:06.531371 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:06.586550 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lazy-loading 'flavor' on Instance uuid 3ad7c142-5f58-498e-b24c-ea7d4faa1d63 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:42:06.608561 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:06.631526 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.100s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:06.631895 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:06.685321 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk 1073741824" returned: 0 in 0.053s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:06.685784 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:06.686163 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:06.758195 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Updating instance_info_cache with network_info: [{"id": "d7084fd1-d136-4a21-81fc-df65be57d7ca", "address": "fa:16:3e:fb:c3:a3", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7084fd1-d1", "ovs_interfaceid": "d7084fd1-d136-4a21-81fc-df65be57d7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:42:06.773095 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.087s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:06.773427 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:42:06.773774 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:06.870145 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:06.870518 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Cannot resize image /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:42:06.870888 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:42:06.871054 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Ensure instance console log exists: /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:42:06.871353 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:06.871562 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:06.871700 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:07.090832 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Ignoring supplied device name: /dev/vdb
May 19 04:42:07.262378 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Releasing lock "refresh_cache-a73d6831-b1cd-4d69-a78c-16d3ac8010c7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:42:07.262378 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Instance network_info: |[{"id": "d7084fd1-d136-4a21-81fc-df65be57d7ca", "address": "fa:16:3e:fb:c3:a3", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7084fd1-d1", "ovs_interfaceid": "d7084fd1-d136-4a21-81fc-df65be57d7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:42:07.262574 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f5e3fdef-eede-4529-abc4-c83cbec46a74 req-4cb101d2-b4df-479d-831f-4d4f1f82f3a7 service nova] Acquired lock "refresh_cache-a73d6831-b1cd-4d69-a78c-16d3ac8010c7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:42:07.262748 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-f5e3fdef-eede-4529-abc4-c83cbec46a74 req-4cb101d2-b4df-479d-831f-4d4f1f82f3a7 service nova] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Refreshing network info cache for port d7084fd1-d136-4a21-81fc-df65be57d7ca {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:42:07.266139 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Start _get_guest_xml network_info=[{"id": "d7084fd1-d136-4a21-81fc-df65be57d7ca", "address": "fa:16:3e:fb:c3:a3", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7084fd1-d1", "ovs_interfaceid": "d7084fd1-d136-4a21-81fc-df65be57d7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:42:07.271299 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:42:07.273082 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-462274281', uuid='a73d6831-b1cd-4d69-a78c-16d3ac8010c7'), owner=OwnerMeta(userid='5885f1561f394d46bd4c1b48e7323c1e', username='tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member', projectid='f7465b5668be4eb9b75c1ddc876e7eac', projectname='tempest-ServerBootFromVolumeStableRescueTest-96916496'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d7084fd1-d136-4a21-81fc-df65be57d7ca", "address": "fa:16:3e:fb:c3:a3", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7084fd1-d1", "ovs_interfaceid": "d7084fd1-d136-4a21-81fc-df65be57d7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165727.2726274) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:42:07.274606 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:42:07.276535 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:42:07.277532 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:42:07.277766 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:42:07.278884 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:42:07.282130 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:42:07.282130 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:42:07.282130 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:42:07.282130 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:42:07.282130 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:42:07.282130 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:42:07.282130 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:42:07.282130 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:42:07.282130 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:42:07.282130 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:42:07.282130 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:42:07.294001 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:41:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-462274281',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverbootfromvolumestablerescuetest-server-462274281',id=43,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7465b5668be4eb9b75c1ddc876e7eac',ramdisk_id='',reservation_id='r-7x6m52p4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-96916496',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:42:05Z,user_data=None,user_id='5885f1561f394d46bd4c1b48e7323c1e',uuid=a73d6831-b1cd-4d69-a78c-16d3ac8010c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7084fd1-d136-4a21-81fc-df65be57d7ca", "address": "fa:16:3e:fb:c3:a3", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7084fd1-d1", "ovs_interfaceid": "d7084fd1-d136-4a21-81fc-df65be57d7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:42:07.294288 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converting VIF {"id": "d7084fd1-d136-4a21-81fc-df65be57d7ca", "address": "fa:16:3e:fb:c3:a3", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7084fd1-d1", "ovs_interfaceid": "d7084fd1-d136-4a21-81fc-df65be57d7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:42:07.295272 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c3:a3,bridge_name='br-int',has_traffic_filtering=True,id=d7084fd1-d136-4a21-81fc-df65be57d7ca,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7084fd1-d1') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:42:07.296819 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'pci_devices' on Instance uuid a73d6831-b1cd-4d69-a78c-16d3ac8010c7 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:42:07.555764 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:07.594322 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:07.767772 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-f5e3fdef-eede-4529-abc4-c83cbec46a74 req-4cb101d2-b4df-479d-831f-4d4f1f82f3a7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:07.798553 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] End _get_guest_xml xml=<domain type="qemu">
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:   <uuid>a73d6831-b1cd-4d69-a78c-16d3ac8010c7</uuid>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:   <name>instance-0000002b</name>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-462274281</nova:name>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:42:07</nova:creationTime>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:         <nova:user uuid="5885f1561f394d46bd4c1b48e7323c1e">tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member</nova:user>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:         <nova:project uuid="f7465b5668be4eb9b75c1ddc876e7eac">tempest-ServerBootFromVolumeStableRescueTest-96916496</nova:project>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:         <nova:port uuid="d7084fd1-d136-4a21-81fc-df65be57d7ca">
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     <system>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <entry name="serial">a73d6831-b1cd-4d69-a78c-16d3ac8010c7</entry>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <entry name="uuid">a73d6831-b1cd-4d69-a78c-16d3ac8010c7</entry>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     </system>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:   <os>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:   </os>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:   <features>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:   </features>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:   <devices>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk"/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     </disk>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk.config"/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     </disk>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:fb:c3:a3"/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <target dev="tapd7084fd1-d1"/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     </interface>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/console.log" append="off"/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     </serial>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     <video>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     </video>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     </rng>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:   </devices>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]: </domain>
May 19 04:42:07.798553 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:42:07.801253 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Preparing to wait for external event network-vif-plugged-d7084fd1-d136-4a21-81fc-df65be57d7ca {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:42:07.801253 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:07.801253 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:07.801253 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:07.801253 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:41:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-462274281',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverbootfromvolumestablerescuetest-server-462274281',id=43,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7465b5668be4eb9b75c1ddc876e7eac',ramdisk_id='',reservation_id='r-7x6m52p4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-96916496',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:42:05Z,user_data=None,user_id='5885f1561f394d46bd4c1b48e7323c1e',uuid=a73d6831-b1cd-4d69-a78c-16d3ac8010c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7084fd1-d136-4a21-81fc-df65be57d7ca", "address": "fa:16:3e:fb:c3:a3", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7084fd1-d1", "ovs_interfaceid": "d7084fd1-d136-4a21-81fc-df65be57d7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:42:07.801665 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converting VIF {"id": "d7084fd1-d136-4a21-81fc-df65be57d7ca", "address": "fa:16:3e:fb:c3:a3", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7084fd1-d1", "ovs_interfaceid": "d7084fd1-d136-4a21-81fc-df65be57d7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:42:07.802156 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c3:a3,bridge_name='br-int',has_traffic_filtering=True,id=d7084fd1-d136-4a21-81fc-df65be57d7ca,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7084fd1-d1') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:42:07.802470 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c3:a3,bridge_name='br-int',has_traffic_filtering=True,id=d7084fd1-d136-4a21-81fc-df65be57d7ca,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7084fd1-d1') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:42:07.803207 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:07.803577 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:42:07.803894 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:42:07.806044 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:07.806219 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b96199a2-2e0a-5b6d-bcf9-7e638e046d07', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:42:07.807198 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:07.807856 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:42:07.809460 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:07.811419 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:07.811599 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7084fd1-d1, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:42:07.811938 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd7084fd1-d1, col_values=(('qos', UUID('7204aab0-003b-45ac-8c85-22f210085bd4')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:42:07.812144 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd7084fd1-d1, col_values=(('external_ids', {'iface-id': 'd7084fd1-d136-4a21-81fc-df65be57d7ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:c3:a3', 'vm-uuid': 'a73d6831-b1cd-4d69-a78c-16d3ac8010c7'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:42:07.812851 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:07.813999 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:42:07.820641 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:07.822086 np0000001025 nova-compute[97981]: INFO os_vif [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c3:a3,bridge_name='br-int',has_traffic_filtering=True,id=d7084fd1-d136-4a21-81fc-df65be57d7ca,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7084fd1-d1')
May 19 04:42:08.105131 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-f5e3fdef-eede-4529-abc4-c83cbec46a74 req-4cb101d2-b4df-479d-831f-4d4f1f82f3a7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:08.234947 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-f5e3fdef-eede-4529-abc4-c83cbec46a74 req-4cb101d2-b4df-479d-831f-4d4f1f82f3a7 service nova] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Updated VIF entry in instance network info cache for port d7084fd1-d136-4a21-81fc-df65be57d7ca. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:42:08.235393 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-f5e3fdef-eede-4529-abc4-c83cbec46a74 req-4cb101d2-b4df-479d-831f-4d4f1f82f3a7 service nova] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Updating instance_info_cache with network_info: [{"id": "d7084fd1-d136-4a21-81fc-df65be57d7ca", "address": "fa:16:3e:fb:c3:a3", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7084fd1-d1", "ovs_interfaceid": "d7084fd1-d136-4a21-81fc-df65be57d7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:42:08.249232 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:08.661928 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:08.662827 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:08.663217 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Attaching volume c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 to /dev/vdb
May 19 04:42:08.699769 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:42:08.713028 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:42:08.736128 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:08.745025 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f5e3fdef-eede-4529-abc4-c83cbec46a74 req-4cb101d2-b4df-479d-831f-4d4f1f82f3a7 service nova] Releasing lock "refresh_cache-a73d6831-b1cd-4d69-a78c-16d3ac8010c7" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:42:08.770574 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:42:08.771270 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:42:08.783356 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:42:08.783356 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fea1:aa43', 'fe80::fc16:3eff:feb0:9e6f', 'fe80::fc16:3eff:fe0c:f096', 'fe80::8849:6dff:fe86:4a4b', 'fe80::fc16:3eff:fe19:f7d', 'fe80::946f:41ff:fe06:ab72', 'fe80::fc16:3eff:fe1d:f0b2', 'fe80::4cb5:1dff:fe2d:31dc'] 
May 19 04:42:08.783747 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:42:08.784026 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:42:08.784502 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:42:08.786597 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Updating existing volume attachment record: 0020afdc-6385-4b95-99f6-e73cbcac295c {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:42:09.335910 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:42:09.335910 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:42:09.335910 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:42:09.339801 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:42:09.339932 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:42:09.340035 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] No VIF found with MAC fa:16:3e:fb:c3:a3, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:42:09.340619 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Using config drive
May 19 04:42:09.846300 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:09.956455 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Creating config drive at /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk.config
May 19 04:42:09.959256 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpblfzqaqi {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:10.012947 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpblfzqaqi" returned: 0 in 0.053s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:10.456749 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:10.457149 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:10.494206 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:10.556769 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:10.727271 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-95329a6a-12dc-4f47-aa4e-9df37907bae0 req-645d70c0-390c-46cb-82be-0922eccf2dd3 service nova] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Received event network-vif-plugged-d7084fd1-d136-4a21-81fc-df65be57d7ca {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:42:10.727271 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-95329a6a-12dc-4f47-aa4e-9df37907bae0 req-645d70c0-390c-46cb-82be-0922eccf2dd3 service nova] Acquiring lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:10.727417 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-95329a6a-12dc-4f47-aa4e-9df37907bae0 req-645d70c0-390c-46cb-82be-0922eccf2dd3 service nova] Lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:10.727572 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-95329a6a-12dc-4f47-aa4e-9df37907bae0 req-645d70c0-390c-46cb-82be-0922eccf2dd3 service nova] Lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:10.727684 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-95329a6a-12dc-4f47-aa4e-9df37907bae0 req-645d70c0-390c-46cb-82be-0922eccf2dd3 service nova] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Processing event network-vif-plugged-d7084fd1-d136-4a21-81fc-df65be57d7ca {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:42:10.798121 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:10.800992 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:10.805462 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:10.830966 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:11.280741 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165731.2803626, a73d6831-b1cd-4d69-a78c-16d3ac8010c7 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:42:11.281175 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] VM Started (Lifecycle Event)
May 19 04:42:11.282422 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:42:11.286747 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:42:11.289601 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Instance spawned successfully.
May 19 04:42:11.289956 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:42:11.783803 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:42:11.788373 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:42:11.798389 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:11.798548 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:11.798890 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:11.799195 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:11.800345 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:11.801610 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:12.290998 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:42:12.291447 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165732.2910821, a73d6831-b1cd-4d69-a78c-16d3ac8010c7 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:42:12.291447 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] VM Paused (Lifecycle Event)
May 19 04:42:12.310024 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Took 5.88 seconds to spawn the instance on the hypervisor.
May 19 04:42:12.310372 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:42:12.793592 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:42:12.796348 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165732.7961166, a73d6831-b1cd-4d69-a78c-16d3ac8010c7 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:42:12.796474 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] VM Resumed (Lifecycle Event)
May 19 04:42:12.827097 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-20005c37-0c31-4cbe-b7e1-9c132e4ed301 req-d96cde95-6c22-4502-86ca-860e08768a0e service nova] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Received event network-vif-plugged-d7084fd1-d136-4a21-81fc-df65be57d7ca {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:42:12.830533 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-20005c37-0c31-4cbe-b7e1-9c132e4ed301 req-d96cde95-6c22-4502-86ca-860e08768a0e service nova] Acquiring lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:12.831122 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-20005c37-0c31-4cbe-b7e1-9c132e4ed301 req-d96cde95-6c22-4502-86ca-860e08768a0e service nova] Lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:12.831297 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-20005c37-0c31-4cbe-b7e1-9c132e4ed301 req-d96cde95-6c22-4502-86ca-860e08768a0e service nova] Lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:12.831579 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-20005c37-0c31-4cbe-b7e1-9c132e4ed301 req-d96cde95-6c22-4502-86ca-860e08768a0e service nova] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] No waiting events found dispatching network-vif-plugged-d7084fd1-d136-4a21-81fc-df65be57d7ca {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:42:12.831752 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-20005c37-0c31-4cbe-b7e1-9c132e4ed301 req-d96cde95-6c22-4502-86ca-860e08768a0e service nova] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Received unexpected event network-vif-plugged-d7084fd1-d136-4a21-81fc-df65be57d7ca for instance with vm_state active and task_state None.
May 19 04:42:12.831944 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:12.832561 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Took 11.59 seconds to build instance.
May 19 04:42:13.251909 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:13.306242 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:42:13.308425 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:42:13.335084 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4218e556-42ee-4658-92e4-44f139dd6d89 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.105s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:13.810673 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] During sync_power_state the instance has a pending task (image_snapshot_pending). Skip.
May 19 04:42:14.281814 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a236dd3a-bac6-42df-a962-de8fd4889d41 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:42:14.788485 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-a236dd3a-bac6-42df-a962-de8fd4889d41 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] instance snapshotting
May 19 04:42:14.872472 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a236dd3a-bac6-42df-a962-de8fd4889d41 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Beginning live snapshot process
May 19 04:42:16.390143 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a236dd3a-bac6-42df-a962-de8fd4889d41 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk --force-share --output=json -f qcow2 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:16.481267 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a236dd3a-bac6-42df-a962-de8fd4889d41 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk --force-share --output=json -f qcow2" returned: 0 in 0.089s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:16.481267 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a236dd3a-bac6-42df-a962-de8fd4889d41 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk --force-share --output=json -f qcow2 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:16.591317 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a236dd3a-bac6-42df-a962-de8fd4889d41 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk --force-share --output=json -f qcow2" returned: 0 in 0.110s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:16.592749 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-a236dd3a-bac6-42df-a962-de8fd4889d41 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:42:16.596490 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-a236dd3a-bac6-42df-a962-de8fd4889d41 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:42:16.597480 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a236dd3a-bac6-42df-a962-de8fd4889d41 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:16.711301 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a236dd3a-bac6-42df-a962-de8fd4889d41 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.113s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:16.711987 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a236dd3a-bac6-42df-a962-de8fd4889d41 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa_315vlp/63d653306377479ba1d5bd4b73d57586.delta 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:16.765723 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a236dd3a-bac6-42df-a962-de8fd4889d41 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa_315vlp/63d653306377479ba1d5bd4b73d57586.delta 1073741824" returned: 0 in 0.054s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:16.766667 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a236dd3a-bac6-42df-a962-de8fd4889d41 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Quiescing instance not available: QEMU guest agent is not enabled.
May 19 04:42:17.000030 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-a236dd3a-bac6-42df-a962-de8fd4889d41 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=97981) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 19 04:42:17.001740 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a236dd3a-bac6-42df-a962-de8fd4889d41 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Skipping quiescing instance: QEMU guest agent is not enabled.
May 19 04:42:17.037719 np0000001025 nova-compute[97981]: DEBUG nova.privsep.utils [None req-a236dd3a-bac6-42df-a962-de8fd4889d41 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97981) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 19 04:42:17.038027 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a236dd3a-bac6-42df-a962-de8fd4889d41 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa_315vlp/63d653306377479ba1d5bd4b73d57586.delta /opt/stack/data/nova/instances/snapshots/tmpa_315vlp/63d653306377479ba1d5bd4b73d57586 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:17.121537 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a236dd3a-bac6-42df-a962-de8fd4889d41 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa_315vlp/63d653306377479ba1d5bd4b73d57586.delta /opt/stack/data/nova/instances/snapshots/tmpa_315vlp/63d653306377479ba1d5bd4b73d57586" returned: 0 in 0.083s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:17.122091 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a236dd3a-bac6-42df-a962-de8fd4889d41 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Snapshot extracted, beginning image upload
May 19 04:42:17.839431 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:18.254202 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:19.419191 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a236dd3a-bac6-42df-a962-de8fd4889d41 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Snapshot image upload complete
May 19 04:42:19.419722 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-a236dd3a-bac6-42df-a962-de8fd4889d41 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Took 4.63 seconds to snapshot the instance on the hypervisor.
May 19 04:42:20.944387 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "92b3fb19-741d-476b-9d2f-83654a17aa0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:20.946194 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:21.450136 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:42:21.997955 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:21.997955 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:22.000915 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:42:22.001363 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Claim successful on node np0000001025
May 19 04:42:22.843784 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:23.257733 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:23.592649 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:42:23.592876 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:42:24.095315 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:42:24.605133 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.607s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:24.605133 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:42:25.108732 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:42:25.108932 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:42:25.109305 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:25.109551 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:25.176321 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5885f1561f394d46bd4c1b48e7323c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7465b5668be4eb9b75c1ddc876e7eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:42:25.561122 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Successfully created port: 29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:42:25.618129 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:42:25.984291 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Successfully updated port: 29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:42:26.030546 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e60194dc-1dfe-4eb6-b497-743796701055 req-f7d15924-8852-4c3a-bf1c-df1ab7acbde1 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received event network-changed-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:42:26.030859 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e60194dc-1dfe-4eb6-b497-743796701055 req-f7d15924-8852-4c3a-bf1c-df1ab7acbde1 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Refreshing instance network info cache due to event network-changed-29504364-b589-4dde-a783-4b3bcaea9e02. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:42:26.030960 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e60194dc-1dfe-4eb6-b497-743796701055 req-f7d15924-8852-4c3a-bf1c-df1ab7acbde1 service nova] Acquiring lock "refresh_cache-92b3fb19-741d-476b-9d2f-83654a17aa0e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:42:26.031081 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e60194dc-1dfe-4eb6-b497-743796701055 req-f7d15924-8852-4c3a-bf1c-df1ab7acbde1 service nova] Acquired lock "refresh_cache-92b3fb19-741d-476b-9d2f-83654a17aa0e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:42:26.031206 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e60194dc-1dfe-4eb6-b497-743796701055 req-f7d15924-8852-4c3a-bf1c-df1ab7acbde1 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Refreshing network info cache for port 29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:42:26.123126 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:42:26.486450 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "refresh_cache-92b3fb19-741d-476b-9d2f-83654a17aa0e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:42:26.533201 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-e60194dc-1dfe-4eb6-b497-743796701055 req-f7d15924-8852-4c3a-bf1c-df1ab7acbde1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:26.590812 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e60194dc-1dfe-4eb6-b497-743796701055 req-f7d15924-8852-4c3a-bf1c-df1ab7acbde1 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:42:26.628901 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Booting with blank volume at /dev/vda
May 19 04:42:26.730928 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e60194dc-1dfe-4eb6-b497-743796701055 req-f7d15924-8852-4c3a-bf1c-df1ab7acbde1 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:42:27.233031 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e60194dc-1dfe-4eb6-b497-743796701055 req-f7d15924-8852-4c3a-bf1c-df1ab7acbde1 service nova] Releasing lock "refresh_cache-92b3fb19-741d-476b-9d2f-83654a17aa0e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:42:27.233372 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquired lock "refresh_cache-92b3fb19-741d-476b-9d2f-83654a17aa0e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:42:27.233518 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:42:27.794345 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:42:27.845769 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:27.929980 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:28.049871 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Updating instance_info_cache with network_info: [{"id": "29504364-b589-4dde-a783-4b3bcaea9e02", "address": "fa:16:3e:8e:f5:3b", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29504364-b5", "ovs_interfaceid": "29504364-b589-4dde-a783-4b3bcaea9e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:42:28.258593 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:28.552452 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Releasing lock "refresh_cache-92b3fb19-741d-476b-9d2f-83654a17aa0e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:42:28.552702 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Instance network_info: |[{"id": "29504364-b589-4dde-a783-4b3bcaea9e02", "address": "fa:16:3e:8e:f5:3b", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29504364-b5", "ovs_interfaceid": "29504364-b589-4dde-a783-4b3bcaea9e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:42:29.932705 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:42:29.942734 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:42:29.961694 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:30.001018 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:42:30.001209 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:42:30.008925 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:42:30.010503 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fea1:aa43', 'fe80::fc16:3eff:feb0:9e6f', 'fe80::fc16:3eff:fe0c:f096', 'fe80::8849:6dff:fe86:4a4b', 'fe80::fc16:3eff:fe19:f7d', 'fe80::946f:41ff:fe06:ab72', 'fe80::fc16:3eff:fe1d:f0b2', 'fe80::4cb5:1dff:fe2d:31dc', 'fe80::fc16:3eff:fefb:c3a3', 'fe80::2c2c:57ff:feff:64a5'] 
May 19 04:42:30.010643 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:42:30.010815 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:42:30.010916 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] <== get_connector_properties: return (78ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:42:30.011181 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Updating existing volume attachment record: 9ec19ead-8286-4f64-af64-8a0b94c89e37 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:42:30.752926 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "0b156bbc-f85d-4739-bf88-bc609d4f8052" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:30.753118 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:30.950942 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._sync_power_states {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:42:31.256763 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lazy-loading 'flavor' on Instance uuid 0b156bbc-f85d-4739-bf88-bc609d4f8052 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:42:31.457852 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] While synchronizing instance power states, found 13 instances in the database and 11 instances on the hypervisor.
May 19 04:42:31.458013 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Triggering sync for uuid aa2cdf1d-65ef-4cf4-b742-72ae783cde27 {{(pid=97981) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 19 04:42:31.458486 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Triggering sync for uuid 32cc5240-7a56-4cee-9b41-54e17386b39f {{(pid=97981) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 19 04:42:31.458865 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:31.459084 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:31.459412 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Triggering sync for uuid b32b8038-72c4-443c-aea3-07cd61ad67f6 {{(pid=97981) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 19 04:42:31.459955 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "32cc5240-7a56-4cee-9b41-54e17386b39f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:31.460157 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "32cc5240-7a56-4cee-9b41-54e17386b39f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:31.460514 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Triggering sync for uuid e644a772-cf7c-4b15-b21b-ea54e773a1f9 {{(pid=97981) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 19 04:42:31.460926 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "b32b8038-72c4-443c-aea3-07cd61ad67f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:31.461144 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:31.462831 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Triggering sync for uuid 0dbaac9f-71f1-4cb6-837c-cafc38f94f11 {{(pid=97981) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 19 04:42:31.463286 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:31.463451 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:31.465334 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Triggering sync for uuid 6f26313e-2659-4687-84da-96cf2da9a4e2 {{(pid=97981) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 19 04:42:31.466371 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:31.466555 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Triggering sync for uuid 417861ee-dcf2-458b-8782-2ec22d2f5421 {{(pid=97981) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 19 04:42:31.466754 np0000001025 nova-compute[97981]: WARNING nova.utils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x72185012ee80> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 19 04:42:31.466927 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Triggering sync for uuid 3ad7c142-5f58-498e-b24c-ea7d4faa1d63 {{(pid=97981) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 19 04:42:31.467739 np0000001025 nova-compute[97981]: WARNING nova.utils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x72185012ee80> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 19 04:42:31.468224 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Triggering sync for uuid 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8 {{(pid=97981) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 19 04:42:31.468397 np0000001025 nova-compute[97981]: WARNING nova.utils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x72185012ee80> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 19 04:42:31.468567 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Triggering sync for uuid 0b156bbc-f85d-4739-bf88-bc609d4f8052 {{(pid=97981) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 19 04:42:31.469281 np0000001025 nova-compute[97981]: WARNING nova.utils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x72185012ee80> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 19 04:42:31.469467 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Triggering sync for uuid a73d6831-b1cd-4d69-a78c-16d3ac8010c7 {{(pid=97981) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 19 04:42:31.469610 np0000001025 nova-compute[97981]: WARNING nova.utils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x72185012ee80> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 19 04:42:31.470015 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Triggering sync for uuid 92b3fb19-741d-476b-9d2f-83654a17aa0e {{(pid=97981) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 19 04:42:31.470386 np0000001025 nova-compute[97981]: WARNING nova.utils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x72185012ee80> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 19 04:42:31.470612 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Triggering sync for uuid 15f0abbc-b8de-4d77-88c4-e5c0e54d691f {{(pid=97981) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 19 04:42:31.470738 np0000001025 nova-compute[97981]: WARNING nova.utils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x72185012ee80> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 19 04:42:31.472025 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.66 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:42:31.964459 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.505s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:31.964832 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "6f26313e-2659-4687-84da-96cf2da9a4e2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:31.964832 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:31.964969 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 19 04:42:31.965069 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:31.965268 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "417861ee-dcf2-458b-8782-2ec22d2f5421" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:31.965380 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:31.966404 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "32cc5240-7a56-4cee-9b41-54e17386b39f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.506s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:31.966717 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:31.970591 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.509s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:31.971184 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:31.972726 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.509s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:31.972915 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "0b156bbc-f85d-4739-bf88-bc609d4f8052" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:32.114451 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:42:32.115395 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:42:32.115613 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Creating image(s)
May 19 04:42:32.115922 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:42:32.116047 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Ensure instance console log exists: /opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:42:32.116288 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:32.116540 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:32.116656 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:32.117342 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Start _get_guest_xml network_info=[{"id": "29504364-b589-4dde-a783-4b3bcaea9e02", "address": "fa:16:3e:8e:f5:3b", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29504364-b5", "ovs_interfaceid": "29504364-b589-4dde-a783-4b3bcaea9e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '9ec19ead-8286-4f64-af64-8a0b94c89e37', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '92b3fb19-741d-476b-9d2f-83654a17aa0e', 'attached_at': '', 'detached_at': '', 'volume_id': '0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'serial': '0e4db490-fa07-43c8-8325-b0028b4b6ecc'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:42:32.119068 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:42:32.120299 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-690448989', uuid='92b3fb19-741d-476b-9d2f-83654a17aa0e'), owner=OwnerMeta(userid='5885f1561f394d46bd4c1b48e7323c1e', username='tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member', projectid='f7465b5668be4eb9b75c1ddc876e7eac', projectname='tempest-ServerBootFromVolumeStableRescueTest-96916496'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "29504364-b589-4dde-a783-4b3bcaea9e02", "address": "fa:16:3e:8e:f5:3b", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29504364-b5", "ovs_interfaceid": "29504364-b589-4dde-a783-4b3bcaea9e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165752.1199448) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:42:32.121083 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:42:32.121420 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:42:32.122055 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:42:32.122287 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:42:32.123151 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:42:32.123462 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:42:32.123592 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:42:32.123677 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:42:32.123787 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:42:32.123904 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:42:32.124050 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:42:32.124275 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:42:32.124381 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:42:32.124486 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:42:32.124580 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:42:32.124689 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:42:32.133745 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:42:32.134051 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:42:32.134217 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:42:32.261046 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:32.261745 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.288s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:32.468814 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.503s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:32.469040 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:32.469204 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:32.765379 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.504s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:32.765639 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "92b3fb19-741d-476b-9d2f-83654a17aa0e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:32.857163 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:32.975090 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.506s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:32.975601 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:32.975601 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:33.131211 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:42:33.131425 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:42:33.131650 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:42:33.131800 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:42:33.132014 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.48 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:42:33.260019 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:33.317124 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "0b156bbc-f85d-4739-bf88-bc609d4f8052" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:33.317312 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:33.317513 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Attaching volume 69aa8c4f-bf28-4b5c-93c7-e315122038c6 to /dev/vdb
May 19 04:42:33.358468 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:42:33.369380 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:42:33.391613 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:33.429914 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:42:33.430523 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:42:33.440742 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:42:33.442384 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fea1:aa43', 'fe80::fc16:3eff:feb0:9e6f', 'fe80::fc16:3eff:fe0c:f096', 'fe80::8849:6dff:fe86:4a4b', 'fe80::fc16:3eff:fe19:f7d', 'fe80::946f:41ff:fe06:ab72', 'fe80::fc16:3eff:fe1d:f0b2', 'fe80::4cb5:1dff:fe2d:31dc', 'fe80::fc16:3eff:fefb:c3a3', 'fe80::2c2c:57ff:feff:64a5'] 
May 19 04:42:33.442504 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:42:33.442642 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:42:33.442859 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:42:33.443087 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Updating existing volume attachment record: bc90df71-385a-491d-be42-64dfbc477035 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:42:33.479453 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.504s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:34.016477 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:42:34.016930 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69aa8c4f-bf28-4b5c-93c7-e315122038c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:42:34.016930 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:42:34.373523 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:34.373771 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:34.373971 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:34.374121 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:34.374244 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:34.376567 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Terminating instance
May 19 04:42:34.615552 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:42:34.615987 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:42:34.889014 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:42:34.909993 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:34.911835 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:34.936369 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:34.949279 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:34.967215 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:34.971729 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:35.054302 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e0469337-bcf6-4a58-9649-434e8fbc6161 req-d5314e6f-cb7b-4eab-9fa9-d9621cdcd8cf service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Received event network-vif-unplugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:42:35.054721 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e0469337-bcf6-4a58-9649-434e8fbc6161 req-d5314e6f-cb7b-4eab-9fa9-d9621cdcd8cf service nova] Acquiring lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:35.054721 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e0469337-bcf6-4a58-9649-434e8fbc6161 req-d5314e6f-cb7b-4eab-9fa9-d9621cdcd8cf service nova] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:35.054818 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e0469337-bcf6-4a58-9649-434e8fbc6161 req-d5314e6f-cb7b-4eab-9fa9-d9621cdcd8cf service nova] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:35.055045 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e0469337-bcf6-4a58-9649-434e8fbc6161 req-d5314e6f-cb7b-4eab-9fa9-d9621cdcd8cf service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] No waiting events found dispatching network-vif-unplugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:42:35.055045 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e0469337-bcf6-4a58-9649-434e8fbc6161 req-d5314e6f-cb7b-4eab-9fa9-d9621cdcd8cf service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Received event network-vif-unplugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:42:35.188143 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:35.196882 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:35.213363 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999714017000088 future=<Future at 0x7218345e95b0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:42:35.213674 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999388527000065 future=<Future at 0x7218345e95b0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:42:35.213780 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999255380000022 future=<Future at 0x7218345e95b0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:42:35.214636 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Instance destroyed successfully.
May 19 04:42:35.214947 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lazy-loading 'resources' on Instance uuid 15f0abbc-b8de-4d77-88c4-e5c0e54d691f {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:42:35.717060 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-19T04:40:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-395626849',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumeshelvetestjson-server-395626849',id=35,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrCQLYSDh4BSAKuJQO3lgIeQcxBF4rxRleMAE4CBnW4YvXO/MjPLM9cnsN7Cu0cFPOG4awlQsAI62nW05tLJ3lA9gst1KdtxXP1kupL4rfaIsrpVkX58JAXH5lwrYvyBw==',key_name='tempest-keypair-802114952',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:41:56Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a3dfff83ce24e619f87507f951f6c69',ramdisk_id='',reservation_id='r-43nv4a6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-51274594',owner_user_name='tempest-AttachVolumeShelveTestJSON-51274594-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:41:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7955853f574d42e58ba89f18ed109760',uuid=15f0abbc-b8de-4d77-88c4-e5c0e54d691f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "address": "fa:16:3e:19:0f:7d", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa25728-c2", "ovs_interfaceid": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:42:35.717288 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converting VIF {"id": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "address": "fa:16:3e:19:0f:7d", "network": {"id": "48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1368879477-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a3dfff83ce24e619f87507f951f6c69", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa25728-c2", "ovs_interfaceid": "7aa25728-c226-4d2c-ac7a-d5a1edf94739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:42:35.717893 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:0f:7d,bridge_name='br-int',has_traffic_filtering=True,id=7aa25728-c226-4d2c-ac7a-d5a1edf94739,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa25728-c2') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:42:35.718122 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:0f:7d,bridge_name='br-int',has_traffic_filtering=True,id=7aa25728-c226-4d2c-ac7a-d5a1edf94739,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa25728-c2') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:42:35.720580 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:35.720580 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7aa25728-c2, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:42:35.724065 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:35.724065 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:42:35.725740 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:35.726929 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:35.727387 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a541d314-a095-48e6-8fa4-c51bdbed5a2b) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:42:35.730488 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:35.731545 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:42:35.733501 np0000001025 nova-compute[97981]: INFO os_vif [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:0f:7d,bridge_name='br-int',has_traffic_filtering=True,id=7aa25728-c226-4d2c-ac7a-d5a1edf94739,network=Network(48b1cc0f-e02e-4e12-93f9-aacc6eb88f6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa25728-c2')
May 19 04:42:35.733772 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Deleting instance files /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f_del
May 19 04:42:35.741014 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Deletion of /opt/stack/data/nova/instances/15f0abbc-b8de-4d77-88c4-e5c0e54d691f_del complete
May 19 04:42:36.246174 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Took 1.36 seconds to destroy the instance on the hypervisor.
May 19 04:42:36.246716 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:42:36.247074 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:42:36.247191 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:42:36.247434 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:36.333250 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:36.615363 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:42:36.616387 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:42:37.120495 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-015abe55-b76e-405c-9cdb-ad2b06255ed1 req-afb2216d-0615-4682-af52-8fc5bd9f168b service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Received event network-vif-unplugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:42:37.120801 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-015abe55-b76e-405c-9cdb-ad2b06255ed1 req-afb2216d-0615-4682-af52-8fc5bd9f168b service nova] Acquiring lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:37.120992 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-015abe55-b76e-405c-9cdb-ad2b06255ed1 req-afb2216d-0615-4682-af52-8fc5bd9f168b service nova] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:37.121181 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-015abe55-b76e-405c-9cdb-ad2b06255ed1 req-afb2216d-0615-4682-af52-8fc5bd9f168b service nova] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:37.121348 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-015abe55-b76e-405c-9cdb-ad2b06255ed1 req-afb2216d-0615-4682-af52-8fc5bd9f168b service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] No waiting events found dispatching network-vif-unplugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:42:37.121476 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-015abe55-b76e-405c-9cdb-ad2b06255ed1 req-afb2216d-0615-4682-af52-8fc5bd9f168b service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Received event network-vif-unplugged-7aa25728-c226-4d2c-ac7a-d5a1edf94739 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:42:37.121635 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-015abe55-b76e-405c-9cdb-ad2b06255ed1 req-afb2216d-0615-4682-af52-8fc5bd9f168b service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Received event network-vif-deleted-7aa25728-c226-4d2c-ac7a-d5a1edf94739 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:42:37.121805 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-015abe55-b76e-405c-9cdb-ad2b06255ed1 req-afb2216d-0615-4682-af52-8fc5bd9f168b service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Neutron deleted interface 7aa25728-c226-4d2c-ac7a-d5a1edf94739; detaching it from the instance and deleting it from the info cache
May 19 04:42:37.121961 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-015abe55-b76e-405c-9cdb-ad2b06255ed1 req-afb2216d-0615-4682-af52-8fc5bd9f168b service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:42:37.149961 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:42:37.615772 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:42:37.625166 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-015abe55-b76e-405c-9cdb-ad2b06255ed1 req-afb2216d-0615-4682-af52-8fc5bd9f168b service nova] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Detach interface failed, port_id=7aa25728-c226-4d2c-ac7a-d5a1edf94739, reason: Instance 15f0abbc-b8de-4d77-88c4-e5c0e54d691f could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:42:37.651920 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Took 1.40 seconds to deallocate network for instance.
May 19 04:42:38.119517 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:38.119677 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:38.119867 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:38.120036 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:42:38.156793 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:38.156885 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:38.262054 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:38.853493 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:42:38.854435 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:42:39.150327 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:39.250691 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:39.251359 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:39.346239 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:39.350939 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:39.363561 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:42:39.432403 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:39.432878 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:39.514031 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:39.514472 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-14 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:42:39.514617 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-0 (vdc) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:42:39.515074 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-6 (vdd) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:42:39.518348 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:39.609867 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:39.610272 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:39.704428 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:39.707905 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:42:39.709338 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:39.794940 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:39.795426 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:39.873952 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.717s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:39.880864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:39.881270 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:42:39.884619 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:39.939158 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Deleted allocations for instance 15f0abbc-b8de-4d77-88c4-e5c0e54d691f
May 19 04:42:39.969710 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:39.970214 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:40.050771 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:40.051407 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:42:40.054812 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:40.138305 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:40.138697 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:40.221022 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:40.224675 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:40.303995 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:40.304594 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:40.390704 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:40.394531 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:40.474062 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:40.474499 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:40.564333 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:40.567674 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:40.647741 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:40.648358 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:40.728703 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:40.733331 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:40.736392 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:42:40.737782 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:40.781253 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:40.781554 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=11472MB free_disk=72.97286224365234GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:42:40.781693 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:40.781963 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:40.951711 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f3586289-7e37-479e-b358-e836c0797a22 tempest-AttachVolumeShelveTestJSON-51274594 tempest-AttachVolumeShelveTestJSON-51274594-project-member] Lock "15f0abbc-b8de-4d77-88c4-e5c0e54d691f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.578s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:40.987192 np0000001025 nova-compute[97981]: WARNING os_brick.exception [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Flushing 3300000003578c8c9 failed: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 19 04:42:40.987349 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:42:41.034450 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:42:41.093609 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Checking to see if SCSI volumes sdk, sdl have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:42:41.093774 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] SCSI volumes sdk, sdl have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:42:41.095481 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Checking to see if device paths {'sdk', 'sdl'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:42:41.106147 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Device paths {'sdk', 'sdl'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:42:41.106481 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:42:41.117098 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:41.153301 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 81, target: iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de, portal: 192.168.40.100,3260]
May 19 04:42:41.153301 np0000001025 nova-compute[97981]: Logout of [sid: 81, target: iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de, portal: 192.168.40.100,3260] successful.
May 19 04:42:41.153301 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:41.171304 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:41.182631 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:41.220193 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 80, target: iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de, portal: 192.168.50.100,3260]
May 19 04:42:41.220193 np0000001025 nova-compute[97981]: Logout of [sid: 80, target: iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de, portal: 192.168.50.100,3260] successful.
May 19 04:42:41.220193 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:41.237439 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:41.237596 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Removing multipath device map 3300000003578c8c9 to stop multipathd from monitoring the device. {{(pid=97981) _cleanup_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1010}}
May 19 04:42:41.237874 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Multipath 3300000003578c8c9 no longer present {{(pid=97981) multipath_del_map /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:894}}
May 19 04:42:41.238077 np0000001025 nova-compute[97981]: WARNING os_brick.initiator.connectors.iscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] There were errors removing {'sdk', 'sdl'}, leftovers may remain in the system
May 19 04:42:41.238373 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 60.324s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:42:41.239680 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] <== disconnect_volume: exception (60324ms)
May 19 04:42:41.239680 np0000001025 nova-compute[97981]: Chained Exception #1
May 19 04:42:41.239680 np0000001025 nova-compute[97981]:         Traceback (most recent call last):
May 19 04:42:41.239680 np0000001025 nova-compute[97981]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py", line 396, in remove_connection
May 19 04:42:41.239680 np0000001025 nova-compute[97981]:             self.flush_multipath_device(multipath_name)
May 19 04:42:41.239680 np0000001025 nova-compute[97981]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py", line 475, in flush_multipath_device
May 19 04:42:41.239680 np0000001025 nova-compute[97981]:             self._execute('multipath', '-f', device_map_name, run_as_root=True,
May 19 04:42:41.239680 np0000001025 nova-compute[97981]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/executor.py", line 53, in _execute
May 19 04:42:41.239680 np0000001025 nova-compute[97981]:             result = self.__execute(*args, **kwargs)
May 19 04:42:41.239680 np0000001025 nova-compute[97981]:                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:42:41.239680 np0000001025 nova-compute[97981]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 173, in execute
May 19 04:42:41.239680 np0000001025 nova-compute[97981]:             return execute_root(*cmd, **kwargs)
May 19 04:42:41.239680 np0000001025 nova-compute[97981]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:42:41.239680 np0000001025 nova-compute[97981]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 315, in _wrap
May 19 04:42:41.239680 np0000001025 nova-compute[97981]:             return self.channel.remote_call(name, args, kwargs, r_call_timeout)
May 19 04:42:41.239680 np0000001025 nova-compute[97981]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:42:41.239680 np0000001025 nova-compute[97981]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 266, in remote_call
May 19 04:42:41.239680 np0000001025 nova-compute[97981]:             raise exc_type(*result[2])
May 19 04:42:41.239680 np0000001025 nova-compute[97981]:         oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 19 04:42:41.239680 np0000001025 nova-compute[97981]:         Command: multipath -f 3300000003578c8c9
May 19 04:42:41.239680 np0000001025 nova-compute[97981]:         Exit code: 1
May 19 04:42:41.239680 np0000001025 nova-compute[97981]:         Stdout: ''
May 19 04:42:41.239680 np0000001025 nova-compute[97981]:         Stderr: '1969.562771 | 3300000003578c8c9: map in use\n'
May 19 04:42:41.239680 np0000001025 nova-compute[97981]:          {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:188}}
May 19 04:42:41.240297 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Ignoring Volume Error on vol 82d50c4c-3f93-4fc1-adcd-170812ca09de during delete
May 19 04:42:41.240297 np0000001025 nova-compute[97981]: Chained Exception #1
May 19 04:42:41.240297 np0000001025 nova-compute[97981]:         Traceback (most recent call last):
May 19 04:42:41.240297 np0000001025 nova-compute[97981]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py", line 396, in remove_connection
May 19 04:42:41.240297 np0000001025 nova-compute[97981]:             self.flush_multipath_device(multipath_name)
May 19 04:42:41.240297 np0000001025 nova-compute[97981]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py", line 475, in flush_multipath_device
May 19 04:42:41.240297 np0000001025 nova-compute[97981]:             self._execute('multipath', '-f', device_map_name, run_as_root=True,
May 19 04:42:41.240297 np0000001025 nova-compute[97981]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/executor.py", line 53, in _execute
May 19 04:42:41.240297 np0000001025 nova-compute[97981]:             result = self.__execute(*args, **kwargs)
May 19 04:42:41.240297 np0000001025 nova-compute[97981]:                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:42:41.240297 np0000001025 nova-compute[97981]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 173, in execute
May 19 04:42:41.240297 np0000001025 nova-compute[97981]:             return execute_root(*cmd, **kwargs)
May 19 04:42:41.240297 np0000001025 nova-compute[97981]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:42:41.240297 np0000001025 nova-compute[97981]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 315, in _wrap
May 19 04:42:41.240297 np0000001025 nova-compute[97981]:             return self.channel.remote_call(name, args, kwargs, r_call_timeout)
May 19 04:42:41.240297 np0000001025 nova-compute[97981]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 19 04:42:41.240297 np0000001025 nova-compute[97981]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 266, in remote_call
May 19 04:42:41.240297 np0000001025 nova-compute[97981]:             raise exc_type(*result[2])
May 19 04:42:41.240297 np0000001025 nova-compute[97981]:         oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 19 04:42:41.240297 np0000001025 nova-compute[97981]:         Command: multipath -f 3300000003578c8c9
May 19 04:42:41.240297 np0000001025 nova-compute[97981]:         Exit code: 1
May 19 04:42:41.240297 np0000001025 nova-compute[97981]:         Stdout: ''
May 19 04:42:41.240297 np0000001025 nova-compute[97981]:         Stderr: '1969.562771 | 3300000003578c8c9: map in use\n'
May 19 04:42:41.240297 np0000001025 nova-compute[97981]:         : os_brick.exception.ExceptionChainer:
May 19 04:42:41.240668 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 55.257s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:42:41.240823 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97cb7b11-9118-4b51-9829-98f5aa82dbfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:42:41.241174 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Deleting instance files /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11_del
May 19 04:42:41.241979 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Deletion of /opt/stack/data/nova/instances/0dbaac9f-71f1-4cb6-837c-cafc38f94f11_del complete
May 19 04:42:41.252017 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:42:41.252572 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:42:41.252758 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:42:41.253418 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:42:41.253973 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:42:41.254231 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:42:41.264586 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:42:41.264586 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:41.269456 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:42:41.269456 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:41.276054 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd] added
May 19 04:42:41.276054 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:42:41.276054 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:42:41.276054 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:42:41.276054 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:42:41.276054 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:42:41.276054 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:41.276352 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:42:41.276507 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0236(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:42:41.276699 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:42:41.280831 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd] added
May 19 04:42:41.280831 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:42:41.280831 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:42:41.280831 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:42:41.280831 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:42:41.280831 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:42:41.280831 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:41.281082 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:42:41.281255 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0271(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:42:41.281376 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:42:41.747819 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Took 61.72 seconds to destroy the instance on the hypervisor.
May 19 04:42:41.748664 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:42:41.749080 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:42:41.749253 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:42:41.749523 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:41.795450 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Applying migration context for instance 6f26313e-2659-4687-84da-96cf2da9a4e2 as it has an incoming, in-progress migration 764a078a-b090-4b69-b61b-fd2f0d233e5e. Migration status is post-migrating {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 19 04:42:41.797651 np0000001025 nova-compute[97981]: INFO nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Updating resource usage from migration 764a078a-b090-4b69-b61b-fd2f0d233e5e
May 19 04:42:41.808803 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:41.854018 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance aa2cdf1d-65ef-4cf4-b742-72ae783cde27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:42:41.854140 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 32cc5240-7a56-4cee-9b41-54e17386b39f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:42:41.854201 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance b32b8038-72c4-443c-aea3-07cd61ad67f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:42:41.854296 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance e644a772-cf7c-4b15-b21b-ea54e773a1f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:42:41.854372 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 0dbaac9f-71f1-4cb6-837c-cafc38f94f11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:42:41.854452 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 417861ee-dcf2-458b-8782-2ec22d2f5421 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:42:41.854529 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 3ad7c142-5f58-498e-b24c-ea7d4faa1d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:42:41.854603 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Migration 764a078a-b090-4b69-b61b-fd2f0d233e5e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 19 04:42:41.854681 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 6f26313e-2659-4687-84da-96cf2da9a4e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:42:41.854756 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:42:41.854850 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 0b156bbc-f85d-4739-bf88-bc609d4f8052 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:42:41.854931 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance a73d6831-b1cd-4d69-a78c-16d3ac8010c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:42:41.855031 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 92b3fb19-741d-476b-9d2f-83654a17aa0e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:42:41.855217 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:42:41.855332 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=3072MB phys_disk=95GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:42:40 up 33 min,  2 users,  load average: 4.22, 5.91, 3.72\n', 'num_instances': '12', 'num_vm_active': '10', 'num_task_None': '8', 'num_os_type_None': '12', 'num_proj_7e0c7a19a41a44fba4c0fca71022a5a1': '2', 'io_workload': '2', 'num_proj_490151decdde445593a86a16976f6b34': '5', 'num_task_deleting': '1', 'num_task_resize_finish': '1', 'num_proj_529ec00acc80453dbe8d6a1295e9eb13': '1', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_28b3c0fa8f894ed2a7c3bcfac99ce74c': '1', 'num_proj_39155484b40c4c4fb5906c33b2682b3d': '1', 'num_proj_f7465b5668be4eb9b75c1ddc876e7eac': '2'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:42:42.277208 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:42:42.281884 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:42:42.289285 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:42:42.289285 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:42:42.300262 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:42:42.300262 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:42.304724 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:42.311775 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:42.326646 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:42.326646 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:42.326646 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:42.326646 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:42.326646 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:42.326646 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:42.326646 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:42.326646 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:42.326646 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:42.326646 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:42:42.326646 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:42.326646 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:42.326646 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:42.326646 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:42.326646 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:42.326646 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:42.326646 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:42.326646 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:42.326646 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:42.326646 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:42:42.332220 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:42.332220 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:42.332220 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:42.332220 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:42.332220 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:42.332220 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:42.332220 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:42.332220 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:42.332220 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:42.332220 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:42:42.332435 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:42.332435 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:42.332435 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:42.332435 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:42.332435 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:42.332435 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:42.332435 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:42.332435 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:42.332435 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:42.332435 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:42:42.335817 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-318abbad-ddad-4d39-a466-cfc6c3cf015b req-bf402ffa-09aa-4e45-b02e-90c2cc2c1e22 service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Received event network-vif-deleted-6b74663e-9ccd-4251-97fd-0eca225719e2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:42:42.335978 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-318abbad-ddad-4d39-a466-cfc6c3cf015b req-bf402ffa-09aa-4e45-b02e-90c2cc2c1e22 service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Neutron deleted interface 6b74663e-9ccd-4251-97fd-0eca225719e2; detaching it from the instance and deleting it from the info cache
May 19 04:42:42.336183 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-318abbad-ddad-4d39-a466-cfc6c3cf015b req-bf402ffa-09aa-4e45-b02e-90c2cc2c1e22 service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:42:42.385938 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd, portal: 192.168.50.100,3260]
May 19 04:42:42.385938 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd, portal: 192.168.50.100,3260] successful.
May 19 04:42:42.385938 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:42.387415 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd, portal: 192.168.40.100,3260]
May 19 04:42:42.387415 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd, portal: 192.168.40.100,3260] successful.
May 19 04:42:42.387415 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:42.397510 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:42.402394 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:42.419447 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:42.419447 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:42.419447 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:42.419447 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:42.419447 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:42.419447 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:42.419447 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:42.419447 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:42.419447 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:42.419447 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:42.419447 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:42.419447 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:42:42.419944 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:42.419944 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:42.419944 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:42.419944 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:42.419944 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:42.419944 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:42.419944 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:42.419944 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:42.419944 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:42.419944 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:42.419944 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:42.419944 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:42:42.420302 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:42:42.420302 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:42:42.421742 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] HCTL ('11', '-', '-', 0) found on session 98 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:42:42.421903 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:42:42.427641 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:42.427641 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:42.427641 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:42.427641 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:42.427641 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:42.427641 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:42.427641 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:42.427641 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:42.427641 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:42.427641 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:42.427641 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:42.427641 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:42:42.428009 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:42.428009 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:42.428009 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:42.428009 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:42.428009 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:42.428009 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:42.428009 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:42.428009 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:42.428009 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:42.428009 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:42.428009 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:42.428009 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:42:42.428386 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:42:42.428386 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:42:42.429336 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] HCTL ('10', '-', '-', 0) found on session 97 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:42:42.429414 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:42:42.443597 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching for a device in session 98 and hctl ['11', '*', '*', 0] yield: sde {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:42:42.443597 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '97cb7b11-9118-4b51-9829-98f5aa82dbfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:42:42.443882 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching for a device in session 97 and hctl ['10', '*', '*', 0] yield: sdf {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:42:42.444038 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97cb7b11-9118-4b51-9829-98f5aa82dbfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:42:42.480861 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:42:42.481144 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:42:42.764328 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:42:42.839315 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-318abbad-ddad-4d39-a466-cfc6c3cf015b req-bf402ffa-09aa-4e45-b02e-90c2cc2c1e22 service nova] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Detach interface failed, port_id=6b74663e-9ccd-4251-97fd-0eca225719e2, reason: Instance 0dbaac9f-71f1-4cb6-837c-cafc38f94f11 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:42:42.984245 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:42:43.254572 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:42:43.263186 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:43.266733 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Took 1.52 seconds to deallocate network for instance.
May 19 04:42:43.281969 np0000001025 nova-compute[97981]: WARNING nova.volume.cinder [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Attachment 93a46743-0234-4022-beb8-5eeb11c1c1a9 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 93a46743-0234-4022-beb8-5eeb11c1c1a9. (HTTP 404) (Request-ID: req-7c3ff267-507b-4600-b26b-faf2a9dcbd31)
May 19 04:42:43.281969 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] Took 0.01 seconds to detach 1 volumes for instance.
May 19 04:42:43.491649 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:42:43.491810 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.710s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:43.492046 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:42:43.787231 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:43.787447 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:44.269522 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Found WWN 330000000c2ce7d1a for multipath device dm-1 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:42:44.269837 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:42:44.270033 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== connect_volume: return (58286ms) {'type': 'block', 'scsi_wwn': '330000000c2ce7d1a', 'path': '/dev/dm-1', 'multipath_id': '330000000c2ce7d1a'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:42:44.270225 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c2ce7d1a', 'path': '/dev/dm-1', 'multipath_id': '330000000c2ce7d1a'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:42:44.270741 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 55.139s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:42:44.270962 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '405ea65f-8d17-42c7-922a-dac27a17a488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:42:44.283045 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:42:44.283743 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:42:44.284177 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:42:44.284625 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:42:44.284912 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:42:44.286397 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.startup = automatic
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.scan = manual
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:42:44.297489 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:42:44.297489 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.startup = automatic
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.scan = manual
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:42:44.302087 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:42:44.302087 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:44.313143 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:44.318018 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:44.330747 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:44.330747 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:44.330747 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:44.330747 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:44.330747 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:44.330747 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:44.330747 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:44.330747 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:44.330747 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:44.330747 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:44.330747 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:44.330747 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:42:44.330973 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:44.330973 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:44.330973 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:44.330973 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:44.330973 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:44.330973 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:44.330973 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:44.330973 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:44.330973 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:44.330973 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:44.330973 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:44.330973 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:42:44.331352 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.047s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:42:44.331507 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:42:44.332492 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] HCTL ('21', '0', '0', 0) found on session 95 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:42:44.332595 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Scanning host 21 c: 0, t: 0, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:42:44.337479 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:44.337479 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:44.337479 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:44.337479 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:44.337479 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:44.337479 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:44.337479 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:44.337479 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:44.337479 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:44.337479 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:44.337479 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:44.337479 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:42:44.337701 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:44.337701 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:44.337701 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:44.337701 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:44.337701 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:44.337701 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:44.337701 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:44.337701 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:44.337701 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:44.337701 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:44.337701 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:44.337701 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:42:44.337880 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.054s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:42:44.337930 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:42:44.338560 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] HCTL ('19', '0', '0', 0) found on session 94 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:42:44.338702 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Scanning host 19 c: 0, t: 0, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:42:44.344146 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching for a device in session 95 and hctl ('21', '0', '0', 0) yield: sdn {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:42:44.344792 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '405ea65f-8d17-42c7-922a-dac27a17a488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:42:44.347838 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching for a device in session 94 and hctl ('19', '0', '0', 0) yield: sdp {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:42:44.348017 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '405ea65f-8d17-42c7-922a-dac27a17a488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:42:44.385258 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:42:44.385472 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:42:44.743276 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:44.777606 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:41:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-900232716',display_name='tempest-TestVolumeBootPattern-volume-backed-server-900232716',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-volume-backed-server-900232716',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFth9htvMi69kNWeSArcbfgCWnicUtKvp6jsYhgNYCet3tKtaBGZ8ukz18dYhkilEPUOYMWTrHKI0EM8sUqd7xeejIZ3OGJ32wBcgSaeAbpmew7BO3B2PSkHexJHAgFNqQ==',key_name='tempest-keypair-1008715844',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-2tajyhyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:41:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c46088fb3e74b819bb456461716a801',uuid=54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de", "address": "fa:16:3e:b6:da:78", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3cbfbfe-4f", "ovs_interfaceid": "b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:42:44.777773 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de", "address": "fa:16:3e:b6:da:78", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3cbfbfe-4f", "ovs_interfaceid": "b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:42:44.778348 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:da:78,bridge_name='br-int',has_traffic_filtering=True,id=b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3cbfbfe-4f') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:42:44.778913 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'pci_devices' on Instance uuid 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:42:44.887907 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:42:45.281559 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] End _get_guest_xml xml=<domain type="qemu">
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:   <uuid>54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8</uuid>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:   <name>instance-00000029</name>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-900232716</nova:name>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:41:45</nova:creationTime>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:         <nova:user uuid="5c46088fb3e74b819bb456461716a801">tempest-TestVolumeBootPattern-1071176852-project-member</nova:user>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:         <nova:project uuid="28b3c0fa8f894ed2a7c3bcfac99ce74c">tempest-TestVolumeBootPattern-1071176852</nova:project>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:         <nova:port uuid="b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de">
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     <system>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <entry name="serial">54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8</entry>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <entry name="uuid">54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8</entry>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     </system>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:   <os>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:   </os>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:   <features>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:   </features>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:   <devices>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8/disk.config"/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     </disk>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <alias name="ua-97cb7b11-9118-4b51-9829-98f5aa82dbfd"/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-1"/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <serial>97cb7b11-9118-4b51-9829-98f5aa82dbfd</serial>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     </disk>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:b6:da:78"/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <target dev="tapb3cbfbfe-4f"/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     </interface>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8/console.log" append="off"/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     </serial>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     <video>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     </video>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     </rng>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:   </devices>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]: </domain>
May 19 04:42:45.281559 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:42:45.284642 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Preparing to wait for external event network-vif-plugged-b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:42:45.284642 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:45.284642 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:45.284642 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:45.284642 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:41:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-900232716',display_name='tempest-TestVolumeBootPattern-volume-backed-server-900232716',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-volume-backed-server-900232716',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFth9htvMi69kNWeSArcbfgCWnicUtKvp6jsYhgNYCet3tKtaBGZ8ukz18dYhkilEPUOYMWTrHKI0EM8sUqd7xeejIZ3OGJ32wBcgSaeAbpmew7BO3B2PSkHexJHAgFNqQ==',key_name='tempest-keypair-1008715844',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-2tajyhyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:41:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c46088fb3e74b819bb456461716a801',uuid=54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de", "address": "fa:16:3e:b6:da:78", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3cbfbfe-4f", "ovs_interfaceid": "b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:42:45.284642 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de", "address": "fa:16:3e:b6:da:78", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3cbfbfe-4f", "ovs_interfaceid": "b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:42:45.284642 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:da:78,bridge_name='br-int',has_traffic_filtering=True,id=b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3cbfbfe-4f') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:42:45.284642 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:da:78,bridge_name='br-int',has_traffic_filtering=True,id=b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3cbfbfe-4f') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:42:45.284642 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:45.284642 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:42:45.285060 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:42:45.285803 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:45.285959 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6624fc7-1857-5f94-98b2-3fe24382cfe8', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:42:45.286751 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:45.287412 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:42:45.288141 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:45.288537 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:42:45.290314 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:45.290455 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3cbfbfe-4f, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:42:45.290749 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3cbfbfe-4f, col_values=(('qos', UUID('86047afd-d56d-498d-8604-a2cc7077d022')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:42:45.290923 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3cbfbfe-4f, col_values=(('external_ids', {'iface-id': 'b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:da:78', 'vm-uuid': '54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:42:45.291590 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:45.292662 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:42:45.297031 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:45.298257 np0000001025 nova-compute[97981]: INFO os_vif [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:da:78,bridge_name='br-int',has_traffic_filtering=True,id=b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3cbfbfe-4f')
May 19 04:42:45.395701 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.608s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:45.457028 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Deleted allocations for instance 0dbaac9f-71f1-4cb6-837c-cafc38f94f11
May 19 04:42:45.491356 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:42:45.491527 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:42:45.491775 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.12 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:42:46.304921 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Found WWN 3300000009f63224e for multipath device dm-11 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:42:46.305507 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.035s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:42:46.305664 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] <== connect_volume: return (57173ms) {'type': 'block', 'scsi_wwn': '3300000009f63224e', 'path': '/dev/dm-11', 'multipath_id': '3300000009f63224e'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:42:46.305902 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009f63224e', 'path': '/dev/dm-11', 'multipath_id': '3300000009f63224e'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:42:46.306617 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 36.971s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:42:46.306864 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:42:46.320536 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:42:46.322191 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:42:46.322191 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:42:46.322473 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:42:46.325055 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:42:46.325055 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:42:46.337548 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:42:46.337548 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:46.339567 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:42:46.339567 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:46.354165 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4] added
May 19 04:42:46.354165 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:42:46.354165 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:42:46.354165 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:42:46.354165 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:42:46.354165 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:42:46.354165 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:46.354165 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:42:46.354478 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0319(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:42:46.354624 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:42:46.355120 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4] added
May 19 04:42:46.355120 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:42:46.355120 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:42:46.355120 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:42:46.355120 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:42:46.355120 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:42:46.355120 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:46.355387 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:42:46.355584 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0308(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:42:46.355663 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:42:46.465380 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-50f33f60-e304-4e6f-9a34-1fe59d77cee2 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 66.953s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:46.466420 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 15.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:46.466713 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] [instance: 0dbaac9f-71f1-4cb6-837c-cafc38f94f11] During sync_power_state the instance has a pending task (deleting). Skip.
May 19 04:42:46.466963 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "0dbaac9f-71f1-4cb6-837c-cafc38f94f11" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:46.817976 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001025',hostname='multiattach-server-0',id=37,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9kq9UfoFPrqlSUYASLa2M8/KXwpiWIksTRz6r+vXFFf5G7djO79flSW+4jvUEBmYvioxzxvTch1hKVIwlMIaMSuT3AyUPlX/5ZPn59wF6pdcyyqAHuNzAVPjAjiGd+6A==',key_name='tempest-keypair-818275091',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:40:51Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001025',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-ksq0p58y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:41:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa432d60cb324c6d87818107e05e0053',uuid=6f26313e-2659-4687-84da-96cf2da9a4e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "vif_mac": "fa:16:3e:fa:d4:f0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:42:46.818537 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "vif_mac": "fa:16:3e:fa:d4:f0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:42:46.819162 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:d4:f0,bridge_name='br-int',has_traffic_filtering=True,id=9791a107-963b-4608-9092-2df622d06125,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9791a107-96') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:42:46.821002 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] End _get_guest_xml xml=<domain type="qemu">
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:   <uuid>6f26313e-2659-4687-84da-96cf2da9a4e2</uuid>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:   <name>instance-00000025</name>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:   <memory>262144</memory>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <nova:name>multiattach-server-0</nova:name>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:41:48</nova:creationTime>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.micro" id="84">
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:         <nova:memory>256</nova:memory>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:           <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:           <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:         <nova:user uuid="aa432d60cb324c6d87818107e05e0053">tempest-AttachVolumeMultiAttachTest-1659172696-project-member</nova:user>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:         <nova:project uuid="490151decdde445593a86a16976f6b34">tempest-AttachVolumeMultiAttachTest-1659172696</nova:project>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:         <nova:port uuid="9791a107-963b-4608-9092-2df622d06125">
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     <system>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <entry name="serial">6f26313e-2659-4687-84da-96cf2da9a4e2</entry>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <entry name="uuid">6f26313e-2659-4687-84da-96cf2da9a4e2</entry>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     </system>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:   <os>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:   </os>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:   <features>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:   </features>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:   <devices>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     </disk>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk.config"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     </disk>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <alias name="ua-405ea65f-8d17-42c7-922a-dac27a17a488"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-11"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <target dev="vdb" bus="virtio"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <serial>405ea65f-8d17-42c7-922a-dac27a17a488</serial>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <shareable/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     </disk>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:fa:d4:f0"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <target dev="tap9791a107-96"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     </interface>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/console.log" append="off"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     </serial>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     <video>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     </video>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     </rng>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:   </devices>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]: </domain>
May 19 04:42:46.821002 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:42:46.823986 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001025',hostname='multiattach-server-0',id=37,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9kq9UfoFPrqlSUYASLa2M8/KXwpiWIksTRz6r+vXFFf5G7djO79flSW+4jvUEBmYvioxzxvTch1hKVIwlMIaMSuT3AyUPlX/5ZPn59wF6pdcyyqAHuNzAVPjAjiGd+6A==',key_name='tempest-keypair-818275091',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:40:51Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001025',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-ksq0p58y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:41:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa432d60cb324c6d87818107e05e0053',uuid=6f26313e-2659-4687-84da-96cf2da9a4e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "vif_mac": "fa:16:3e:fa:d4:f0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:42:46.823986 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "vif_mac": "fa:16:3e:fa:d4:f0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:42:46.823986 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:d4:f0,bridge_name='br-int',has_traffic_filtering=True,id=9791a107-963b-4608-9092-2df622d06125,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9791a107-96') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:42:46.823986 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:d4:f0,bridge_name='br-int',has_traffic_filtering=True,id=9791a107-963b-4608-9092-2df622d06125,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9791a107-96') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:42:46.823986 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:46.823986 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:42:46.823986 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:42:46.824737 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:46.824893 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dfa44868-5d55-5b96-bf58-0256ee942c6f', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:42:46.826051 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:42:46.826738 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:46.827074 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:42:46.827271 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:42:46.827548 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No VIF found with MAC fa:16:3e:b6:da:78, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:42:46.828093 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Using config drive
May 19 04:42:46.831740 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:46.833870 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:46.834023 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9791a107-96, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:42:46.834330 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9791a107-96, col_values=(('qos', UUID('27a9590d-4e68-4896-8078-bb847e85aa93')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:42:46.834470 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9791a107-96, col_values=(('external_ids', {'iface-id': '9791a107-963b-4608-9092-2df622d06125', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:d4:f0', 'vm-uuid': '6f26313e-2659-4687-84da-96cf2da9a4e2'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:42:46.835217 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:46.836780 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:42:46.845684 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:46.846370 np0000001025 nova-compute[97981]: INFO os_vif [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:d4:f0,bridge_name='br-int',has_traffic_filtering=True,id=9791a107-963b-4608-9092-2df622d06125,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9791a107-96')
May 19 04:42:47.097901 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:47.098161 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:47.333047 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:47.355951 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:42:47.356474 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:42:47.371754 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:42:47.371754 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:42:47.374548 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:42:47.374548 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:47.386470 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:47.393240 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:47.404165 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:47.404165 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:47.404165 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:47.404165 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:47.404165 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:47.404165 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:47.404165 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:47.404165 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:47.404165 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:47.404165 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:47.404165 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:47.404165 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:42:47.404615 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:47.404615 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:47.404615 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:47.404615 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:47.404615 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:47.404615 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:47.404615 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:47.404615 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:47.404615 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:47.404615 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:47.404615 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:47.404615 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:42:47.415901 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:47.415901 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:47.415901 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:47.415901 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:47.415901 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:47.415901 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:47.415901 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:47.415901 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:47.415901 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:47.415901 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:47.415901 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:47.415901 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:42:47.416313 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:47.416313 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:47.416313 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:47.416313 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:47.416313 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:47.416313 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:47.416313 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:47.416313 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:47.416313 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:47.416313 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:47.416313 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:47.416313 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:42:47.454367 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4, portal: 192.168.40.100,3260]
May 19 04:42:47.454367 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4, portal: 192.168.40.100,3260] successful.
May 19 04:42:47.454367 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:47.466835 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:47.478215 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Creating config drive at /opt/stack/data/nova/instances/54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8/disk.config
May 19 04:42:47.482864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj996gz1x {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:47.496565 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4, portal: 192.168.50.100,3260]
May 19 04:42:47.496565 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4, portal: 192.168.50.100,3260] successful.
May 19 04:42:47.496565 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:47.497870 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:47.497870 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:47.497870 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:47.497870 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:47.497870 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:47.497870 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:47.497870 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:47.497870 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:47.497870 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:47.497870 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:47.497870 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:47.497870 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:47.497870 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:47.497870 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:42:47.498424 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:47.498424 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:47.498424 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:47.498424 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:47.498424 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:47.498424 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:47.498424 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:47.498424 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:47.498424 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:47.498424 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:47.498424 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:47.498424 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:47.498424 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:47.498424 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:42:47.499424 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:42:47.499673 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:42:47.502875 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] HCTL ('12', '-', '-', 0) found on session 99 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:42:47.503094 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:42:47.511857 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:47.523773 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Searching for a device in session 99 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:42:47.523773 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:42:47.537397 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:47.537397 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:47.537397 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:47.537397 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:47.537397 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:47.537397 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:47.537397 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:47.537397 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:47.537397 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:47.537397 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:47.537397 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:47.537397 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:47.537397 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:47.537397 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:42:47.537991 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:47.537991 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:47.537991 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:47.537991 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:47.537991 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:47.537991 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:47.537991 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:47.537991 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:47.537991 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:47.537991 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:47.537991 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:47.537991 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:47.537991 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:47.537991 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:42:47.538432 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.214s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:42:47.538432 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:42:47.539345 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj996gz1x" returned: 0 in 0.057s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:47.541318 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] HCTL ('16', '-', '-', 0) found on session 100 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:42:47.541527 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:42:47.554796 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Searching for a device in session 100 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:42:47.554796 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:42:47.601935 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Detaching volume 82d50c4c-3f93-4fc1-adcd-170812ca09de
May 19 04:42:47.651210 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Attempting to driver detach volume 82d50c4c-3f93-4fc1-adcd-170812ca09de from mountpoint /dev/vdd
May 19 04:42:47.658789 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Found disk vdd by alias ua-82d50c4c-3f93-4fc1-adcd-170812ca09de {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:42:47.660474 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Found disk vdd by alias ua-82d50c4c-3f93-4fc1-adcd-170812ca09de {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:42:47.660560 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Attempting to detach device vdd from instance aa2cdf1d-65ef-4cf4-b742-72ae783cde27 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:42:47.660845 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:42:47.660845 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:42:47.660845 np0000001025 nova-compute[97981]:   <alias name="ua-82d50c4c-3f93-4fc1-adcd-170812ca09de"/>
May 19 04:42:47.660845 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-6"/>
May 19 04:42:47.660845 np0000001025 nova-compute[97981]:   <target dev="vdd" bus="virtio"/>
May 19 04:42:47.660845 np0000001025 nova-compute[97981]:   <serial>82d50c4c-3f93-4fc1-adcd-170812ca09de</serial>
May 19 04:42:47.660845 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:42:47.660845 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 19 04:42:47.660845 np0000001025 nova-compute[97981]: </disk>
May 19 04:42:47.660845 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:42:47.668436 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Successfully detached device vdd from instance aa2cdf1d-65ef-4cf4-b742-72ae783cde27 from the persistent domain config.
May 19 04:42:47.668436 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] (1/8): Attempting to detach device vdd with device alias ua-82d50c4c-3f93-4fc1-adcd-170812ca09de from instance aa2cdf1d-65ef-4cf4-b742-72ae783cde27 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:42:47.668653 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:42:47.668653 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:42:47.668653 np0000001025 nova-compute[97981]:   <alias name="ua-82d50c4c-3f93-4fc1-adcd-170812ca09de"/>
May 19 04:42:47.668653 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-6"/>
May 19 04:42:47.668653 np0000001025 nova-compute[97981]:   <target dev="vdd" bus="virtio"/>
May 19 04:42:47.668653 np0000001025 nova-compute[97981]:   <serial>82d50c4c-3f93-4fc1-adcd-170812ca09de</serial>
May 19 04:42:47.668653 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:42:47.668653 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 19 04:42:47.668653 np0000001025 nova-compute[97981]: </disk>
May 19 04:42:47.668653 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:42:47.983500 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:48.015034 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:48.134915 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:48.231793 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165768.2314124, aa2cdf1d-65ef-4cf4-b742-72ae783cde27 => ua-82d50c4c-3f93-4fc1-adcd-170812ca09de> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:42:48.235123 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Start waiting for the detach event from libvirt for device vdd with device alias ua-82d50c4c-3f93-4fc1-adcd-170812ca09de for instance aa2cdf1d-65ef-4cf4-b742-72ae783cde27 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:42:48.238103 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Successfully detached device vdd from instance aa2cdf1d-65ef-4cf4-b742-72ae783cde27 from the live domain config.
May 19 04:42:48.264173 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:48.273581 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:42:48.274031 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '82d50c4c-3f93-4fc1-adcd-170812ca09de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:42:48.274240 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:42:48.310645 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:48.319603 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:48.321777 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:48.322864 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:42:48.343477 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:48.347065 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:48.362464 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:42:48.362570 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:42:48.362802 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:42:48.362802 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No VIF found with MAC fa:16:3e:fa:d4:f0, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:42:48.363329 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Using config drive
May 19 04:42:48.463842 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-81e86d2c-72cc-49b3-aded-59256f93b169 req-02572b98-f202-48ff-a2ca-b791cf5dcfb5 service nova] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Received event network-vif-plugged-b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:42:48.464281 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-81e86d2c-72cc-49b3-aded-59256f93b169 req-02572b98-f202-48ff-a2ca-b791cf5dcfb5 service nova] Acquiring lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:48.465840 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-81e86d2c-72cc-49b3-aded-59256f93b169 req-02572b98-f202-48ff-a2ca-b791cf5dcfb5 service nova] Lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:48.465840 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-81e86d2c-72cc-49b3-aded-59256f93b169 req-02572b98-f202-48ff-a2ca-b791cf5dcfb5 service nova] Lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:48.465840 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-81e86d2c-72cc-49b3-aded-59256f93b169 req-02572b98-f202-48ff-a2ca-b791cf5dcfb5 service nova] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Processing event network-vif-plugged-b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:42:48.835212 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:48.866396 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:48.870504 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:48.964318 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:48.983867 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165768.982559, 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:42:48.983867 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] VM Started (Lifecycle Event)
May 19 04:42:48.986139 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:42:48.991534 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:42:48.995202 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Instance spawned successfully.
May 19 04:42:48.995565 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:42:49.007801 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:49.043670 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-94e7d5de-6579-4728-97aa-919349537ff5 req-13a2fc9f-b870-4b09-a272-2b1f18e6b882 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Received event network-vif-plugged-9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:42:49.043839 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-94e7d5de-6579-4728-97aa-919349537ff5 req-13a2fc9f-b870-4b09-a272-2b1f18e6b882 service nova] Acquiring lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:49.044155 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-94e7d5de-6579-4728-97aa-919349537ff5 req-13a2fc9f-b870-4b09-a272-2b1f18e6b882 service nova] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:49.044650 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-94e7d5de-6579-4728-97aa-919349537ff5 req-13a2fc9f-b870-4b09-a272-2b1f18e6b882 service nova] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:49.044840 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-94e7d5de-6579-4728-97aa-919349537ff5 req-13a2fc9f-b870-4b09-a272-2b1f18e6b882 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] No waiting events found dispatching network-vif-plugged-9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:42:49.045006 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-94e7d5de-6579-4728-97aa-919349537ff5 req-13a2fc9f-b870-4b09-a272-2b1f18e6b882 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Received unexpected event network-vif-plugged-9791a107-963b-4608-9092-2df622d06125 for instance with vm_state active and task_state resize_finish.
May 19 04:42:49.338031 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Found WWN 330000000ad3b08db for multipath device dm-4 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:42:49.338422 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:42:49.338685 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] <== connect_volume: return (40002ms) {'type': 'block', 'scsi_wwn': '330000000ad3b08db', 'path': '/dev/dm-4', 'multipath_id': '330000000ad3b08db'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:42:49.338873 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ad3b08db', 'path': '/dev/dm-4', 'multipath_id': '330000000ad3b08db'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:42:49.339435 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 17.205s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:42:49.339666 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:42:49.342484 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lazy-loading 'flavor' on Instance uuid 3ad7c142-5f58-498e-b24c-ea7d4faa1d63 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:42:49.352449 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:42:49.353049 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:42:49.353522 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:42:49.353840 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:42:49.354333 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:42:49.354597 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:42:49.369674 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:42:49.369674 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:49.379777 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:42:49.379777 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:49.385589 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc] added
May 19 04:42:49.385589 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:42:49.385589 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:42:49.385589 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:42:49.385589 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:42:49.385589 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:42:49.385589 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:49.385853 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:42:49.385968 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:42:49.386062 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:42:49.393831 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc] added
May 19 04:42:49.393831 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:42:49.393831 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:42:49.393831 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:42:49.393831 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:42:49.393831 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:42:49.393831 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:49.394076 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:42:49.394363 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0397(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:42:49.394962 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:42:49.488430 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:42:49.492199 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:42:49.505240 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:49.505429 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:49.505801 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:49.506062 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:49.506364 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:49.506617 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:49.638243 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Instance event wait completed in 0 seconds for  {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:42:49.643115 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Instance running successfully.
May 19 04:42:49.644084 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Failed to set time: agent not configured {{(pid=97981) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 19 04:42:49.644233 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-669d5a17-65f0-4f0b-a5bf-27a638630dcb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] finish_migration finished successfully. {{(pid=97981) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 19 04:42:49.845215 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Attempting to attach volume c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:42:49.846322 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:42:49.846322 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:42:49.846322 np0000001025 nova-compute[97981]:   <alias name="ua-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4"/>
May 19 04:42:49.846322 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-4"/>
May 19 04:42:49.846322 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:42:49.846322 np0000001025 nova-compute[97981]:   <serial>c2d31c73-c0d3-4dbe-a967-28714c1b9ec4</serial>
May 19 04:42:49.846322 np0000001025 nova-compute[97981]: </disk>
May 19 04:42:49.846322 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:42:49.996862 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:42:49.997204 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165769.9969869, 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:42:49.997369 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] VM Paused (Lifecycle Event)
May 19 04:42:50.005277 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:50.012701 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Took 64.50 seconds to spawn the instance on the hypervisor.
May 19 04:42:50.012962 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:42:50.214875 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0017942269998911797 future=<Future at 0x7218345e95b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:42:50.214983 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:42:50.218065 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Emitting event <LifecycleEvent: 1779165755.2129767, 15f0abbc-b8de-4d77-88c4-e5c0e54d691f => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:42:50.218196 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] VM Stopped (Lifecycle Event)
May 19 04:42:50.386483 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:42:50.402434 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:42:50.406572 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:42:50.406572 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:42:50.417472 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:42:50.417472 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:50.421559 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:50.428746 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:50.444022 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:50.444022 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:50.444022 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:50.444022 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:50.444022 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:50.444022 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:50.444022 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:50.444022 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:50.444022 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:50.444022 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:50.444022 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:50.444022 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:50.444022 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:50.444022 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:42:50.444521 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:50.444521 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:50.444521 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:50.444521 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:50.444521 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:50.444521 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:50.444521 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:50.444521 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:50.444521 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:50.444521 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:50.444521 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:50.444521 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:50.444521 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:50.444521 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:42:50.451702 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:50.451702 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:50.451702 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:50.451702 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:50.451702 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:50.451702 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:50.451702 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:50.451702 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:50.451702 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:50.451702 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:50.451702 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:50.451702 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:50.451702 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:50.451702 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:42:50.452172 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:50.452172 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:50.452172 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:50.452172 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:50.452172 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:50.452172 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:50.452172 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:50.452172 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:50.452172 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:50.452172 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:50.452172 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:50.452172 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:50.452172 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:50.452172 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:42:50.507285 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:42:50.507366 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc, portal: 192.168.40.100,3260]
May 19 04:42:50.507366 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc, portal: 192.168.40.100,3260] successful.
May 19 04:42:50.507366 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:50.510374 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165770.5101016, 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:42:50.510836 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] VM Resumed (Lifecycle Event)
May 19 04:42:50.515679 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc, portal: 192.168.50.100,3260]
May 19 04:42:50.515679 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc, portal: 192.168.50.100,3260] successful.
May 19 04:42:50.515679 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:50.524486 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Took 75.63 seconds to build instance.
May 19 04:42:50.526562 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:50.531229 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:50.549848 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:50.549848 np0000001025 nova-compute[97981]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:50.549848 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:50.549848 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:50.549848 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:50.549848 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:50.549848 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:50.549848 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:50.549848 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:50.549848 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:50.549848 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:50.549848 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:50.549848 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:50.549848 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:50.549848 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:50.549848 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:42:50.550485 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:50.550485 np0000001025 nova-compute[97981]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:50.550485 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:50.550485 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:50.550485 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:50.550485 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:50.550485 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:50.550485 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:50.550485 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:50.550485 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:50.550485 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:50.550485 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:50.550485 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:50.550485 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:50.550485 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:50.550485 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:42:50.550485 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:42:50.550975 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:42:50.556873 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-58680a54-56f3-4c1b-ab91-af7138bcdec1 req-11c08d35-f57a-43f7-ac72-e5dc1e97c5a9 service nova] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Received event network-vif-plugged-b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:42:50.556873 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-58680a54-56f3-4c1b-ab91-af7138bcdec1 req-11c08d35-f57a-43f7-ac72-e5dc1e97c5a9 service nova] Acquiring lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:50.556873 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-58680a54-56f3-4c1b-ab91-af7138bcdec1 req-11c08d35-f57a-43f7-ac72-e5dc1e97c5a9 service nova] Lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:50.556873 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-58680a54-56f3-4c1b-ab91-af7138bcdec1 req-11c08d35-f57a-43f7-ac72-e5dc1e97c5a9 service nova] Lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:50.556873 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-58680a54-56f3-4c1b-ab91-af7138bcdec1 req-11c08d35-f57a-43f7-ac72-e5dc1e97c5a9 service nova] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] No waiting events found dispatching network-vif-plugged-b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:42:50.556873 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-58680a54-56f3-4c1b-ab91-af7138bcdec1 req-11c08d35-f57a-43f7-ac72-e5dc1e97c5a9 service nova] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Received unexpected event network-vif-plugged-b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de for instance with vm_state active and task_state None.
May 19 04:42:50.557238 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] HCTL ('17', '-', '-', 0) found on session 101 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:42:50.557238 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:50.558009 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:42:50.558752 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.204s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:42:50.558752 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:42:50.559949 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] HCTL ('18', '-', '-', 0) found on session 102 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:42:50.560048 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:42:50.573225 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Searching for a device in session 101 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:42:50.573368 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:42:50.580531 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Searching for a device in session 102 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:42:50.580531 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:42:50.722442 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 15f0abbc-b8de-4d77-88c4-e5c0e54d691f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:42:51.013199 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:42:51.016035 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:42:51.027934 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4607675d-c33f-4b58-8c49-37ba03ade959 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 77.142s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:51.028545 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 19.057s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:51.028767 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:42:51.028907 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:51.123881 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-14cc6009-c90d-40c9-8f10-8faa45c347ab req-b304d587-3853-4b05-9878-65d310c436f4 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Received event network-vif-plugged-9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:42:51.124016 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-14cc6009-c90d-40c9-8f10-8faa45c347ab req-b304d587-3853-4b05-9878-65d310c436f4 service nova] Acquiring lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:51.124197 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-14cc6009-c90d-40c9-8f10-8faa45c347ab req-b304d587-3853-4b05-9878-65d310c436f4 service nova] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:51.124331 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-14cc6009-c90d-40c9-8f10-8faa45c347ab req-b304d587-3853-4b05-9878-65d310c436f4 service nova] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:51.124466 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-14cc6009-c90d-40c9-8f10-8faa45c347ab req-b304d587-3853-4b05-9878-65d310c436f4 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] No waiting events found dispatching network-vif-plugged-9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:42:51.124632 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-14cc6009-c90d-40c9-8f10-8faa45c347ab req-b304d587-3853-4b05-9878-65d310c436f4 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Received unexpected event network-vif-plugged-9791a107-963b-4608-9092-2df622d06125 for instance with vm_state resized and task_state None.
May 19 04:42:51.354294 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:42:51.518526 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:42:51.518912 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:42:51.518944 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:42:51.519125 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] No VIF found with MAC fa:16:3e:0c:f0:96, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:42:51.522332 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165771.5219922, 6f26313e-2659-4687-84da-96cf2da9a4e2 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:42:51.522827 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] VM Resumed (Lifecycle Event)
May 19 04:42:51.836665 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:52.025893 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:42:52.030761 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:42:52.153633 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe963d4a-6ee5-4e07-9a9d-0e818638abdb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "6f26313e-2659-4687-84da-96cf2da9a4e2" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:52.153867 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe963d4a-6ee5-4e07-9a9d-0e818638abdb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:52.154052 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-fe963d4a-6ee5-4e07-9a9d-0e818638abdb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Going to confirm migration 3 {{(pid=97981) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 19 04:42:52.373604 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Found WWN 330000000d723aaaa for multipath device dm-5 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:42:52.373930 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:42:52.374153 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] <== connect_volume: return (20239ms) {'type': 'block', 'scsi_wwn': '330000000d723aaaa', 'path': '/dev/dm-5', 'multipath_id': '330000000d723aaaa'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:42:52.374300 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d723aaaa', 'path': '/dev/dm-5', 'multipath_id': '330000000d723aaaa'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:42:52.375523 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 18.359s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:42:52.375773 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69aa8c4f-bf28-4b5c-93c7-e315122038c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:42:52.389268 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:42:52.394137 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:42:52.394137 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:42:52.394137 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:42:52.394137 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:42:52.394137 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:42:52.406647 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:42:52.406647 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:52.416502 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:42:52.416502 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:52.421114 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6] added
May 19 04:42:52.421114 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:42:52.421114 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:42:52.421114 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:42:52.421114 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:42:52.421114 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:42:52.421114 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:52.421283 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:42:52.421406 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0299(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:42:52.421523 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:42:52.429256 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6] added
May 19 04:42:52.429256 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:42:52.429256 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:42:52.429256 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:42:52.429256 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:42:52.429256 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:42:52.429256 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:52.429458 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:42:52.429597 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0372(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:42:52.429756 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:42:52.536678 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165772.535484, 6f26313e-2659-4687-84da-96cf2da9a4e2 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:42:52.536678 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] VM Started (Lifecycle Event)
May 19 04:42:52.630441 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fd8cabe9-9d0c-469d-8cc1-26f82f76e56e req-6ba35c64-bfb5-4b18-ad97-6e93f356b981 service nova] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Received event network-changed-b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:42:52.630801 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fd8cabe9-9d0c-469d-8cc1-26f82f76e56e req-6ba35c64-bfb5-4b18-ad97-6e93f356b981 service nova] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Refreshing instance network info cache due to event network-changed-b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:42:52.631001 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fd8cabe9-9d0c-469d-8cc1-26f82f76e56e req-6ba35c64-bfb5-4b18-ad97-6e93f356b981 service nova] Acquiring lock "refresh_cache-54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:42:52.631139 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fd8cabe9-9d0c-469d-8cc1-26f82f76e56e req-6ba35c64-bfb5-4b18-ad97-6e93f356b981 service nova] Acquired lock "refresh_cache-54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:42:52.631278 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-fd8cabe9-9d0c-469d-8cc1-26f82f76e56e req-6ba35c64-bfb5-4b18-ad97-6e93f356b981 service nova] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Refreshing network info cache for port b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:42:52.660141 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-fe963d4a-6ee5-4e07-9a9d-0e818638abdb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:52.794718 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-fe963d4a-6ee5-4e07-9a9d-0e818638abdb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:52.795094 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe963d4a-6ee5-4e07-9a9d-0e818638abdb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:42:52.795310 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe963d4a-6ee5-4e07-9a9d-0e818638abdb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquired lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:42:52.795502 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-fe963d4a-6ee5-4e07-9a9d-0e818638abdb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:42:52.795712 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-fe963d4a-6ee5-4e07-9a9d-0e818638abdb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'info_cache' on Instance uuid 6f26313e-2659-4687-84da-96cf2da9a4e2 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:42:52.885793 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-690448989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverbootfromvolumestablerescuetest-server-690448989',id=44,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7465b5668be4eb9b75c1ddc876e7eac',ramdisk_id='',reservation_id='r-8ma0qp1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-96916496',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:42:26Z,user_data=None,user_id='5885f1561f394d46bd4c1b48e7323c1e',uuid=92b3fb19-741d-476b-9d2f-83654a17aa0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29504364-b589-4dde-a783-4b3bcaea9e02", "address": "fa:16:3e:8e:f5:3b", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29504364-b5", "ovs_interfaceid": "29504364-b589-4dde-a783-4b3bcaea9e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:42:52.886059 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converting VIF {"id": "29504364-b589-4dde-a783-4b3bcaea9e02", "address": "fa:16:3e:8e:f5:3b", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29504364-b5", "ovs_interfaceid": "29504364-b589-4dde-a783-4b3bcaea9e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:42:52.886813 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:f5:3b,bridge_name='br-int',has_traffic_filtering=True,id=29504364-b589-4dde-a783-4b3bcaea9e02,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29504364-b5') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:42:52.890884 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'pci_devices' on Instance uuid 92b3fb19-741d-476b-9d2f-83654a17aa0e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:42:52.938984 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "80436afa-9cd9-41cd-b589-629da01b6bfe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:52.939197 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:53.038875 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:42:53.039922 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:42:53.075915 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1500c765-c928-46f8-83f6-f412299893fe tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 44.413s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:53.077426 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 21.109s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:53.132947 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-fd8cabe9-9d0c-469d-8cc1-26f82f76e56e req-6ba35c64-bfb5-4b18-ad97-6e93f356b981 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:53.265617 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:53.395150 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] End _get_guest_xml xml=<domain type="qemu">
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:   <uuid>92b3fb19-741d-476b-9d2f-83654a17aa0e</uuid>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:   <name>instance-0000002c</name>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-690448989</nova:name>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:42:32</nova:creationTime>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:         <nova:user uuid="5885f1561f394d46bd4c1b48e7323c1e">tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member</nova:user>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:         <nova:project uuid="f7465b5668be4eb9b75c1ddc876e7eac">tempest-ServerBootFromVolumeStableRescueTest-96916496</nova:project>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:         <nova:port uuid="29504364-b589-4dde-a783-4b3bcaea9e02">
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     <system>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <entry name="serial">92b3fb19-741d-476b-9d2f-83654a17aa0e</entry>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <entry name="uuid">92b3fb19-741d-476b-9d2f-83654a17aa0e</entry>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     </system>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:   <os>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:   </os>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:   <features>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:   </features>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:   <devices>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e/disk.config"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     </disk>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <alias name="ua-0e4db490-fa07-43c8-8325-b0028b4b6ecc"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-5"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <serial>0e4db490-fa07-43c8-8325-b0028b4b6ecc</serial>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     </disk>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:8e:f5:3b"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <target dev="tap29504364-b5"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     </interface>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e/console.log" append="off"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     </serial>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     <video>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     </video>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     </rng>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:   </devices>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]: </domain>
May 19 04:42:53.395150 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:42:53.397011 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Preparing to wait for external event network-vif-plugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:42:53.397011 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:53.397011 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:53.397011 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:53.397011 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-690448989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverbootfromvolumestablerescuetest-server-690448989',id=44,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7465b5668be4eb9b75c1ddc876e7eac',ramdisk_id='',reservation_id='r-8ma0qp1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-96916496',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:42:26Z,user_data=None,user_id='5885f1561f394d46bd4c1b48e7323c1e',uuid=92b3fb19-741d-476b-9d2f-83654a17aa0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29504364-b589-4dde-a783-4b3bcaea9e02", "address": "fa:16:3e:8e:f5:3b", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29504364-b5", "ovs_interfaceid": "29504364-b589-4dde-a783-4b3bcaea9e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:42:53.397011 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converting VIF {"id": "29504364-b589-4dde-a783-4b3bcaea9e02", "address": "fa:16:3e:8e:f5:3b", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29504364-b5", "ovs_interfaceid": "29504364-b589-4dde-a783-4b3bcaea9e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:42:53.397969 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:f5:3b,bridge_name='br-int',has_traffic_filtering=True,id=29504364-b589-4dde-a783-4b3bcaea9e02,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29504364-b5') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:42:53.397969 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:f5:3b,bridge_name='br-int',has_traffic_filtering=True,id=29504364-b589-4dde-a783-4b3bcaea9e02,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29504364-b5') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:42:53.398570 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:53.398570 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:42:53.398829 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:42:53.399749 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:53.399898 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8197a127-b86f-59bb-9fbe-6f5863e80bf7', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:42:53.401000 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:53.401855 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:42:53.402398 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:53.405536 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:53.405678 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29504364-b5, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:42:53.406017 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29504364-b5, col_values=(('qos', UUID('22721980-0a5f-4110-8823-357498f40c99')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:42:53.406240 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29504364-b5, col_values=(('external_ids', {'iface-id': '29504364-b589-4dde-a783-4b3bcaea9e02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:f5:3b', 'vm-uuid': '92b3fb19-741d-476b-9d2f-83654a17aa0e'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:42:53.408912 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:42:53.413422 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:53.414609 np0000001025 nova-compute[97981]: INFO os_vif [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:f5:3b,bridge_name='br-int',has_traffic_filtering=True,id=29504364-b589-4dde-a783-4b3bcaea9e02,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29504364-b5')
May 19 04:42:53.421919 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:42:53.432781 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-fd8cabe9-9d0c-469d-8cc1-26f82f76e56e req-6ba35c64-bfb5-4b18-ad97-6e93f356b981 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:53.435607 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:42:53.442346 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:42:53.452252 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:42:53.452252 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:42:53.461659 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:42:53.461659 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:53.464354 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:53.471476 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:53.489745 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:42:53.495295 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:53.495295 np0000001025 nova-compute[97981]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:53.495295 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:53.495295 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:53.495295 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:53.495295 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:53.495295 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:53.495295 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:53.495295 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:53.495295 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:53.495295 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:53.495295 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:53.495295 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:53.495295 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:53.495295 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:53.495295 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:42:53.495599 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:53.495599 np0000001025 nova-compute[97981]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:53.495599 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:53.495599 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:53.495599 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:53.495599 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:53.495599 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:53.495599 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:53.495599 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:53.495599 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:53.495599 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:53.495599 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:53.495599 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:53.495599 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:53.495599 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:53.495599 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:42:53.547598 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6, portal: 192.168.40.100,3260]
May 19 04:42:53.547598 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6, portal: 192.168.40.100,3260] successful.
May 19 04:42:53.547598 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:53.555983 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6, portal: 192.168.50.100,3260]
May 19 04:42:53.555983 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6, portal: 192.168.50.100,3260] successful.
May 19 04:42:53.555983 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:53.562540 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:53.568191 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:53.581140 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.504s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:53.584719 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-fd8cabe9-9d0c-469d-8cc1-26f82f76e56e req-6ba35c64-bfb5-4b18-ad97-6e93f356b981 service nova] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Updated VIF entry in instance network info cache for port b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:42:53.585356 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-fd8cabe9-9d0c-469d-8cc1-26f82f76e56e req-6ba35c64-bfb5-4b18-ad97-6e93f356b981 service nova] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Updating instance_info_cache with network_info: [{"id": "b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de", "address": "fa:16:3e:b6:da:78", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3cbfbfe-4f", "ovs_interfaceid": "b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:42:53.586214 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:53.586214 np0000001025 nova-compute[97981]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:53.586214 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:53.586214 np0000001025 nova-compute[97981]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:42:53.586214 np0000001025 nova-compute[97981]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:42:53.586214 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:53.586214 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:53.586214 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:53.586214 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:53.586214 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:53.586214 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:53.586214 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:53.586214 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:53.586214 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:53.586214 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:53.586214 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:53.586214 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:53.586214 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:42:53.586862 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:53.586862 np0000001025 nova-compute[97981]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:53.586862 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:53.586862 np0000001025 nova-compute[97981]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:42:53.586862 np0000001025 nova-compute[97981]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:42:53.586862 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:53.586862 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:53.586862 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:53.586862 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:53.586862 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:53.586862 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:53.586862 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:53.586862 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:53.586862 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:53.586862 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:53.586862 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:53.586862 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:53.586862 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:42:53.587639 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.196s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:42:53.587639 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:42:53.591761 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] HCTL ('22', '-', '-', 0) found on session 103 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:42:53.591761 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:42:53.592384 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:53.592384 np0000001025 nova-compute[97981]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:53.592384 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:53.592384 np0000001025 nova-compute[97981]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:42:53.592384 np0000001025 nova-compute[97981]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:42:53.592384 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:53.592384 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:53.592384 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:53.592384 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:53.592384 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:53.592384 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:53.592384 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:53.592384 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:53.592384 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:53.592384 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:53.592384 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:53.592384 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:53.592384 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:42:53.592672 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:53.592672 np0000001025 nova-compute[97981]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:53.592672 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:53.592672 np0000001025 nova-compute[97981]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:42:53.592672 np0000001025 nova-compute[97981]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:42:53.592672 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:53.592672 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:53.592672 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:53.592672 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:53.592672 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:53.592672 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:53.592672 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:53.592672 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:53.592672 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:53.592672 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:53.592672 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:53.592672 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:53.592672 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:42:53.593029 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:42:53.593029 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:42:53.594291 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] HCTL ('23', '-', '-', 0) found on session 104 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:42:53.594408 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Scanning host 23 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:42:53.608013 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Searching for a device in session 103 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:42:53.608013 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69aa8c4f-bf28-4b5c-93c7-e315122038c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:42:53.613354 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Searching for a device in session 104 and hctl ['23', '*', '*', 0] yield: sdr {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:42:53.613464 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Connected to sdr using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '69aa8c4f-bf28-4b5c-93c7-e315122038c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:42:53.799898 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-fe963d4a-6ee5-4e07-9a9d-0e818638abdb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:54.023778 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:54.023953 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:54.027287 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:42:54.027429 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Claim successful on node np0000001025
May 19 04:42:54.087919 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fd8cabe9-9d0c-469d-8cc1-26f82f76e56e req-6ba35c64-bfb5-4b18-ad97-6e93f356b981 service nova] Releasing lock "refresh_cache-54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:42:54.127346 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-fe963d4a-6ee5-4e07-9a9d-0e818638abdb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:54.255420 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-fe963d4a-6ee5-4e07-9a9d-0e818638abdb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Updating instance_info_cache with network_info: [{"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:42:54.392463 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:42:54.758626 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe963d4a-6ee5-4e07-9a9d-0e818638abdb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Releasing lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:42:54.759027 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-fe963d4a-6ee5-4e07-9a9d-0e818638abdb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'migration_context' on Instance uuid 6f26313e-2659-4687-84da-96cf2da9a4e2 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:42:54.931250 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:42:54.931414 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:42:54.931564 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] No VIF found with MAC fa:16:3e:8e:f5:3b, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:42:54.932161 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Using config drive
May 19 04:42:55.262220 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-fe963d4a-6ee5-4e07-9a9d-0e818638abdb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Object Instance<6f26313e-2659-4687-84da-96cf2da9a4e2> lazy-loaded attributes: info_cache,migration_context {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:42:55.269645 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe963d4a-6ee5-4e07-9a9d-0e818638abdb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:55.410290 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Found WWN 3300000004ab3d8eb for multipath device dm-10 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:42:55.410569 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:42:55.410725 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] <== connect_volume: return (21394ms) {'type': 'block', 'scsi_wwn': '3300000004ab3d8eb', 'path': '/dev/dm-10', 'multipath_id': '3300000004ab3d8eb'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:42:55.410951 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004ab3d8eb', 'path': '/dev/dm-10', 'multipath_id': '3300000004ab3d8eb'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:42:55.411948 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 7.137s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:42:55.411948 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '82d50c4c-3f93-4fc1-adcd-170812ca09de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:42:55.411948 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:42:55.413873 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lazy-loading 'flavor' on Instance uuid 0b156bbc-f85d-4739-bf88-bc609d4f8052 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:42:55.439012 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:55.451648 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', '100'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '102'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', '103'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', '99')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de, 0): [] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de') {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de, 0): [] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82d50c4c-3f93-4fc1-adcd-170812ca09de') {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185012eca0>, {}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Disconnecting from: [] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.040s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] <== disconnect_volume: return (7176ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:42:55.451648 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:42:55.599391 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Creating config drive at /opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e/disk.config
May 19 04:42:55.602492 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcdw8tlq7 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:55.670122 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcdw8tlq7" returned: 0 in 0.067s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:55.789838 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:42:55.790389 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:42:55.921748 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Attempting to attach volume 69aa8c4f-bf28-4b5c-93c7-e315122038c6 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:42:55.926352 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:42:55.926352 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:42:55.926352 np0000001025 nova-compute[97981]:   <alias name="ua-69aa8c4f-bf28-4b5c-93c7-e315122038c6"/>
May 19 04:42:55.926352 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-10"/>
May 19 04:42:55.926352 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:42:55.926352 np0000001025 nova-compute[97981]:   <serial>69aa8c4f-bf28-4b5c-93c7-e315122038c6</serial>
May 19 04:42:55.926352 np0000001025 nova-compute[97981]: </disk>
May 19 04:42:55.926352 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:42:56.017139 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lazy-loading 'flavor' on Instance uuid aa2cdf1d-65ef-4cf4-b742-72ae783cde27 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:42:56.210169 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:56.238080 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:56.293662 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:42:56.325286 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:56.360971 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:56.380755 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9259f84f-7ad9-4ebd-8f7a-6d5b2c1f03ae req-05d51e7b-65c1-4dfc-8409-e8f8d80381f8 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received event network-vif-plugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:42:56.384163 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9259f84f-7ad9-4ebd-8f7a-6d5b2c1f03ae req-05d51e7b-65c1-4dfc-8409-e8f8d80381f8 service nova] Acquiring lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:56.384163 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9259f84f-7ad9-4ebd-8f7a-6d5b2c1f03ae req-05d51e7b-65c1-4dfc-8409-e8f8d80381f8 service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:56.384163 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9259f84f-7ad9-4ebd-8f7a-6d5b2c1f03ae req-05d51e7b-65c1-4dfc-8409-e8f8d80381f8 service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:56.384163 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9259f84f-7ad9-4ebd-8f7a-6d5b2c1f03ae req-05d51e7b-65c1-4dfc-8409-e8f8d80381f8 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Processing event network-vif-plugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:42:56.800500 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.776s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:56.801076 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe963d4a-6ee5-4e07-9a9d-0e818638abdb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 1.531s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:56.802713 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:42:57.000609 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:42:57.002316 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165777.0007033, 92b3fb19-741d-476b-9d2f-83654a17aa0e => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:42:57.002551 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] VM Started (Lifecycle Event)
May 19 04:42:57.005162 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:42:57.007253 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Instance spawned successfully.
May 19 04:42:57.007705 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:42:57.022252 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe1521b4-2885-4397-889f-97bbed63b74e tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 9.924s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:57.311887 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:42:57.312127 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:42:57.312458 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:57.312946 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:57.346730 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:57.418697 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96f7f84eb55d44e89c2ed500098135e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662c1a9b25e44aff8242f468232af7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:42:57.506869 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:42:57.512022 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:42:57.517490 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:57.517628 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:57.517933 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:57.518230 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:57.518464 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:57.518711 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:42:57.633908 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:42:57.633908 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:42:57.633908 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:42:57.633908 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] No VIF found with MAC fa:16:3e:1d:f0:b2, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:42:57.722694 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:57.722916 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:57.813416 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:42:57.964895 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Successfully created port: 15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:42:58.016127 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:42:58.016849 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165778.0166526, 92b3fb19-741d-476b-9d2f-83654a17aa0e => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:42:58.017039 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] VM Paused (Lifecycle Event)
May 19 04:42:58.023314 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Took 25.91 seconds to spawn the instance on the hypervisor.
May 19 04:42:58.023458 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:42:58.093977 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fe963d4a-6ee5-4e07-9a9d-0e818638abdb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:42:58.094248 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-fe963d4a-6ee5-4e07-9a9d-0e818638abdb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:42:58.232100 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Detaching volume 1497a529-407f-487e-a103-bfd3abdbb8e4
May 19 04:42:58.268402 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:58.280413 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Attempting to driver detach volume 1497a529-407f-487e-a103-bfd3abdbb8e4 from mountpoint /dev/vdc
May 19 04:42:58.319717 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:42:58.324753 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1497a529-407f-487e-a103-bfd3abdbb8e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'aa2cdf1d-65ef-4cf4-b742-72ae783cde27', 'attached_at': '', 'detached_at': '', 'volume_id': '1497a529-407f-487e-a103-bfd3abdbb8e4', 'serial': '1497a529-407f-487e-a103-bfd3abdbb8e4'} {{(pid=97981) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 19 04:42:58.328677 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Found disk vdc by alias ua-1497a529-407f-487e-a103-bfd3abdbb8e4 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:42:58.329850 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Found disk vdc by alias ua-1497a529-407f-487e-a103-bfd3abdbb8e4 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:42:58.330226 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Attempting to detach device vdc from instance aa2cdf1d-65ef-4cf4-b742-72ae783cde27 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:42:58.330226 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:42:58.330226 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:42:58.330226 np0000001025 nova-compute[97981]:   <alias name="ua-1497a529-407f-487e-a103-bfd3abdbb8e4"/>
May 19 04:42:58.330226 np0000001025 nova-compute[97981]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 19 04:42:58.330226 np0000001025 nova-compute[97981]:   <target dev="vdc" bus="virtio"/>
May 19 04:42:58.330226 np0000001025 nova-compute[97981]:   <serial>1497a529-407f-487e-a103-bfd3abdbb8e4</serial>
May 19 04:42:58.330226 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 19 04:42:58.330226 np0000001025 nova-compute[97981]:   <encryption format="luks">
May 19 04:42:58.330226 np0000001025 nova-compute[97981]:     <secret type="passphrase" uuid="c301b491-9277-438b-8aee-0f00d303d1d0"/>
May 19 04:42:58.330226 np0000001025 nova-compute[97981]:   </encryption>
May 19 04:42:58.330226 np0000001025 nova-compute[97981]: </disk>
May 19 04:42:58.330226 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:42:58.337855 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Successfully detached device vdc from instance aa2cdf1d-65ef-4cf4-b742-72ae783cde27 from the persistent domain config.
May 19 04:42:58.338011 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] (1/8): Attempting to detach device vdc with device alias ua-1497a529-407f-487e-a103-bfd3abdbb8e4 from instance aa2cdf1d-65ef-4cf4-b742-72ae783cde27 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:42:58.338378 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:42:58.338378 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:42:58.338378 np0000001025 nova-compute[97981]:   <alias name="ua-1497a529-407f-487e-a103-bfd3abdbb8e4"/>
May 19 04:42:58.338378 np0000001025 nova-compute[97981]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 19 04:42:58.338378 np0000001025 nova-compute[97981]:   <target dev="vdc" bus="virtio"/>
May 19 04:42:58.338378 np0000001025 nova-compute[97981]:   <serial>1497a529-407f-487e-a103-bfd3abdbb8e4</serial>
May 19 04:42:58.338378 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 19 04:42:58.338378 np0000001025 nova-compute[97981]:   <encryption format="luks">
May 19 04:42:58.338378 np0000001025 nova-compute[97981]:     <secret type="passphrase" uuid="c301b491-9277-438b-8aee-0f00d303d1d0"/>
May 19 04:42:58.338378 np0000001025 nova-compute[97981]:   </encryption>
May 19 04:42:58.338378 np0000001025 nova-compute[97981]: </disk>
May 19 04:42:58.338378 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:42:58.406961 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:42:58.448863 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d3a8eb84-89e2-452b-b2d5-71528c39d296 req-279afe91-e39b-48fc-ae58-c62be815af05 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received event network-vif-plugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:42:58.449045 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d3a8eb84-89e2-452b-b2d5-71528c39d296 req-279afe91-e39b-48fc-ae58-c62be815af05 service nova] Acquiring lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:58.449282 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d3a8eb84-89e2-452b-b2d5-71528c39d296 req-279afe91-e39b-48fc-ae58-c62be815af05 service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:58.449429 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d3a8eb84-89e2-452b-b2d5-71528c39d296 req-279afe91-e39b-48fc-ae58-c62be815af05 service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:58.449575 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d3a8eb84-89e2-452b-b2d5-71528c39d296 req-279afe91-e39b-48fc-ae58-c62be815af05 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] No waiting events found dispatching network-vif-plugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:42:58.449735 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-d3a8eb84-89e2-452b-b2d5-71528c39d296 req-279afe91-e39b-48fc-ae58-c62be815af05 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received unexpected event network-vif-plugged-29504364-b589-4dde-a783-4b3bcaea9e02 for instance with vm_state active and task_state None.
May 19 04:42:58.479705 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Successfully updated port: 15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:42:58.519658 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:42:58.521614 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165778.5213993, 92b3fb19-741d-476b-9d2f-83654a17aa0e => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:42:58.521748 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] VM Resumed (Lifecycle Event)
May 19 04:42:58.535139 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Took 36.58 seconds to build instance.
May 19 04:42:58.597075 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-fe963d4a-6ee5-4e07-9a9d-0e818638abdb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:42:58.853268 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-1497a529-407f-487e-a103-bfd3abdbb8e4 for instance aa2cdf1d-65ef-4cf4-b742-72ae783cde27 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:42:58.984822 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "refresh_cache-80436afa-9cd9-41cd-b589-629da01b6bfe" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:42:58.984931 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquired lock "refresh_cache-80436afa-9cd9-41cd-b589-629da01b6bfe" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:42:58.985090 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:42:59.028629 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:42:59.029906 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:42:59.037584 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f086e757-242b-48c9-ba22-30279d6d23ae tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.092s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:59.038096 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 26.272s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:59.038217 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
May 19 04:42:59.038378 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:59.200729 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8bf521ab-240b-434e-98c0-1a831c549147 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.883s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:59.319787 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:59.320035 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:59.344317 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:42:59.344317 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:42:59.344317 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Creating image(s)
May 19 04:42:59.344317 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "/opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:59.344317 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "/opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:59.345846 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "/opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:59.346518 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:42:59.350052 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:42:59.351261 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:59.408282 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:59.450412 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.099s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:59.454127 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:59.454127 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:59.454127 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:42:59.454602 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:42:59.455076 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:59.532829 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165779.5323374, aa2cdf1d-65ef-4cf4-b742-72ae783cde27 => ua-1497a529-407f-487e-a103-bfd3abdbb8e4> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:42:59.538001 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Successfully detached device vdc from instance aa2cdf1d-65ef-4cf4-b742-72ae783cde27 from the live domain config.
May 19 04:42:59.546211 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:42:59.546211 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1497a529-407f-487e-a103-bfd3abdbb8e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:42:59.546211 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:42:59.547367 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:42:59.551028 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1497a529-407f-487e-a103-bfd3abdbb8e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:42:59.551028 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:42:59.561898 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.107s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:59.565133 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:59.589673 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:42:59.614717 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe963d4a-6ee5-4e07-9a9d-0e818638abdb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.814s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4 (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:42:59.620081 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', '100'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '102'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', '103'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', '99')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:42:59.620081 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '74')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:42:59.622405 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4', '75')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:42:59.630161 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218344467a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4'): ({'sdc'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:42:59.631446 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Removing multipathed devices sdc, sdb {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:42:59.631446 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Flush multipath device 330000000acf53476 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:42:59.639771 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk 1073741824" returned: 0 in 0.077s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:59.643286 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:59.643286 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:59.672743 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Acquiring lock "48bdc405-dd40-4f80-a701-c25ee025d9a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:59.673380 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lock "48bdc405-dd40-4f80-a701-c25ee025d9a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:59.688059 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:42:59.740340 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:42:59.755169 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.111s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:59.755169 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:42:59.755169 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:42:59.794231 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:42:59.794485 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:42:59.796817 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:42:59.807433 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:42:59.807799 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:42:59.826505 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Detaching volume c2d31c73-c0d3-4dbe-a967-28714c1b9ec4
May 19 04:42:59.828873 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:59.848178 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:42:59.875068 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:42:59.878294 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Cannot resize image /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:42:59.878294 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:42:59.878294 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Ensure instance console log exists: /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:42:59.879456 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:42:59.882527 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 74, target: iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4, portal: 192.168.40.100,3260]
May 19 04:42:59.882527 np0000001025 nova-compute[97981]: Logout of [sid: 74, target: iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4, portal: 192.168.40.100,3260] successful.
May 19 04:42:59.882527 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:59.882527 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:42:59.882527 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:42:59.885902 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Attempting to driver detach volume c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 from mountpoint /dev/vdb
May 19 04:42:59.892603 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Found disk vdb by alias ua-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:42:59.893940 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Found disk vdb by alias ua-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:42:59.894094 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Attempting to detach device vdb from instance 3ad7c142-5f58-498e-b24c-ea7d4faa1d63 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:42:59.894365 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:42:59.894365 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:42:59.894365 np0000001025 nova-compute[97981]:   <alias name="ua-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4"/>
May 19 04:42:59.894365 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-4"/>
May 19 04:42:59.894365 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:42:59.894365 np0000001025 nova-compute[97981]:   <serial>c2d31c73-c0d3-4dbe-a967-28714c1b9ec4</serial>
May 19 04:42:59.894365 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:42:59.894365 np0000001025 nova-compute[97981]: </disk>
May 19 04:42:59.894365 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:42:59.905200 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Successfully detached device vdb from instance 3ad7c142-5f58-498e-b24c-ea7d4faa1d63 from the persistent domain config.
May 19 04:42:59.905381 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] (1/8): Attempting to detach device vdb with device alias ua-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 from instance 3ad7c142-5f58-498e-b24c-ea7d4faa1d63 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:42:59.905689 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:42:59.905689 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:42:59.905689 np0000001025 nova-compute[97981]:   <alias name="ua-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4"/>
May 19 04:42:59.905689 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-4"/>
May 19 04:42:59.905689 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:42:59.905689 np0000001025 nova-compute[97981]:   <serial>c2d31c73-c0d3-4dbe-a967-28714c1b9ec4</serial>
May 19 04:42:59.905689 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:42:59.905689 np0000001025 nova-compute[97981]: </disk>
May 19 04:42:59.905689 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:42:59.907070 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:59.919786 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:59.960338 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 75, target: iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4, portal: 192.168.50.100,3260]
May 19 04:42:59.960338 np0000001025 nova-compute[97981]: Logout of [sid: 75, target: iqn.2023-03.storpool.com:os--volume-1497a529-407f-487e-a103-bfd3abdbb8e4, portal: 192.168.50.100,3260] successful.
May 19 04:42:59.960338 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:59.989723 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:42:59.991342 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.444s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:42:59.991483 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] <== disconnect_volume: return (445ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:42:59.991606 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:43:00.030927 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Updating instance_info_cache with network_info: [{"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:00.130123 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Rescuing
May 19 04:43:00.130309 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "refresh_cache-92b3fb19-741d-476b-9d2f-83654a17aa0e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:00.130403 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquired lock "refresh_cache-92b3fb19-741d-476b-9d2f-83654a17aa0e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:00.130511 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:43:00.190487 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:43:00.258430 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-fe963d4a-6ee5-4e07-9a9d-0e818638abdb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Deleted allocation for migration 764a078a-b090-4b69-b61b-fd2f0d233e5e
May 19 04:43:00.485490 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165780.4850295, 3ad7c142-5f58-498e-b24c-ea7d4faa1d63 => ua-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:43:00.485848 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 for instance 3ad7c142-5f58-498e-b24c-ea7d4faa1d63 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:43:00.489226 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Successfully detached device vdb from instance 3ad7c142-5f58-498e-b24c-ea7d4faa1d63 from the live domain config.
May 19 04:43:00.490088 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:43:00.490433 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:43:00.490740 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:43:00.491056 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:43:00.491350 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:43:00.491476 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:43:00.510308 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-21eac350-75af-40c6-89c5-782ef8a3c68f req-7c4c6aea-aa33-4adc-a52f-5a20f3cd6f58 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received event network-changed-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:00.510308 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-21eac350-75af-40c6-89c5-782ef8a3c68f req-7c4c6aea-aa33-4adc-a52f-5a20f3cd6f58 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Refreshing instance network info cache due to event network-changed-15e6bc86-13bd-43b9-ad28-342f33dbdeb8. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:43:00.513273 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-21eac350-75af-40c6-89c5-782ef8a3c68f req-7c4c6aea-aa33-4adc-a52f-5a20f3cd6f58 service nova] Acquiring lock "refresh_cache-80436afa-9cd9-41cd-b589-629da01b6bfe" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:00.525144 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:43:00.525144 np0000001025 nova-compute[97981]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:00.525144 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:00.525144 np0000001025 nova-compute[97981]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:43:00.525144 np0000001025 nova-compute[97981]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:43:00.525144 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:00.525144 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:00.525144 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:43:00.525144 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:43:00.525144 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:00.525144 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:00.525144 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:00.525144 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:00.525144 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:43:00.525144 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:43:00.525524 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:43:00.525524 np0000001025 nova-compute[97981]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:00.525524 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:00.525524 np0000001025 nova-compute[97981]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:43:00.525524 np0000001025 nova-compute[97981]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:43:00.525524 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:00.525524 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:00.525524 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:43:00.525524 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:43:00.525524 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:00.525524 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:00.525524 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:00.525524 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:00.525524 np0000001025 nova-compute[97981]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4 (non-flash)
May 19 04:43:00.525524 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:43:00.525524 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', '100'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '102'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', '103'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', '99')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:43:00.525524 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', '99')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:43:00.527998 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', '100')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:43:00.528992 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185018c4a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4'): ({'sdk'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:43:00.529242 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Removing multipathed devices sdg, sdk {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:43:00.529465 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Flush multipath device 330000000ad3b08db {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:43:00.535481 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Releasing lock "refresh_cache-80436afa-9cd9-41cd-b589-629da01b6bfe" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:00.535724 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Instance network_info: |[{"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:43:00.536097 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-21eac350-75af-40c6-89c5-782ef8a3c68f req-7c4c6aea-aa33-4adc-a52f-5a20f3cd6f58 service nova] Acquired lock "refresh_cache-80436afa-9cd9-41cd-b589-629da01b6bfe" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:00.536278 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-21eac350-75af-40c6-89c5-782ef8a3c68f req-7c4c6aea-aa33-4adc-a52f-5a20f3cd6f58 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Refreshing network info cache for port 15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:43:00.538309 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Start _get_guest_xml network_info=[{"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:43:00.544589 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:43:00.546591 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-640764006', uuid='80436afa-9cd9-41cd-b589-629da01b6bfe'), owner=OwnerMeta(userid='96f7f84eb55d44e89c2ed500098135e0', username='tempest-AttachVolumeTestJSON-1215369469-project-member', projectid='662c1a9b25e44aff8242f468232af7f3', projectname='tempest-AttachVolumeTestJSON-1215369469'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165780.5459633) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:43:00.548033 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:43:00.549430 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:43:00.550658 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:43:00.550918 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:43:00.552744 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:43:00.553184 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:43:00.553493 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:43:00.555125 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:43:00.555125 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:43:00.555125 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:43:00.555125 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:43:00.555125 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:43:00.555125 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:43:00.555125 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:43:00.555125 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:43:00.555125 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:43:00.564840 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lazy-loading 'flavor' on Instance uuid aa2cdf1d-65ef-4cf4-b742-72ae783cde27 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:00.569704 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-640764006',display_name='tempest-AttachVolumeTestJSON-server-640764006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumetestjson-server-640764006',id=45,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2tj8xzpEQbsFz0KUREQNWmpjZhzzIU4JsBBAhR6kXLneAex6Ogc6JmA+zSTxW3EHqpPyo/1HFfxr+XwLCwn6E7c5wL4jf0HNaUzjvIvGdUt6TsdBS845t/ZQ77wWohcw==',key_name='tempest-keypair-402968852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='662c1a9b25e44aff8242f468232af7f3',ramdisk_id='',reservation_id='r-bmmqkbkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1215369469',owner_user_name='tempest-AttachVolumeTestJSON-1215369469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:42:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f7f84eb55d44e89c2ed500098135e0',uuid=80436afa-9cd9-41cd-b589-629da01b6bfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:43:00.570508 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converting VIF {"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:43:00.571390 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:43:00.571808 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:04:9d,bridge_name='br-int',has_traffic_filtering=True,id=15e6bc86-13bd-43b9-ad28-342f33dbdeb8,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6bc86-13') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:43:00.573472 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'pci_devices' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:00.617639 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:43:00.633575 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:00.658188 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Checking to see if SCSI volumes sdg, sdk have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:43:00.658346 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] SCSI volumes sdg, sdk have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:43:00.659761 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Checking to see if device paths {'sdg', 'sdk'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:43:00.670465 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Device paths {'sdg', 'sdk'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:43:00.670803 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:43:00.682605 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:00.724314 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 99, target: iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4, portal: 192.168.40.100,3260]
May 19 04:43:00.724314 np0000001025 nova-compute[97981]: Logout of [sid: 99, target: iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4, portal: 192.168.40.100,3260] successful.
May 19 04:43:00.724314 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:00.744956 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:00.758029 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:00.762657 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe963d4a-6ee5-4e07-9a9d-0e818638abdb tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 8.609s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:00.782558 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:00.783255 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:00.788201 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:43:00.788949 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Claim successful on node np0000001025
May 19 04:43:00.797528 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 100, target: iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4, portal: 192.168.50.100,3260]
May 19 04:43:00.797528 np0000001025 nova-compute[97981]: Logout of [sid: 100, target: iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4, portal: 192.168.50.100,3260] successful.
May 19 04:43:00.797528 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:00.825944 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:00.826200 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:43:00.826345 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] <== disconnect_volume: return (335ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:43:00.826507 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:43:00.966771 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:01.042767 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-21eac350-75af-40c6-89c5-782ef8a3c68f req-7c4c6aea-aa33-4adc-a52f-5a20f3cd6f58 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:01.080684 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] End _get_guest_xml xml=<domain type="qemu">
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:   <uuid>80436afa-9cd9-41cd-b589-629da01b6bfe</uuid>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:   <name>instance-0000002d</name>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <nova:name>tempest-AttachVolumeTestJSON-server-640764006</nova:name>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:43:00</nova:creationTime>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:         <nova:user uuid="96f7f84eb55d44e89c2ed500098135e0">tempest-AttachVolumeTestJSON-1215369469-project-member</nova:user>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:         <nova:project uuid="662c1a9b25e44aff8242f468232af7f3">tempest-AttachVolumeTestJSON-1215369469</nova:project>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:         <nova:port uuid="15e6bc86-13bd-43b9-ad28-342f33dbdeb8">
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     <system>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <entry name="serial">80436afa-9cd9-41cd-b589-629da01b6bfe</entry>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <entry name="uuid">80436afa-9cd9-41cd-b589-629da01b6bfe</entry>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     </system>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:   <os>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:   </os>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:   <features>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:   </features>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:   <devices>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk"/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     </disk>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk.config"/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     </disk>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:08:04:9d"/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <target dev="tap15e6bc86-13"/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     </interface>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/console.log" append="off"/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     </serial>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     <video>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     </video>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     </rng>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:   </devices>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]: </domain>
May 19 04:43:01.080684 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:43:01.082448 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Preparing to wait for external event network-vif-plugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:43:01.082448 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:01.082448 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:01.082448 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:01.082704 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-640764006',display_name='tempest-AttachVolumeTestJSON-server-640764006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumetestjson-server-640764006',id=45,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2tj8xzpEQbsFz0KUREQNWmpjZhzzIU4JsBBAhR6kXLneAex6Ogc6JmA+zSTxW3EHqpPyo/1HFfxr+XwLCwn6E7c5wL4jf0HNaUzjvIvGdUt6TsdBS845t/ZQ77wWohcw==',key_name='tempest-keypair-402968852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='662c1a9b25e44aff8242f468232af7f3',ramdisk_id='',reservation_id='r-bmmqkbkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1215369469',owner_user_name='tempest-AttachVolumeTestJSON-1215369469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:42:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f7f84eb55d44e89c2ed500098135e0',uuid=80436afa-9cd9-41cd-b589-629da01b6bfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:43:01.082823 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converting VIF {"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:43:01.083804 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:04:9d,bridge_name='br-int',has_traffic_filtering=True,id=15e6bc86-13bd-43b9-ad28-342f33dbdeb8,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6bc86-13') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:43:01.083804 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:04:9d,bridge_name='br-int',has_traffic_filtering=True,id=15e6bc86-13bd-43b9-ad28-342f33dbdeb8,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6bc86-13') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:43:01.085150 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:01.086166 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:01.086498 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:43:01.090843 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:01.090843 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51c35113-096a-5174-9894-21a7513c268b', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:01.091612 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:01.093454 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:01.097451 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:01.097882 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15e6bc86-13, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:01.098645 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15e6bc86-13, col_values=(('qos', UUID('4711b7c2-73dc-4983-81f3-9be1c01a48ec')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:01.098812 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15e6bc86-13, col_values=(('external_ids', {'iface-id': '15e6bc86-13bd-43b9-ad28-342f33dbdeb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:04:9d', 'vm-uuid': '80436afa-9cd9-41cd-b589-629da01b6bfe'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:01.106831 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:01.108157 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:01.109179 np0000001025 nova-compute[97981]: INFO os_vif [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:04:9d,bridge_name='br-int',has_traffic_filtering=True,id=15e6bc86-13bd-43b9-ad28-342f33dbdeb8,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6bc86-13')
May 19 04:43:01.154571 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Updating instance_info_cache with network_info: [{"id": "29504364-b589-4dde-a783-4b3bcaea9e02", "address": "fa:16:3e:8e:f5:3b", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29504364-b5", "ovs_interfaceid": "29504364-b589-4dde-a783-4b3bcaea9e02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:01.385541 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lazy-loading 'flavor' on Instance uuid 3ad7c142-5f58-498e-b24c-ea7d4faa1d63 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:01.446147 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-21eac350-75af-40c6-89c5-782ef8a3c68f req-7c4c6aea-aa33-4adc-a52f-5a20f3cd6f58 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:01.584740 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-018091b1-03bd-4e29-8482-7e5e09b9abe0 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.861s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:01.623567 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-21eac350-75af-40c6-89c5-782ef8a3c68f req-7c4c6aea-aa33-4adc-a52f-5a20f3cd6f58 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Updated VIF entry in instance network info cache for port 15e6bc86-13bd-43b9-ad28-342f33dbdeb8. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:43:01.623950 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-21eac350-75af-40c6-89c5-782ef8a3c68f req-7c4c6aea-aa33-4adc-a52f-5a20f3cd6f58 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Updating instance_info_cache with network_info: [{"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:01.633926 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ab7c2e3f-303f-4ce5-b6cd-76294e7482a9 req-2081d3a0-e1a5-4206-a35f-618d31c155f2 service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Received event network-changed-d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:01.634085 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ab7c2e3f-303f-4ce5-b6cd-76294e7482a9 req-2081d3a0-e1a5-4206-a35f-618d31c155f2 service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Refreshing instance network info cache due to event network-changed-d51c757a-3333-4e40-8d5f-3c2d35a128b2. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:43:01.635817 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ab7c2e3f-303f-4ce5-b6cd-76294e7482a9 req-2081d3a0-e1a5-4206-a35f-618d31c155f2 service nova] Acquiring lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:01.635817 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ab7c2e3f-303f-4ce5-b6cd-76294e7482a9 req-2081d3a0-e1a5-4206-a35f-618d31c155f2 service nova] Acquired lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:01.636546 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-ab7c2e3f-303f-4ce5-b6cd-76294e7482a9 req-2081d3a0-e1a5-4206-a35f-618d31c155f2 service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Refreshing network info cache for port d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:43:01.657970 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Releasing lock "refresh_cache-92b3fb19-741d-476b-9d2f-83654a17aa0e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:02.127078 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-21eac350-75af-40c6-89c5-782ef8a3c68f req-7c4c6aea-aa33-4adc-a52f-5a20f3cd6f58 service nova] Releasing lock "refresh_cache-80436afa-9cd9-41cd-b589-629da01b6bfe" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:02.140833 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-ab7c2e3f-303f-4ce5-b6cd-76294e7482a9 req-2081d3a0-e1a5-4206-a35f-618d31c155f2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:02.171366 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:02.171766 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:02.396702 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3926a3bf-efef-42e7-b408-dbec2e7ac06c tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.076s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:02.397646 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.989s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:02.397895 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:02.398066 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:02.398215 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:02.400157 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Terminating instance
May 19 04:43:02.540633 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-ab7c2e3f-303f-4ce5-b6cd-76294e7482a9 req-2081d3a0-e1a5-4206-a35f-618d31c155f2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:02.542978 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:43:02.543299 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:43:02.653450 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:43:02.653450 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:43:02.653450 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No VIF found with MAC fa:16:3e:08:04:9d, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:43:02.653450 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Using config drive
May 19 04:43:02.669122 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-ab7c2e3f-303f-4ce5-b6cd-76294e7482a9 req-2081d3a0-e1a5-4206-a35f-618d31c155f2 service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Updated VIF entry in instance network info cache for port d51c757a-3333-4e40-8d5f-3c2d35a128b2. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:43:02.669358 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-ab7c2e3f-303f-4ce5-b6cd-76294e7482a9 req-2081d3a0-e1a5-4206-a35f-618d31c155f2 service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Updating instance_info_cache with network_info: [{"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:02.674496 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Detaching volume 06f28aae-b80a-4cf7-9a58-f2f84a6356aa
May 19 04:43:02.718712 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Attempting to driver detach volume 06f28aae-b80a-4cf7-9a58-f2f84a6356aa from mountpoint /dev/vdb
May 19 04:43:02.722607 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Found disk vdb by alias ua-06f28aae-b80a-4cf7-9a58-f2f84a6356aa {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:43:02.723686 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Found disk vdb by alias ua-06f28aae-b80a-4cf7-9a58-f2f84a6356aa {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:43:02.723816 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Attempting to detach device vdb from instance aa2cdf1d-65ef-4cf4-b742-72ae783cde27 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:43:02.724057 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:43:02.724057 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:43:02.724057 np0000001025 nova-compute[97981]:   <alias name="ua-06f28aae-b80a-4cf7-9a58-f2f84a6356aa"/>
May 19 04:43:02.724057 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-14"/>
May 19 04:43:02.724057 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:43:02.724057 np0000001025 nova-compute[97981]:   <serial>06f28aae-b80a-4cf7-9a58-f2f84a6356aa</serial>
May 19 04:43:02.724057 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:43:02.724057 np0000001025 nova-compute[97981]: </disk>
May 19 04:43:02.724057 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:43:02.729736 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Successfully detached device vdb from instance aa2cdf1d-65ef-4cf4-b742-72ae783cde27 from the persistent domain config.
May 19 04:43:02.729846 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] (1/8): Attempting to detach device vdb with device alias ua-06f28aae-b80a-4cf7-9a58-f2f84a6356aa from instance aa2cdf1d-65ef-4cf4-b742-72ae783cde27 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:43:02.730418 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:43:02.730418 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:43:02.730418 np0000001025 nova-compute[97981]:   <alias name="ua-06f28aae-b80a-4cf7-9a58-f2f84a6356aa"/>
May 19 04:43:02.730418 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-14"/>
May 19 04:43:02.730418 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:43:02.730418 np0000001025 nova-compute[97981]:   <serial>06f28aae-b80a-4cf7-9a58-f2f84a6356aa</serial>
May 19 04:43:02.730418 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:43:02.730418 np0000001025 nova-compute[97981]: </disk>
May 19 04:43:02.730418 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:43:02.905541 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:43:02.931372 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:02.934334 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:02.956535 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:02.961427 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:02.996565 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:03.046232 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:43:03.090834 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-412fc374-28a0-48e4-bf10-d1e6a7326885 req-c4acf908-47b7-4c1c-adf0-201ed2efec14 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Received event network-vif-unplugged-f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:03.091035 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-412fc374-28a0-48e4-bf10-d1e6a7326885 req-c4acf908-47b7-4c1c-adf0-201ed2efec14 service nova] Acquiring lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:03.093815 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-412fc374-28a0-48e4-bf10-d1e6a7326885 req-c4acf908-47b7-4c1c-adf0-201ed2efec14 service nova] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:03.096082 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-412fc374-28a0-48e4-bf10-d1e6a7326885 req-c4acf908-47b7-4c1c-adf0-201ed2efec14 service nova] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:03.096897 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-412fc374-28a0-48e4-bf10-d1e6a7326885 req-c4acf908-47b7-4c1c-adf0-201ed2efec14 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] No waiting events found dispatching network-vif-unplugged-f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:03.096897 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-412fc374-28a0-48e4-bf10-d1e6a7326885 req-c4acf908-47b7-4c1c-adf0-201ed2efec14 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Received event network-vif-unplugged-f8804350-de17-488a-8b3a-f94271e358f5 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:43:03.158708 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:03.172060 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ab7c2e3f-303f-4ce5-b6cd-76294e7482a9 req-2081d3a0-e1a5-4206-a35f-618d31c155f2 service nova] Releasing lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:03.227298 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165783.22694, aa2cdf1d-65ef-4cf4-b742-72ae783cde27 => ua-06f28aae-b80a-4cf7-9a58-f2f84a6356aa> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:43:03.229397 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-06f28aae-b80a-4cf7-9a58-f2f84a6356aa for instance aa2cdf1d-65ef-4cf4-b742-72ae783cde27 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:43:03.232013 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Successfully detached device vdb from instance aa2cdf1d-65ef-4cf4-b742-72ae783cde27 from the live domain config.
May 19 04:43:03.234813 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:43:03.234813 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06f28aae-b80a-4cf7-9a58-f2f84a6356aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:43:03.234813 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:43:03.234813 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:43:03.234813 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06f28aae-b80a-4cf7-9a58-f2f84a6356aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:43:03.234813 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:03.269940 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '102'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', '103'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '98')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '71')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa', '70')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721850740900>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa'): ({'sdj'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Removing multipathed devices sdo, sdj {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:43:03.269940 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Flush multipath device 330000000db1e4c2c {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:43:03.272732 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:03.287188 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Creating config drive at /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk.config
May 19 04:43:03.292012 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf5hetnzr {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:03.310286 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:43:03.332138 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:03.352574 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:43:03.356546 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf5hetnzr" returned: 0 in 0.064s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:03.360305 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999604721999958 future=<Future at 0x721850251df0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:03.360699 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.99918879400002 future=<Future at 0x721850251df0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:03.360831 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999043856000071 future=<Future at 0x721850251df0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:03.361710 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Instance destroyed successfully.
May 19 04:43:03.362279 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lazy-loading 'resources' on Instance uuid 3ad7c142-5f58-498e-b24c-ea7d4faa1d63 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:03.384466 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:03.400882 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Checking to see if SCSI volumes sdo, sdj have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:43:03.401057 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] SCSI volumes sdo, sdj have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:43:03.402750 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Checking to see if device paths {'sdo', 'sdj'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:43:03.417367 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Device paths {'sdo', 'sdj'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:43:03.418142 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:43:03.423236 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:03.429485 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:03.519004 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 71, target: iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa, portal: 192.168.40.100,3260]
May 19 04:43:03.519004 np0000001025 nova-compute[97981]: Logout of [sid: 71, target: iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa, portal: 192.168.40.100,3260] successful.
May 19 04:43:03.519004 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:03.543477 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:03.555133 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.771s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:03.555280 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:43:03.562558 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:03.587427 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "0b156bbc-f85d-4739-bf88-bc609d4f8052" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:03.590743 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:03.599343 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa, portal: 192.168.50.100,3260]
May 19 04:43:03.599343 np0000001025 nova-compute[97981]: Logout of [sid: 70, target: iqn.2023-03.storpool.com:os--volume-06f28aae-b80a-4cf7-9a58-f2f84a6356aa, portal: 192.168.50.100,3260] successful.
May 19 04:43:03.599343 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:03.624042 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:03.624651 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:43:03.624832 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] <== disconnect_volume: return (391ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:43:03.625019 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:43:03.635751 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cc8abceb-f0df-4ded-99eb-99dc8d266ae1 req-f1940ebf-2472-4882-9ac0-64d00a6bf4e6 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received event network-vif-unplugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:03.639864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cc8abceb-f0df-4ded-99eb-99dc8d266ae1 req-f1940ebf-2472-4882-9ac0-64d00a6bf4e6 service nova] Acquiring lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:03.640126 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cc8abceb-f0df-4ded-99eb-99dc8d266ae1 req-f1940ebf-2472-4882-9ac0-64d00a6bf4e6 service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:03.640315 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cc8abceb-f0df-4ded-99eb-99dc8d266ae1 req-f1940ebf-2472-4882-9ac0-64d00a6bf4e6 service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:03.640484 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cc8abceb-f0df-4ded-99eb-99dc8d266ae1 req-f1940ebf-2472-4882-9ac0-64d00a6bf4e6 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] No waiting events found dispatching network-vif-unplugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:03.640650 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-cc8abceb-f0df-4ded-99eb-99dc8d266ae1 req-f1940ebf-2472-4882-9ac0-64d00a6bf4e6 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received unexpected event network-vif-unplugged-29504364-b589-4dde-a783-4b3bcaea9e02 for instance with vm_state active and task_state rescuing.
May 19 04:43:03.708940 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8ec019e4-7a3f-4c79-ad67-8df7017e42c1 req-485e9232-7a2f-4e9a-a10a-6014fcf02d71 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Received event network-changed-9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:03.710260 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8ec019e4-7a3f-4c79-ad67-8df7017e42c1 req-485e9232-7a2f-4e9a-a10a-6014fcf02d71 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Refreshing instance network info cache due to event network-changed-9791a107-963b-4608-9092-2df622d06125. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:43:03.710485 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8ec019e4-7a3f-4c79-ad67-8df7017e42c1 req-485e9232-7a2f-4e9a-a10a-6014fcf02d71 service nova] Acquiring lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:03.710522 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8ec019e4-7a3f-4c79-ad67-8df7017e42c1 req-485e9232-7a2f-4e9a-a10a-6014fcf02d71 service nova] Acquired lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:03.710656 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-8ec019e4-7a3f-4c79-ad67-8df7017e42c1 req-485e9232-7a2f-4e9a-a10a-6014fcf02d71 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Refreshing network info cache for port 9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:43:03.713100 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:03.733937 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:03.736984 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:03.781713 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:03.797097 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:03.870496 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:41:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-838199839',display_name='tempest-VolumesSnapshotTestJSON-instance-838199839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumessnapshottestjson-instance-838199839',id=40,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeoCBJycwqrGbVkEKjn5sJBRXKAobF0Zhv5k/tSP8lozrIb6Qx/VPrN7atxZUiwt0G0Lz2FhznMvf+stCri1+qhU0sdkHtnLdG9nWUn0LdNlIkN4MqlgvJIt1IF3PznaQ==',key_name='tempest-keypair-2144147369',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:41:27Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='529ec00acc80453dbe8d6a1295e9eb13',ramdisk_id='',reservation_id='r-fh2u1ufb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-492014726',owner_user_name='tempest-VolumesSnapshotTestJSON-492014726-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:41:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f331813eed6416a9bfa432c8b3ed42a',uuid=3ad7c142-5f58-498e-b24c-ea7d4faa1d63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8804350-de17-488a-8b3a-f94271e358f5", "address": "fa:16:3e:0c:f0:96", "network": {"id": "3f564857-63e6-46af-9e0f-3a2de30297d4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-951031274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "529ec00acc80453dbe8d6a1295e9eb13", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8804350-de", "ovs_interfaceid": "f8804350-de17-488a-8b3a-f94271e358f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:43:03.873617 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Converting VIF {"id": "f8804350-de17-488a-8b3a-f94271e358f5", "address": "fa:16:3e:0c:f0:96", "network": {"id": "3f564857-63e6-46af-9e0f-3a2de30297d4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-951031274-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "529ec00acc80453dbe8d6a1295e9eb13", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8804350-de", "ovs_interfaceid": "f8804350-de17-488a-8b3a-f94271e358f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:43:03.874310 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:f0:96,bridge_name='br-int',has_traffic_filtering=True,id=f8804350-de17-488a-8b3a-f94271e358f5,network=Network(3f564857-63e6-46af-9e0f-3a2de30297d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8804350-de') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:43:03.874550 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:f0:96,bridge_name='br-int',has_traffic_filtering=True,id=f8804350-de17-488a-8b3a-f94271e358f5,network=Network(3f564857-63e6-46af-9e0f-3a2de30297d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8804350-de') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:43:03.877451 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:03.877780 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8804350-de, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:03.880901 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:03.881701 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:03.904610 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:03.906639 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:03.906639 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=393320d9-7b59-4f6c-86f0-e82d3a0032e1) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:03.915134 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:03.936629 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:03.937535 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:03.940876 np0000001025 nova-compute[97981]: INFO os_vif [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:f0:96,bridge_name='br-int',has_traffic_filtering=True,id=f8804350-de17-488a-8b3a-f94271e358f5,network=Network(3f564857-63e6-46af-9e0f-3a2de30297d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8804350-de')
May 19 04:43:03.944565 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:43:03.944927 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:43:03.945071 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:43:03.945583 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:43:03.945863 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:43:03.946001 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:43:03.951998 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:03.979627 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:03.979627 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:03.979627 np0000001025 nova-compute[97981]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:43:03.979627 np0000001025 nova-compute[97981]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:43:03.979627 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:03.979627 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:03.979627 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:03.979627 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:03.979627 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:03.979627 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:03.979627 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:43:03.979908 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:03.979908 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:03.979908 np0000001025 nova-compute[97981]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:43:03.979908 np0000001025 nova-compute[97981]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:43:03.979908 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:03.979908 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:03.979908 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:03.979908 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:03.979908 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:03.979908 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:03.979908 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:43:03.979908 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '102'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', '103'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '98')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:43:03.980199 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4, 0): [] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:43:03.980199 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4') {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 19 04:43:03.980199 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4, 0): [] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:43:03.980269 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2d31c73-c0d3-4dbe-a967-28714c1b9ec4') {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 19 04:43:03.981972 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185012cea0>, {}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:43:03.981972 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Disconnecting from: [] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:43:03.981972 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.035s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:43:03.981972 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] <== disconnect_volume: return (36ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:43:03.981972 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:43:03.981972 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Deleting instance files /opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63_del
May 19 04:43:03.982145 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Deletion of /opt/stack/data/nova/instances/3ad7c142-5f58-498e-b24c-ea7d4faa1d63_del complete
May 19 04:43:03.989185 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999684124000169 future=<Future at 0x721834112390 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:03.999568 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Instance destroyed successfully.
May 19 04:43:04.000582 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'numa_topology' on Instance uuid 92b3fb19-741d-476b-9d2f-83654a17aa0e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:04.017331 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:04.056159 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:04.070402 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:43:04.070609 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:43:04.070960 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:04.071260 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:04.090615 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Detaching volume 69aa8c4f-bf28-4b5c-93c7-e315122038c6
May 19 04:43:04.134509 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Attempting to driver detach volume 69aa8c4f-bf28-4b5c-93c7-e315122038c6 from mountpoint /dev/vdb
May 19 04:43:04.147531 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Found disk vdb by alias ua-69aa8c4f-bf28-4b5c-93c7-e315122038c6 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:43:04.155165 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d57d5c7c834497abcbd5aa7ed1df8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4df421703949c7814d3fa7c2637793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:43:04.156969 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Found disk vdb by alias ua-69aa8c4f-bf28-4b5c-93c7-e315122038c6 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:43:04.157684 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Attempting to detach device vdb from instance 0b156bbc-f85d-4739-bf88-bc609d4f8052 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:43:04.157684 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:43:04.157684 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:43:04.157684 np0000001025 nova-compute[97981]:   <alias name="ua-69aa8c4f-bf28-4b5c-93c7-e315122038c6"/>
May 19 04:43:04.157684 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-10"/>
May 19 04:43:04.157684 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:43:04.157684 np0000001025 nova-compute[97981]:   <serial>69aa8c4f-bf28-4b5c-93c7-e315122038c6</serial>
May 19 04:43:04.157684 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:43:04.157684 np0000001025 nova-compute[97981]: </disk>
May 19 04:43:04.157684 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:43:04.165533 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:04.168965 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:04.175182 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:04.178866 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Successfully detached device vdb from instance 0b156bbc-f85d-4739-bf88-bc609d4f8052 from the persistent domain config.
May 19 04:43:04.178866 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] (1/8): Attempting to detach device vdb with device alias ua-69aa8c4f-bf28-4b5c-93c7-e315122038c6 from instance 0b156bbc-f85d-4739-bf88-bc609d4f8052 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:43:04.178866 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:43:04.178866 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:43:04.178866 np0000001025 nova-compute[97981]:   <alias name="ua-69aa8c4f-bf28-4b5c-93c7-e315122038c6"/>
May 19 04:43:04.178866 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-10"/>
May 19 04:43:04.178866 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:43:04.178866 np0000001025 nova-compute[97981]:   <serial>69aa8c4f-bf28-4b5c-93c7-e315122038c6</serial>
May 19 04:43:04.178866 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:43:04.178866 np0000001025 nova-compute[97981]: </disk>
May 19 04:43:04.178866 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:43:04.215706 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-8ec019e4-7a3f-4c79-ad67-8df7017e42c1 req-485e9232-7a2f-4e9a-a10a-6014fcf02d71 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:04.223447 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lazy-loading 'flavor' on Instance uuid aa2cdf1d-65ef-4cf4-b742-72ae783cde27 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:04.492138 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Took 1.59 seconds to destroy the instance on the hypervisor.
May 19 04:43:04.492138 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:43:04.492138 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:43:04.492350 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:43:04.492598 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:04.509781 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Attempting a stable device rescue
May 19 04:43:04.512942 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:04.521344 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:04.524060 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:04.555010 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:04.561742 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:04.575844 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:43:04.588936 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:04.670808 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=97981) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 19 04:43:04.680842 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Instance directory exists: not creating {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 19 04:43:04.680955 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Creating image(s)
May 19 04:43:04.682220 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "/opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:04.682364 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "/opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:04.682873 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "/opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:04.683373 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'trusted_certs' on Instance uuid 92b3fb19-741d-476b-9d2f-83654a17aa0e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:04.704826 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165784.7015324, 0b156bbc-f85d-4739-bf88-bc609d4f8052 => ua-69aa8c4f-bf28-4b5c-93c7-e315122038c6> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:43:04.704826 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-69aa8c4f-bf28-4b5c-93c7-e315122038c6 for instance 0b156bbc-f85d-4739-bf88-bc609d4f8052 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:43:04.705056 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Successfully detached device vdb from instance 0b156bbc-f85d-4739-bf88-bc609d4f8052 from the live domain config.
May 19 04:43:04.706313 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:43:04.706630 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69aa8c4f-bf28-4b5c-93c7-e315122038c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:43:04.706759 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:43:04.707083 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:43:04.707446 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69aa8c4f-bf28-4b5c-93c7-e315122038c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:43:04.707593 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:43:04.715200 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-8ec019e4-7a3f-4c79-ad67-8df7017e42c1 req-485e9232-7a2f-4e9a-a10a-6014fcf02d71 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:04.744471 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:04.744471 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:04.744471 np0000001025 nova-compute[97981]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:43:04.744471 np0000001025 nova-compute[97981]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:43:04.744471 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:04.744471 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:04.744471 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:04.744471 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:04.744471 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:04.744471 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:04.744471 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:43:04.744776 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:04.744776 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:04.744776 np0000001025 nova-compute[97981]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:43:04.744776 np0000001025 nova-compute[97981]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6 (non-flash)
May 19 04:43:04.744776 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:04.744776 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:04.744776 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:04.744776 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:04.744776 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:04.744776 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:04.744776 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:43:04.744944 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '102'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', '103'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '98')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:43:04.744944 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', '103')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:43:04.746025 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6', '104')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:43:04.749900 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185041d120>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6'): ({'sdq'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6'): ({'sdr'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:43:04.749900 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Removing multipathed devices sdq, sdr {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:43:04.751284 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Flush multipath device 3300000004ab3d8eb {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:43:04.760810 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Successfully created port: 0da752b6-6eef-4ad0-8bd2-315518fbea60 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:43:04.796966 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:43:04.852717 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Remove SCSI device /dev/sdr with /sys/block/sdr/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:43:04.911394 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Checking to see if SCSI volumes sdq, sdr have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:43:04.911722 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] SCSI volumes sdq, sdr have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:43:04.913251 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Checking to see if device paths {'sdq', 'sdr'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:43:04.933470 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Device paths {'sdq', 'sdr'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:43:04.934297 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:43:04.953440 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:04.973911 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-8ec019e4-7a3f-4c79-ad67-8df7017e42c1 req-485e9232-7a2f-4e9a-a10a-6014fcf02d71 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Updated VIF entry in instance network info cache for port 9791a107-963b-4608-9092-2df622d06125. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:43:04.975753 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-8ec019e4-7a3f-4c79-ad67-8df7017e42c1 req-485e9232-7a2f-4e9a-a10a-6014fcf02d71 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Updating instance_info_cache with network_info: [{"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:04.995025 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 103, target: iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6, portal: 192.168.40.100,3260]
May 19 04:43:04.995025 np0000001025 nova-compute[97981]: Logout of [sid: 103, target: iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6, portal: 192.168.40.100,3260] successful.
May 19 04:43:04.995025 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:05.018205 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:05.035377 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:05.064004 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 104, target: iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6, portal: 192.168.50.100,3260]
May 19 04:43:05.064004 np0000001025 nova-compute[97981]: Logout of [sid: 104, target: iqn.2023-03.storpool.com:os--volume-69aa8c4f-bf28-4b5c-93c7-e315122038c6, portal: 192.168.50.100,3260] successful.
May 19 04:43:05.064004 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:05.080895 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165785.0805638, 80436afa-9cd9-41cd-b589-629da01b6bfe => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:05.081019 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] VM Started (Lifecycle Event)
May 19 04:43:05.082245 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:43:05.093312 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:05.093549 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:43:05.093698 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] <== disconnect_volume: return (387ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:43:05.093860 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:43:05.166670 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Received event network-vif-unplugged-f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:05.167138 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] Acquiring lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:05.167138 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:05.167567 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:05.169386 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] No waiting events found dispatching network-vif-unplugged-f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:05.169638 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Received event network-vif-unplugged-f8804350-de17-488a-8b3a-f94271e358f5 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:43:05.169886 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Received event network-vif-plugged-f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:05.170344 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] Acquiring lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:05.170821 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:05.170984 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:05.171191 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] No waiting events found dispatching network-vif-plugged-f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:05.171349 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Received unexpected event network-vif-plugged-f8804350-de17-488a-8b3a-f94271e358f5 for instance with vm_state active and task_state deleting.
May 19 04:43:05.171524 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Received event network-vif-plugged-f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:05.171697 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] Acquiring lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:05.171875 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:05.172034 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:05.172216 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] No waiting events found dispatching network-vif-plugged-f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:05.172360 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Received unexpected event network-vif-plugged-f8804350-de17-488a-8b3a-f94271e358f5 for instance with vm_state active and task_state deleting.
May 19 04:43:05.172497 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Received event network-vif-unplugged-f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:05.172645 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] Acquiring lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:05.172802 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:05.172955 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:05.173094 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] No waiting events found dispatching network-vif-unplugged-f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:05.173253 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Received event network-vif-unplugged-f8804350-de17-488a-8b3a-f94271e358f5 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:43:05.173400 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Received event network-vif-unplugged-f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:05.173570 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] Acquiring lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:05.173735 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:05.173873 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:05.174014 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] No waiting events found dispatching network-vif-unplugged-f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:05.174754 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a350113e-04ab-4611-8484-e8ec77e128f9 req-c7840e43-f989-41f7-aa92-ed1d1a3f4bb5 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Received event network-vif-unplugged-f8804350-de17-488a-8b3a-f94271e358f5 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:43:05.187097 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Object Instance<92b3fb19-741d-476b-9d2f-83654a17aa0e> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:43:05.187477 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "1ca15e9fd9929ce022744a6ccd424ba2b91bd6d8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:05.187851 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "1ca15e9fd9929ce022744a6ccd424ba2b91bd6d8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:05.232250 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-db6e2ef2-a9d7-441c-bb8a-7c46cd77d773 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.060s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:05.338013 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Successfully updated port: 0da752b6-6eef-4ad0-8bd2-315518fbea60 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:43:05.481822 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8ec019e4-7a3f-4c79-ad67-8df7017e42c1 req-485e9232-7a2f-4e9a-a10a-6014fcf02d71 service nova] Releasing lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:05.585239 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:05.587452 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Booting with volume 092646db-f85b-4a27-bbec-4a5c360cc73f at /dev/vda
May 19 04:43:05.590120 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165785.5898159, 80436afa-9cd9-41cd-b589-629da01b6bfe => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:05.590309 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] VM Paused (Lifecycle Event)
May 19 04:43:05.594345 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:05.631580 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:43:05.639822 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lazy-loading 'flavor' on Instance uuid 0b156bbc-f85d-4739-bf88-bc609d4f8052 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:05.646318 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:43:05.674854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:05.719897 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-24d1669f-87a0-4a88-9b8d-722d13c9336a req-3849eb11-8637-4d7d-845c-63fdd6f96d7f service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received event network-vif-unplugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:05.720325 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-24d1669f-87a0-4a88-9b8d-722d13c9336a req-3849eb11-8637-4d7d-845c-63fdd6f96d7f service nova] Acquiring lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:05.723644 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-24d1669f-87a0-4a88-9b8d-722d13c9336a req-3849eb11-8637-4d7d-845c-63fdd6f96d7f service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:05.723850 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-24d1669f-87a0-4a88-9b8d-722d13c9336a req-3849eb11-8637-4d7d-845c-63fdd6f96d7f service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:05.724004 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-24d1669f-87a0-4a88-9b8d-722d13c9336a req-3849eb11-8637-4d7d-845c-63fdd6f96d7f service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] No waiting events found dispatching network-vif-unplugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:05.724155 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-24d1669f-87a0-4a88-9b8d-722d13c9336a req-3849eb11-8637-4d7d-845c-63fdd6f96d7f service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received unexpected event network-vif-unplugged-29504364-b589-4dde-a783-4b3bcaea9e02 for instance with vm_state active and task_state rescuing.
May 19 04:43:05.724355 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-24d1669f-87a0-4a88-9b8d-722d13c9336a req-3849eb11-8637-4d7d-845c-63fdd6f96d7f service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Received event network-changed-0da752b6-6eef-4ad0-8bd2-315518fbea60 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:05.724515 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-24d1669f-87a0-4a88-9b8d-722d13c9336a req-3849eb11-8637-4d7d-845c-63fdd6f96d7f service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Refreshing instance network info cache due to event network-changed-0da752b6-6eef-4ad0-8bd2-315518fbea60. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:43:05.724765 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-24d1669f-87a0-4a88-9b8d-722d13c9336a req-3849eb11-8637-4d7d-845c-63fdd6f96d7f service nova] Acquiring lock "refresh_cache-48bdc405-dd40-4f80-a701-c25ee025d9a6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:05.724843 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-24d1669f-87a0-4a88-9b8d-722d13c9336a req-3849eb11-8637-4d7d-845c-63fdd6f96d7f service nova] Acquired lock "refresh_cache-48bdc405-dd40-4f80-a701-c25ee025d9a6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:05.724962 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-24d1669f-87a0-4a88-9b8d-722d13c9336a req-3849eb11-8637-4d7d-845c-63fdd6f96d7f service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Refreshing network info cache for port 0da752b6-6eef-4ad0-8bd2-315518fbea60 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:43:05.726361 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:43:05.726849 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:43:05.737893 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:43:05.739435 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fe3c:c4ae', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fea1:aa43', 'fe80::fc16:3eff:feb0:9e6f', 'fe80::fc16:3eff:fe1d:f0b2', 'fe80::4cb5:1dff:fe2d:31dc', 'fe80::fc16:3eff:fefb:c3a3', 'fe80::2c2c:57ff:feff:64a5', 'fe80::fc16:3eff:feb6:da78', 'fe80::bc20:d2ff:fef5:7278', 'fe80::fc16:3eff:fefa:d4f0', 'fe80::fc16:3eff:fe08:49d', 'fe80::bc2a:1ff:fe94:f24f'] 
May 19 04:43:05.739614 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:43:05.739768 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:43:05.739863 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:43:05.740036 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Updating existing volume attachment record: ca41df6b-74b1-42f0-9fd7-3fcb14471e0a {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:43:05.774810 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ad1e9149-df51-48b7-adb5-45cc6b90efac req-202a61bf-099c-4c16-a252-b65ba3991a79 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received event network-vif-plugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:05.775011 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ad1e9149-df51-48b7-adb5-45cc6b90efac req-202a61bf-099c-4c16-a252-b65ba3991a79 service nova] Acquiring lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:05.775236 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ad1e9149-df51-48b7-adb5-45cc6b90efac req-202a61bf-099c-4c16-a252-b65ba3991a79 service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:05.775396 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ad1e9149-df51-48b7-adb5-45cc6b90efac req-202a61bf-099c-4c16-a252-b65ba3991a79 service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:05.775554 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ad1e9149-df51-48b7-adb5-45cc6b90efac req-202a61bf-099c-4c16-a252-b65ba3991a79 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Processing event network-vif-plugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:43:05.775742 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ad1e9149-df51-48b7-adb5-45cc6b90efac req-202a61bf-099c-4c16-a252-b65ba3991a79 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received event network-vif-plugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:05.775895 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ad1e9149-df51-48b7-adb5-45cc6b90efac req-202a61bf-099c-4c16-a252-b65ba3991a79 service nova] Acquiring lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:05.776041 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ad1e9149-df51-48b7-adb5-45cc6b90efac req-202a61bf-099c-4c16-a252-b65ba3991a79 service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:05.776240 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ad1e9149-df51-48b7-adb5-45cc6b90efac req-202a61bf-099c-4c16-a252-b65ba3991a79 service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:05.776641 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ad1e9149-df51-48b7-adb5-45cc6b90efac req-202a61bf-099c-4c16-a252-b65ba3991a79 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] No waiting events found dispatching network-vif-plugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:05.776641 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-ad1e9149-df51-48b7-adb5-45cc6b90efac req-202a61bf-099c-4c16-a252-b65ba3991a79 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received unexpected event network-vif-plugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 for instance with vm_state building and task_state spawning.
May 19 04:43:05.776768 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ad1e9149-df51-48b7-adb5-45cc6b90efac req-202a61bf-099c-4c16-a252-b65ba3991a79 service nova] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Received event network-vif-deleted-f8804350-de17-488a-8b3a-f94271e358f5 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:05.777161 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:43:05.789245 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:43:05.791424 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:05.795424 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:05.796249 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ca15e9fd9929ce022744a6ccd424ba2b91bd6d8.part --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:05.823883 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Instance spawned successfully.
May 19 04:43:05.825073 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:43:05.843405 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Acquiring lock "refresh_cache-48bdc405-dd40-4f80-a701-c25ee025d9a6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:05.898790 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ca15e9fd9929ce022744a6ccd424ba2b91bd6d8.part --force-share --output=json" returned: 0 in 0.102s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:05.899168 np0000001025 nova-compute[97981]: DEBUG nova.virt.images [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] 72aaea48-2294-40bc-8610-9c320421f475 was qcow2, converting to raw {{(pid=97981) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 19 04:43:05.899741 np0000001025 nova-compute[97981]: DEBUG nova.privsep.utils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97981) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 19 04:43:05.900006 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1ca15e9fd9929ce022744a6ccd424ba2b91bd6d8.part /opt/stack/data/nova/instances/_base/1ca15e9fd9929ce022744a6ccd424ba2b91bd6d8.converted {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:05.996208 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1ca15e9fd9929ce022744a6ccd424ba2b91bd6d8.part /opt/stack/data/nova/instances/_base/1ca15e9fd9929ce022744a6ccd424ba2b91bd6d8.converted" returned: 0 in 0.096s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:06.003365 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ca15e9fd9929ce022744a6ccd424ba2b91bd6d8.converted --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:06.087872 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ca15e9fd9929ce022744a6ccd424ba2b91bd6d8.converted --force-share --output=json" returned: 0 in 0.084s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:06.088592 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "1ca15e9fd9929ce022744a6ccd424ba2b91bd6d8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.901s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:06.089074 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:06.091528 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:06.092431 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "1ca15e9fd9929ce022744a6ccd424ba2b91bd6d8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:06.092833 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "1ca15e9fd9929ce022744a6ccd424ba2b91bd6d8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:06.093074 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:06.097774 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Took 1.60 seconds to deallocate network for instance.
May 19 04:43:06.098541 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:06.105999 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:06.106729 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ca15e9fd9929ce022744a6ccd424ba2b91bd6d8 --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:06.128823 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165786.1274672, 80436afa-9cd9-41cd-b589-629da01b6bfe => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:06.129217 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] VM Resumed (Lifecycle Event)
May 19 04:43:06.151002 np0000001025 nova-compute[97981]: WARNING nova.volume.cinder [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Attachment 0020afdc-6385-4b95-99f6-e73cbcac295c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 0020afdc-6385-4b95-99f6-e73cbcac295c. (HTTP 404) (Request-ID: req-a23b5dda-9f59-4a66-a528-96048df6e1b7)
May 19 04:43:06.151415 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Took 0.05 seconds to detach 1 volumes for instance.
May 19 04:43:06.221943 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ca15e9fd9929ce022744a6ccd424ba2b91bd6d8 --force-share --output=json" returned: 0 in 0.115s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:06.224733 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1ca15e9fd9929ce022744a6ccd424ba2b91bd6d8,backing_fmt=raw /opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e/disk.rescue {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:06.244011 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-24d1669f-87a0-4a88-9b8d-722d13c9336a req-3849eb11-8637-4d7d-845c-63fdd6f96d7f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:06.288533 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1ca15e9fd9929ce022744a6ccd424ba2b91bd6d8,backing_fmt=raw /opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e/disk.rescue" returned: 0 in 0.064s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:06.289121 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "1ca15e9fd9929ce022744a6ccd424ba2b91bd6d8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:06.289537 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'migration_context' on Instance uuid 92b3fb19-741d-476b-9d2f-83654a17aa0e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:06.340812 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-24d1669f-87a0-4a88-9b8d-722d13c9336a req-3849eb11-8637-4d7d-845c-63fdd6f96d7f service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:43:06.344204 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:06.344352 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:06.344879 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:06.345166 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:06.345418 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:06.345909 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:06.498613 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-24d1669f-87a0-4a88-9b8d-722d13c9336a req-3849eb11-8637-4d7d-845c-63fdd6f96d7f service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:06.637982 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:06.639911 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:43:06.661224 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5e0d82a7-9388-4ab6-8bf0-51c9ea0ba307 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.073s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:06.663254 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:06.664066 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:06.795455 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Object Instance<92b3fb19-741d-476b-9d2f-83654a17aa0e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:43:06.796224 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:43:06.797449 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Start _get_guest_xml network_info=[{"id": "29504364-b589-4dde-a783-4b3bcaea9e02", "address": "fa:16:3e:8e:f5:3b", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "vif_mac": "fa:16:3e:8e:f5:3b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29504364-b5", "ovs_interfaceid": "29504364-b589-4dde-a783-4b3bcaea9e02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '72aaea48-2294-40bc-8610-9c320421f475', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '9ec19ead-8286-4f64-af64-8a0b94c89e37', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, 'status': 'reserved', 'instance': '92b3fb19-741d-476b-9d2f-83654a17aa0e', 'attached_at': '', 'detached_at': '', 'volume_id': '0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'serial': '0e4db490-fa07-43c8-8325-b0028b4b6ecc'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:43:06.799293 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'resources' on Instance uuid 92b3fb19-741d-476b-9d2f-83654a17aa0e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:06.851698 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Took 7.51 seconds to spawn the instance on the hypervisor.
May 19 04:43:06.852031 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:06.999637 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-24d1669f-87a0-4a88-9b8d-722d13c9336a req-3849eb11-8637-4d7d-845c-63fdd6f96d7f service nova] Releasing lock "refresh_cache-48bdc405-dd40-4f80-a701-c25ee025d9a6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:07.000600 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Acquired lock "refresh_cache-48bdc405-dd40-4f80-a701-c25ee025d9a6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:07.000600 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:43:07.142096 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:43:07.261234 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:43:07.261635 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:43:07.307137 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Object Instance<92b3fb19-741d-476b-9d2f-83654a17aa0e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:43:07.309295 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:43:07.310884 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-690448989', uuid='92b3fb19-741d-476b-9d2f-83654a17aa0e'), owner=OwnerMeta(userid='5885f1561f394d46bd4c1b48e7323c1e', username='tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member', projectid='f7465b5668be4eb9b75c1ddc876e7eac', projectname='tempest-ServerBootFromVolumeStableRescueTest-96916496'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "29504364-b589-4dde-a783-4b3bcaea9e02", "address": "fa:16:3e:8e:f5:3b", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "vif_mac": "fa:16:3e:8e:f5:3b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29504364-b5", "ovs_interfaceid": "29504364-b589-4dde-a783-4b3bcaea9e02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165787.3104274) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:43:07.312078 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:43:07.312604 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:43:07.313520 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:43:07.313753 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:43:07.314815 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:43:07.315129 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:43:07.315263 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:43:07.315358 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:43:07.315467 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:43:07.315573 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:43:07.315675 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:43:07.315841 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:43:07.315945 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:43:07.316047 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:43:07.316272 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:43:07.316455 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:43:07.316663 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'vcpu_model' on Instance uuid 92b3fb19-741d-476b-9d2f-83654a17aa0e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:07.360713 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Took 13.41 seconds to build instance.
May 19 04:43:07.578134 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:43:07.758163 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:07.764562 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:43:07.821295 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Object Instance<92b3fb19-741d-476b-9d2f-83654a17aa0e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:43:07.833097 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e/disk.config --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:07.862283 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:43:07.867499 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4789ff61-1141-4fc4-8c23-361b43a26520 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.923s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:07.868310 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:43:07.869978 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Creating image(s)
May 19 04:43:07.870359 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:43:07.871050 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Ensure instance console log exists: /opt/stack/data/nova/instances/48bdc405-dd40-4f80-a701-c25ee025d9a6/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:43:07.871050 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:07.871344 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:07.871507 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:07.903792 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Updating instance_info_cache with network_info: [{"id": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "address": "fa:16:3e:60:02:e1", "network": {"id": "bed9f44e-8923-437b-b7fa-e20405554b44", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1907498263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5c4df421703949c7814d3fa7c2637793", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da752b6-6e", "ovs_interfaceid": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:07.926719 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e/disk.config --force-share --output=json" returned: 0 in 0.093s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:07.927128 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "/opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:07.927335 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "/opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:07.927855 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "/opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:07.928202 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:43:07.928582 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:43:07.928717 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:43:07.929028 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:43:07.929316 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:43:07.943816 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:43:07.944755 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:43:07.945388 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:43:07.945852 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:43:07.946138 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:43:07.946399 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.startup = automatic
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.scan = manual
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:43:07.960654 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:43:07.960654 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.startup = automatic
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.scan = manual
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:43:07.973029 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:43:07.973029 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:07.977878 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:07.988063 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:08.000307 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:08.000307 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:08.000307 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:08.000307 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:08.000307 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:08.000307 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:08.000307 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:08.000307 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:08.000307 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:43:08.000307 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:08.000307 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:08.000307 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:08.000307 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:08.000307 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:08.000307 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:08.000307 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:08.000307 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:08.000307 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:43:08.000307 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.054s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:43:08.000307 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:43:08.000799 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] HCTL ('17', '0', '0', 0) found on session 101 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:43:08.000921 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Scanning host 17 c: 0, t: 0, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:43:08.007339 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:08.007339 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:08.007339 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:08.007339 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:08.007339 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:08.007339 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:08.007339 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:08.007339 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:08.007339 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:43:08.007575 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:08.007575 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:08.007575 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:08.007575 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:08.007575 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:08.007575 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:08.007575 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:08.007575 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:08.007575 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:43:08.007800 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.062s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:43:08.007800 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:43:08.008406 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] HCTL ('18', '0', '0', 0) found on session 102 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:43:08.008535 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Scanning host 18 c: 0, t: 0, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:43:08.015121 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Searching for a device in session 101 and hctl ('17', '0', '0', 0) yield: sdl {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:43:08.015226 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:43:08.020338 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Searching for a device in session 102 and hctl ('18', '0', '0', 0) yield: sdm {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:43:08.020409 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:43:08.273711 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.609s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:08.287585 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:08.310262 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-277d0b83-3ba7-428a-830a-4b8b93201ec7 req-e5c3b98a-ba47-40bc-ad1b-5eb8ddc755d0 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received event network-changed-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:08.310437 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-277d0b83-3ba7-428a-830a-4b8b93201ec7 req-e5c3b98a-ba47-40bc-ad1b-5eb8ddc755d0 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Refreshing instance network info cache due to event network-changed-15e6bc86-13bd-43b9-ad28-342f33dbdeb8. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:43:08.310505 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-277d0b83-3ba7-428a-830a-4b8b93201ec7 req-e5c3b98a-ba47-40bc-ad1b-5eb8ddc755d0 service nova] Acquiring lock "refresh_cache-80436afa-9cd9-41cd-b589-629da01b6bfe" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:08.310886 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-277d0b83-3ba7-428a-830a-4b8b93201ec7 req-e5c3b98a-ba47-40bc-ad1b-5eb8ddc755d0 service nova] Acquired lock "refresh_cache-80436afa-9cd9-41cd-b589-629da01b6bfe" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:08.311000 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-277d0b83-3ba7-428a-830a-4b8b93201ec7 req-e5c3b98a-ba47-40bc-ad1b-5eb8ddc755d0 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Refreshing network info cache for port 15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:43:08.325160 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Deleted allocations for instance 3ad7c142-5f58-498e-b24c-ea7d4faa1d63
May 19 04:43:08.405837 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Releasing lock "refresh_cache-48bdc405-dd40-4f80-a701-c25ee025d9a6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:08.406162 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Instance network_info: |[{"id": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "address": "fa:16:3e:60:02:e1", "network": {"id": "bed9f44e-8923-437b-b7fa-e20405554b44", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1907498263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5c4df421703949c7814d3fa7c2637793", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da752b6-6e", "ovs_interfaceid": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:43:08.407340 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Start _get_guest_xml network_info=[{"id": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "address": "fa:16:3e:60:02:e1", "network": {"id": "bed9f44e-8923-437b-b7fa-e20405554b44", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1907498263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5c4df421703949c7814d3fa7c2637793", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da752b6-6e", "ovs_interfaceid": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'ca41df6b-74b1-42f0-9fd7-3fcb14471e0a', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f', 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '092646db-f85b-4a27-bbec-4a5c360cc73f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '48bdc405-dd40-4f80-a701-c25ee025d9a6', 'attached_at': '', 'detached_at': '', 'volume_id': '092646db-f85b-4a27-bbec-4a5c360cc73f', 'serial': '092646db-f85b-4a27-bbec-4a5c360cc73f'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:43:08.410794 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:43:08.411993 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBackupRestore-server-1505589867', uuid='48bdc405-dd40-4f80-a701-c25ee025d9a6'), owner=OwnerMeta(userid='6d57d5c7c834497abcbd5aa7ed1df8c5', username='tempest-TestVolumeBackupRestore-89711280-project-member', projectid='5c4df421703949c7814d3fa7c2637793', projectname='tempest-TestVolumeBackupRestore-89711280'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "address": "fa:16:3e:60:02:e1", "network": {"id": "bed9f44e-8923-437b-b7fa-e20405554b44", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1907498263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5c4df421703949c7814d3fa7c2637793", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da752b6-6e", "ovs_interfaceid": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165788.4115822) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:43:08.413120 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:43:08.413484 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:43:08.414308 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:43:08.414505 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:43:08.415469 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:43:08.415782 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:43:08.415923 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:43:08.416019 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:43:08.416150 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:43:08.416233 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:43:08.416329 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:43:08.416502 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:43:08.416615 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:43:08.416759 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:43:08.416875 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:43:08.416999 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:43:08.427760 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:43:08.428018 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f', 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '092646db-f85b-4a27-bbec-4a5c360cc73f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:43:08.428180 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:43:08.813232 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-277d0b83-3ba7-428a-830a-4b8b93201ec7 req-e5c3b98a-ba47-40bc-ad1b-5eb8ddc755d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:08.907675 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:08.945820 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:43:09.128194 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-277d0b83-3ba7-428a-830a-4b8b93201ec7 req-e5c3b98a-ba47-40bc-ad1b-5eb8ddc755d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:09.201273 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:09.201448 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:09.201623 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:09.201793 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:09.201887 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:09.203862 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Terminating instance
May 19 04:43:09.237317 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-71f440bf-6f68-4a8e-a068-da121dcebfd6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:09.252578 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-277d0b83-3ba7-428a-830a-4b8b93201ec7 req-e5c3b98a-ba47-40bc-ad1b-5eb8ddc755d0 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Updated VIF entry in instance network info cache for port 15e6bc86-13bd-43b9-ad28-342f33dbdeb8. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:43:09.252878 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-277d0b83-3ba7-428a-830a-4b8b93201ec7 req-e5c3b98a-ba47-40bc-ad1b-5eb8ddc755d0 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Updating instance_info_cache with network_info: [{"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:09.335727 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b906346b-40de-4432-977c-4506b79d5c02 tempest-VolumesSnapshotTestJSON-492014726 tempest-VolumesSnapshotTestJSON-492014726-project-member] Lock "3ad7c142-5f58-498e-b24c-ea7d4faa1d63" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.939s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:09.706664 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:43:09.730888 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:09.733976 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:09.742821 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-71f440bf-6f68-4a8e-a068-da121dcebfd6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] instance snapshotting
May 19 04:43:09.754792 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-277d0b83-3ba7-428a-830a-4b8b93201ec7 req-e5c3b98a-ba47-40bc-ad1b-5eb8ddc755d0 service nova] Releasing lock "refresh_cache-80436afa-9cd9-41cd-b589-629da01b6bfe" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:09.759022 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:09.764366 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:09.792275 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:09.857495 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-71f440bf-6f68-4a8e-a068-da121dcebfd6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Beginning live snapshot process
May 19 04:43:09.919928 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-87d2af88-e2e3-4e2f-a325-fe6ebc972c8f req-9f329f0b-c5be-4fbc-b59a-448e79c0dd79 service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Received event network-vif-unplugged-2f49d1e8-3715-4f15-8d97-10c3446283ad {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:09.919990 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-87d2af88-e2e3-4e2f-a325-fe6ebc972c8f req-9f329f0b-c5be-4fbc-b59a-448e79c0dd79 service nova] Acquiring lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:09.920156 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-87d2af88-e2e3-4e2f-a325-fe6ebc972c8f req-9f329f0b-c5be-4fbc-b59a-448e79c0dd79 service nova] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:09.920288 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-87d2af88-e2e3-4e2f-a325-fe6ebc972c8f req-9f329f0b-c5be-4fbc-b59a-448e79c0dd79 service nova] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:09.920426 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-87d2af88-e2e3-4e2f-a325-fe6ebc972c8f req-9f329f0b-c5be-4fbc-b59a-448e79c0dd79 service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] No waiting events found dispatching network-vif-unplugged-2f49d1e8-3715-4f15-8d97-10c3446283ad {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:09.920886 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-87d2af88-e2e3-4e2f-a325-fe6ebc972c8f req-9f329f0b-c5be-4fbc-b59a-448e79c0dd79 service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Received event network-vif-unplugged-2f49d1e8-3715-4f15-8d97-10c3446283ad for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:43:09.963818 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Found WWN 330000000d723aaaa for multipath device dm-5 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:43:09.964209 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.035s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:43:09.964572 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] <== connect_volume: return (2035ms) {'type': 'block', 'scsi_wwn': '330000000d723aaaa', 'path': '/dev/dm-5', 'multipath_id': '330000000d723aaaa'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:43:09.964840 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d723aaaa', 'path': '/dev/dm-5', 'multipath_id': '330000000d723aaaa'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:43:09.965145 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.537s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:43:09.965331 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f', 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '092646db-f85b-4a27-bbec-4a5c360cc73f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:43:09.977524 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:43:09.978230 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:43:09.978942 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:43:09.979219 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:43:09.979755 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:43:09.980041 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:43:09.996537 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:43:09.996537 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:09.997436 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:43:09.997436 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:10.010432 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f] added
May 19 04:43:10.010432 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:43:10.010432 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:43:10.010432 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:43:10.010432 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:43:10.010432 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:43:10.010432 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:10.010432 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:43:10.010432 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0299(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:43:10.010432 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:43:10.012856 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f] added
May 19 04:43:10.012856 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:43:10.012856 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:43:10.012856 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:43:10.012856 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:43:10.012856 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:43:10.012856 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:10.012856 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:43:10.012856 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0326(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:43:10.012856 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:43:10.038480 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999740403000033 future=<Future at 0x7218506026c0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:10.041524 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Instance destroyed successfully.
May 19 04:43:10.041699 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lazy-loading 'resources' on Instance uuid aa2cdf1d-65ef-4cf4-b742-72ae783cde27 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:10.471693 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-690448989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverbootfromvolumestablerescuetest-server-690448989',id=44,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:42:58Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7465b5668be4eb9b75c1ddc876e7eac',ramdisk_id='',reservation_id='r-8ma0qp1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-96916496',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:42:58Z,user_data=None,user_id='5885f1561f394d46bd4c1b48e7323c1e',uuid=92b3fb19-741d-476b-9d2f-83654a17aa0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29504364-b589-4dde-a783-4b3bcaea9e02", "address": "fa:16:3e:8e:f5:3b", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "vif_mac": "fa:16:3e:8e:f5:3b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29504364-b5", "ovs_interfaceid": "29504364-b589-4dde-a783-4b3bcaea9e02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:43:10.472189 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converting VIF {"id": "29504364-b589-4dde-a783-4b3bcaea9e02", "address": "fa:16:3e:8e:f5:3b", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "vif_mac": "fa:16:3e:8e:f5:3b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29504364-b5", "ovs_interfaceid": "29504364-b589-4dde-a783-4b3bcaea9e02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:43:10.472487 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:f5:3b,bridge_name='br-int',has_traffic_filtering=True,id=29504364-b589-4dde-a783-4b3bcaea9e02,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29504364-b5') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:43:10.473050 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'pci_devices' on Instance uuid 92b3fb19-741d-476b-9d2f-83654a17aa0e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:10.544129 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1563421223',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumemultiattachtests-server-1563421223',id=28,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhD1xUGbzXEFTpwLqV7IdahQdRsxUTWfjsap1G2V5FlaOoCCsM3NvS7ZgZ3Tks73vH5y6V2PuKxg4zJpt6nENVtmQis2Ldrn3RUIJ9Ob13Jj154qwicTD8P/PfTnb2SSg==',key_name='tempest-keypair-883733818',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:39:08Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e0c7a19a41a44fba4c0fca71022a5a1',ramdisk_id='',reservation_id='r-s912lur9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1349332830',owner_user_name='tempest-VolumeMultiattachTests-1349332830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:39:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93a5d16bed8c474fa58e1982fa784db9',uuid=aa2cdf1d-65ef-4cf4-b742-72ae783cde27,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "address": "fa:16:3e:3c:c4:ae", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f49d1e8-37", "ovs_interfaceid": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:43:10.544539 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Converting VIF {"id": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "address": "fa:16:3e:3c:c4:ae", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f49d1e8-37", "ovs_interfaceid": "2f49d1e8-3715-4f15-8d97-10c3446283ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:43:10.545116 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:c4:ae,bridge_name='br-int',has_traffic_filtering=True,id=2f49d1e8-3715-4f15-8d97-10c3446283ad,network=Network(c948b992-32a1-4652-a328-d2d326ea9148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f49d1e8-37') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:43:10.545366 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:c4:ae,bridge_name='br-int',has_traffic_filtering=True,id=2f49d1e8-3715-4f15-8d97-10c3446283ad,network=Network(c948b992-32a1-4652-a328-d2d326ea9148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f49d1e8-37') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:43:10.546646 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:10.546940 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f49d1e8-37, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:10.570350 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:10.571146 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:10.576708 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:10.577470 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:10.577597 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1450551a-9e1c-4d85-ae1f-bf62c0356cfd) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:10.578024 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:10.578454 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:10.583534 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:10.585246 np0000001025 nova-compute[97981]: INFO os_vif [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:c4:ae,bridge_name='br-int',has_traffic_filtering=True,id=2f49d1e8-3715-4f15-8d97-10c3446283ad,network=Network(c948b992-32a1-4652-a328-d2d326ea9148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f49d1e8-37')
May 19 04:43:10.585501 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Deleting instance files /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27_del
May 19 04:43:10.586209 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Deletion of /opt/stack/data/nova/instances/aa2cdf1d-65ef-4cf4-b742-72ae783cde27_del complete
May 19 04:43:10.975459 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Object Instance<92b3fb19-741d-476b-9d2f-83654a17aa0e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:43:10.976507 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] End _get_guest_xml xml=<domain type="qemu">
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:   <uuid>92b3fb19-741d-476b-9d2f-83654a17aa0e</uuid>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:   <name>instance-0000002c</name>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-690448989</nova:name>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:43:07</nova:creationTime>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:           <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:           <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:         <nova:user uuid="5885f1561f394d46bd4c1b48e7323c1e">tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member</nova:user>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:         <nova:project uuid="f7465b5668be4eb9b75c1ddc876e7eac">tempest-ServerBootFromVolumeStableRescueTest-96916496</nova:project>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:         <nova:port uuid="29504364-b589-4dde-a783-4b3bcaea9e02">
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     <system>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <entry name="serial">92b3fb19-741d-476b-9d2f-83654a17aa0e</entry>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <entry name="uuid">92b3fb19-741d-476b-9d2f-83654a17aa0e</entry>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     </system>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:   <os>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:   </os>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:   <features>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:   </features>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:   <devices>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e/disk.config"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     </disk>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <alias name="ua-0e4db490-fa07-43c8-8325-b0028b4b6ecc"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-5"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <serial>0e4db490-fa07-43c8-8325-b0028b4b6ecc</serial>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     </disk>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e/disk.rescue"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <target dev="vdb" bus="virtio"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <boot order="1"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     </disk>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:8e:f5:3b"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <target dev="tap29504364-b5"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     </interface>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e/console.log" append="off"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     </serial>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     <video>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     </video>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     </rng>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:   </devices>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]: </domain>
May 19 04:43:10.976507 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:43:10.980796 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Instance destroyed successfully.
May 19 04:43:11.010711 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:43:11.012246 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:43:11.025531 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:43:11.025531 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:43:11.029121 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:43:11.029121 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:11.039457 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:11.044902 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:11.055316 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:11.055316 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:11.055316 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:11.055316 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:11.055316 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:11.055316 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:11.055316 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:11.055316 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:11.055316 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:43:11.055668 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:11.055668 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:11.055668 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:11.055668 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:11.055668 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:11.055668 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:11.055668 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:11.055668 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:11.055668 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:43:11.059959 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:11.059959 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:11.059959 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:11.059959 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:11.059959 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:11.059959 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:11.059959 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:11.059959 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:11.059959 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:43:11.060306 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:11.060306 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:11.060306 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:11.060306 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:11.060306 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:11.060306 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:11.060306 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:11.060306 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:11.060306 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:43:11.092098 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Took 1.39 seconds to destroy the instance on the hypervisor.
May 19 04:43:11.092844 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:43:11.093059 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:43:11.093191 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:43:11.093408 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:11.099991 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f, portal: 192.168.50.100,3260]
May 19 04:43:11.099991 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f, portal: 192.168.50.100,3260] successful.
May 19 04:43:11.099991 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:11.105307 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f, portal: 192.168.40.100,3260]
May 19 04:43:11.105307 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f, portal: 192.168.40.100,3260] successful.
May 19 04:43:11.105307 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:11.112758 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:11.122843 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:11.134101 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:11.134101 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:11.134101 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:11.134101 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:11.134101 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:11.134101 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:11.134101 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:11.134101 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:11.134101 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:11.134101 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:11.134101 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:43:11.134416 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:11.134416 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:11.134416 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:11.134416 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:11.134416 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:11.134416 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:11.134416 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:11.134416 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:11.134416 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:11.134416 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:11.134416 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:43:11.134716 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:43:11.134880 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:43:11.136028 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] HCTL ('7', '-', '-', 0) found on session 105 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:43:11.136174 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:43:11.147545 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:11.147545 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:11.147545 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:11.147545 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:11.147545 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:11.147545 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:11.147545 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:11.147545 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:11.147545 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:11.147545 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:11.147545 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:43:11.147848 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:11.147848 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:11.147848 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:11.147848 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:11.147848 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:11.147848 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:11.147848 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:11.147848 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:11.147848 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:11.147848 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:11.147848 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:43:11.148053 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:43:11.148053 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:43:11.152974 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] HCTL ('8', '-', '-', 0) found on session 106 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:43:11.152974 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:43:11.152974 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Searching for a device in session 105 and hctl ['7', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:43:11.162885 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Searching for a device in session 106 and hctl ['8', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:43:11.165528 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:11.370290 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-71f440bf-6f68-4a8e-a068-da121dcebfd6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk --force-share --output=json -f qcow2 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:11.470676 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-71f440bf-6f68-4a8e-a068-da121dcebfd6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk --force-share --output=json -f qcow2" returned: 0 in 0.100s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:11.471263 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-71f440bf-6f68-4a8e-a068-da121dcebfd6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk --force-share --output=json -f qcow2 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:11.526620 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2d2bd64c-717a-4839-85c3-f3582442afae req-9f84550f-5e81-4a4a-9aa0-7b13c402f45e service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Received event network-vif-deleted-2f49d1e8-3715-4f15-8d97-10c3446283ad {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:11.527068 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-2d2bd64c-717a-4839-85c3-f3582442afae req-9f84550f-5e81-4a4a-9aa0-7b13c402f45e service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Neutron deleted interface 2f49d1e8-3715-4f15-8d97-10c3446283ad; detaching it from the instance and deleting it from the info cache
May 19 04:43:11.527330 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2d2bd64c-717a-4839-85c3-f3582442afae req-9f84550f-5e81-4a4a-9aa0-7b13c402f45e service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:11.565423 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-71f440bf-6f68-4a8e-a068-da121dcebfd6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk --force-share --output=json -f qcow2" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:11.566246 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-71f440bf-6f68-4a8e-a068-da121dcebfd6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:11.570459 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-71f440bf-6f68-4a8e-a068-da121dcebfd6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:11.571000 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-71f440bf-6f68-4a8e-a068-da121dcebfd6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:11.667427 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-71f440bf-6f68-4a8e-a068-da121dcebfd6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.096s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:11.668044 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-71f440bf-6f68-4a8e-a068-da121dcebfd6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxt7abq_3/f65afbd5fe314a18b27387f3736d78af.delta 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:11.725854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-71f440bf-6f68-4a8e-a068-da121dcebfd6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxt7abq_3/f65afbd5fe314a18b27387f3736d78af.delta 1073741824" returned: 0 in 0.057s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:11.726556 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-71f440bf-6f68-4a8e-a068-da121dcebfd6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Quiescing instance not available: QEMU guest agent is not enabled.
May 19 04:43:11.944708 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-71f440bf-6f68-4a8e-a068-da121dcebfd6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] COPY block job progress, current cursor: 0 final cursor: 76742656 {{(pid=97981) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 19 04:43:11.994088 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a9c63886-a42c-4b80-886f-86c77939e0d2 req-f1733628-1641-44ab-ad38-8b854af42fdd service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Received event network-vif-unplugged-2f49d1e8-3715-4f15-8d97-10c3446283ad {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:11.994927 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a9c63886-a42c-4b80-886f-86c77939e0d2 req-f1733628-1641-44ab-ad38-8b854af42fdd service nova] Acquiring lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:11.995062 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a9c63886-a42c-4b80-886f-86c77939e0d2 req-f1733628-1641-44ab-ad38-8b854af42fdd service nova] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:11.995347 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a9c63886-a42c-4b80-886f-86c77939e0d2 req-f1733628-1641-44ab-ad38-8b854af42fdd service nova] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:11.995555 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a9c63886-a42c-4b80-886f-86c77939e0d2 req-f1733628-1641-44ab-ad38-8b854af42fdd service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] No waiting events found dispatching network-vif-unplugged-2f49d1e8-3715-4f15-8d97-10c3446283ad {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:11.995723 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a9c63886-a42c-4b80-886f-86c77939e0d2 req-f1733628-1641-44ab-ad38-8b854af42fdd service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Received event network-vif-unplugged-2f49d1e8-3715-4f15-8d97-10c3446283ad for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:43:12.003101 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:12.031017 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2d2bd64c-717a-4839-85c3-f3582442afae req-9f84550f-5e81-4a4a-9aa0-7b13c402f45e service nova] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Detach interface failed, port_id=2f49d1e8-3715-4f15-8d97-10c3446283ad, reason: Instance aa2cdf1d-65ef-4cf4-b742-72ae783cde27 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:43:12.151767 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Searching for a device in session 105 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:43:12.151928 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '092646db-f85b-4a27-bbec-4a5c360cc73f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:43:12.163570 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Searching for a device in session 106 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:43:12.163737 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '092646db-f85b-4a27-bbec-4a5c360cc73f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:43:12.453605 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-71f440bf-6f68-4a8e-a068-da121dcebfd6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] COPY block job progress, current cursor: 76742656 final cursor: 76742656 {{(pid=97981) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 19 04:43:12.457512 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-71f440bf-6f68-4a8e-a068-da121dcebfd6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Skipping quiescing instance: QEMU guest agent is not enabled.
May 19 04:43:12.500067 np0000001025 nova-compute[97981]: DEBUG nova.privsep.utils [None req-71f440bf-6f68-4a8e-a068-da121dcebfd6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97981) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 19 04:43:12.500359 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-71f440bf-6f68-4a8e-a068-da121dcebfd6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxt7abq_3/f65afbd5fe314a18b27387f3736d78af.delta /opt/stack/data/nova/instances/snapshots/tmpxt7abq_3/f65afbd5fe314a18b27387f3736d78af {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:12.522921 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Took 1.42 seconds to deallocate network for instance.
May 19 04:43:12.533009 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:43:12.533356 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:43:12.533356 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:43:12.533356 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] No VIF found with MAC fa:16:3e:8e:f5:3b, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:43:12.534348 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Using config drive
May 19 04:43:12.707343 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-71f440bf-6f68-4a8e-a068-da121dcebfd6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxt7abq_3/f65afbd5fe314a18b27387f3736d78af.delta /opt/stack/data/nova/instances/snapshots/tmpxt7abq_3/f65afbd5fe314a18b27387f3736d78af" returned: 0 in 0.207s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:12.712513 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-71f440bf-6f68-4a8e-a068-da121dcebfd6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Snapshot extracted, beginning image upload
May 19 04:43:12.979822 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:43:13.032923 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:13.033324 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:13.038332 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'ec2_ids' on Instance uuid 92b3fb19-741d-476b-9d2f-83654a17aa0e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:13.290480 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:13.547728 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Object Instance<92b3fb19-741d-476b-9d2f-83654a17aa0e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:43:13.548167 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'keypairs' on Instance uuid 92b3fb19-741d-476b-9d2f-83654a17aa0e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:13.711330 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:43:13.711607 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:43:14.000253 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Found WWN 3300000005a25effc for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:43:14.000253 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.034s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:43:14.000253 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] <== connect_volume: return (5570ms) {'type': 'block', 'scsi_wwn': '3300000005a25effc', 'path': '/dev/dm-0', 'multipath_id': '3300000005a25effc'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:43:14.000253 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005a25effc', 'path': '/dev/dm-0', 'multipath_id': '3300000005a25effc'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:43:14.050732 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Object Instance<92b3fb19-741d-476b-9d2f-83654a17aa0e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:43:14.053530 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:14.188623 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Creating config drive at /opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e/disk.config.rescue
May 19 04:43:14.193675 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4wmxa9un {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:14.217563 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:43:14.257627 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4wmxa9un" returned: 0 in 0.063s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:14.507785 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:42:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1505589867',display_name='tempest-TestVolumeBackupRestore-server-1505589867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebackuprestore-server-1505589867',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxG5N7PxOI+26lVI/+FDfmbLyEkEAn1kwR6Kcyo1qaMxyuvH7CEFb0/SOO2N89mtQq1FqwqcY6S5CXppgPZTENFgrlilNhwcHIBzV5yvshsLmoAfOoNYR0QxlUHa90djA==',key_name='tempest-TestVolumeBackupRestore-2103061142',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c4df421703949c7814d3fa7c2637793',ramdisk_id='',reservation_id='r-oq3f1736',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-89711280',owner_user_name='tempest-TestVolumeBackupRestore-89711280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:43:05Z,user_data=None,user_id='6d57d5c7c834497abcbd5aa7ed1df8c5',uuid=48bdc405-dd40-4f80-a701-c25ee025d9a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "address": "fa:16:3e:60:02:e1", "network": {"id": "bed9f44e-8923-437b-b7fa-e20405554b44", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1907498263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5c4df421703949c7814d3fa7c2637793", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da752b6-6e", "ovs_interfaceid": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:43:14.511094 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Converting VIF {"id": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "address": "fa:16:3e:60:02:e1", "network": {"id": "bed9f44e-8923-437b-b7fa-e20405554b44", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1907498263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5c4df421703949c7814d3fa7c2637793", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da752b6-6e", "ovs_interfaceid": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:43:14.511094 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:02:e1,bridge_name='br-int',has_traffic_filtering=True,id=0da752b6-6eef-4ad0-8bd2-315518fbea60,network=Network(bed9f44e-8923-437b-b7fa-e20405554b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da752b6-6e') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:43:14.511094 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lazy-loading 'pci_devices' on Instance uuid 48bdc405-dd40-4f80-a701-c25ee025d9a6 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:14.693475 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:14.722480 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:14.730823 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.697s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:14.736217 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:14.824614 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Deleted allocations for instance aa2cdf1d-65ef-4cf4-b742-72ae783cde27
May 19 04:43:14.843862 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:14.914300 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:14.914724 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:14.964617 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7c3440c3-aef7-404e-b0fd-0b1fcca355a5 req-67742a77-6aa8-4046-8adc-602e23afa175 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received event network-vif-plugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:14.965289 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7c3440c3-aef7-404e-b0fd-0b1fcca355a5 req-67742a77-6aa8-4046-8adc-602e23afa175 service nova] Acquiring lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:14.965289 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7c3440c3-aef7-404e-b0fd-0b1fcca355a5 req-67742a77-6aa8-4046-8adc-602e23afa175 service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:14.965289 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7c3440c3-aef7-404e-b0fd-0b1fcca355a5 req-67742a77-6aa8-4046-8adc-602e23afa175 service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:14.965458 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7c3440c3-aef7-404e-b0fd-0b1fcca355a5 req-67742a77-6aa8-4046-8adc-602e23afa175 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] No waiting events found dispatching network-vif-plugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:14.965642 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-7c3440c3-aef7-404e-b0fd-0b1fcca355a5 req-67742a77-6aa8-4046-8adc-602e23afa175 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received unexpected event network-vif-plugged-29504364-b589-4dde-a783-4b3bcaea9e02 for instance with vm_state active and task_state rescuing.
May 19 04:43:15.025178 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] End _get_guest_xml xml=<domain type="qemu">
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:   <uuid>48bdc405-dd40-4f80-a701-c25ee025d9a6</uuid>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:   <name>instance-0000002e</name>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestVolumeBackupRestore-server-1505589867</nova:name>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:43:08</nova:creationTime>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:         <nova:user uuid="6d57d5c7c834497abcbd5aa7ed1df8c5">tempest-TestVolumeBackupRestore-89711280-project-member</nova:user>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:         <nova:project uuid="5c4df421703949c7814d3fa7c2637793">tempest-TestVolumeBackupRestore-89711280</nova:project>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:         <nova:port uuid="0da752b6-6eef-4ad0-8bd2-315518fbea60">
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     <system>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <entry name="serial">48bdc405-dd40-4f80-a701-c25ee025d9a6</entry>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <entry name="uuid">48bdc405-dd40-4f80-a701-c25ee025d9a6</entry>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     </system>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:   <os>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:   </os>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:   <features>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:   </features>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:   <devices>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/48bdc405-dd40-4f80-a701-c25ee025d9a6/disk.config"/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     </disk>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <alias name="ua-092646db-f85b-4a27-bbec-4a5c360cc73f"/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-0"/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <serial>092646db-f85b-4a27-bbec-4a5c360cc73f</serial>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     </disk>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:60:02:e1"/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <target dev="tap0da752b6-6e"/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     </interface>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/48bdc405-dd40-4f80-a701-c25ee025d9a6/console.log" append="off"/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     </serial>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     <video>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     </video>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     </rng>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:   </devices>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]: </domain>
May 19 04:43:15.025178 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:43:15.027890 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Preparing to wait for external event network-vif-plugged-0da752b6-6eef-4ad0-8bd2-315518fbea60 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:43:15.027890 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Acquiring lock "48bdc405-dd40-4f80-a701-c25ee025d9a6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:15.027890 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lock "48bdc405-dd40-4f80-a701-c25ee025d9a6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:15.027890 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lock "48bdc405-dd40-4f80-a701-c25ee025d9a6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:15.027890 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:42:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1505589867',display_name='tempest-TestVolumeBackupRestore-server-1505589867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebackuprestore-server-1505589867',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxG5N7PxOI+26lVI/+FDfmbLyEkEAn1kwR6Kcyo1qaMxyuvH7CEFb0/SOO2N89mtQq1FqwqcY6S5CXppgPZTENFgrlilNhwcHIBzV5yvshsLmoAfOoNYR0QxlUHa90djA==',key_name='tempest-TestVolumeBackupRestore-2103061142',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c4df421703949c7814d3fa7c2637793',ramdisk_id='',reservation_id='r-oq3f1736',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-89711280',owner_user_name='tempest-TestVolumeBackupRestore-89711280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:43:05Z,user_data=None,user_id='6d57d5c7c834497abcbd5aa7ed1df8c5',uuid=48bdc405-dd40-4f80-a701-c25ee025d9a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "address": "fa:16:3e:60:02:e1", "network": {"id": "bed9f44e-8923-437b-b7fa-e20405554b44", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1907498263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5c4df421703949c7814d3fa7c2637793", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da752b6-6e", "ovs_interfaceid": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:43:15.027890 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Converting VIF {"id": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "address": "fa:16:3e:60:02:e1", "network": {"id": "bed9f44e-8923-437b-b7fa-e20405554b44", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1907498263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5c4df421703949c7814d3fa7c2637793", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da752b6-6e", "ovs_interfaceid": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:43:15.027890 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:02:e1,bridge_name='br-int',has_traffic_filtering=True,id=0da752b6-6eef-4ad0-8bd2-315518fbea60,network=Network(bed9f44e-8923-437b-b7fa-e20405554b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da752b6-6e') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:43:15.028814 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:02:e1,bridge_name='br-int',has_traffic_filtering=True,id=0da752b6-6eef-4ad0-8bd2-315518fbea60,network=Network(bed9f44e-8923-437b-b7fa-e20405554b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da752b6-6e') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:43:15.029526 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:15.029911 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:15.032528 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:43:15.036314 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:15.036541 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '855ff42a-f233-59bc-8b1d-620bde068e59', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:15.040507 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:15.041526 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:15.042772 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:15.046890 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:15.046890 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0da752b6-6e, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:15.046890 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0da752b6-6e, col_values=(('qos', UUID('e0582ae8-5d1f-4690-b3b9-b444166df98d')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:15.046890 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0da752b6-6e, col_values=(('external_ids', {'iface-id': '0da752b6-6eef-4ad0-8bd2-315518fbea60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:02:e1', 'vm-uuid': '48bdc405-dd40-4f80-a701-c25ee025d9a6'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:15.049562 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:15.052757 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:15.057470 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:15.059325 np0000001025 nova-compute[97981]: INFO os_vif [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:02:e1,bridge_name='br-int',has_traffic_filtering=True,id=0da752b6-6eef-4ad0-8bd2-315518fbea60,network=Network(bed9f44e-8923-437b-b7fa-e20405554b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da752b6-6e')
May 19 04:43:15.421334 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-71f440bf-6f68-4a8e-a068-da121dcebfd6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Snapshot image upload complete
May 19 04:43:15.421535 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-71f440bf-6f68-4a8e-a068-da121dcebfd6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Took 5.68 seconds to snapshot the instance on the hypervisor.
May 19 04:43:15.591119 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Removed pending STOPPED event for 92b3fb19-741d-476b-9d2f-83654a17aa0e due to new event <LifecycleEvent: 1779165795.5906959, 92b3fb19-741d-476b-9d2f-83654a17aa0e => Resumed> {{(pid=97981) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 19 04:43:15.591338 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165795.5906959, 92b3fb19-741d-476b-9d2f-83654a17aa0e => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:15.591450 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] VM Resumed (Lifecycle Event)
May 19 04:43:15.601888 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7a08d516-aecb-448b-9cf9-c74d2ce81a2d tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:15.841333 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ff879ac5-a70c-4494-95b6-f5c8872fe073 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "aa2cdf1d-65ef-4cf4-b742-72ae783cde27" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.640s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:16.100928 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:16.104017 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:43:16.584838 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:43:16.584838 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:43:16.585352 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] No VIF found with MAC fa:16:3e:60:02:e1, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:43:16.585553 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Using config drive
May 19 04:43:16.608363 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165796.6079617, 92b3fb19-741d-476b-9d2f-83654a17aa0e => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:16.608566 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] VM Started (Lifecycle Event)
May 19 04:43:16.985976 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4ac0e185-b55a-41da-8ce4-c1199ea14ba2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Unrescuing
May 19 04:43:16.986622 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4ac0e185-b55a-41da-8ce4-c1199ea14ba2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "refresh_cache-92b3fb19-741d-476b-9d2f-83654a17aa0e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:16.986622 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4ac0e185-b55a-41da-8ce4-c1199ea14ba2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquired lock "refresh_cache-92b3fb19-741d-476b-9d2f-83654a17aa0e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:16.986622 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4ac0e185-b55a-41da-8ce4-c1199ea14ba2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:43:17.035076 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e99d00eb-807e-4c8f-a61a-c27d8e80a3a7 req-de40eb34-c52f-45a0-a515-a93fa26369dd service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received event network-vif-plugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:17.035309 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e99d00eb-807e-4c8f-a61a-c27d8e80a3a7 req-de40eb34-c52f-45a0-a515-a93fa26369dd service nova] Acquiring lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:17.035720 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e99d00eb-807e-4c8f-a61a-c27d8e80a3a7 req-de40eb34-c52f-45a0-a515-a93fa26369dd service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:17.035720 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e99d00eb-807e-4c8f-a61a-c27d8e80a3a7 req-de40eb34-c52f-45a0-a515-a93fa26369dd service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:17.035797 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e99d00eb-807e-4c8f-a61a-c27d8e80a3a7 req-de40eb34-c52f-45a0-a515-a93fa26369dd service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] No waiting events found dispatching network-vif-plugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:17.036180 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-e99d00eb-807e-4c8f-a61a-c27d8e80a3a7 req-de40eb34-c52f-45a0-a515-a93fa26369dd service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received unexpected event network-vif-plugged-29504364-b589-4dde-a783-4b3bcaea9e02 for instance with vm_state rescued and task_state unrescuing.
May 19 04:43:17.093701 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:17.113098 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:17.115603 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:43:17.206853 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "e991af6e-6fc9-4286-a848-84682121bbb1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:17.207088 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "e991af6e-6fc9-4286-a848-84682121bbb1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:17.248629 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Creating config drive at /opt/stack/data/nova/instances/48bdc405-dd40-4f80-a701-c25ee025d9a6/disk.config
May 19 04:43:17.252059 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/48bdc405-dd40-4f80-a701-c25ee025d9a6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppx2jo_v3 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:17.324441 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/48bdc405-dd40-4f80-a701-c25ee025d9a6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppx2jo_v3" returned: 0 in 0.072s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:17.383827 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Stashing vm_state: active {{(pid=97981) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 19 04:43:17.492898 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4ac0e185-b55a-41da-8ce4-c1199ea14ba2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:17.620259 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 19 04:43:17.709589 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:43:17.797976 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:17.832607 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:17.834981 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:17.919721 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:17.958955 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4ac0e185-b55a-41da-8ce4-c1199ea14ba2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:17.963838 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:17.963838 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:18.145166 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6dca5e14-eea5-4a15-b7f3-06abee0d01b6 req-4b7e4d0a-0dea-4a54-8960-6d4157de33a2 service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Received event network-vif-plugged-0da752b6-6eef-4ad0-8bd2-315518fbea60 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:18.145166 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6dca5e14-eea5-4a15-b7f3-06abee0d01b6 req-4b7e4d0a-0dea-4a54-8960-6d4157de33a2 service nova] Acquiring lock "48bdc405-dd40-4f80-a701-c25ee025d9a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:18.145166 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6dca5e14-eea5-4a15-b7f3-06abee0d01b6 req-4b7e4d0a-0dea-4a54-8960-6d4157de33a2 service nova] Lock "48bdc405-dd40-4f80-a701-c25ee025d9a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:18.145535 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6dca5e14-eea5-4a15-b7f3-06abee0d01b6 req-4b7e4d0a-0dea-4a54-8960-6d4157de33a2 service nova] Lock "48bdc405-dd40-4f80-a701-c25ee025d9a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:18.145535 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6dca5e14-eea5-4a15-b7f3-06abee0d01b6 req-4b7e4d0a-0dea-4a54-8960-6d4157de33a2 service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Processing event network-vif-plugged-0da752b6-6eef-4ad0-8bd2-315518fbea60 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:43:18.184377 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4ac0e185-b55a-41da-8ce4-c1199ea14ba2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Updating instance_info_cache with network_info: [{"id": "29504364-b589-4dde-a783-4b3bcaea9e02", "address": "fa:16:3e:8e:f5:3b", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29504364-b5", "ovs_interfaceid": "29504364-b589-4dde-a783-4b3bcaea9e02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:18.187654 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:18.192650 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:18.215719 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:18.294076 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:18.294600 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:18.360467 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00048680300005798927 future=<Future at 0x721850251df0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:18.362551 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Emitting event <LifecycleEvent: 1779165783.3597732, 3ad7c142-5f58-498e-b24c-ea7d4faa1d63 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:18.362777 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:18.362915 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=0.6238386640000044 future=<Future at 0x721834112390 state=cancelled>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:18.364026 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=0.6237486229999831 future=<Future at 0x721834112390 state=cancelled>) was cancelled while queued, skipping {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:18.364026 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] VM Stopped (Lifecycle Event)
May 19 04:43:18.364273 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:18.364395 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=6.6737761350000255 future=<Future at 0x7218506026c0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:18.364469 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=6.673695120000048 future=<Future at 0x7218506026c0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:18.473081 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:43:18.473784 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Claim successful on node np0000001025
May 19 04:43:18.688851 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4ac0e185-b55a-41da-8ce4-c1199ea14ba2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Releasing lock "refresh_cache-92b3fb19-741d-476b-9d2f-83654a17aa0e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:18.689615 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-4ac0e185-b55a-41da-8ce4-c1199ea14ba2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'flavor' on Instance uuid 92b3fb19-741d-476b-9d2f-83654a17aa0e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:18.798425 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:43:18.800033 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165798.7988236, 48bdc405-dd40-4f80-a701-c25ee025d9a6 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:18.800033 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] VM Started (Lifecycle Event)
May 19 04:43:18.803444 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:43:18.806230 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Instance spawned successfully.
May 19 04:43:18.806502 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:43:18.866000 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 3ad7c142-5f58-498e-b24c-ea7d4faa1d63] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:18.980145 np0000001025 nova-compute[97981]: INFO nova.compute.resource_tracker [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Updating resource usage from migration 22841eb6-38a9-46df-8c9d-aa8e46ab8cc3
May 19 04:43:19.219224 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:19.224814 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:19.257954 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:19.306318 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:19.320888 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:43:19.329135 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:19.329288 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:19.331153 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:19.331153 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:19.331153 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:19.331153 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:19.396796 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:19.405847 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:19.463575 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b584a6b8-a71e-422b-aecb-768116cc26ed req-061acbb0-eeb0-426d-bbd6-10465e52889a service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received event network-vif-unplugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:19.463724 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b584a6b8-a71e-422b-aecb-768116cc26ed req-061acbb0-eeb0-426d-bbd6-10465e52889a service nova] Acquiring lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:19.463877 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b584a6b8-a71e-422b-aecb-768116cc26ed req-061acbb0-eeb0-426d-bbd6-10465e52889a service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:19.464207 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b584a6b8-a71e-422b-aecb-768116cc26ed req-061acbb0-eeb0-426d-bbd6-10465e52889a service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:19.466125 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b584a6b8-a71e-422b-aecb-768116cc26ed req-061acbb0-eeb0-426d-bbd6-10465e52889a service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] No waiting events found dispatching network-vif-unplugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:19.466125 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-b584a6b8-a71e-422b-aecb-768116cc26ed req-061acbb0-eeb0-426d-bbd6-10465e52889a service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received unexpected event network-vif-unplugged-29504364-b589-4dde-a783-4b3bcaea9e02 for instance with vm_state rescued and task_state unrescuing.
May 19 04:43:19.522200 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:19.559677 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Instance destroyed successfully.
May 19 04:43:19.561527 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-4ac0e185-b55a-41da-8ce4-c1199ea14ba2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'numa_topology' on Instance uuid 92b3fb19-741d-476b-9d2f-83654a17aa0e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:19.751408 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:43:19.751649 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:43:19.825610 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:43:19.825897 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165799.8257077, 48bdc405-dd40-4f80-a701-c25ee025d9a6 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:19.826006 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] VM Paused (Lifecycle Event)
May 19 04:43:19.838621 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Took 11.98 seconds to spawn the instance on the hypervisor.
May 19 04:43:19.839555 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:20.048719 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:20.062536 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-4ac0e185-b55a-41da-8ce4-c1199ea14ba2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Object Instance<92b3fb19-741d-476b-9d2f-83654a17aa0e> lazy-loaded attributes: flavor,numa_topology {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:43:20.206092 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d0eb4ca4-7eec-4f36-9190-e4bb44bd3643 req-010f3252-f973-41ba-afeb-615f65ee66cd service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Received event network-vif-plugged-0da752b6-6eef-4ad0-8bd2-315518fbea60 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:20.206456 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d0eb4ca4-7eec-4f36-9190-e4bb44bd3643 req-010f3252-f973-41ba-afeb-615f65ee66cd service nova] Acquiring lock "48bdc405-dd40-4f80-a701-c25ee025d9a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:20.206688 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d0eb4ca4-7eec-4f36-9190-e4bb44bd3643 req-010f3252-f973-41ba-afeb-615f65ee66cd service nova] Lock "48bdc405-dd40-4f80-a701-c25ee025d9a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:20.206745 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d0eb4ca4-7eec-4f36-9190-e4bb44bd3643 req-010f3252-f973-41ba-afeb-615f65ee66cd service nova] Lock "48bdc405-dd40-4f80-a701-c25ee025d9a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:20.207134 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d0eb4ca4-7eec-4f36-9190-e4bb44bd3643 req-010f3252-f973-41ba-afeb-615f65ee66cd service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] No waiting events found dispatching network-vif-plugged-0da752b6-6eef-4ad0-8bd2-315518fbea60 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:20.207134 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-d0eb4ca4-7eec-4f36-9190-e4bb44bd3643 req-010f3252-f973-41ba-afeb-615f65ee66cd service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Received unexpected event network-vif-plugged-0da752b6-6eef-4ad0-8bd2-315518fbea60 for instance with vm_state active and task_state None.
May 19 04:43:20.254879 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:43:20.328837 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:20.334747 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165800.3344994, 48bdc405-dd40-4f80-a701-c25ee025d9a6 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:20.334869 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] VM Resumed (Lifecycle Event)
May 19 04:43:20.353339 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Took 19.66 seconds to build instance.
May 19 04:43:20.512136 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:20.557505 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:20.629443 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:20.655033 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:20.656546 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:20.769029 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.805s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:20.769125 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Migrating
May 19 04:43:20.769393 np0000001025 nova-compute[97981]: DEBUG nova.compute.rpcapi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97981) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 19 04:43:20.775664 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.482s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:20.781421 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:43:20.781589 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Claim successful on node np0000001025
May 19 04:43:20.830088 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:20.830458 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:20.837059 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:20.842683 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:43:20.854739 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lock "48bdc405-dd40-4f80-a701-c25ee025d9a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.181s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:21.295380 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:21.296195 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquired lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:21.296636 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:43:21.333532 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:43:21.346050 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.99975934000031 future=<Future at 0x7218501a4ad0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:21.368244 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Removed pending STOPPED event for 92b3fb19-741d-476b-9d2f-83654a17aa0e due to new event <LifecycleEvent: 1779165801.3678057, 92b3fb19-741d-476b-9d2f-83654a17aa0e => Resumed> {{(pid=97981) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 19 04:43:21.368498 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165801.3678057, 92b3fb19-741d-476b-9d2f-83654a17aa0e => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:21.368774 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] VM Resumed (Lifecycle Event)
May 19 04:43:21.370753 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4ac0e185-b55a-41da-8ce4-c1199ea14ba2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:21.530810 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-47f8fdc7-fa23-4914-a886-28290084a43e req-7fef55b2-093e-40f3-99ca-9170353cd881 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received event network-vif-unplugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:21.531026 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-47f8fdc7-fa23-4914-a886-28290084a43e req-7fef55b2-093e-40f3-99ca-9170353cd881 service nova] Acquiring lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:21.531174 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-47f8fdc7-fa23-4914-a886-28290084a43e req-7fef55b2-093e-40f3-99ca-9170353cd881 service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:21.531344 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-47f8fdc7-fa23-4914-a886-28290084a43e req-7fef55b2-093e-40f3-99ca-9170353cd881 service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:21.531496 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-47f8fdc7-fa23-4914-a886-28290084a43e req-7fef55b2-093e-40f3-99ca-9170353cd881 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] No waiting events found dispatching network-vif-unplugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:21.531739 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-47f8fdc7-fa23-4914-a886-28290084a43e req-7fef55b2-093e-40f3-99ca-9170353cd881 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received unexpected event network-vif-unplugged-29504364-b589-4dde-a783-4b3bcaea9e02 for instance with vm_state active and task_state None.
May 19 04:43:21.531855 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-47f8fdc7-fa23-4914-a886-28290084a43e req-7fef55b2-093e-40f3-99ca-9170353cd881 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received event network-vif-plugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:21.531994 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-47f8fdc7-fa23-4914-a886-28290084a43e req-7fef55b2-093e-40f3-99ca-9170353cd881 service nova] Acquiring lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:21.532445 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-47f8fdc7-fa23-4914-a886-28290084a43e req-7fef55b2-093e-40f3-99ca-9170353cd881 service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:21.532685 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-47f8fdc7-fa23-4914-a886-28290084a43e req-7fef55b2-093e-40f3-99ca-9170353cd881 service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:21.532775 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-47f8fdc7-fa23-4914-a886-28290084a43e req-7fef55b2-093e-40f3-99ca-9170353cd881 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] No waiting events found dispatching network-vif-plugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:21.532876 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-47f8fdc7-fa23-4914-a886-28290084a43e req-7fef55b2-093e-40f3-99ca-9170353cd881 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received unexpected event network-vif-plugged-29504364-b589-4dde-a783-4b3bcaea9e02 for instance with vm_state active and task_state None.
May 19 04:43:21.532961 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-47f8fdc7-fa23-4914-a886-28290084a43e req-7fef55b2-093e-40f3-99ca-9170353cd881 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received event network-vif-plugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:21.533076 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-47f8fdc7-fa23-4914-a886-28290084a43e req-7fef55b2-093e-40f3-99ca-9170353cd881 service nova] Acquiring lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:21.533222 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-47f8fdc7-fa23-4914-a886-28290084a43e req-7fef55b2-093e-40f3-99ca-9170353cd881 service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:21.533327 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-47f8fdc7-fa23-4914-a886-28290084a43e req-7fef55b2-093e-40f3-99ca-9170353cd881 service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:21.533424 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-47f8fdc7-fa23-4914-a886-28290084a43e req-7fef55b2-093e-40f3-99ca-9170353cd881 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] No waiting events found dispatching network-vif-plugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:21.533516 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-47f8fdc7-fa23-4914-a886-28290084a43e req-7fef55b2-093e-40f3-99ca-9170353cd881 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received unexpected event network-vif-plugged-29504364-b589-4dde-a783-4b3bcaea9e02 for instance with vm_state active and task_state None.
May 19 04:43:21.799646 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:21.875400 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:21.892952 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:43:21.918715 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:22.171496 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:22.362763 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Updating instance_info_cache with network_info: [{"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:22.395223 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b5d290b9-e82d-45a3-b7f7-cb2f018fa670 req-5a061adb-73f7-4e93-ad44-b12fefb09d2a service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Received event network-changed-0da752b6-6eef-4ad0-8bd2-315518fbea60 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:22.395916 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b5d290b9-e82d-45a3-b7f7-cb2f018fa670 req-5a061adb-73f7-4e93-ad44-b12fefb09d2a service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Refreshing instance network info cache due to event network-changed-0da752b6-6eef-4ad0-8bd2-315518fbea60. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:43:22.396055 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b5d290b9-e82d-45a3-b7f7-cb2f018fa670 req-5a061adb-73f7-4e93-ad44-b12fefb09d2a service nova] Acquiring lock "refresh_cache-48bdc405-dd40-4f80-a701-c25ee025d9a6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:22.396167 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b5d290b9-e82d-45a3-b7f7-cb2f018fa670 req-5a061adb-73f7-4e93-ad44-b12fefb09d2a service nova] Acquired lock "refresh_cache-48bdc405-dd40-4f80-a701-c25ee025d9a6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:22.396892 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-b5d290b9-e82d-45a3-b7f7-cb2f018fa670 req-5a061adb-73f7-4e93-ad44-b12fefb09d2a service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Refreshing network info cache for port 0da752b6-6eef-4ad0-8bd2-315518fbea60 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:43:22.397747 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165802.397446, 92b3fb19-741d-476b-9d2f-83654a17aa0e => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:22.398709 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] VM Started (Lifecycle Event)
May 19 04:43:22.597782 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:43:22.597946 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:43:22.865098 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Releasing lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:22.898853 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-b5d290b9-e82d-45a3-b7f7-cb2f018fa670 req-5a061adb-73f7-4e93-ad44-b12fefb09d2a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:22.902456 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:22.903810 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:43:23.100212 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:43:23.119925 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "3aa0ffed-decc-493c-8735-aba1d221571d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:23.120714 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "3aa0ffed-decc-493c-8735-aba1d221571d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:23.192322 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-b5d290b9-e82d-45a3-b7f7-cb2f018fa670 req-5a061adb-73f7-4e93-ad44-b12fefb09d2a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:23.293975 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:23.336842 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-b5d290b9-e82d-45a3-b7f7-cb2f018fa670 req-5a061adb-73f7-4e93-ad44-b12fefb09d2a service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Updated VIF entry in instance network info cache for port 0da752b6-6eef-4ad0-8bd2-315518fbea60. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:43:23.337121 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-b5d290b9-e82d-45a3-b7f7-cb2f018fa670 req-5a061adb-73f7-4e93-ad44-b12fefb09d2a service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Updating instance_info_cache with network_info: [{"id": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "address": "fa:16:3e:60:02:e1", "network": {"id": "bed9f44e-8923-437b-b7fa-e20405554b44", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1907498263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5c4df421703949c7814d3fa7c2637793", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da752b6-6e", "ovs_interfaceid": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:23.608097 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.831s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:23.608097 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:43:23.612215 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.692s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:23.619130 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:43:23.619130 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Claim successful on node np0000001025
May 19 04:43:23.626898 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:43:23.839146 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b5d290b9-e82d-45a3-b7f7-cb2f018fa670 req-5a061adb-73f7-4e93-ad44-b12fefb09d2a service nova] Releasing lock "refresh_cache-48bdc405-dd40-4f80-a701-c25ee025d9a6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:24.114013 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:43:24.114172 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:43:24.114485 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:24.114741 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:24.181159 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:24.182254 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2bee156928644e1a450ae7c480d04d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39155484b40c4c4fb5906c33b2682b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:43:24.377796 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Starting migrate_disk_and_power_off {{(pid=97981) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 19 04:43:24.397643 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:24.421040 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:24.479281 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2b155da3-7270-4c27-9118-ed6e59298787 req-87c6b86b-4217-4a81-9a50-826524e8561d service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Received event network-changed-0da752b6-6eef-4ad0-8bd2-315518fbea60 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:24.479713 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2b155da3-7270-4c27-9118-ed6e59298787 req-87c6b86b-4217-4a81-9a50-826524e8561d service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Refreshing instance network info cache due to event network-changed-0da752b6-6eef-4ad0-8bd2-315518fbea60. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:43:24.479883 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2b155da3-7270-4c27-9118-ed6e59298787 req-87c6b86b-4217-4a81-9a50-826524e8561d service nova] Acquiring lock "refresh_cache-48bdc405-dd40-4f80-a701-c25ee025d9a6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:24.479971 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2b155da3-7270-4c27-9118-ed6e59298787 req-87c6b86b-4217-4a81-9a50-826524e8561d service nova] Acquired lock "refresh_cache-48bdc405-dd40-4f80-a701-c25ee025d9a6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:24.480095 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2b155da3-7270-4c27-9118-ed6e59298787 req-87c6b86b-4217-4a81-9a50-826524e8561d service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Refreshing network info cache for port 0da752b6-6eef-4ad0-8bd2-315518fbea60 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:43:24.562381 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:24.565926 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a98dcb14-c9da-48e6-b70f-75bfcc53ba04 req-11b2d066-ee93-45b5-b92d-a819ee674667 service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Received event network-vif-unplugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:24.566888 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a98dcb14-c9da-48e6-b70f-75bfcc53ba04 req-11b2d066-ee93-45b5-b92d-a819ee674667 service nova] Acquiring lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:24.567310 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a98dcb14-c9da-48e6-b70f-75bfcc53ba04 req-11b2d066-ee93-45b5-b92d-a819ee674667 service nova] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:24.567583 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a98dcb14-c9da-48e6-b70f-75bfcc53ba04 req-11b2d066-ee93-45b5-b92d-a819ee674667 service nova] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:24.568012 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a98dcb14-c9da-48e6-b70f-75bfcc53ba04 req-11b2d066-ee93-45b5-b92d-a819ee674667 service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] No waiting events found dispatching network-vif-unplugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:24.568012 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-a98dcb14-c9da-48e6-b70f-75bfcc53ba04 req-11b2d066-ee93-45b5-b92d-a819ee674667 service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Received unexpected event network-vif-unplugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 for instance with vm_state active and task_state resize_migrating.
May 19 04:43:24.568323 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:24.616743 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:43:24.636140 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Successfully created port: 3ba06f13-fd8a-4116-a906-70f339d1b0ba {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:43:24.688764 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:24.696136 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:24.729675 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999685849000343 future=<Future at 0x7218501a7d10 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:24.732289 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Instance destroyed successfully.
May 19 04:43:24.733806 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='multiattach-server-1',id=38,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9kq9UfoFPrqlSUYASLa2M8/KXwpiWIksTRz6r+vXFFf5G7djO79flSW+4jvUEBmYvioxzxvTch1hKVIwlMIaMSuT3AyUPlX/5ZPn59wF6pdcyyqAHuNzAVPjAjiGd+6A==',key_name='tempest-keypair-818275091',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:41:08Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-56qgb0gs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:43:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa432d60cb324c6d87818107e05e0053',uuid=417861ee-dcf2-458b-8782-2ec22d2f5421,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "vif_mac": "fa:16:3e:b0:9e:6f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:43:24.733988 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "vif_mac": "fa:16:3e:b0:9e:6f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:43:24.734781 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:9e:6f,bridge_name='br-int',has_traffic_filtering=True,id=d51c757a-3333-4e40-8d5f-3c2d35a128b2,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51c757a-33') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:43:24.735072 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:9e:6f,bridge_name='br-int',has_traffic_filtering=True,id=d51c757a-3333-4e40-8d5f-3c2d35a128b2,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51c757a-33') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:43:24.741134 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:24.741134 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd51c757a-33, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:24.745691 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:24.748345 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:24.748808 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e7bd3bf-417c-429a-a0b4-352b6cbbbb3c) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:24.749954 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:24.749954 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:24.751212 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:24.754926 np0000001025 nova-compute[97981]: INFO os_vif [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:9e:6f,bridge_name='br-int',has_traffic_filtering=True,id=d51c757a-3333-4e40-8d5f-3c2d35a128b2,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51c757a-33')
May 19 04:43:24.983436 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-2b155da3-7270-4c27-9118-ed6e59298787 req-87c6b86b-4217-4a81-9a50-826524e8561d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:25.038609 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00038451899990832317 future=<Future at 0x7218506026c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:25.039160 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Emitting event <LifecycleEvent: 1779165790.0380955, aa2cdf1d-65ef-4cf4-b742-72ae783cde27 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:25.039387 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:25.039589 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] VM Stopped (Lifecycle Event)
May 19 04:43:25.040571 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=11.305220955000095 future=<Future at 0x7218501a4ad0 state=cancelled>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:25.040701 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=11.305070739000257 future=<Future at 0x7218501a4ad0 state=cancelled>) was cancelled while queued, skipping {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:25.040772 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:25.040858 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.68846217700002 future=<Future at 0x7218501a7d10 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:25.040922 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.688391191000392 future=<Future at 0x7218501a7d10 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:25.120311 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:43:25.249172 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Successfully updated port: 3ba06f13-fd8a-4116-a906-70f339d1b0ba {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:43:25.301284 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Detected multiple connections on this host for volume: 405ea65f-8d17-42c7-922a-dac27a17a488, skipping target disconnect.
May 19 04:43:25.305007 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:25.353845 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-2b155da3-7270-4c27-9118-ed6e59298787 req-87c6b86b-4217-4a81-9a50-826524e8561d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:25.394515 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:25.394947 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:25.436098 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:43:25.436458 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:43:25.488460 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:25.489336 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:43:25.491529 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2b155da3-7270-4c27-9118-ed6e59298787 req-87c6b86b-4217-4a81-9a50-826524e8561d service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Updated VIF entry in instance network info cache for port 0da752b6-6eef-4ad0-8bd2-315518fbea60. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:43:25.491731 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2b155da3-7270-4c27-9118-ed6e59298787 req-87c6b86b-4217-4a81-9a50-826524e8561d service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Updating instance_info_cache with network_info: [{"id": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "address": "fa:16:3e:60:02:e1", "network": {"id": "bed9f44e-8923-437b-b7fa-e20405554b44", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1907498263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5c4df421703949c7814d3fa7c2637793", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da752b6-6e", "ovs_interfaceid": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:25.493279 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421_resize/disk /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:25.543430 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: aa2cdf1d-65ef-4cf4-b742-72ae783cde27] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:25.584995 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "cp -r /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421_resize/disk /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk" returned: 0 in 0.092s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:25.585342 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421_resize/disk.config /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk.config {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:25.628568 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "cp -r /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421_resize/disk.config /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk.config" returned: 0 in 0.043s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:25.639844 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421_resize/disk.info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk.info {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:25.672595 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "cp -r /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421_resize/disk.info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk.info" returned: 0 in 0.043s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:25.751481 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "refresh_cache-e991af6e-6fc9-4286-a848-84682121bbb1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:25.751603 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquired lock "refresh_cache-e991af6e-6fc9-4286-a848-84682121bbb1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:25.751898 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:43:25.940991 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:43:25.994350 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2b155da3-7270-4c27-9118-ed6e59298787 req-87c6b86b-4217-4a81-9a50-826524e8561d service nova] Releasing lock "refresh_cache-48bdc405-dd40-4f80-a701-c25ee025d9a6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:25.994665 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2b155da3-7270-4c27-9118-ed6e59298787 req-87c6b86b-4217-4a81-9a50-826524e8561d service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Received event network-changed-0da752b6-6eef-4ad0-8bd2-315518fbea60 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:25.994807 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2b155da3-7270-4c27-9118-ed6e59298787 req-87c6b86b-4217-4a81-9a50-826524e8561d service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Refreshing instance network info cache due to event network-changed-0da752b6-6eef-4ad0-8bd2-315518fbea60. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:43:25.994955 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2b155da3-7270-4c27-9118-ed6e59298787 req-87c6b86b-4217-4a81-9a50-826524e8561d service nova] Acquiring lock "refresh_cache-48bdc405-dd40-4f80-a701-c25ee025d9a6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:25.995043 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2b155da3-7270-4c27-9118-ed6e59298787 req-87c6b86b-4217-4a81-9a50-826524e8561d service nova] Acquired lock "refresh_cache-48bdc405-dd40-4f80-a701-c25ee025d9a6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:25.995166 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2b155da3-7270-4c27-9118-ed6e59298787 req-87c6b86b-4217-4a81-9a50-826524e8561d service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Refreshing network info cache for port 0da752b6-6eef-4ad0-8bd2-315518fbea60 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:43:26.129689 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:43:26.130808 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:43:26.131065 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Creating image(s)
May 19 04:43:26.131922 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "/opt/stack/data/nova/instances/e991af6e-6fc9-4286-a848-84682121bbb1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:26.132065 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "/opt/stack/data/nova/instances/e991af6e-6fc9-4286-a848-84682121bbb1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:26.132595 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "/opt/stack/data/nova/instances/e991af6e-6fc9-4286-a848-84682121bbb1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:26.133241 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "b68a2903f98676aa2401b24f19e2a5cfb463071d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:26.133581 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "b68a2903f98676aa2401b24f19e2a5cfb463071d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:26.340746 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:43:26.447781 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.837s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:26.448140 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:43:26.453976 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.273s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:26.460231 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:43:26.460481 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Claim successful on node np0000001025
May 19 04:43:26.497040 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-2b155da3-7270-4c27-9118-ed6e59298787 req-87c6b86b-4217-4a81-9a50-826524e8561d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:26.534648 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:26.658346 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1ba13ed7-5f02-468d-aed1-e76846810459 req-0db96fa0-acb8-4657-9077-404549e027bf service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Received event network-vif-unplugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:26.658729 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1ba13ed7-5f02-468d-aed1-e76846810459 req-0db96fa0-acb8-4657-9077-404549e027bf service nova] Acquiring lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:26.658830 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1ba13ed7-5f02-468d-aed1-e76846810459 req-0db96fa0-acb8-4657-9077-404549e027bf service nova] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:26.659036 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1ba13ed7-5f02-468d-aed1-e76846810459 req-0db96fa0-acb8-4657-9077-404549e027bf service nova] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:26.659036 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1ba13ed7-5f02-468d-aed1-e76846810459 req-0db96fa0-acb8-4657-9077-404549e027bf service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] No waiting events found dispatching network-vif-unplugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:26.659230 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-1ba13ed7-5f02-468d-aed1-e76846810459 req-0db96fa0-acb8-4657-9077-404549e027bf service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Received unexpected event network-vif-unplugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 for instance with vm_state active and task_state resize_migrating.
May 19 04:43:26.659389 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1ba13ed7-5f02-468d-aed1-e76846810459 req-0db96fa0-acb8-4657-9077-404549e027bf service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Received event network-changed-3ba06f13-fd8a-4116-a906-70f339d1b0ba {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:26.659546 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1ba13ed7-5f02-468d-aed1-e76846810459 req-0db96fa0-acb8-4657-9077-404549e027bf service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Refreshing instance network info cache due to event network-changed-3ba06f13-fd8a-4116-a906-70f339d1b0ba. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:43:26.660659 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1ba13ed7-5f02-468d-aed1-e76846810459 req-0db96fa0-acb8-4657-9077-404549e027bf service nova] Acquiring lock "refresh_cache-e991af6e-6fc9-4286-a848-84682121bbb1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:26.706046 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Updating instance_info_cache with network_info: [{"id": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "address": "fa:16:3e:1f:14:50", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba06f13-fd", "ovs_interfaceid": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:26.778048 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:26.778512 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:26.864426 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Port d51c757a-3333-4e40-8d5f-3c2d35a128b2 binding to destination host np0000001025 is already ACTIVE {{(pid=97981) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}}
May 19 04:43:26.867132 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-2b155da3-7270-4c27-9118-ed6e59298787 req-87c6b86b-4217-4a81-9a50-826524e8561d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:26.925865 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:26.928270 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:26.928587 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b68a2903f98676aa2401b24f19e2a5cfb463071d.part --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:26.966496 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:43:26.966496 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:43:26.966496 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:26.966496 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:27.029239 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b68a2903f98676aa2401b24f19e2a5cfb463071d.part --force-share --output=json" returned: 0 in 0.101s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:27.029613 np0000001025 nova-compute[97981]: DEBUG nova.virt.images [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] 753d6474-0abb-4f63-968d-d1e9ee5fab88 was qcow2, converting to raw {{(pid=97981) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 19 04:43:27.030259 np0000001025 nova-compute[97981]: DEBUG nova.privsep.utils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97981) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 19 04:43:27.030607 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b68a2903f98676aa2401b24f19e2a5cfb463071d.part /opt/stack/data/nova/instances/_base/b68a2903f98676aa2401b24f19e2a5cfb463071d.converted {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:27.065169 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2b155da3-7270-4c27-9118-ed6e59298787 req-87c6b86b-4217-4a81-9a50-826524e8561d service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Updated VIF entry in instance network info cache for port 0da752b6-6eef-4ad0-8bd2-315518fbea60. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:43:27.067756 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2b155da3-7270-4c27-9118-ed6e59298787 req-87c6b86b-4217-4a81-9a50-826524e8561d service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Updating instance_info_cache with network_info: [{"id": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "address": "fa:16:3e:60:02:e1", "network": {"id": "bed9f44e-8923-437b-b7fa-e20405554b44", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1907498263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5c4df421703949c7814d3fa7c2637793", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da752b6-6e", "ovs_interfaceid": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:27.073277 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93a5d16bed8c474fa58e1982fa784db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0c7a19a41a44fba4c0fca71022a5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:43:27.208615 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Releasing lock "refresh_cache-e991af6e-6fc9-4286-a848-84682121bbb1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:27.208916 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Instance network_info: |[{"id": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "address": "fa:16:3e:1f:14:50", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba06f13-fd", "ovs_interfaceid": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:43:27.211081 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1ba13ed7-5f02-468d-aed1-e76846810459 req-0db96fa0-acb8-4657-9077-404549e027bf service nova] Acquired lock "refresh_cache-e991af6e-6fc9-4286-a848-84682121bbb1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:27.211760 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1ba13ed7-5f02-468d-aed1-e76846810459 req-0db96fa0-acb8-4657-9077-404549e027bf service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Refreshing network info cache for port 3ba06f13-fd8a-4116-a906-70f339d1b0ba {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:43:27.219740 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:27.234982 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b68a2903f98676aa2401b24f19e2a5cfb463071d.part /opt/stack/data/nova/instances/_base/b68a2903f98676aa2401b24f19e2a5cfb463071d.converted" returned: 0 in 0.204s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:27.246351 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b68a2903f98676aa2401b24f19e2a5cfb463071d.converted --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:27.350405 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b68a2903f98676aa2401b24f19e2a5cfb463071d.converted --force-share --output=json" returned: 0 in 0.104s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:27.351795 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "b68a2903f98676aa2401b24f19e2a5cfb463071d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.218s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:27.354405 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:27.358063 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:27.359526 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b68a2903f98676aa2401b24f19e2a5cfb463071d --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:27.448082 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b68a2903f98676aa2401b24f19e2a5cfb463071d --force-share --output=json" returned: 0 in 0.088s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:27.448783 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "b68a2903f98676aa2401b24f19e2a5cfb463071d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:27.449915 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "b68a2903f98676aa2401b24f19e2a5cfb463071d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:27.450551 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:27.456428 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:27.456912 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b68a2903f98676aa2401b24f19e2a5cfb463071d --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:27.481454 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:43:27.565915 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b68a2903f98676aa2401b24f19e2a5cfb463071d --force-share --output=json" returned: 0 in 0.108s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:27.565915 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b68a2903f98676aa2401b24f19e2a5cfb463071d,backing_fmt=raw /opt/stack/data/nova/instances/e991af6e-6fc9-4286-a848-84682121bbb1/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:27.586315 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2b155da3-7270-4c27-9118-ed6e59298787 req-87c6b86b-4217-4a81-9a50-826524e8561d service nova] Releasing lock "refresh_cache-48bdc405-dd40-4f80-a701-c25ee025d9a6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:27.617723 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b68a2903f98676aa2401b24f19e2a5cfb463071d,backing_fmt=raw /opt/stack/data/nova/instances/e991af6e-6fc9-4286-a848-84682121bbb1/disk 1073741824" returned: 0 in 0.052s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:27.618201 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "b68a2903f98676aa2401b24f19e2a5cfb463071d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.168s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:27.618636 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b68a2903f98676aa2401b24f19e2a5cfb463071d --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:27.682661 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Successfully created port: 0e304a34-15bb-43c9-b664-3ceb8240b8ae {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:43:27.716171 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-1ba13ed7-5f02-468d-aed1-e76846810459 req-0db96fa0-acb8-4657-9077-404549e027bf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:27.721363 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b68a2903f98676aa2401b24f19e2a5cfb463071d --force-share --output=json" returned: 0 in 0.103s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:27.721879 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:43:27.722220 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Ensure instance console log exists: /opt/stack/data/nova/instances/e991af6e-6fc9-4286-a848-84682121bbb1/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:43:27.722311 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:27.722488 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:27.722631 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:27.724172 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Start _get_guest_xml network_info=[{"id": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "address": "fa:16:3e:1f:14:50", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba06f13-fd", "ovs_interfaceid": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='323611b4e7b650b294f56fac6efd6556',container_format='bare',created_at=2026-05-19T04:43:08Z,direct_url=<?>,disk_format='qcow2',id=753d6474-0abb-4f63-968d-d1e9ee5fab88,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-107338821',owner='39155484b40c4c4fb5906c33b2682b3d',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-19T04:43:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '753d6474-0abb-4f63-968d-d1e9ee5fab88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:43:27.727915 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:43:27.729483 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-1103585281', uuid='e991af6e-6fc9-4286-a848-84682121bbb1'), owner=OwnerMeta(userid='a2bee156928644e1a450ae7c480d04d0', username='tempest-TestStampPattern-1526088943-project-member', projectid='39155484b40c4c4fb5906c33b2682b3d', projectname='tempest-TestStampPattern-1526088943'), image=ImageMeta(id='753d6474-0abb-4f63-968d-d1e9ee5fab88', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_owner_id': '39155484b40c4c4fb5906c33b2682b3d'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "address": "fa:16:3e:1f:14:50", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba06f13-fd", "ovs_interfaceid": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165807.7290714) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:43:27.732557 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:43:27.732986 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:43:27.737726 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:43:27.737726 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:43:27.737726 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:43:27.737726 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='323611b4e7b650b294f56fac6efd6556',container_format='bare',created_at=2026-05-19T04:43:08Z,direct_url=<?>,disk_format='qcow2',id=753d6474-0abb-4f63-968d-d1e9ee5fab88,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-107338821',owner='39155484b40c4c4fb5906c33b2682b3d',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-19T04:43:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:43:27.737726 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:43:27.737726 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:43:27.737726 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:43:27.737726 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:43:27.737726 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:43:27.737726 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:43:27.738168 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:43:27.738571 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:43:27.738571 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:43:27.738651 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:43:27.763014 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:43:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1103585281',display_name='tempest-TestStampPattern-server-1103585281',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-teststamppattern-server-1103585281',id=47,image_ref='753d6474-0abb-4f63-968d-d1e9ee5fab88',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKU2n0VcX8xMH+sW7ZCTVd5WzR5Ckycn9oGpkVd3uX9291bcgn3KJ8WDVGgJl9FiOS6puDyqsoALPmLm1PDDqcos+J/7xzJXkaCOlPt64B9ufpXMvpZcYNFqFdKYfiUbJw==',key_name='tempest-TestStampPattern-1529897663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39155484b40c4c4fb5906c33b2682b3d',ramdisk_id='',reservation_id='r-8nt6racw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0b156bbc-f85d-4739-bf88-bc609d4f8052',image_min_disk='1',image_min_ram='0',image_owner_id='39155484b40c4c4fb5906c33b2682b3d',image_owner_project_name='tempest-TestStampPattern-1526088943',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1526088943-project-member',image_user_id='a2bee156928644e1a450ae7c480d04d0',network_allocated='True',owner_project_name='tempest-TestStampPattern-1526088943',owner_user_name='tempest-TestStampPattern-1526088943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:43:25Z,user_data=None,user_id='a2bee156928644e1a450ae7c480d04d0',uuid=e991af6e-6fc9-4286-a848-84682121bbb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "address": "fa:16:3e:1f:14:50", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba06f13-fd", "ovs_interfaceid": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:43:27.763014 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Converting VIF {"id": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "address": "fa:16:3e:1f:14:50", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba06f13-fd", "ovs_interfaceid": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:43:27.763014 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:14:50,bridge_name='br-int',has_traffic_filtering=True,id=3ba06f13-fd8a-4116-a906-70f339d1b0ba,network=Network(61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba06f13-fd') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:43:27.763014 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lazy-loading 'pci_devices' on Instance uuid e991af6e-6fc9-4286-a848-84682121bbb1 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:27.881661 np0000001025 nova-compute[97981]: DEBUG nova.compute.rpcapi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97981) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 19 04:43:27.899908 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:27.901558 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:27.901786 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:27.992182 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:43:28.135279 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-1ba13ed7-5f02-468d-aed1-e76846810459 req-0db96fa0-acb8-4657-9077-404549e027bf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:28.265048 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] End _get_guest_xml xml=<domain type="qemu">
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:   <uuid>e991af6e-6fc9-4286-a848-84682121bbb1</uuid>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:   <name>instance-0000002f</name>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestStampPattern-server-1103585281</nova:name>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:43:27</nova:creationTime>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:           <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:           <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:           <nova:property name="img_owner_id">39155484b40c4c4fb5906c33b2682b3d</nova:property>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:         <nova:user uuid="a2bee156928644e1a450ae7c480d04d0">tempest-TestStampPattern-1526088943-project-member</nova:user>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:         <nova:project uuid="39155484b40c4c4fb5906c33b2682b3d">tempest-TestStampPattern-1526088943</nova:project>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:         <nova:port uuid="3ba06f13-fd8a-4116-a906-70f339d1b0ba">
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     <system>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <entry name="serial">e991af6e-6fc9-4286-a848-84682121bbb1</entry>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <entry name="uuid">e991af6e-6fc9-4286-a848-84682121bbb1</entry>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     </system>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:   <os>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:   </os>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:   <features>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:   </features>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:   <devices>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/e991af6e-6fc9-4286-a848-84682121bbb1/disk"/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     </disk>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/e991af6e-6fc9-4286-a848-84682121bbb1/disk.config"/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     </disk>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:1f:14:50"/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <target dev="tap3ba06f13-fd"/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     </interface>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/e991af6e-6fc9-4286-a848-84682121bbb1/console.log" append="off"/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     </serial>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     <video>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     </video>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     </rng>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:   </devices>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]: </domain>
May 19 04:43:28.265048 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:43:28.265048 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Preparing to wait for external event network-vif-plugged-3ba06f13-fd8a-4116-a906-70f339d1b0ba {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:43:28.265048 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "e991af6e-6fc9-4286-a848-84682121bbb1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:28.265048 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "e991af6e-6fc9-4286-a848-84682121bbb1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:28.265048 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "e991af6e-6fc9-4286-a848-84682121bbb1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:28.265048 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:43:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1103585281',display_name='tempest-TestStampPattern-server-1103585281',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-teststamppattern-server-1103585281',id=47,image_ref='753d6474-0abb-4f63-968d-d1e9ee5fab88',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKU2n0VcX8xMH+sW7ZCTVd5WzR5Ckycn9oGpkVd3uX9291bcgn3KJ8WDVGgJl9FiOS6puDyqsoALPmLm1PDDqcos+J/7xzJXkaCOlPt64B9ufpXMvpZcYNFqFdKYfiUbJw==',key_name='tempest-TestStampPattern-1529897663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39155484b40c4c4fb5906c33b2682b3d',ramdisk_id='',reservation_id='r-8nt6racw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0b156bbc-f85d-4739-bf88-bc609d4f8052',image_min_disk='1',image_min_ram='0',image_owner_id='39155484b40c4c4fb5906c33b2682b3d',image_owner_project_name='tempest-TestStampPattern-1526088943',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1526088943-project-member',image_user_id='a2bee156928644e1a450ae7c480d04d0',network_allocated='True',owner_project_name='tempest-TestStampPattern-1526088943',owner_user_name='tempest-TestStampPattern-1526088943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:43:25Z,user_data=None,user_id='a2bee156928644e1a450ae7c480d04d0',uuid=e991af6e-6fc9-4286-a848-84682121bbb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "address": "fa:16:3e:1f:14:50", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba06f13-fd", "ovs_interfaceid": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:43:28.265048 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Converting VIF {"id": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "address": "fa:16:3e:1f:14:50", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba06f13-fd", "ovs_interfaceid": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:43:28.265048 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:14:50,bridge_name='br-int',has_traffic_filtering=True,id=3ba06f13-fd8a-4116-a906-70f339d1b0ba,network=Network(61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba06f13-fd') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:43:28.265048 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:14:50,bridge_name='br-int',has_traffic_filtering=True,id=3ba06f13-fd8a-4116-a906-70f339d1b0ba,network=Network(61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba06f13-fd') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:43:28.270130 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:28.270130 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:28.270130 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:43:28.272122 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:28.272122 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ceb959a-d09e-5966-833b-b4ab5f387730', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:28.273075 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:28.274716 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:28.276338 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:28.280465 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:28.280702 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ba06f13-fd, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:28.281158 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ba06f13-fd, col_values=(('qos', UUID('bf0e6d69-9db9-4eb4-ac0a-c7c0f83bc65b')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:28.281380 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ba06f13-fd, col_values=(('external_ids', {'iface-id': '3ba06f13-fd8a-4116-a906-70f339d1b0ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:14:50', 'vm-uuid': 'e991af6e-6fc9-4286-a848-84682121bbb1'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:28.282609 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:28.284654 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:28.291855 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:28.292916 np0000001025 nova-compute[97981]: INFO os_vif [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:14:50,bridge_name='br-int',has_traffic_filtering=True,id=3ba06f13-fd8a-4116-a906-70f339d1b0ba,network=Network(61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba06f13-fd')
May 19 04:43:28.296132 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:28.304298 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1ba13ed7-5f02-468d-aed1-e76846810459 req-0db96fa0-acb8-4657-9077-404549e027bf service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Updated VIF entry in instance network info cache for port 3ba06f13-fd8a-4116-a906-70f339d1b0ba. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:43:28.304622 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1ba13ed7-5f02-468d-aed1-e76846810459 req-0db96fa0-acb8-4657-9077-404549e027bf service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Updating instance_info_cache with network_info: [{"id": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "address": "fa:16:3e:1f:14:50", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba06f13-fd", "ovs_interfaceid": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:28.322836 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Successfully updated port: 0e304a34-15bb-43c9-b664-3ceb8240b8ae {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:43:28.393200 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:43:28.393436 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:43:28.444387 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-366768c8-dfca-44c1-bc69-08cf0e08ce1f req-85f005cd-0a4a-4936-9d9b-27b3a44c1e6e service nova] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Received event network-changed-0e304a34-15bb-43c9-b664-3ceb8240b8ae {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:28.445004 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-366768c8-dfca-44c1-bc69-08cf0e08ce1f req-85f005cd-0a4a-4936-9d9b-27b3a44c1e6e service nova] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Refreshing instance network info cache due to event network-changed-0e304a34-15bb-43c9-b664-3ceb8240b8ae. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:43:28.445222 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-366768c8-dfca-44c1-bc69-08cf0e08ce1f req-85f005cd-0a4a-4936-9d9b-27b3a44c1e6e service nova] Acquiring lock "refresh_cache-035dd3e2-1951-4cb3-8cda-691019c0c9cb" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:28.445350 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-366768c8-dfca-44c1-bc69-08cf0e08ce1f req-85f005cd-0a4a-4936-9d9b-27b3a44c1e6e service nova] Acquired lock "refresh_cache-035dd3e2-1951-4cb3-8cda-691019c0c9cb" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:28.445514 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-366768c8-dfca-44c1-bc69-08cf0e08ce1f req-85f005cd-0a4a-4936-9d9b-27b3a44c1e6e service nova] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Refreshing network info cache for port 0e304a34-15bb-43c9-b664-3ceb8240b8ae {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:43:28.816292 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1ba13ed7-5f02-468d-aed1-e76846810459 req-0db96fa0-acb8-4657-9077-404549e027bf service nova] Releasing lock "refresh_cache-e991af6e-6fc9-4286-a848-84682121bbb1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:28.825921 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "refresh_cache-035dd3e2-1951-4cb3-8cda-691019c0c9cb" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:28.897244 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:43:28.922227 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:28.951436 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-366768c8-dfca-44c1-bc69-08cf0e08ce1f req-85f005cd-0a4a-4936-9d9b-27b3a44c1e6e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:29.003745 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:43:29.004896 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:43:29.007181 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Creating image(s)
May 19 04:43:29.008390 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "/opt/stack/data/nova/instances/035dd3e2-1951-4cb3-8cda-691019c0c9cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:29.008825 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "/opt/stack/data/nova/instances/035dd3e2-1951-4cb3-8cda-691019c0c9cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:29.010385 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "/opt/stack/data/nova/instances/035dd3e2-1951-4cb3-8cda-691019c0c9cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:29.011097 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:29.019995 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:29.023458 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:29.023615 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquired lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:29.023796 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:43:29.024675 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:29.051560 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-366768c8-dfca-44c1-bc69-08cf0e08ce1f req-85f005cd-0a4a-4936-9d9b-27b3a44c1e6e service nova] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:43:29.116205 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.091s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:29.116614 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:29.117098 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:29.117436 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:29.119920 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:29.120209 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:29.204325 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-366768c8-dfca-44c1-bc69-08cf0e08ce1f req-85f005cd-0a4a-4936-9d9b-27b3a44c1e6e service nova] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:29.224264 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.104s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:29.224481 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/035dd3e2-1951-4cb3-8cda-691019c0c9cb/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:29.296034 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/035dd3e2-1951-4cb3-8cda-691019c0c9cb/disk 1073741824" returned: 0 in 0.071s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:29.298614 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.181s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:29.298993 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:29.423786 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.954s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:29.423786 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:43:29.424784 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.126s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:29.425750 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Checking if we can resize image /opt/stack/data/nova/instances/035dd3e2-1951-4cb3-8cda-691019c0c9cb/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:43:29.426608 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035dd3e2-1951-4cb3-8cda-691019c0c9cb/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:29.541086 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035dd3e2-1951-4cb3-8cda-691019c0c9cb/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:29.541441 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Cannot resize image /opt/stack/data/nova/instances/035dd3e2-1951-4cb3-8cda-691019c0c9cb/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:43:29.541845 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:43:29.542185 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Ensure instance console log exists: /opt/stack/data/nova/instances/035dd3e2-1951-4cb3-8cda-691019c0c9cb/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:43:29.542482 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:29.542717 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:29.542849 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:29.557045 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:29.706931 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-366768c8-dfca-44c1-bc69-08cf0e08ce1f req-85f005cd-0a4a-4936-9d9b-27b3a44c1e6e service nova] Releasing lock "refresh_cache-035dd3e2-1951-4cb3-8cda-691019c0c9cb" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:29.707395 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquired lock "refresh_cache-035dd3e2-1951-4cb3-8cda-691019c0c9cb" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:29.707577 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:43:29.828668 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:43:29.829144 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:43:29.829144 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] No VIF found with MAC fa:16:3e:1f:14:50, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:43:29.829908 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Using config drive
May 19 04:43:29.914175 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:29.917876 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:43:29.918239 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:43:29.918560 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:29.918821 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:30.011471 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5885f1561f394d46bd4c1b48e7323c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7465b5668be4eb9b75c1ddc876e7eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:43:30.076391 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Updating instance_info_cache with network_info: [{"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:30.305179 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:43:30.335545 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:30.430034 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:43:30.526975 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Successfully created port: e7186e58-a62a-4993-ac19-98c145d5ef47 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:43:30.554696 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Creating config drive at /opt/stack/data/nova/instances/e991af6e-6fc9-4286-a848-84682121bbb1/disk.config
May 19 04:43:30.559005 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e991af6e-6fc9-4286-a848-84682121bbb1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnzrinbqj {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:30.587132 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Releasing lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:30.600768 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:30.624289 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e991af6e-6fc9-4286-a848-84682121bbb1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnzrinbqj" returned: 0 in 0.064s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:30.788226 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Updating instance_info_cache with network_info: [{"id": "0e304a34-15bb-43c9-b664-3ceb8240b8ae", "address": "fa:16:3e:bf:92:41", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e304a34-15", "ovs_interfaceid": "0e304a34-15bb-43c9-b664-3ceb8240b8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:30.937400 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:43:31.091663 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:31.120274 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:43:31.134885 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:43:31.164292 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:31.178389 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:31.192317 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:31.238052 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:43:31.238400 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:43:31.248605 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:43:31.248764 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fea1:aa43', 'fe80::fc16:3eff:fe1d:f0b2', 'fe80::4cb5:1dff:fe2d:31dc', 'fe80::fc16:3eff:fefb:c3a3', 'fe80::2c2c:57ff:feff:64a5', 'fe80::fc16:3eff:feb6:da78', 'fe80::bc20:d2ff:fef5:7278', 'fe80::fc16:3eff:fefa:d4f0', 'fe80::fc16:3eff:fe08:49d', 'fe80::bc2a:1ff:fe94:f24f', 'fe80::fc16:3eff:fe60:2e1', 'fe80::1c47:6dff:fe04:c9d9', 'fe80::fc16:3eff:fe8e:f53b', 'fe80::fc16:3eff:fe1f:1450'] 
May 19 04:43:31.250064 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:43:31.250064 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:43:31.250064 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:43:31.290945 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Releasing lock "refresh_cache-035dd3e2-1951-4cb3-8cda-691019c0c9cb" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:31.291367 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Instance network_info: |[{"id": "0e304a34-15bb-43c9-b664-3ceb8240b8ae", "address": "fa:16:3e:bf:92:41", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e304a34-15", "ovs_interfaceid": "0e304a34-15bb-43c9-b664-3ceb8240b8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:43:31.293882 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Start _get_guest_xml network_info=[{"id": "0e304a34-15bb-43c9-b664-3ceb8240b8ae", "address": "fa:16:3e:bf:92:41", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e304a34-15", "ovs_interfaceid": "0e304a34-15bb-43c9-b664-3ceb8240b8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:43:31.301545 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:43:31.303255 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1964855574', uuid='035dd3e2-1951-4cb3-8cda-691019c0c9cb'), owner=OwnerMeta(userid='93a5d16bed8c474fa58e1982fa784db9', username='tempest-VolumeMultiattachTests-1349332830-project-member', projectid='7e0c7a19a41a44fba4c0fca71022a5a1', projectname='tempest-VolumeMultiattachTests-1349332830'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0e304a34-15bb-43c9-b664-3ceb8240b8ae", "address": "fa:16:3e:bf:92:41", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e304a34-15", "ovs_interfaceid": "0e304a34-15bb-43c9-b664-3ceb8240b8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165811.3026278) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:43:31.304668 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:43:31.307228 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:43:31.310831 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:31.310831 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:43:31.310831 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:43:31.310831 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:43:31.310831 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:43:31.310831 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:43:31.310831 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:43:31.311241 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:43:31.311241 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:43:31.311241 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:43:31.311645 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:43:31.311645 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:43:31.311645 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:43:31.311645 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:43:31.312582 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:43:31.324045 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:43:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1964855574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumemultiattachtests-server-1964855574',id=48,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjFouPpPO7vShqGexlsyxCbcJupWN8W08CArgg9PiFIml458N7wqc5CZAN0wkqP6rLcVICsrsq+oDBM6In3A2goh8llqsdZqWD/jfCCd+sViF8rwXnvN3XA3rP4jvYotw==',key_name='tempest-keypair-899081243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e0c7a19a41a44fba4c0fca71022a5a1',ramdisk_id='',reservation_id='r-boedkpxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1349332830',owner_user_name='tempest-VolumeMultiattachTests-1349332830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:43:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93a5d16bed8c474fa58e1982fa784db9',uuid=035dd3e2-1951-4cb3-8cda-691019c0c9cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e304a34-15bb-43c9-b664-3ceb8240b8ae", "address": "fa:16:3e:bf:92:41", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e304a34-15", "ovs_interfaceid": "0e304a34-15bb-43c9-b664-3ceb8240b8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:43:31.324221 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Converting VIF {"id": "0e304a34-15bb-43c9-b664-3ceb8240b8ae", "address": "fa:16:3e:bf:92:41", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e304a34-15", "ovs_interfaceid": "0e304a34-15bb-43c9-b664-3ceb8240b8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:43:31.325078 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:92:41,bridge_name='br-int',has_traffic_filtering=True,id=0e304a34-15bb-43c9-b664-3ceb8240b8ae,network=Network(c948b992-32a1-4652-a328-d2d326ea9148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e304a34-15') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:43:31.326263 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lazy-loading 'pci_devices' on Instance uuid 035dd3e2-1951-4cb3-8cda-691019c0c9cb {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:31.341378 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:31.343623 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:31.360933 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Successfully updated port: e7186e58-a62a-4993-ac19-98c145d5ef47 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:43:31.415660 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c96f4c33-afbf-45d1-960e-c6bb793fd8e7 req-0b417105-f29b-4742-b559-54e70f4a409d service nova] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Received event network-changed-e7186e58-a62a-4993-ac19-98c145d5ef47 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:31.418093 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c96f4c33-afbf-45d1-960e-c6bb793fd8e7 req-0b417105-f29b-4742-b559-54e70f4a409d service nova] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Refreshing instance network info cache due to event network-changed-e7186e58-a62a-4993-ac19-98c145d5ef47. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:43:31.418093 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c96f4c33-afbf-45d1-960e-c6bb793fd8e7 req-0b417105-f29b-4742-b559-54e70f4a409d service nova] Acquiring lock "refresh_cache-3aa0ffed-decc-493c-8735-aba1d221571d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:31.418093 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c96f4c33-afbf-45d1-960e-c6bb793fd8e7 req-0b417105-f29b-4742-b559-54e70f4a409d service nova] Acquired lock "refresh_cache-3aa0ffed-decc-493c-8735-aba1d221571d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:31.418093 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c96f4c33-afbf-45d1-960e-c6bb793fd8e7 req-0b417105-f29b-4742-b559-54e70f4a409d service nova] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Refreshing network info cache for port e7186e58-a62a-4993-ac19-98c145d5ef47 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:43:31.429908 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-14dfe475-e65e-4bd8-ab07-cd039a831a54 req-ecefd2b6-d7b4-49be-809a-0a7438a058dc service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Received event network-vif-plugged-3ba06f13-fd8a-4116-a906-70f339d1b0ba {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:31.430202 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-14dfe475-e65e-4bd8-ab07-cd039a831a54 req-ecefd2b6-d7b4-49be-809a-0a7438a058dc service nova] Acquiring lock "e991af6e-6fc9-4286-a848-84682121bbb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:31.431075 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-14dfe475-e65e-4bd8-ab07-cd039a831a54 req-ecefd2b6-d7b4-49be-809a-0a7438a058dc service nova] Lock "e991af6e-6fc9-4286-a848-84682121bbb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:31.431264 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-14dfe475-e65e-4bd8-ab07-cd039a831a54 req-ecefd2b6-d7b4-49be-809a-0a7438a058dc service nova] Lock "e991af6e-6fc9-4286-a848-84682121bbb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:31.431424 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-14dfe475-e65e-4bd8-ab07-cd039a831a54 req-ecefd2b6-d7b4-49be-809a-0a7438a058dc service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Processing event network-vif-plugged-3ba06f13-fd8a-4116-a906-70f339d1b0ba {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:43:31.832335 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] End _get_guest_xml xml=<domain type="qemu">
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:   <uuid>035dd3e2-1951-4cb3-8cda-691019c0c9cb</uuid>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:   <name>instance-00000030</name>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <nova:name>tempest-VolumeMultiattachTests-server-1964855574</nova:name>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:43:31</nova:creationTime>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:         <nova:user uuid="93a5d16bed8c474fa58e1982fa784db9">tempest-VolumeMultiattachTests-1349332830-project-member</nova:user>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:         <nova:project uuid="7e0c7a19a41a44fba4c0fca71022a5a1">tempest-VolumeMultiattachTests-1349332830</nova:project>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:         <nova:port uuid="0e304a34-15bb-43c9-b664-3ceb8240b8ae">
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     <system>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <entry name="serial">035dd3e2-1951-4cb3-8cda-691019c0c9cb</entry>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <entry name="uuid">035dd3e2-1951-4cb3-8cda-691019c0c9cb</entry>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     </system>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:   <os>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:   </os>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:   <features>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:   </features>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:   <devices>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/035dd3e2-1951-4cb3-8cda-691019c0c9cb/disk"/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     </disk>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/035dd3e2-1951-4cb3-8cda-691019c0c9cb/disk.config"/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     </disk>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:bf:92:41"/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <target dev="tap0e304a34-15"/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     </interface>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/035dd3e2-1951-4cb3-8cda-691019c0c9cb/console.log" append="off"/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     </serial>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     <video>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     </video>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     </rng>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:   </devices>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]: </domain>
May 19 04:43:31.832335 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:43:31.832335 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Preparing to wait for external event network-vif-plugged-0e304a34-15bb-43c9-b664-3ceb8240b8ae {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:43:31.836576 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:31.836576 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:31.836576 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:31.836576 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:43:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1964855574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumemultiattachtests-server-1964855574',id=48,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjFouPpPO7vShqGexlsyxCbcJupWN8W08CArgg9PiFIml458N7wqc5CZAN0wkqP6rLcVICsrsq+oDBM6In3A2goh8llqsdZqWD/jfCCd+sViF8rwXnvN3XA3rP4jvYotw==',key_name='tempest-keypair-899081243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e0c7a19a41a44fba4c0fca71022a5a1',ramdisk_id='',reservation_id='r-boedkpxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1349332830',owner_user_name='tempest-VolumeMultiattachTests-1349332830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:43:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93a5d16bed8c474fa58e1982fa784db9',uuid=035dd3e2-1951-4cb3-8cda-691019c0c9cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e304a34-15bb-43c9-b664-3ceb8240b8ae", "address": "fa:16:3e:bf:92:41", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e304a34-15", "ovs_interfaceid": "0e304a34-15bb-43c9-b664-3ceb8240b8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:43:31.836576 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Converting VIF {"id": "0e304a34-15bb-43c9-b664-3ceb8240b8ae", "address": "fa:16:3e:bf:92:41", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e304a34-15", "ovs_interfaceid": "0e304a34-15bb-43c9-b664-3ceb8240b8ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:43:31.836576 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:92:41,bridge_name='br-int',has_traffic_filtering=True,id=0e304a34-15bb-43c9-b664-3ceb8240b8ae,network=Network(c948b992-32a1-4652-a328-d2d326ea9148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e304a34-15') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:43:31.836576 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:92:41,bridge_name='br-int',has_traffic_filtering=True,id=0e304a34-15bb-43c9-b664-3ceb8240b8ae,network=Network(c948b992-32a1-4652-a328-d2d326ea9148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e304a34-15') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:43:31.836576 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:31.836576 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:31.836576 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:43:31.837703 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:31.837899 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03949ba1-4f15-58dd-9b84-0f7f0704d55a', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:31.840695 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:31.842392 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:31.848408 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:31.848652 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e304a34-15, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:31.849102 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e304a34-15, col_values=(('qos', UUID('b5bec3b6-517c-466e-bcf9-f14a99ebf7c5')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:31.849344 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e304a34-15, col_values=(('external_ids', {'iface-id': '0e304a34-15bb-43c9-b664-3ceb8240b8ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:92:41', 'vm-uuid': '035dd3e2-1951-4cb3-8cda-691019c0c9cb'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:31.850206 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:31.852191 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:31.857650 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:31.860839 np0000001025 nova-compute[97981]: INFO os_vif [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:92:41,bridge_name='br-int',has_traffic_filtering=True,id=0e304a34-15bb-43c9-b664-3ceb8240b8ae,network=Network(c948b992-32a1-4652-a328-d2d326ea9148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e304a34-15')
May 19 04:43:31.863426 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "refresh_cache-3aa0ffed-decc-493c-8735-aba1d221571d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:31.921296 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-c96f4c33-afbf-45d1-960e-c6bb793fd8e7 req-0b417105-f29b-4742-b559-54e70f4a409d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:31.950304 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:43:31.952361 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:43:31.952361 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Creating image(s)
May 19 04:43:31.952361 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "/opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:31.952361 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "/opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:31.953325 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "/opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:31.953808 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:31.957060 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:31.959498 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:32.069627 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c96f4c33-afbf-45d1-960e-c6bb793fd8e7 req-0b417105-f29b-4742-b559-54e70f4a409d service nova] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:43:32.074375 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:43:32.075031 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165812.0746233, e991af6e-6fc9-4286-a848-84682121bbb1 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:32.075202 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] VM Started (Lifecycle Event)
May 19 04:43:32.077135 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:43:32.080034 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.120s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:32.080551 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:32.081015 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Instance spawned successfully.
May 19 04:43:32.081423 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:32.081852 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:32.086299 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:32.086757 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:32.088453 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:43:32.133232 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:32.133232 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:32.210146 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.123s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:32.211979 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:32.274325 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk 1073741824" returned: 0 in 0.062s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:32.276139 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:32.276379 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:32.335149 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c96f4c33-afbf-45d1-960e-c6bb793fd8e7 req-0b417105-f29b-4742-b559-54e70f4a409d service nova] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:32.378458 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.102s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:32.379994 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:43:32.380278 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:32.440648 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Starting finish_migration {{(pid=97981) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 19 04:43:32.443582 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Instance directory exists: not creating {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 19 04:43:32.443582 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Creating image(s)
May 19 04:43:32.444375 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:32.485472 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:32.486012 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Cannot resize image /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:43:32.486423 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:43:32.486565 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Ensure instance console log exists: /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:43:32.486997 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:32.487377 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:32.487589 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:32.570770 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.126s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:32.571096 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Checking if we can resize image /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:43:32.571381 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:32.592731 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:32.599181 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:43:32.615634 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:43:32.616270 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:43:32.643021 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Took 6.51 seconds to spawn the instance on the hypervisor.
May 19 04:43:32.643230 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:32.681736 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:32.682084 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Cannot resize image /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:43:32.839594 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c96f4c33-afbf-45d1-960e-c6bb793fd8e7 req-0b417105-f29b-4742-b559-54e70f4a409d service nova] Releasing lock "refresh_cache-3aa0ffed-decc-493c-8735-aba1d221571d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:32.840297 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquired lock "refresh_cache-3aa0ffed-decc-493c-8735-aba1d221571d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:32.840566 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:43:33.106169 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:43:33.106600 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165813.1062744, e991af6e-6fc9-4286-a848-84682121bbb1 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:33.106600 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] VM Paused (Lifecycle Event)
May 19 04:43:33.127508 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:33.158993 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Took 14.94 seconds to build instance.
May 19 04:43:33.184665 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:43:33.184841 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Ensure instance console log exists: /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:43:33.185160 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:33.185354 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:33.185477 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:33.187838 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Start _get_guest_xml network_info=[{"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "vif_mac": "fa:16:3e:b0:9e:6f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': 'ec2ae9aa-3973-4aa5-9f99-96fa636d740f', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '405ea65f-8d17-42c7-922a-dac27a17a488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '417861ee-dcf2-458b-8782-2ec22d2f5421', 'attached_at': '2026-05-19T04:43:31.000000', 'detached_at': '', 'volume_id': '405ea65f-8d17-42c7-922a-dac27a17a488', 'multiattach': True, 'serial': '405ea65f-8d17-42c7-922a-dac27a17a488'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:43:33.190453 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:43:33.191962 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='417861ee-dcf2-458b-8782-2ec22d2f5421'), owner=OwnerMeta(userid='aa432d60cb324c6d87818107e05e0053', username='tempest-AttachVolumeMultiAttachTest-1659172696-project-member', projectid='490151decdde445593a86a16976f6b34', projectname='tempest-AttachVolumeMultiAttachTest-1659172696'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "vif_mac": "fa:16:3e:b0:9e:6f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165813.1913834) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:43:33.193179 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:43:33.193179 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:43:33.193815 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:43:33.194289 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:43:33.194882 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:43:33.195241 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:43:33.195338 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:43:33.197800 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:43:33.197800 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:43:33.197800 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:43:33.197800 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:43:33.197800 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:43:33.197800 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:43:33.197800 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:43:33.197800 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:43:33.197800 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:43:33.212323 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk.config --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:33.299246 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:33.307249 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk.config --force-share --output=json" returned: 0 in 0.095s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:33.307694 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "/opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:33.307968 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "/opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:33.308579 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "/opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:33.308952 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:43:33.309372 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '405ea65f-8d17-42c7-922a-dac27a17a488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:43:33.309558 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:43:33.309873 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:43:33.310152 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '405ea65f-8d17-42c7-922a-dac27a17a488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:43:33.329477 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:43:33.330322 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:43:33.331082 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:43:33.331399 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:43:33.331864 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:43:33.332080 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.startup = automatic
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.scan = manual
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:43:33.353453 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:43:33.353453 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.startup = automatic
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.scan = manual
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:43:33.357650 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:43:33.357650 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:33.370624 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:33.380799 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:33.386201 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:43:33.386201 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:43:33.386201 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No VIF found with MAC fa:16:3e:bf:92:41, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:43:33.386201 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Using config drive
May 19 04:43:33.396232 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:33.396232 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:33.396232 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:33.396232 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:33.396232 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:33.396232 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:33.396232 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:33.396232 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:33.396232 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:33.396232 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:33.396232 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:43:33.397224 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:33.397224 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:33.397224 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:33.397224 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:33.397224 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:33.397224 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:33.397224 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:33.397224 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:33.397224 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:33.397224 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:33.397224 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:43:33.397638 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.067s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:43:33.397766 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:43:33.400019 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] HCTL ('19', '0', '0', 0) found on session 94 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:43:33.400229 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Scanning host 19 c: 0, t: 0, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:43:33.401688 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:33.401688 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:33.401688 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:33.401688 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:33.401688 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:33.401688 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:33.401688 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:33.401688 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:33.401688 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:33.401688 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:33.401688 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:43:33.401892 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:33.401892 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:33.401892 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:33.401892 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:33.401892 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:33.401892 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:33.401892 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:33.401892 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:33.401892 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:33.401892 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:33.401892 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:43:33.402274 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.071s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:43:33.402367 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:43:33.404621 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] HCTL ('21', '0', '0', 0) found on session 95 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:43:33.404816 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Scanning host 21 c: 0, t: 0, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:43:33.418312 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching for a device in session 94 and hctl ('19', '0', '0', 0) yield: sdp {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:43:33.418507 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '405ea65f-8d17-42c7-922a-dac27a17a488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:43:33.422156 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching for a device in session 95 and hctl ('21', '0', '0', 0) yield: sdn {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:43:33.422374 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '405ea65f-8d17-42c7-922a-dac27a17a488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:43:33.451633 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:43:33.610256 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:33.611234 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:43:33.611815 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:43:33.615159 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165813.6145935, e991af6e-6fc9-4286-a848-84682121bbb1 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:33.615379 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] VM Resumed (Lifecycle Event)
May 19 04:43:33.616908 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:43:33.616908 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:43:33.661041 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4f676975-5dfd-45ba-b8c5-ca7b89ddfe84 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "e991af6e-6fc9-4286-a848-84682121bbb1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.454s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:33.666515 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:33.729875 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5d75fa3d-40f0-4b8e-b118-020e7afb946b req-31a96be3-8a67-4a3d-94e6-b83fd29b28de service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Received event network-vif-plugged-3ba06f13-fd8a-4116-a906-70f339d1b0ba {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:33.730233 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5d75fa3d-40f0-4b8e-b118-020e7afb946b req-31a96be3-8a67-4a3d-94e6-b83fd29b28de service nova] Acquiring lock "e991af6e-6fc9-4286-a848-84682121bbb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:33.730301 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5d75fa3d-40f0-4b8e-b118-020e7afb946b req-31a96be3-8a67-4a3d-94e6-b83fd29b28de service nova] Lock "e991af6e-6fc9-4286-a848-84682121bbb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:33.730502 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5d75fa3d-40f0-4b8e-b118-020e7afb946b req-31a96be3-8a67-4a3d-94e6-b83fd29b28de service nova] Lock "e991af6e-6fc9-4286-a848-84682121bbb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:33.730502 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5d75fa3d-40f0-4b8e-b118-020e7afb946b req-31a96be3-8a67-4a3d-94e6-b83fd29b28de service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] No waiting events found dispatching network-vif-plugged-3ba06f13-fd8a-4116-a906-70f339d1b0ba {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:33.730788 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-5d75fa3d-40f0-4b8e-b118-020e7afb946b req-31a96be3-8a67-4a3d-94e6-b83fd29b28de service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Received unexpected event network-vif-plugged-3ba06f13-fd8a-4116-a906-70f339d1b0ba for instance with vm_state active and task_state None.
May 19 04:43:33.886657 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Updating instance_info_cache with network_info: [{"id": "e7186e58-a62a-4993-ac19-98c145d5ef47", "address": "fa:16:3e:ea:48:91", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7186e58-a6", "ovs_interfaceid": "e7186e58-a62a-4993-ac19-98c145d5ef47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:33.894623 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:34.118518 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Creating config drive at /opt/stack/data/nova/instances/035dd3e2-1951-4cb3-8cda-691019c0c9cb/disk.config
May 19 04:43:34.119693 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:34.121599 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:43:34.125662 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/035dd3e2-1951-4cb3-8cda-691019c0c9cb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7bz6hcsh {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:34.207773 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/035dd3e2-1951-4cb3-8cda-691019c0c9cb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7bz6hcsh" returned: 0 in 0.082s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:34.332841 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:43:34.357592 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "9563147c-542a-4b2c-8944-8961cfb68132" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:34.357767 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "9563147c-542a-4b2c-8944-8961cfb68132" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:34.388064 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Releasing lock "refresh_cache-3aa0ffed-decc-493c-8735-aba1d221571d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:34.388602 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Instance network_info: |[{"id": "e7186e58-a62a-4993-ac19-98c145d5ef47", "address": "fa:16:3e:ea:48:91", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7186e58-a6", "ovs_interfaceid": "e7186e58-a62a-4993-ac19-98c145d5ef47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:43:34.390542 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Start _get_guest_xml network_info=[{"id": "e7186e58-a62a-4993-ac19-98c145d5ef47", "address": "fa:16:3e:ea:48:91", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7186e58-a6", "ovs_interfaceid": "e7186e58-a62a-4993-ac19-98c145d5ef47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:43:34.394014 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:43:34.395330 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1624420279', uuid='3aa0ffed-decc-493c-8735-aba1d221571d'), owner=OwnerMeta(userid='5885f1561f394d46bd4c1b48e7323c1e', username='tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member', projectid='f7465b5668be4eb9b75c1ddc876e7eac', projectname='tempest-ServerBootFromVolumeStableRescueTest-96916496'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e7186e58-a62a-4993-ac19-98c145d5ef47", "address": "fa:16:3e:ea:48:91", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7186e58-a6", "ovs_interfaceid": "e7186e58-a62a-4993-ac19-98c145d5ef47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165814.3949015) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:43:34.396644 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:43:34.397044 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:43:34.398709 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:43:34.398886 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:43:34.399918 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:43:34.400217 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:43:34.400360 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:43:34.400445 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:43:34.400557 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:43:34.400625 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:43:34.400710 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:43:34.400858 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:43:34.400968 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:43:34.401068 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:43:34.401185 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:43:34.401318 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:43:34.412192 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1624420279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverbootfromvolumestablerescuetest-server-1624420279',id=49,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7465b5668be4eb9b75c1ddc876e7eac',ramdisk_id='',reservation_id='r-79g9f53r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-96916496',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:43:31Z,user_data=None,user_id='5885f1561f394d46bd4c1b48e7323c1e',uuid=3aa0ffed-decc-493c-8735-aba1d221571d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7186e58-a62a-4993-ac19-98c145d5ef47", "address": "fa:16:3e:ea:48:91", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7186e58-a6", "ovs_interfaceid": "e7186e58-a62a-4993-ac19-98c145d5ef47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:43:34.412440 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converting VIF {"id": "e7186e58-a62a-4993-ac19-98c145d5ef47", "address": "fa:16:3e:ea:48:91", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7186e58-a6", "ovs_interfaceid": "e7186e58-a62a-4993-ac19-98c145d5ef47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:43:34.413011 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:48:91,bridge_name='br-int',has_traffic_filtering=True,id=e7186e58-a62a-4993-ac19-98c145d5ef47,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7186e58-a6') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:43:34.413639 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'pci_devices' on Instance uuid 3aa0ffed-decc-493c-8735-aba1d221571d {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:34.617518 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:43:34.618231 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:43:34.678728 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:34.706279 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:34.709763 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:34.812760 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:34.863875 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:43:34.917806 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] End _get_guest_xml xml=<domain type="qemu">
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:   <uuid>3aa0ffed-decc-493c-8735-aba1d221571d</uuid>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:   <name>instance-00000031</name>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1624420279</nova:name>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:43:34</nova:creationTime>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:         <nova:user uuid="5885f1561f394d46bd4c1b48e7323c1e">tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member</nova:user>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:         <nova:project uuid="f7465b5668be4eb9b75c1ddc876e7eac">tempest-ServerBootFromVolumeStableRescueTest-96916496</nova:project>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:         <nova:port uuid="e7186e58-a62a-4993-ac19-98c145d5ef47">
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     <system>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <entry name="serial">3aa0ffed-decc-493c-8735-aba1d221571d</entry>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <entry name="uuid">3aa0ffed-decc-493c-8735-aba1d221571d</entry>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     </system>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:   <os>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:   </os>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:   <features>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:   </features>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:   <devices>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk"/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     </disk>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk.config"/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     </disk>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:ea:48:91"/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <target dev="tape7186e58-a6"/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     </interface>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/console.log" append="off"/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     </serial>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     <video>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     </video>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     </rng>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:   </devices>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]: </domain>
May 19 04:43:34.917806 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:43:34.919722 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Preparing to wait for external event network-vif-plugged-e7186e58-a62a-4993-ac19-98c145d5ef47 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:43:34.919828 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "3aa0ffed-decc-493c-8735-aba1d221571d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:34.920082 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "3aa0ffed-decc-493c-8735-aba1d221571d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:34.921028 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "3aa0ffed-decc-493c-8735-aba1d221571d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:34.922086 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1624420279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverbootfromvolumestablerescuetest-server-1624420279',id=49,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7465b5668be4eb9b75c1ddc876e7eac',ramdisk_id='',reservation_id='r-79g9f53r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-96916496',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:43:31Z,user_data=None,user_id='5885f1561f394d46bd4c1b48e7323c1e',uuid=3aa0ffed-decc-493c-8735-aba1d221571d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7186e58-a62a-4993-ac19-98c145d5ef47", "address": "fa:16:3e:ea:48:91", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7186e58-a6", "ovs_interfaceid": "e7186e58-a62a-4993-ac19-98c145d5ef47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:43:34.922772 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converting VIF {"id": "e7186e58-a62a-4993-ac19-98c145d5ef47", "address": "fa:16:3e:ea:48:91", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7186e58-a6", "ovs_interfaceid": "e7186e58-a62a-4993-ac19-98c145d5ef47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:43:34.923765 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:48:91,bridge_name='br-int',has_traffic_filtering=True,id=e7186e58-a62a-4993-ac19-98c145d5ef47,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7186e58-a6') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:43:34.924149 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:48:91,bridge_name='br-int',has_traffic_filtering=True,id=e7186e58-a62a-4993-ac19-98c145d5ef47,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7186e58-a6') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:43:34.924469 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:34.924724 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:34.925016 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:43:34.927459 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:34.927712 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf0ea308-5464-5775-8886-c2bcf00fd3e0', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:34.929622 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:34.930922 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:34.934741 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:34.937740 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:34.937961 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7186e58-a6, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:34.938403 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7186e58-a6, col_values=(('qos', UUID('85ccb54b-5980-48db-816c-668a1e3095ba')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:34.938610 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7186e58-a6, col_values=(('external_ids', {'iface-id': 'e7186e58-a62a-4993-ac19-98c145d5ef47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:48:91', 'vm-uuid': '3aa0ffed-decc-493c-8735-aba1d221571d'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:34.939658 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:34.941656 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:34.947186 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:34.947686 np0000001025 nova-compute[97981]: INFO os_vif [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:48:91,bridge_name='br-int',has_traffic_filtering=True,id=e7186e58-a62a-4993-ac19-98c145d5ef47,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7186e58-a6')
May 19 04:43:35.089219 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:35.103013 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:35.103013 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:35.133934 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:35.437485 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:35.437485 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:35.442668 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:43:35.442843 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Claim successful on node np0000001025
May 19 04:43:35.576923 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165815.5765731, 035dd3e2-1951-4cb3-8cda-691019c0c9cb => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:35.577159 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] VM Started (Lifecycle Event)
May 19 04:43:35.815002 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a0147ecd-43d6-4470-b1ea-7fa84b1af9a0 req-420989fb-d319-4ce5-9356-0dbd77d5df88 service nova] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Received event network-vif-plugged-0e304a34-15bb-43c9-b664-3ceb8240b8ae {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:35.815359 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a0147ecd-43d6-4470-b1ea-7fa84b1af9a0 req-420989fb-d319-4ce5-9356-0dbd77d5df88 service nova] Acquiring lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:35.815498 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a0147ecd-43d6-4470-b1ea-7fa84b1af9a0 req-420989fb-d319-4ce5-9356-0dbd77d5df88 service nova] Lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:35.815619 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a0147ecd-43d6-4470-b1ea-7fa84b1af9a0 req-420989fb-d319-4ce5-9356-0dbd77d5df88 service nova] Lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:35.815737 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a0147ecd-43d6-4470-b1ea-7fa84b1af9a0 req-420989fb-d319-4ce5-9356-0dbd77d5df88 service nova] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Processing event network-vif-plugged-0e304a34-15bb-43c9-b664-3ceb8240b8ae {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:43:35.815857 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a0147ecd-43d6-4470-b1ea-7fa84b1af9a0 req-420989fb-d319-4ce5-9356-0dbd77d5df88 service nova] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Received event network-vif-plugged-0e304a34-15bb-43c9-b664-3ceb8240b8ae {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:35.816070 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a0147ecd-43d6-4470-b1ea-7fa84b1af9a0 req-420989fb-d319-4ce5-9356-0dbd77d5df88 service nova] Acquiring lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:35.816193 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a0147ecd-43d6-4470-b1ea-7fa84b1af9a0 req-420989fb-d319-4ce5-9356-0dbd77d5df88 service nova] Lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:35.816312 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a0147ecd-43d6-4470-b1ea-7fa84b1af9a0 req-420989fb-d319-4ce5-9356-0dbd77d5df88 service nova] Lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:35.816460 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a0147ecd-43d6-4470-b1ea-7fa84b1af9a0 req-420989fb-d319-4ce5-9356-0dbd77d5df88 service nova] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] No waiting events found dispatching network-vif-plugged-0e304a34-15bb-43c9-b664-3ceb8240b8ae {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:35.816545 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-a0147ecd-43d6-4470-b1ea-7fa84b1af9a0 req-420989fb-d319-4ce5-9356-0dbd77d5df88 service nova] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Received unexpected event network-vif-plugged-0e304a34-15bb-43c9-b664-3ceb8240b8ae for instance with vm_state building and task_state spawning.
May 19 04:43:35.816592 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a0147ecd-43d6-4470-b1ea-7fa84b1af9a0 req-420989fb-d319-4ce5-9356-0dbd77d5df88 service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Received event network-changed-3ba06f13-fd8a-4116-a906-70f339d1b0ba {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:35.816691 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a0147ecd-43d6-4470-b1ea-7fa84b1af9a0 req-420989fb-d319-4ce5-9356-0dbd77d5df88 service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Refreshing instance network info cache due to event network-changed-3ba06f13-fd8a-4116-a906-70f339d1b0ba. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:43:35.816804 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a0147ecd-43d6-4470-b1ea-7fa84b1af9a0 req-420989fb-d319-4ce5-9356-0dbd77d5df88 service nova] Acquiring lock "refresh_cache-e991af6e-6fc9-4286-a848-84682121bbb1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:35.816883 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a0147ecd-43d6-4470-b1ea-7fa84b1af9a0 req-420989fb-d319-4ce5-9356-0dbd77d5df88 service nova] Acquired lock "refresh_cache-e991af6e-6fc9-4286-a848-84682121bbb1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:35.817011 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a0147ecd-43d6-4470-b1ea-7fa84b1af9a0 req-420989fb-d319-4ce5-9356-0dbd77d5df88 service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Refreshing network info cache for port 3ba06f13-fd8a-4116-a906-70f339d1b0ba {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:43:35.818496 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:43:35.824159 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:43:35.827970 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Instance spawned successfully.
May 19 04:43:35.828460 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:43:36.079257 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:36.083830 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:43:36.319441 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-a0147ecd-43d6-4470-b1ea-7fa84b1af9a0 req-420989fb-d319-4ce5-9356-0dbd77d5df88 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:36.338468 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:36.338638 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:36.338958 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:36.339291 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:36.339606 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:36.339928 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:36.474853 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:43:36.475064 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:43:36.475258 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] No VIF found with MAC fa:16:3e:ea:48:91, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:43:36.475834 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Using config drive
May 19 04:43:36.586001 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:43:36.586337 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165816.5860722, 035dd3e2-1951-4cb3-8cda-691019c0c9cb => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:36.586449 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] VM Paused (Lifecycle Event)
May 19 04:43:36.611490 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:43:36.612259 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:43:36.615562 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:43:36.616162 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:43:36.618037 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:43:36.714604 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-a0147ecd-43d6-4470-b1ea-7fa84b1af9a0 req-420989fb-d319-4ce5-9356-0dbd77d5df88 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:36.739082 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:36.846814 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Took 7.84 seconds to spawn the instance on the hypervisor.
May 19 04:43:36.847006 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:36.935129 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a0147ecd-43d6-4470-b1ea-7fa84b1af9a0 req-420989fb-d319-4ce5-9356-0dbd77d5df88 service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Updated VIF entry in instance network info cache for port 3ba06f13-fd8a-4116-a906-70f339d1b0ba. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:43:36.935570 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a0147ecd-43d6-4470-b1ea-7fa84b1af9a0 req-420989fb-d319-4ce5-9356-0dbd77d5df88 service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Updating instance_info_cache with network_info: [{"id": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "address": "fa:16:3e:1f:14:50", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba06f13-fd", "ovs_interfaceid": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:36.986606 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:37.089573 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:37.092630 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165817.0923815, 035dd3e2-1951-4cb3-8cda-691019c0c9cb => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:37.092928 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] VM Resumed (Lifecycle Event)
May 19 04:43:37.248537 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Creating config drive at /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk.config
May 19 04:43:37.257469 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7_mx7lsi {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:37.322673 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7_mx7lsi" returned: 0 in 0.065s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:37.363549 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Took 15.52 seconds to build instance.
May 19 04:43:37.438335 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a0147ecd-43d6-4470-b1ea-7fa84b1af9a0 req-420989fb-d319-4ce5-9356-0dbd77d5df88 service nova] Releasing lock "refresh_cache-e991af6e-6fc9-4286-a848-84682121bbb1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:37.500397 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:43:37.500654 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:43:37.595803 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:37.604843 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:43:37.827502 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:37.855944 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:37.858813 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:37.865424 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d7c651e-3800-4d08-8a91-c6d5018c30d4 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.035s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:37.970193 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:37.988798 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:37.989888 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:38.007344 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:43:38.300481 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:38.515817 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.079s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:38.516434 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:43:38.576706 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-032607ff-aa86-40f1-b013-02c5eae01d99 req-b477815c-0034-4af6-9627-8fc073e7cfa1 service nova] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Received event network-changed-0e304a34-15bb-43c9-b664-3ceb8240b8ae {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:38.576946 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-032607ff-aa86-40f1-b013-02c5eae01d99 req-b477815c-0034-4af6-9627-8fc073e7cfa1 service nova] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Refreshing instance network info cache due to event network-changed-0e304a34-15bb-43c9-b664-3ceb8240b8ae. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:43:38.577178 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-032607ff-aa86-40f1-b013-02c5eae01d99 req-b477815c-0034-4af6-9627-8fc073e7cfa1 service nova] Acquiring lock "refresh_cache-035dd3e2-1951-4cb3-8cda-691019c0c9cb" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:38.577320 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-032607ff-aa86-40f1-b013-02c5eae01d99 req-b477815c-0034-4af6-9627-8fc073e7cfa1 service nova] Acquired lock "refresh_cache-035dd3e2-1951-4cb3-8cda-691019c0c9cb" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:38.577490 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-032607ff-aa86-40f1-b013-02c5eae01d99 req-b477815c-0034-4af6-9627-8fc073e7cfa1 service nova] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Refreshing network info cache for port 0e304a34-15bb-43c9-b664-3ceb8240b8ae {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:43:38.600919 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:38.706516 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165818.7062104, 3aa0ffed-decc-493c-8735-aba1d221571d => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:38.706642 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] VM Started (Lifecycle Event)
May 19 04:43:39.021841 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:43:39.025531 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:43:39.025845 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:43:39.026268 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:39.026916 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:39.081365 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-032607ff-aa86-40f1-b013-02c5eae01d99 req-b477815c-0034-4af6-9627-8fc073e7cfa1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:39.135276 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c46088fb3e74b819bb456461716a801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b3c0fa8f894ed2a7c3bcfac99ce74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:43:39.211748 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:39.214033 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165819.2138317, 3aa0ffed-decc-493c-8735-aba1d221571d => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:39.215128 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] VM Paused (Lifecycle Event)
May 19 04:43:39.441236 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-032607ff-aa86-40f1-b013-02c5eae01d99 req-b477815c-0034-4af6-9627-8fc073e7cfa1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:39.527068 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:43:39.584316 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-032607ff-aa86-40f1-b013-02c5eae01d99 req-b477815c-0034-4af6-9627-8fc073e7cfa1 service nova] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Updated VIF entry in instance network info cache for port 0e304a34-15bb-43c9-b664-3ceb8240b8ae. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:43:39.584690 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-032607ff-aa86-40f1-b013-02c5eae01d99 req-b477815c-0034-4af6-9627-8fc073e7cfa1 service nova] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Updating instance_info_cache with network_info: [{"id": "0e304a34-15bb-43c9-b664-3ceb8240b8ae", "address": "fa:16:3e:bf:92:41", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e304a34-15", "ovs_interfaceid": "0e304a34-15bb-43c9-b664-3ceb8240b8ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:39.616359 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:43:39.616528 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:43:39.616720 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:43:39.720342 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:39.725299 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:43:39.729802 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0004371029999674647 future=<Future at 0x7218501a7d10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:39.732158 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Emitting event <LifecycleEvent: 1779165804.729269, 417861ee-dcf2-458b-8782-2ec22d2f5421 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:39.732158 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:39.732540 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] VM Stopped (Lifecycle Event)
May 19 04:43:39.872246 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Successfully created port: 0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:43:39.942215 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:39.992336 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1d9a7746-5013-4dfa-8cfa-bd72371ac699 req-866d2ffe-3075-4aef-a05f-ed18498751a3 service nova] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Received event network-vif-plugged-e7186e58-a62a-4993-ac19-98c145d5ef47 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:39.992737 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1d9a7746-5013-4dfa-8cfa-bd72371ac699 req-866d2ffe-3075-4aef-a05f-ed18498751a3 service nova] Acquiring lock "3aa0ffed-decc-493c-8735-aba1d221571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:39.993227 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1d9a7746-5013-4dfa-8cfa-bd72371ac699 req-866d2ffe-3075-4aef-a05f-ed18498751a3 service nova] Lock "3aa0ffed-decc-493c-8735-aba1d221571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:39.993458 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1d9a7746-5013-4dfa-8cfa-bd72371ac699 req-866d2ffe-3075-4aef-a05f-ed18498751a3 service nova] Lock "3aa0ffed-decc-493c-8735-aba1d221571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:39.993684 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1d9a7746-5013-4dfa-8cfa-bd72371ac699 req-866d2ffe-3075-4aef-a05f-ed18498751a3 service nova] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Processing event network-vif-plugged-e7186e58-a62a-4993-ac19-98c145d5ef47 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:43:39.994498 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:43:39.999256 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:43:40.002095 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Instance spawned successfully.
May 19 04:43:40.003374 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:43:40.032780 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Booting with volume snapshot 11f363f4-80e2-4536-b509-7bda3884e03f at /dev/vda
May 19 04:43:40.089860 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-032607ff-aa86-40f1-b013-02c5eae01d99 req-b477815c-0034-4af6-9627-8fc073e7cfa1 service nova] Releasing lock "refresh_cache-035dd3e2-1951-4cb3-8cda-691019c0c9cb" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:40.121284 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:40.121514 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:40.121595 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:40.121734 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:43:40.232608 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:43:40.232608 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165820.2322054, 3aa0ffed-decc-493c-8735-aba1d221571d => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:40.232608 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] VM Resumed (Lifecycle Event)
May 19 04:43:40.235703 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:40.239842 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:43:40.423922 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Successfully updated port: 0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:43:40.508487 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:40.508607 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:40.508898 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:40.509120 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:40.509371 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:40.509599 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:40.645627 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-27fbf276-cc97-4550-a672-e98eabe1889c req-24cf6783-ded1-4343-ab63-121c7422c6db service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Received event network-changed-0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:40.645627 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-27fbf276-cc97-4550-a672-e98eabe1889c req-24cf6783-ded1-4343-ab63-121c7422c6db service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Refreshing instance network info cache due to event network-changed-0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:43:40.645627 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-27fbf276-cc97-4550-a672-e98eabe1889c req-24cf6783-ded1-4343-ab63-121c7422c6db service nova] Acquiring lock "refresh_cache-9563147c-542a-4b2c-8944-8961cfb68132" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:40.645627 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-27fbf276-cc97-4550-a672-e98eabe1889c req-24cf6783-ded1-4343-ab63-121c7422c6db service nova] Acquired lock "refresh_cache-9563147c-542a-4b2c-8944-8961cfb68132" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:40.645627 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-27fbf276-cc97-4550-a672-e98eabe1889c req-24cf6783-ded1-4343-ab63-121c7422c6db service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Refreshing network info cache for port 0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:43:40.737199 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:40.739036 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:43:40.744435 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 19 04:43:40.925793 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "refresh_cache-9563147c-542a-4b2c-8944-8961cfb68132" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:41.014830 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Took 9.06 seconds to spawn the instance on the hypervisor.
May 19 04:43:41.015404 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:41.148987 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-27fbf276-cc97-4550-a672-e98eabe1889c req-24cf6783-ded1-4343-ab63-121c7422c6db service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:41.175888 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:41.243356 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:43:41.252638 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-27fbf276-cc97-4550-a672-e98eabe1889c req-24cf6783-ded1-4343-ab63-121c7422c6db service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:43:41.271675 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:41.272123 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:41.374238 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Found WWN 3300000009f63224e for multipath device dm-11 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:43:41.374845 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 8.065s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:43:41.375121 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] <== connect_volume: return (8065ms) {'type': 'block', 'scsi_wwn': '3300000009f63224e', 'path': '/dev/dm-11', 'multipath_id': '3300000009f63224e'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:43:41.375373 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009f63224e', 'path': '/dev/dm-11', 'multipath_id': '3300000009f63224e'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:43:41.377253 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:41.377619 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:43:41.381504 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e991af6e-6fc9-4286-a848-84682121bbb1/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:41.439565 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-27fbf276-cc97-4550-a672-e98eabe1889c req-24cf6783-ded1-4343-ab63-121c7422c6db service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:41.482636 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e991af6e-6fc9-4286-a848-84682121bbb1/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:41.483093 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e991af6e-6fc9-4286-a848-84682121bbb1/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:41.538144 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Took 17.40 seconds to build instance.
May 19 04:43:41.585526 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e991af6e-6fc9-4286-a848-84682121bbb1/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:41.590390 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:41.633866 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:41.634220 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:41.694477 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:41.695008 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:41.807040 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:41.814135 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:41.885963 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001025',hostname='multiattach-server-1',id=38,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9kq9UfoFPrqlSUYASLa2M8/KXwpiWIksTRz6r+vXFFf5G7djO79flSW+4jvUEBmYvioxzxvTch1hKVIwlMIaMSuT3AyUPlX/5ZPn59wF6pdcyyqAHuNzAVPjAjiGd+6A==',key_name='tempest-keypair-818275091',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:41:08Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001025',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-56qgb0gs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:43:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa432d60cb324c6d87818107e05e0053',uuid=417861ee-dcf2-458b-8782-2ec22d2f5421,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "vif_mac": "fa:16:3e:b0:9e:6f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:43:41.886356 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "vif_mac": "fa:16:3e:b0:9e:6f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:43:41.887149 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:9e:6f,bridge_name='br-int',has_traffic_filtering=True,id=d51c757a-3333-4e40-8d5f-3c2d35a128b2,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51c757a-33') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:43:41.889038 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] End _get_guest_xml xml=<domain type="qemu">
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:   <uuid>417861ee-dcf2-458b-8782-2ec22d2f5421</uuid>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:   <name>instance-00000026</name>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:   <memory>262144</memory>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <nova:name>multiattach-server-1</nova:name>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:43:33</nova:creationTime>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.micro" id="84">
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:         <nova:memory>256</nova:memory>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:           <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:           <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:         <nova:user uuid="aa432d60cb324c6d87818107e05e0053">tempest-AttachVolumeMultiAttachTest-1659172696-project-member</nova:user>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:         <nova:project uuid="490151decdde445593a86a16976f6b34">tempest-AttachVolumeMultiAttachTest-1659172696</nova:project>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:         <nova:port uuid="d51c757a-3333-4e40-8d5f-3c2d35a128b2">
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     <system>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <entry name="serial">417861ee-dcf2-458b-8782-2ec22d2f5421</entry>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <entry name="uuid">417861ee-dcf2-458b-8782-2ec22d2f5421</entry>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     </system>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:   <os>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:   </os>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:   <features>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:   </features>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:   <devices>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     </disk>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk.config"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     </disk>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <alias name="ua-405ea65f-8d17-42c7-922a-dac27a17a488"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-11"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <target dev="vdb" bus="virtio"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <serial>405ea65f-8d17-42c7-922a-dac27a17a488</serial>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <shareable/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     </disk>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:b0:9e:6f"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <target dev="tapd51c757a-33"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     </interface>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/console.log" append="off"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     </serial>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     <video>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     </video>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     </rng>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:   </devices>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]: </domain>
May 19 04:43:41.889038 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:43:41.894239 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001025',hostname='multiattach-server-1',id=38,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9kq9UfoFPrqlSUYASLa2M8/KXwpiWIksTRz6r+vXFFf5G7djO79flSW+4jvUEBmYvioxzxvTch1hKVIwlMIaMSuT3AyUPlX/5ZPn59wF6pdcyyqAHuNzAVPjAjiGd+6A==',key_name='tempest-keypair-818275091',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:41:08Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001025',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-56qgb0gs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:43:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa432d60cb324c6d87818107e05e0053',uuid=417861ee-dcf2-458b-8782-2ec22d2f5421,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "vif_mac": "fa:16:3e:b0:9e:6f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:43:41.894239 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "vif_mac": "fa:16:3e:b0:9e:6f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:43:41.894239 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:9e:6f,bridge_name='br-int',has_traffic_filtering=True,id=d51c757a-3333-4e40-8d5f-3c2d35a128b2,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51c757a-33') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:43:41.894239 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:9e:6f,bridge_name='br-int',has_traffic_filtering=True,id=d51c757a-3333-4e40-8d5f-3c2d35a128b2,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51c757a-33') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:43:41.894459 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:41.894881 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:41.895331 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:43:41.896578 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:41.896773 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d380807-505f-5f42-895e-d45e443fa6f8', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:41.897742 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:41.898732 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:41.898828 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:41.900988 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:41.901204 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd51c757a-33, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:41.901672 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd51c757a-33, col_values=(('qos', UUID('226f16ce-1add-490c-8309-45a363891445')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:41.901900 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd51c757a-33, col_values=(('external_ids', {'iface-id': 'd51c757a-3333-4e40-8d5f-3c2d35a128b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:9e:6f', 'vm-uuid': '417861ee-dcf2-458b-8782-2ec22d2f5421'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:41.902855 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:41.905471 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:41.906830 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:41.907330 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:41.922867 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:41.927295 np0000001025 nova-compute[97981]: INFO os_vif [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:9e:6f,bridge_name='br-int',has_traffic_filtering=True,id=d51c757a-3333-4e40-8d5f-3c2d35a128b2,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51c757a-33')
May 19 04:43:41.942881 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-27fbf276-cc97-4550-a672-e98eabe1889c req-24cf6783-ded1-4343-ab63-121c7422c6db service nova] Releasing lock "refresh_cache-9563147c-542a-4b2c-8944-8961cfb68132" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:41.944762 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquired lock "refresh_cache-9563147c-542a-4b2c-8944-8961cfb68132" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:41.944762 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:43:42.003671 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:42.004127 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:43:42.006834 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:43:42.008733 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035dd3e2-1951-4cb3-8cda-691019c0c9cb/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:42.042395 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "3aa0ffed-decc-493c-8735-aba1d221571d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.921s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:42.051610 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-60031dc1-ef13-4f46-8368-b4b160a8c42b req-a8ef1851-1a58-4dfc-8388-76957a897461 service nova] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Received event network-vif-plugged-e7186e58-a62a-4993-ac19-98c145d5ef47 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:42.051902 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-60031dc1-ef13-4f46-8368-b4b160a8c42b req-a8ef1851-1a58-4dfc-8388-76957a897461 service nova] Acquiring lock "3aa0ffed-decc-493c-8735-aba1d221571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:42.052162 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-60031dc1-ef13-4f46-8368-b4b160a8c42b req-a8ef1851-1a58-4dfc-8388-76957a897461 service nova] Lock "3aa0ffed-decc-493c-8735-aba1d221571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:42.052668 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-60031dc1-ef13-4f46-8368-b4b160a8c42b req-a8ef1851-1a58-4dfc-8388-76957a897461 service nova] Lock "3aa0ffed-decc-493c-8735-aba1d221571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:42.052802 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-60031dc1-ef13-4f46-8368-b4b160a8c42b req-a8ef1851-1a58-4dfc-8388-76957a897461 service nova] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] No waiting events found dispatching network-vif-plugged-e7186e58-a62a-4993-ac19-98c145d5ef47 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:42.052918 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-60031dc1-ef13-4f46-8368-b4b160a8c42b req-a8ef1851-1a58-4dfc-8388-76957a897461 service nova] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Received unexpected event network-vif-plugged-e7186e58-a62a-4993-ac19-98c145d5ef47 for instance with vm_state active and task_state None.
May 19 04:43:42.109100 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035dd3e2-1951-4cb3-8cda-691019c0c9cb/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:42.109673 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035dd3e2-1951-4cb3-8cda-691019c0c9cb/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:42.138494 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:43:42.203806 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035dd3e2-1951-4cb3-8cda-691019c0c9cb/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:42.207504 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:43:42.208911 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:42.308686 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:42.309178 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:42.405508 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:42.411057 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:43:42.412591 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:42.504237 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:42.504709 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:42.542630 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:43:42.618074 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:42.622670 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:42.716309 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:42.720814 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:42.740854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:42.741660 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:42.752594 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:43:42.752594 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Claim successful on node np0000001025
May 19 04:43:42.808493 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:42.832717 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:42.836671 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:42.955717 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:42.958324 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:43.005212 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Updating instance_info_cache with network_info: [{"id": "0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4", "address": "fa:16:3e:c9:1d:95", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a95c435-6c", "ovs_interfaceid": "0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:43.049936 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:43.055806 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:43.151036 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:43.152028 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:43.246319 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:43.251457 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:43:43.253421 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:43:43.254839 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:43.303642 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:43.310362 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.055s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:43.310811 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=10644MB free_disk=72.84650039672852GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:43:43.311003 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:43.488490 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:43:43.489097 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:43:43.489353 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:43:43.489521 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No VIF found with MAC fa:16:3e:b0:9e:6f, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:43:43.490369 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Using config drive
May 19 04:43:43.510862 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Releasing lock "refresh_cache-9563147c-542a-4b2c-8944-8961cfb68132" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:43.511357 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Instance network_info: |[{"id": "0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4", "address": "fa:16:3e:c9:1d:95", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a95c435-6c", "ovs_interfaceid": "0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:43:43.523673 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:43:43.535961 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:43:43.557909 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:43.604402 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:43:43.604726 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:43:43.616444 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:43:43.618378 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fea1:aa43', 'fe80::fc16:3eff:fe1d:f0b2', 'fe80::4cb5:1dff:fe2d:31dc', 'fe80::fc16:3eff:fefb:c3a3', 'fe80::2c2c:57ff:feff:64a5', 'fe80::fc16:3eff:feb6:da78', 'fe80::bc20:d2ff:fef5:7278', 'fe80::fc16:3eff:fefa:d4f0', 'fe80::fc16:3eff:fe08:49d', 'fe80::bc2a:1ff:fe94:f24f', 'fe80::fc16:3eff:fe60:2e1', 'fe80::1c47:6dff:fe04:c9d9', 'fe80::fc16:3eff:fe8e:f53b', 'fe80::fc16:3eff:fe1f:1450', 'fe80::fc16:3eff:febf:9241', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:feea:4891'] 
May 19 04:43:43.618519 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:43:43.618637 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:43:43.618960 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:43:43.619333 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Updating existing volume attachment record: 87288b04-127a-40d3-92cc-2a8f9377272c {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:43:43.904626 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a197bbb6-d305-460f-a55f-f5fd20ed69ee tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:43.956575 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:43.992182 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:44.002488 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:44.078693 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:44.107176 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:44.109539 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:44.203219 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3b79fd13-7199-493b-8ad0-8d83dc379b94 req-0d5075fc-ac5c-4fee-9e7c-a7642460e16b service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Received event network-vif-plugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:44.204713 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3b79fd13-7199-493b-8ad0-8d83dc379b94 req-0d5075fc-ac5c-4fee-9e7c-a7642460e16b service nova] Acquiring lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:44.204929 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3b79fd13-7199-493b-8ad0-8d83dc379b94 req-0d5075fc-ac5c-4fee-9e7c-a7642460e16b service nova] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:44.205080 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3b79fd13-7199-493b-8ad0-8d83dc379b94 req-0d5075fc-ac5c-4fee-9e7c-a7642460e16b service nova] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:44.205249 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3b79fd13-7199-493b-8ad0-8d83dc379b94 req-0d5075fc-ac5c-4fee-9e7c-a7642460e16b service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] No waiting events found dispatching network-vif-plugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:44.205386 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-3b79fd13-7199-493b-8ad0-8d83dc379b94 req-0d5075fc-ac5c-4fee-9e7c-a7642460e16b service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Received unexpected event network-vif-plugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 for instance with vm_state active and task_state resize_finish.
May 19 04:43:44.427575 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-a197bbb6-d305-460f-a55f-f5fd20ed69ee tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] instance snapshotting
May 19 04:43:44.541541 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a197bbb6-d305-460f-a55f-f5fd20ed69ee tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Beginning live snapshot process
May 19 04:43:44.692047 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:43:44.692306 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:43:44.861925 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165824.8614724, 417861ee-dcf2-458b-8782-2ec22d2f5421 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:44.862740 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] VM Resumed (Lifecycle Event)
May 19 04:43:44.865204 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Instance event wait completed in 0 seconds for  {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:43:44.872800 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Instance running successfully.
May 19 04:43:44.872800 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Failed to set time: agent not configured {{(pid=97981) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 19 04:43:44.872800 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-458bad04-c686-4459-a83b-78913c8d97a6 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] finish_migration finished successfully. {{(pid=97981) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 19 04:43:45.195185 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:43:45.367166 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:45.368644 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:43:45.701612 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.960s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:45.702023 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:43:45.704448 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 2.393s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:45.731841 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:43:45.733037 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:43:45.735221 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Creating image(s)
May 19 04:43:45.735221 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:43:45.735221 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Ensure instance console log exists: /opt/stack/data/nova/instances/9563147c-542a-4b2c-8944-8961cfb68132/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:43:45.735221 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:45.735221 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:45.735221 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:45.735221 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Start _get_guest_xml network_info=[{"id": "0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4", "address": "fa:16:3e:c9:1d:95", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a95c435-6c", "ovs_interfaceid": "0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-19T04:43:30Z,direct_url=<?>,disk_format='raw',id=ba03f1aa-ba87-41bd-89cc-2741970fa40a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1197980864',owner='28b3c0fa8f894ed2a7c3bcfac99ce74c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-19T04:43:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '87288b04-127a-40d3-92cc-2a8f9377272c', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9563147c-542a-4b2c-8944-8961cfb68132', 'attached_at': '', 'detached_at': '', 'volume_id': '1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', 'serial': '1ad4b0bd-ec3b-444c-8754-f26cfb2c7326'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:43:45.737629 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:43:45.739060 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-image-snapshot-server-1988812583', uuid='9563147c-542a-4b2c-8944-8961cfb68132'), owner=OwnerMeta(userid='5c46088fb3e74b819bb456461716a801', username='tempest-TestVolumeBootPattern-1071176852-project-member', projectid='28b3c0fa8f894ed2a7c3bcfac99ce74c', projectname='tempest-TestVolumeBootPattern-1071176852'), image=ImageMeta(id='ba03f1aa-ba87-41bd-89cc-2741970fa40a', name=None, container_format='bare', disk_format='raw', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_bdm_v2': True, 'img_root_device_name': '/dev/vda'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4", "address": "fa:16:3e:c9:1d:95", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a95c435-6c", "ovs_interfaceid": "0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165825.7386596) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:43:45.740811 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:43:45.741164 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:43:45.742945 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:43:45.743372 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:43:45.744331 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:43:45.745137 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-19T04:43:30Z,direct_url=<?>,disk_format='raw',id=ba03f1aa-ba87-41bd-89cc-2741970fa40a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1197980864',owner='28b3c0fa8f894ed2a7c3bcfac99ce74c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-19T04:43:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:43:45.745137 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:43:45.745268 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:43:45.747063 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:43:45.747063 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:43:45.747063 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:43:45.747063 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:43:45.747063 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:43:45.747063 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:43:45.747063 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:43:45.747063 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:43:45.757118 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:43:45.757610 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:43:45.759565 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:43:45.759565 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:43:45.759565 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:43:45.773432 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:43:45.774072 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:43:45.774743 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:43:45.775167 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:43:45.775433 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:43:45.775753 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:43:45.790395 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:43:45.790395 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:45.791003 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:43:45.791003 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:45.804523 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326] added
May 19 04:43:45.804523 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:43:45.804523 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:43:45.804523 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:43:45.804523 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:43:45.804523 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:43:45.804523 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:45.804523 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:43:45.804523 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:43:45.804523 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:43:45.806965 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326] added
May 19 04:43:45.806965 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:43:45.806965 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:43:45.806965 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:43:45.806965 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:43:45.806965 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:43:45.806965 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:45.807186 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:43:45.807298 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0319(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:43:45.807483 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:43:45.871209 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 19 04:43:45.871521 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165825.871211, 417861ee-dcf2-458b-8782-2ec22d2f5421 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:45.871723 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] VM Started (Lifecycle Event)
May 19 04:43:46.058719 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a197bbb6-d305-460f-a55f-f5fd20ed69ee tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk --force-share --output=json -f qcow2 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:46.197120 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "80436afa-9cd9-41cd-b589-629da01b6bfe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:46.197492 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:46.200233 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a197bbb6-d305-460f-a55f-f5fd20ed69ee tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk --force-share --output=json -f qcow2" returned: 0 in 0.141s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:46.201123 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a197bbb6-d305-460f-a55f-f5fd20ed69ee tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk --force-share --output=json -f qcow2 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:46.233424 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:43:46.233680 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:43:46.237694 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:46.240009 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:46.291757 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5f408586-031c-48f9-84fe-24b1afc4b5cf req-36138945-6928-4b38-ace3-20aada20787a service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Received event network-vif-plugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:46.292696 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5f408586-031c-48f9-84fe-24b1afc4b5cf req-36138945-6928-4b38-ace3-20aada20787a service nova] Acquiring lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:46.292696 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5f408586-031c-48f9-84fe-24b1afc4b5cf req-36138945-6928-4b38-ace3-20aada20787a service nova] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:46.292696 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5f408586-031c-48f9-84fe-24b1afc4b5cf req-36138945-6928-4b38-ace3-20aada20787a service nova] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:46.292696 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5f408586-031c-48f9-84fe-24b1afc4b5cf req-36138945-6928-4b38-ace3-20aada20787a service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] No waiting events found dispatching network-vif-plugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:46.292696 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-5f408586-031c-48f9-84fe-24b1afc4b5cf req-36138945-6928-4b38-ace3-20aada20787a service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Received unexpected event network-vif-plugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 for instance with vm_state resized and task_state None.
May 19 04:43:46.293830 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a197bbb6-d305-460f-a55f-f5fd20ed69ee tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk --force-share --output=json -f qcow2" returned: 0 in 0.093s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:46.294070 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-a197bbb6-d305-460f-a55f-f5fd20ed69ee tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:46.296815 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-a197bbb6-d305-460f-a55f-f5fd20ed69ee tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:46.298534 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a197bbb6-d305-460f-a55f-f5fd20ed69ee tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:46.348292 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ada528b0c5c740799599a2b163709a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041ddbe11174207bbc7363b3bf08af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:43:46.375378 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:46.379432 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:43:46.385613 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a197bbb6-d305-460f-a55f-f5fd20ed69ee tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.087s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:46.387183 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a197bbb6-d305-460f-a55f-f5fd20ed69ee tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpw255ic2e/07d3132a3f3a494cb98be4644ebb0d33.delta 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:46.445914 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a197bbb6-d305-460f-a55f-f5fd20ed69ee tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpw255ic2e/07d3132a3f3a494cb98be4644ebb0d33.delta 1073741824" returned: 0 in 0.059s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:46.446333 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a197bbb6-d305-460f-a55f-f5fd20ed69ee tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Quiescing instance not available: QEMU guest agent is not enabled.
May 19 04:43:46.703417 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'flavor' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:46.738779 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:43:46.743692 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-a197bbb6-d305-460f-a55f-f5fd20ed69ee tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=97981) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 19 04:43:46.747434 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a197bbb6-d305-460f-a55f-f5fd20ed69ee tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Skipping quiescing instance: QEMU guest agent is not enabled.
May 19 04:43:46.751334 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Applying migration context for instance 417861ee-dcf2-458b-8782-2ec22d2f5421 as it has an incoming, in-progress migration 22841eb6-38a9-46df-8c9d-aa8e46ab8cc3. Migration status is finished {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 19 04:43:46.753326 np0000001025 nova-compute[97981]: INFO nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Updating resource usage from migration 22841eb6-38a9-46df-8c9d-aa8e46ab8cc3
May 19 04:43:46.796707 np0000001025 nova-compute[97981]: DEBUG nova.privsep.utils [None req-a197bbb6-d305-460f-a55f-f5fd20ed69ee tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97981) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 19 04:43:46.796988 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a197bbb6-d305-460f-a55f-f5fd20ed69ee tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpw255ic2e/07d3132a3f3a494cb98be4644ebb0d33.delta /opt/stack/data/nova/instances/snapshots/tmpw255ic2e/07d3132a3f3a494cb98be4644ebb0d33 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:46.812500 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:43:46.816761 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:43:46.834126 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:43:46.834126 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:43:46.842658 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:43:46.842658 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:46.850973 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:46.858160 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 32cc5240-7a56-4cee-9b41-54e17386b39f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:43:46.858160 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance b32b8038-72c4-443c-aea3-07cd61ad67f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:43:46.858160 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance e644a772-cf7c-4b15-b21b-ea54e773a1f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:43:46.858160 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 6f26313e-2659-4687-84da-96cf2da9a4e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:43:46.858160 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:43:46.858160 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 0b156bbc-f85d-4739-bf88-bc609d4f8052 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:43:46.858540 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance a73d6831-b1cd-4d69-a78c-16d3ac8010c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:43:46.858540 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 92b3fb19-741d-476b-9d2f-83654a17aa0e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:43:46.858540 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 80436afa-9cd9-41cd-b589-629da01b6bfe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:43:46.858540 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 48bdc405-dd40-4f80-a701-c25ee025d9a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:43:46.858540 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Migration 22841eb6-38a9-46df-8c9d-aa8e46ab8cc3 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 19 04:43:46.858751 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 417861ee-dcf2-458b-8782-2ec22d2f5421 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:43:46.858751 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance e991af6e-6fc9-4286-a848-84682121bbb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:43:46.858832 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 035dd3e2-1951-4cb3-8cda-691019c0c9cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:43:46.858880 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 3aa0ffed-decc-493c-8735-aba1d221571d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:43:46.858932 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 9563147c-542a-4b2c-8944-8961cfb68132 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:43:46.859008 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:43:46.859453 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 17 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:43:46.859527 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=3904MB phys_disk=95GB used_disk=12GB total_vcpus=12 used_vcpus=17 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:43:43 up 34 min,  2 users,  load average: 5.78, 5.98, 3.89\n', 'num_instances': '16', 'num_vm_active': '13', 'num_task_None': '14', 'num_os_type_None': '16', 'num_proj_490151decdde445593a86a16976f6b34': '5', 'io_workload': '2', 'num_vm_resized': '1', 'num_proj_28b3c0fa8f894ed2a7c3bcfac99ce74c': '2', 'num_proj_39155484b40c4c4fb5906c33b2682b3d': '2', 'num_proj_f7465b5668be4eb9b75c1ddc876e7eac': '3', 'num_proj_662c1a9b25e44aff8242f468232af7f3': '1', 'num_proj_5c4df421703949c7814d3fa7c2637793': '1', 'num_proj_7e0c7a19a41a44fba4c0fca71022a5a1': '1', 'num_task_image_pending_upload': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_7041ddbe11174207bbc7363b3bf08af5': '1'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:43:46.864224 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:46.875046 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:46.875046 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:46.875046 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:46.875046 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:46.875046 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:46.875046 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:46.875046 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:46.875046 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:46.875046 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:46.875046 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:46.875046 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:43:46.875483 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:46.875483 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:46.875483 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:46.875483 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:46.875483 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:46.875483 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:46.875483 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:46.875483 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:46.875483 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:46.875483 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:46.875483 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:43:46.883935 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:46.883935 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:46.883935 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:46.883935 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:46.883935 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:46.883935 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:46.883935 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:46.883935 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:46.883935 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:46.883935 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:46.883935 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:43:46.888541 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:46.888541 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:46.888541 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:46.888541 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:46.888541 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:46.888541 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:46.888541 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:46.888541 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:46.888541 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:46.888541 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:46.888541 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:43:46.905072 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:46.931125 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a197bbb6-d305-460f-a55f-f5fd20ed69ee tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpw255ic2e/07d3132a3f3a494cb98be4644ebb0d33.delta /opt/stack/data/nova/instances/snapshots/tmpw255ic2e/07d3132a3f3a494cb98be4644ebb0d33" returned: 0 in 0.134s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:46.932492 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a197bbb6-d305-460f-a55f-f5fd20ed69ee tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Snapshot extracted, beginning image upload
May 19 04:43:46.944309 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326, portal: 192.168.50.100,3260]
May 19 04:43:46.944309 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326, portal: 192.168.50.100,3260] successful.
May 19 04:43:46.944309 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:46.948699 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326, portal: 192.168.40.100,3260]
May 19 04:43:46.948699 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326, portal: 192.168.40.100,3260] successful.
May 19 04:43:46.948699 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:46.959581 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:46.966425 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:46.976361 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84cab01d-24f8-4a34-a879-9994aa945817 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "417861ee-dcf2-458b-8782-2ec22d2f5421" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:46.976620 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84cab01d-24f8-4a34-a879-9994aa945817 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:46.976806 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-84cab01d-24f8-4a34-a879-9994aa945817 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Going to confirm migration 4 {{(pid=97981) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 19 04:43:46.979882 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:46.979882 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:46.979882 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:46.979882 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:46.979882 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:46.979882 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:46.979882 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:46.979882 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:46.979882 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:46.979882 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:46.979882 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:46.979882 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:46.979882 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:43:46.980274 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:46.980274 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:46.980274 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:46.980274 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:46.980274 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:46.980274 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:46.980274 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:46.980274 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:46.980274 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:46.980274 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:46.980274 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:46.980274 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:46.980274 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:43:46.980611 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:43:46.980611 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:43:46.983287 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] HCTL ('9', '-', '-', 0) found on session 107 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:43:46.983554 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:43:46.997158 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:46.997158 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:46.997158 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:46.997158 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:46.997158 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:46.997158 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:46.997158 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:46.997158 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:46.997158 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:46.997158 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:46.997158 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:46.997158 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:46.997158 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:43:46.997724 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:46.997724 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:46.997724 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:46.997724 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:46.997724 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:46.997724 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:46.997724 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:46.997724 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:46.997724 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:46.997724 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:46.997724 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:46.997724 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:46.997724 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:43:46.997724 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.223s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:43:46.997724 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:43:47.002674 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] HCTL ('12', '-', '-', 0) found on session 108 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:43:47.002674 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:43:47.009356 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching for a device in session 107 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:43:47.009911 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:43:47.022907 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching for a device in session 108 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:43:47.023057 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:43:47.041875 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Successfully created port: cae1ad91-b98a-4f8e-b208-20159307d77d {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:43:47.247429 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:43:47.484894 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-84cab01d-24f8-4a34-a879-9994aa945817 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:47.616507 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Successfully updated port: cae1ad91-b98a-4f8e-b208-20159307d77d {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:43:47.668331 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-84cab01d-24f8-4a34-a879-9994aa945817 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:47.668644 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84cab01d-24f8-4a34-a879-9994aa945817 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:47.668791 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84cab01d-24f8-4a34-a879-9994aa945817 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquired lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:47.668961 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-84cab01d-24f8-4a34-a879-9994aa945817 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:43:47.669354 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-84cab01d-24f8-4a34-a879-9994aa945817 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'info_cache' on Instance uuid 417861ee-dcf2-458b-8782-2ec22d2f5421 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:47.709126 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-621e4670-7b81-4252-a225-16c97bad7674 req-bc0440c8-8cb9-4ad0-8b59-0bb59451cbd8 service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Received event network-changed-cae1ad91-b98a-4f8e-b208-20159307d77d {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:47.709291 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-621e4670-7b81-4252-a225-16c97bad7674 req-bc0440c8-8cb9-4ad0-8b59-0bb59451cbd8 service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Refreshing instance network info cache due to event network-changed-cae1ad91-b98a-4f8e-b208-20159307d77d. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:43:47.709598 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-621e4670-7b81-4252-a225-16c97bad7674 req-bc0440c8-8cb9-4ad0-8b59-0bb59451cbd8 service nova] Acquiring lock "refresh_cache-73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:47.709663 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-621e4670-7b81-4252-a225-16c97bad7674 req-bc0440c8-8cb9-4ad0-8b59-0bb59451cbd8 service nova] Acquired lock "refresh_cache-73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:47.709809 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-621e4670-7b81-4252-a225-16c97bad7674 req-bc0440c8-8cb9-4ad0-8b59-0bb59451cbd8 service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Refreshing network info cache for port cae1ad91-b98a-4f8e-b208-20159307d77d {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:43:47.713921 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:47.776033 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:43:47.997802 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:43:47.997802 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:43:48.118055 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "refresh_cache-73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:48.214266 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-621e4670-7b81-4252-a225-16c97bad7674 req-bc0440c8-8cb9-4ad0-8b59-0bb59451cbd8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:48.256971 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:43:48.258042 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:43:48.258301 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Creating image(s)
May 19 04:43:48.258824 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "/opt/stack/data/nova/instances/73d8ac91-6ca4-4ec9-81ce-c708d25f68dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:48.259024 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "/opt/stack/data/nova/instances/73d8ac91-6ca4-4ec9-81ce-c708d25f68dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:48.261796 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "/opt/stack/data/nova/instances/73d8ac91-6ca4-4ec9-81ce-c708d25f68dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:48.262585 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:48.271482 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:48.273509 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:48.301045 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-621e4670-7b81-4252-a225-16c97bad7674 req-bc0440c8-8cb9-4ad0-8b59-0bb59451cbd8 service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:43:48.317094 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:48.400063 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.126s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:48.400525 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:48.401082 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:48.401555 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:48.405335 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:43:48.405545 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:48.505709 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:43:48.513278 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.108s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:48.513804 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/73d8ac91-6ca4-4ec9-81ce-c708d25f68dd/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:48.536127 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-621e4670-7b81-4252-a225-16c97bad7674 req-bc0440c8-8cb9-4ad0-8b59-0bb59451cbd8 service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:48.575407 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/73d8ac91-6ca4-4ec9-81ce-c708d25f68dd/disk 1073741824" returned: 0 in 0.061s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:48.576535 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:48.576535 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:48.678356 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-84cab01d-24f8-4a34-a879-9994aa945817 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:48.699474 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.121s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:48.699474 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73d8ac91-6ca4-4ec9-81ce-c708d25f68dd/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:43:48.699474 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d8ac91-6ca4-4ec9-81ce-c708d25f68dd/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:48.800130 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Found WWN 330000000303a3c3c for multipath device dm-12 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:43:48.800130 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:43:48.800130 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '330000000303a3c3c', 'path': '/dev/dm-12', 'multipath_id': '330000000303a3c3c'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:43:48.800130 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000303a3c3c', 'path': '/dev/dm-12', 'multipath_id': '330000000303a3c3c'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:43:48.818671 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d8ac91-6ca4-4ec9-81ce-c708d25f68dd/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:48.819100 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Cannot resize image /opt/stack/data/nova/instances/73d8ac91-6ca4-4ec9-81ce-c708d25f68dd/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:43:48.819483 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:43:48.819682 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Ensure instance console log exists: /opt/stack/data/nova/instances/73d8ac91-6ca4-4ec9-81ce-c708d25f68dd/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:43:48.820040 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:48.820226 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:48.820595 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:48.838195 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "80436afa-9cd9-41cd-b589-629da01b6bfe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:48.838425 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:48.839002 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Attaching volume 1f1a7080-9228-4c04-afc2-2907210007ec to /dev/vdb
May 19 04:43:48.892062 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:43:48.905158 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:43:48.929405 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:48.976138 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:43:48.976310 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:43:48.993126 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:43:48.995678 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fea1:aa43', 'fe80::fc16:3eff:fe1d:f0b2', 'fe80::4cb5:1dff:fe2d:31dc', 'fe80::fc16:3eff:fefb:c3a3', 'fe80::2c2c:57ff:feff:64a5', 'fe80::fc16:3eff:feb6:da78', 'fe80::bc20:d2ff:fef5:7278', 'fe80::fc16:3eff:fefa:d4f0', 'fe80::fc16:3eff:fe08:49d', 'fe80::bc2a:1ff:fe94:f24f', 'fe80::fc16:3eff:fe60:2e1', 'fe80::1c47:6dff:fe04:c9d9', 'fe80::fc16:3eff:fe8e:f53b', 'fe80::fc16:3eff:fe1f:1450', 'fe80::fc16:3eff:febf:9241', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:feea:4891', 'fe80::fc16:3eff:feb0:9e6f'] 
May 19 04:43:48.995888 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:43:48.996052 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:43:48.996450 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:43:48.996901 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Updating existing volume attachment record: 6a4e1471-7423-4609-b6c6-62976a0bdab6 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:43:49.014987 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:43:49.015236 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.311s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:49.015614 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 53.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:43:49.040703 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-621e4670-7b81-4252-a225-16c97bad7674 req-bc0440c8-8cb9-4ad0-8b59-0bb59451cbd8 service nova] Releasing lock "refresh_cache-73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:49.042555 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquired lock "refresh_cache-73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:49.042861 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:43:49.173000 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-84cab01d-24f8-4a34-a879-9994aa945817 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:49.313614 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:43:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1988812583',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1988812583',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-image-snapshot-server-1988812583',id=50,image_ref='ba03f1aa-ba87-41bd-89cc-2741970fa40a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgr7SMT8BWfh6MJcinCdeGmtSN+Aa8qHvBbg4DMzICQ6cJnv5e5eKj6HniXhzej9h7h7emvyEHVN1O5QnKX5QLJ4iHdjfi/hMR+C1bikTkbvRoJxzl/2ciAUKvy2QmcEA==',key_name='tempest-keypair-900032320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-gxns44g3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1071176852',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:43:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c46088fb3e74b819bb456461716a801',uuid=9563147c-542a-4b2c-8944-8961cfb68132,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4", "address": "fa:16:3e:c9:1d:95", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a95c435-6c", "ovs_interfaceid": "0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:43:49.319594 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4", "address": "fa:16:3e:c9:1d:95", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a95c435-6c", "ovs_interfaceid": "0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:43:49.320572 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:1d:95,bridge_name='br-int',has_traffic_filtering=True,id=0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a95c435-6c') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:43:49.323691 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'pci_devices' on Instance uuid 9563147c-542a-4b2c-8944-8961cfb68132 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:49.338405 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-84cab01d-24f8-4a34-a879-9994aa945817 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Updating instance_info_cache with network_info: [{"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:49.588415 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:43:49.588887 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1f1a7080-9228-4c04-afc2-2907210007ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:43:49.589095 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:43:49.589633 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:43:49.589906 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1f1a7080-9228-4c04-afc2-2907210007ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:43:49.604616 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:43:49.605472 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:43:49.605883 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:43:49.607617 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:43:49.607617 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:43:49.607617 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:43:49.622168 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:43:49.622168 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:49.640984 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:43:49.640984 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:49.647724 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:43:49.650643 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec] added
May 19 04:43:49.650643 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:43:49.650643 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:43:49.650643 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:43:49.650643 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:43:49.650643 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:43:49.650643 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:49.650948 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:43:49.651296 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0439(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:43:49.651547 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:43:49.657444 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec] added
May 19 04:43:49.657444 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:43:49.657444 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:43:49.657444 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:43:49.657444 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:43:49.657444 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:43:49.657444 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:49.657726 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:43:49.657996 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0518(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:43:49.658184 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:43:49.736421 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a197bbb6-d305-460f-a55f-f5fd20ed69ee tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Snapshot image upload complete
May 19 04:43:49.736694 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-a197bbb6-d305-460f-a55f-f5fd20ed69ee tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Took 5.30 seconds to snapshot the instance on the hypervisor.
May 19 04:43:49.829939 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] End _get_guest_xml xml=<domain type="qemu">
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:   <uuid>9563147c-542a-4b2c-8944-8961cfb68132</uuid>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:   <name>instance-00000032</name>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1988812583</nova:name>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:43:45</nova:creationTime>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:         <nova:diskFormat>raw</nova:diskFormat>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:           <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:           <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:           <nova:property name="img_bdm_v2">True</nova:property>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:           <nova:property name="img_root_device_name">/dev/vda</nova:property>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:         <nova:user uuid="5c46088fb3e74b819bb456461716a801">tempest-TestVolumeBootPattern-1071176852-project-member</nova:user>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:         <nova:project uuid="28b3c0fa8f894ed2a7c3bcfac99ce74c">tempest-TestVolumeBootPattern-1071176852</nova:project>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid=""/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:         <nova:port uuid="0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4">
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     <system>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <entry name="serial">9563147c-542a-4b2c-8944-8961cfb68132</entry>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <entry name="uuid">9563147c-542a-4b2c-8944-8961cfb68132</entry>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     </system>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:   <os>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:   </os>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:   <features>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:   </features>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:   <devices>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/9563147c-542a-4b2c-8944-8961cfb68132/disk.config"/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     </disk>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <alias name="ua-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326"/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-12"/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <serial>1ad4b0bd-ec3b-444c-8754-f26cfb2c7326</serial>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     </disk>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:c9:1d:95"/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <target dev="tap0a95c435-6c"/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     </interface>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/9563147c-542a-4b2c-8944-8961cfb68132/console.log" append="off"/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     </serial>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     <video>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     </video>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     </rng>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:   </devices>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]: </domain>
May 19 04:43:49.829939 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:43:49.833661 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Preparing to wait for external event network-vif-plugged-0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:43:49.833661 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "9563147c-542a-4b2c-8944-8961cfb68132-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:49.833661 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "9563147c-542a-4b2c-8944-8961cfb68132-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:49.833661 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "9563147c-542a-4b2c-8944-8961cfb68132-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:49.833661 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:43:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1988812583',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1988812583',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-image-snapshot-server-1988812583',id=50,image_ref='ba03f1aa-ba87-41bd-89cc-2741970fa40a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgr7SMT8BWfh6MJcinCdeGmtSN+Aa8qHvBbg4DMzICQ6cJnv5e5eKj6HniXhzej9h7h7emvyEHVN1O5QnKX5QLJ4iHdjfi/hMR+C1bikTkbvRoJxzl/2ciAUKvy2QmcEA==',key_name='tempest-keypair-900032320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-gxns44g3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1071176852',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:43:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c46088fb3e74b819bb456461716a801',uuid=9563147c-542a-4b2c-8944-8961cfb68132,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4", "address": "fa:16:3e:c9:1d:95", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a95c435-6c", "ovs_interfaceid": "0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:43:49.833661 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4", "address": "fa:16:3e:c9:1d:95", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a95c435-6c", "ovs_interfaceid": "0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:43:49.833661 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:1d:95,bridge_name='br-int',has_traffic_filtering=True,id=0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a95c435-6c') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:43:49.833661 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:1d:95,bridge_name='br-int',has_traffic_filtering=True,id=0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a95c435-6c') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:43:49.834244 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:49.835614 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:49.835614 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:43:49.836920 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:49.836920 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8846689b-2f2d-5e49-b60e-59a5a24c7731', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:49.837869 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:49.838870 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:49.840391 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84cab01d-24f8-4a34-a879-9994aa945817 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Releasing lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:49.845784 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:49.846023 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-84cab01d-24f8-4a34-a879-9994aa945817 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'migration_context' on Instance uuid 417861ee-dcf2-458b-8782-2ec22d2f5421 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:49.852594 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:49.852594 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a95c435-6c, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:49.853317 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a95c435-6c, col_values=(('qos', UUID('e29b20a3-bfbf-4968-8d30-65552791e842')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:49.853552 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a95c435-6c, col_values=(('external_ids', {'iface-id': '0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:1d:95', 'vm-uuid': '9563147c-542a-4b2c-8944-8961cfb68132'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:49.856452 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:49.857887 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:49.863651 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:49.865091 np0000001025 nova-compute[97981]: INFO os_vif [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:1d:95,bridge_name='br-int',has_traffic_filtering=True,id=0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a95c435-6c')
May 19 04:43:49.936081 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:49.948579 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9ec693cb-264f-48c5-8ef0-15700ee39238 req-1c8c9a3c-c38d-4547-b3cf-d14c60c1f94b service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Received event network-changed-0da752b6-6eef-4ad0-8bd2-315518fbea60 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:49.948725 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9ec693cb-264f-48c5-8ef0-15700ee39238 req-1c8c9a3c-c38d-4547-b3cf-d14c60c1f94b service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Refreshing instance network info cache due to event network-changed-0da752b6-6eef-4ad0-8bd2-315518fbea60. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:43:49.948869 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9ec693cb-264f-48c5-8ef0-15700ee39238 req-1c8c9a3c-c38d-4547-b3cf-d14c60c1f94b service nova] Acquiring lock "refresh_cache-48bdc405-dd40-4f80-a701-c25ee025d9a6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:49.948956 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9ec693cb-264f-48c5-8ef0-15700ee39238 req-1c8c9a3c-c38d-4547-b3cf-d14c60c1f94b service nova] Acquired lock "refresh_cache-48bdc405-dd40-4f80-a701-c25ee025d9a6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:49.949236 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-9ec693cb-264f-48c5-8ef0-15700ee39238 req-1c8c9a3c-c38d-4547-b3cf-d14c60c1f94b service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Refreshing network info cache for port 0da752b6-6eef-4ad0-8bd2-315518fbea60 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:43:50.102467 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Updating instance_info_cache with network_info: [{"id": "cae1ad91-b98a-4f8e-b208-20159307d77d", "address": "fa:16:3e:ec:99:36", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae1ad91-b9", "ovs_interfaceid": "cae1ad91-b98a-4f8e-b208-20159307d77d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:50.351135 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-84cab01d-24f8-4a34-a879-9994aa945817 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Object Instance<417861ee-dcf2-458b-8782-2ec22d2f5421> lazy-loaded attributes: info_cache,migration_context {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:43:50.357913 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84cab01d-24f8-4a34-a879-9994aa945817 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:50.358233 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84cab01d-24f8-4a34-a879-9994aa945817 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:50.451687 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-9ec693cb-264f-48c5-8ef0-15700ee39238 req-1c8c9a3c-c38d-4547-b3cf-d14c60c1f94b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:50.479264 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Acquiring lock "48bdc405-dd40-4f80-a701-c25ee025d9a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:50.479474 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lock "48bdc405-dd40-4f80-a701-c25ee025d9a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:50.479704 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Acquiring lock "48bdc405-dd40-4f80-a701-c25ee025d9a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:50.479869 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lock "48bdc405-dd40-4f80-a701-c25ee025d9a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:50.480044 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lock "48bdc405-dd40-4f80-a701-c25ee025d9a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:50.483955 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Terminating instance
May 19 04:43:50.604515 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Releasing lock "refresh_cache-73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:50.604784 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Instance network_info: |[{"id": "cae1ad91-b98a-4f8e-b208-20159307d77d", "address": "fa:16:3e:ec:99:36", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae1ad91-b9", "ovs_interfaceid": "cae1ad91-b98a-4f8e-b208-20159307d77d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:43:50.606700 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Start _get_guest_xml network_info=[{"id": "cae1ad91-b98a-4f8e-b208-20159307d77d", "address": "fa:16:3e:ec:99:36", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae1ad91-b9", "ovs_interfaceid": "cae1ad91-b98a-4f8e-b208-20159307d77d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:43:50.608983 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:43:50.612000 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-663938824', uuid='73d8ac91-6ca4-4ec9-81ce-c708d25f68dd'), owner=OwnerMeta(userid='ada528b0c5c740799599a2b163709a87', username='tempest-TestEncryptedCinderVolumes-324201327-project-member', projectid='7041ddbe11174207bbc7363b3bf08af5', projectname='tempest-TestEncryptedCinderVolumes-324201327'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cae1ad91-b98a-4f8e-b208-20159307d77d", "address": "fa:16:3e:ec:99:36", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae1ad91-b9", "ovs_interfaceid": "cae1ad91-b98a-4f8e-b208-20159307d77d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165830.6098502) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:43:50.612415 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:43:50.612753 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:43:50.613657 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:43:50.613808 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:43:50.614650 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:43:50.614924 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:43:50.615402 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:43:50.615402 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:43:50.615402 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:43:50.615513 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:43:50.615843 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:43:50.616031 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:43:50.616203 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:43:50.616437 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:43:50.616591 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:43:50.616747 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:43:50.628678 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-663938824',display_name='tempest-TestEncryptedCinderVolumes-server-663938824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testencryptedcindervolumes-server-663938824',id=51,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIavdP3Q5NRCoqt8IuXxLAxBF1OYoWySY8rtnV6JB6amawlmuOMFFOc1nfw3in4xS0pC4iLbxjjY+hfEKqCmN11FwW0eKSB4YFteLI4WTo3fS/UvEkSjjPkwrUeqktCsnA==',key_name='tempest-keypair-1613029429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7041ddbe11174207bbc7363b3bf08af5',ramdisk_id='',reservation_id='r-k71fj25u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-324201327',owner_user_name='tempest-TestEncryptedCinderVolumes-324201327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:43:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada528b0c5c740799599a2b163709a87',uuid=73d8ac91-6ca4-4ec9-81ce-c708d25f68dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cae1ad91-b98a-4f8e-b208-20159307d77d", "address": "fa:16:3e:ec:99:36", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae1ad91-b9", "ovs_interfaceid": "cae1ad91-b98a-4f8e-b208-20159307d77d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:43:50.628873 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Converting VIF {"id": "cae1ad91-b98a-4f8e-b208-20159307d77d", "address": "fa:16:3e:ec:99:36", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae1ad91-b9", "ovs_interfaceid": "cae1ad91-b98a-4f8e-b208-20159307d77d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:43:50.629405 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:99:36,bridge_name='br-int',has_traffic_filtering=True,id=cae1ad91-b98a-4f8e-b208-20159307d77d,network=Network(1eda8fb0-3870-4644-873a-b485fff9e767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcae1ad91-b9') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:43:50.629981 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lazy-loading 'pci_devices' on Instance uuid 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:50.652228 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:43:50.659596 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:43:50.671832 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:43:50.671832 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:43:50.678619 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:43:50.678619 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:50.690143 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:50.701058 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:50.719539 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:50.719539 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:50.719539 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:50.719539 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:50.719539 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:50.719539 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:50.719539 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:50.719539 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:50.719539 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:50.719539 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:50.719539 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:50.719539 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:50.719539 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:43:50.719918 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:50.719918 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:50.719918 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:50.719918 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:50.719918 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:50.719918 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:50.719918 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:50.719918 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:50.719918 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:50.719918 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:50.719918 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:50.719918 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:50.719918 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:50.726623 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:43:50.783103 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec, portal: 192.168.40.100,3260]
May 19 04:43:50.783103 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec, portal: 192.168.40.100,3260] successful.
May 19 04:43:50.783103 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:50.793015 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec, portal: 192.168.50.100,3260]
May 19 04:43:50.793015 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec, portal: 192.168.50.100,3260] successful.
May 19 04:43:50.793015 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:50.805527 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:50.806418 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:50.840524 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.233s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] HCTL ('16', '-', '-', 0) found on session 110 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:43:50.840524 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:50.846034 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:43:50.846900 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.241s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:43:50.846900 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:43:50.848093 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] HCTL ('15', '-', '-', 0) found on session 109 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:43:50.848252 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:43:50.867044 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-9ec693cb-264f-48c5-8ef0-15700ee39238 req-1c8c9a3c-c38d-4547-b3cf-d14c60c1f94b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:50.876384 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:43:50.876384 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Searching for a device in session 109 and hctl ['15', '*', '*', 0] yield: sdk {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:43:50.876384 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Searching for a device in session 110 and hctl ['16', '*', '*', 0] yield: sdj {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:43:50.876384 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1f1a7080-9228-4c04-afc2-2907210007ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:43:50.876955 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1f1a7080-9228-4c04-afc2-2907210007ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:43:50.990283 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:43:51.020012 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:51.025688 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:51.049600 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:51.062263 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:51.093625 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:51.096141 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:51.104510 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-9ec693cb-264f-48c5-8ef0-15700ee39238 req-1c8c9a3c-c38d-4547-b3cf-d14c60c1f94b service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Updated VIF entry in instance network info cache for port 0da752b6-6eef-4ad0-8bd2-315518fbea60. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:43:51.104968 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-9ec693cb-264f-48c5-8ef0-15700ee39238 req-1c8c9a3c-c38d-4547-b3cf-d14c60c1f94b service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Updating instance_info_cache with network_info: [{"id": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "address": "fa:16:3e:60:02:e1", "network": {"id": "bed9f44e-8923-437b-b7fa-e20405554b44", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1907498263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5c4df421703949c7814d3fa7c2637793", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da752b6-6e", "ovs_interfaceid": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:51.133350 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] End _get_guest_xml xml=<domain type="qemu">
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:   <uuid>73d8ac91-6ca4-4ec9-81ce-c708d25f68dd</uuid>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:   <name>instance-00000033</name>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-663938824</nova:name>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:43:50</nova:creationTime>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:         <nova:user uuid="ada528b0c5c740799599a2b163709a87">tempest-TestEncryptedCinderVolumes-324201327-project-member</nova:user>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:         <nova:project uuid="7041ddbe11174207bbc7363b3bf08af5">tempest-TestEncryptedCinderVolumes-324201327</nova:project>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:         <nova:port uuid="cae1ad91-b98a-4f8e-b208-20159307d77d">
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     <system>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <entry name="serial">73d8ac91-6ca4-4ec9-81ce-c708d25f68dd</entry>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <entry name="uuid">73d8ac91-6ca4-4ec9-81ce-c708d25f68dd</entry>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     </system>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:   <os>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:   </os>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:   <features>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:   </features>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:   <devices>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/73d8ac91-6ca4-4ec9-81ce-c708d25f68dd/disk"/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     </disk>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/73d8ac91-6ca4-4ec9-81ce-c708d25f68dd/disk.config"/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     </disk>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:ec:99:36"/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <target dev="tapcae1ad91-b9"/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     </interface>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/73d8ac91-6ca4-4ec9-81ce-c708d25f68dd/console.log" append="off"/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     </serial>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     <video>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     </video>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     </rng>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:   </devices>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]: </domain>
May 19 04:43:51.133350 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:43:51.138376 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Preparing to wait for external event network-vif-plugged-cae1ad91-b98a-4f8e-b208-20159307d77d {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:43:51.138376 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:51.138376 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:51.138376 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:51.138376 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-663938824',display_name='tempest-TestEncryptedCinderVolumes-server-663938824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testencryptedcindervolumes-server-663938824',id=51,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIavdP3Q5NRCoqt8IuXxLAxBF1OYoWySY8rtnV6JB6amawlmuOMFFOc1nfw3in4xS0pC4iLbxjjY+hfEKqCmN11FwW0eKSB4YFteLI4WTo3fS/UvEkSjjPkwrUeqktCsnA==',key_name='tempest-keypair-1613029429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7041ddbe11174207bbc7363b3bf08af5',ramdisk_id='',reservation_id='r-k71fj25u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-324201327',owner_user_name='tempest-TestEncryptedCinderVolumes-324201327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:43:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada528b0c5c740799599a2b163709a87',uuid=73d8ac91-6ca4-4ec9-81ce-c708d25f68dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cae1ad91-b98a-4f8e-b208-20159307d77d", "address": "fa:16:3e:ec:99:36", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae1ad91-b9", "ovs_interfaceid": "cae1ad91-b98a-4f8e-b208-20159307d77d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:43:51.138376 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Converting VIF {"id": "cae1ad91-b98a-4f8e-b208-20159307d77d", "address": "fa:16:3e:ec:99:36", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae1ad91-b9", "ovs_interfaceid": "cae1ad91-b98a-4f8e-b208-20159307d77d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:43:51.138376 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:99:36,bridge_name='br-int',has_traffic_filtering=True,id=cae1ad91-b98a-4f8e-b208-20159307d77d,network=Network(1eda8fb0-3870-4644-873a-b485fff9e767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcae1ad91-b9') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:43:51.138376 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:99:36,bridge_name='br-int',has_traffic_filtering=True,id=cae1ad91-b98a-4f8e-b208-20159307d77d,network=Network(1eda8fb0-3870-4644-873a-b485fff9e767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcae1ad91-b9') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:43:51.141240 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:51.142044 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:51.142044 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:43:51.144126 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:51.144126 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bea0084e-ca2a-57a1-aebe-f33637fadf98', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:51.145395 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:51.145395 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:51.158772 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:51.161589 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:51.161589 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcae1ad91-b9, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:51.161589 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcae1ad91-b9, col_values=(('qos', UUID('693f9be3-5c5d-480a-9b66-b5769b918590')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:51.161589 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcae1ad91-b9, col_values=(('external_ids', {'iface-id': 'cae1ad91-b98a-4f8e-b208-20159307d77d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:99:36', 'vm-uuid': '73d8ac91-6ca4-4ec9-81ce-c708d25f68dd'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:51.161935 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:51.162999 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:51.182475 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:51.183865 np0000001025 nova-compute[97981]: INFO os_vif [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:99:36,bridge_name='br-int',has_traffic_filtering=True,id=cae1ad91-b98a-4f8e-b208-20159307d77d,network=Network(1eda8fb0-3870-4644-873a-b485fff9e767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcae1ad91-b9')
May 19 04:43:51.326836 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999388629999885 future=<Future at 0x7218505c4ad0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:51.328316 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.99780407299977 future=<Future at 0x7218505c4ad0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:51.328859 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.997340963999704 future=<Future at 0x7218505c4ad0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:51.332820 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Instance destroyed successfully.
May 19 04:43:51.334947 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lazy-loading 'resources' on Instance uuid 48bdc405-dd40-4f80-a701-c25ee025d9a6 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:51.392840 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:43:51.393164 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:43:51.393238 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No VIF found with MAC fa:16:3e:c9:1d:95, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:43:51.394446 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Using config drive
May 19 04:43:51.608054 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9ec693cb-264f-48c5-8ef0-15700ee39238 req-1c8c9a3c-c38d-4547-b3cf-d14c60c1f94b service nova] Releasing lock "refresh_cache-48bdc405-dd40-4f80-a701-c25ee025d9a6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:51.609017 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:43:51.841885 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:42:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1505589867',display_name='tempest-TestVolumeBackupRestore-server-1505589867',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebackuprestore-server-1505589867',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxG5N7PxOI+26lVI/+FDfmbLyEkEAn1kwR6Kcyo1qaMxyuvH7CEFb0/SOO2N89mtQq1FqwqcY6S5CXppgPZTENFgrlilNhwcHIBzV5yvshsLmoAfOoNYR0QxlUHa90djA==',key_name='tempest-TestVolumeBackupRestore-2103061142',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:43:19Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c4df421703949c7814d3fa7c2637793',ramdisk_id='',reservation_id='r-oq3f1736',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBackupRestore-89711280',owner_user_name='tempest-TestVolumeBackupRestore-89711280-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:43:20Z,user_data=None,user_id='6d57d5c7c834497abcbd5aa7ed1df8c5',uuid=48bdc405-dd40-4f80-a701-c25ee025d9a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "address": "fa:16:3e:60:02:e1", "network": {"id": "bed9f44e-8923-437b-b7fa-e20405554b44", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1907498263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5c4df421703949c7814d3fa7c2637793", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da752b6-6e", "ovs_interfaceid": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:43:51.842166 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Converting VIF {"id": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "address": "fa:16:3e:60:02:e1", "network": {"id": "bed9f44e-8923-437b-b7fa-e20405554b44", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1907498263-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5c4df421703949c7814d3fa7c2637793", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da752b6-6e", "ovs_interfaceid": "0da752b6-6eef-4ad0-8bd2-315518fbea60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:43:51.842871 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:02:e1,bridge_name='br-int',has_traffic_filtering=True,id=0da752b6-6eef-4ad0-8bd2-315518fbea60,network=Network(bed9f44e-8923-437b-b7fa-e20405554b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da752b6-6e') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:43:51.843169 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:02:e1,bridge_name='br-int',has_traffic_filtering=True,id=0da752b6-6eef-4ad0-8bd2-315518fbea60,network=Network(bed9f44e-8923-437b-b7fa-e20405554b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da752b6-6e') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:43:51.846415 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:51.846415 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0da752b6-6e, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:51.848467 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:51.849334 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:51.862159 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:51.863402 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:51.863678 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0582ae8-5d1f-4690-b3b9-b444166df98d) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:43:51.865081 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:51.865502 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:43:51.866915 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84cab01d-24f8-4a34-a879-9994aa945817 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:43:51.867379 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-84cab01d-24f8-4a34-a879-9994aa945817 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:43:51.879219 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:51.881666 np0000001025 nova-compute[97981]: INFO os_vif [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:02:e1,bridge_name='br-int',has_traffic_filtering=True,id=0da752b6-6eef-4ad0-8bd2-315518fbea60,network=Network(bed9f44e-8923-437b-b7fa-e20405554b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da752b6-6e')
May 19 04:43:51.882794 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:43:51.883074 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f', 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '092646db-f85b-4a27-bbec-4a5c360cc73f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:43:51.883216 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:43:51.900753 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:51.921901 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "1674daae-17fb-49d5-9305-c9d53a88ecde" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:51.922215 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:52.008991 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cdb4aaa9-91ba-4e5d-ba07-1f1fec7db6aa req-085f4ceb-6b04-45c8-a3b3-382a0ae0314d service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Received event network-vif-unplugged-0da752b6-6eef-4ad0-8bd2-315518fbea60 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:52.009174 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cdb4aaa9-91ba-4e5d-ba07-1f1fec7db6aa req-085f4ceb-6b04-45c8-a3b3-382a0ae0314d service nova] Acquiring lock "48bdc405-dd40-4f80-a701-c25ee025d9a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:52.009313 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cdb4aaa9-91ba-4e5d-ba07-1f1fec7db6aa req-085f4ceb-6b04-45c8-a3b3-382a0ae0314d service nova] Lock "48bdc405-dd40-4f80-a701-c25ee025d9a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:52.009420 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cdb4aaa9-91ba-4e5d-ba07-1f1fec7db6aa req-085f4ceb-6b04-45c8-a3b3-382a0ae0314d service nova] Lock "48bdc405-dd40-4f80-a701-c25ee025d9a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:52.009521 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cdb4aaa9-91ba-4e5d-ba07-1f1fec7db6aa req-085f4ceb-6b04-45c8-a3b3-382a0ae0314d service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] No waiting events found dispatching network-vif-unplugged-0da752b6-6eef-4ad0-8bd2-315518fbea60 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:52.009635 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cdb4aaa9-91ba-4e5d-ba07-1f1fec7db6aa req-085f4ceb-6b04-45c8-a3b3-382a0ae0314d service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Received event network-vif-unplugged-0da752b6-6eef-4ad0-8bd2-315518fbea60 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:43:52.009725 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cdb4aaa9-91ba-4e5d-ba07-1f1fec7db6aa req-085f4ceb-6b04-45c8-a3b3-382a0ae0314d service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Received event network-vif-unplugged-0da752b6-6eef-4ad0-8bd2-315518fbea60 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:52.009838 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cdb4aaa9-91ba-4e5d-ba07-1f1fec7db6aa req-085f4ceb-6b04-45c8-a3b3-382a0ae0314d service nova] Acquiring lock "48bdc405-dd40-4f80-a701-c25ee025d9a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:52.009942 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cdb4aaa9-91ba-4e5d-ba07-1f1fec7db6aa req-085f4ceb-6b04-45c8-a3b3-382a0ae0314d service nova] Lock "48bdc405-dd40-4f80-a701-c25ee025d9a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:52.010265 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cdb4aaa9-91ba-4e5d-ba07-1f1fec7db6aa req-085f4ceb-6b04-45c8-a3b3-382a0ae0314d service nova] Lock "48bdc405-dd40-4f80-a701-c25ee025d9a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:52.010265 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cdb4aaa9-91ba-4e5d-ba07-1f1fec7db6aa req-085f4ceb-6b04-45c8-a3b3-382a0ae0314d service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] No waiting events found dispatching network-vif-unplugged-0da752b6-6eef-4ad0-8bd2-315518fbea60 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:52.010265 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cdb4aaa9-91ba-4e5d-ba07-1f1fec7db6aa req-085f4ceb-6b04-45c8-a3b3-382a0ae0314d service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Received event network-vif-unplugged-0da752b6-6eef-4ad0-8bd2-315518fbea60 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:43:52.045044 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Creating config drive at /opt/stack/data/nova/instances/9563147c-542a-4b2c-8944-8961cfb68132/disk.config
May 19 04:43:52.049780 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9563147c-542a-4b2c-8944-8961cfb68132/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpku8sklpb {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:52.105216 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9563147c-542a-4b2c-8944-8961cfb68132/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpku8sklpb" returned: 0 in 0.055s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:52.372610 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-84cab01d-24f8-4a34-a879-9994aa945817 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:43:52.426235 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:43:52.538397 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:52.573139 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:52.625835 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Found WWN 3300000002344c80c for multipath device dm-15 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:43:52.626391 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:43:52.626665 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000002344c80c', 'path': '/dev/dm-15', 'multipath_id': '3300000002344c80c'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:43:52.626818 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002344c80c', 'path': '/dev/dm-15', 'multipath_id': '3300000002344c80c'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:43:52.627849 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.745s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:43:52.628240 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f', 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '092646db-f85b-4a27-bbec-4a5c360cc73f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:43:52.628418 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:43:52.634479 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'flavor' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:52.655493 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:52.671050 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:52.671050 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:52.671050 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:52.671050 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:52.671050 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:52.671050 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:52.671050 np0000001025 nova-compute[97981]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:43:52.671050 np0000001025 nova-compute[97981]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:43:52.671050 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:52.671050 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:52.671050 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:52.671050 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:52.671050 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:52.671050 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:52.671050 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:43:52.671797 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:52.671797 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:43:52.671797 np0000001025 nova-compute[97981]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:52.671797 np0000001025 nova-compute[97981]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f (non-flash)
May 19 04:43:52.671797 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:52.671797 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:43:52.671797 np0000001025 nova-compute[97981]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:43:52.671797 np0000001025 nova-compute[97981]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:43:52.671797 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:52.671797 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:43:52.671797 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:52.671797 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:43:52.671797 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:52.671797 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:43:52.671797 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:43:52.671797 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', '108'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '109'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '110'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '98')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:43:52.671797 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f', '106')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:43:52.673265 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f', '105')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:43:52.675327 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721834355b20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f'): ({'sdb'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:43:52.675685 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Removing multipathed devices sdc, sdb {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:43:52.676396 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Flush multipath device 3300000005a25effc {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:43:52.703162 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:43:52.707624 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:43:52.707624 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] No VIF found with MAC fa:16:3e:ec:99:36, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:43:52.707624 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Using config drive
May 19 04:43:52.714537 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:52.721590 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:52.730171 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:43:52.775066 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:43:52.827894 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:43:52.828076 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:43:52.830301 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:43:52.841808 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:43:52.842027 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:43:52.855437 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:52.894473 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 106, target: iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f, portal: 192.168.40.100,3260]
May 19 04:43:52.894473 np0000001025 nova-compute[97981]: Logout of [sid: 106, target: iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f, portal: 192.168.40.100,3260] successful.
May 19 04:43:52.894473 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:52.925856 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:52.936160 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:52.971167 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 105, target: iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f, portal: 192.168.50.100,3260]
May 19 04:43:52.971167 np0000001025 nova-compute[97981]: Logout of [sid: 105, target: iqn.2023-03.storpool.com:os--volume-092646db-f85b-4a27-bbec-4a5c360cc73f, portal: 192.168.50.100,3260] successful.
May 19 04:43:52.971167 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:52.993193 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:52.994858 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:43:52.995229 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:43:52.995405 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] <== disconnect_volume: return (1111ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:43:52.995628 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:43:52.996011 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Deleting instance files /opt/stack/data/nova/instances/48bdc405-dd40-4f80-a701-c25ee025d9a6_del
May 19 04:43:52.996663 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Deletion of /opt/stack/data/nova/instances/48bdc405-dd40-4f80-a701-c25ee025d9a6_del complete
May 19 04:43:53.140878 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Attempting to attach volume 1f1a7080-9228-4c04-afc2-2907210007ec with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:43:53.142518 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:43:53.142518 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:43:53.142518 np0000001025 nova-compute[97981]:   <alias name="ua-1f1a7080-9228-4c04-afc2-2907210007ec"/>
May 19 04:43:53.142518 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-15"/>
May 19 04:43:53.142518 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:43:53.142518 np0000001025 nova-compute[97981]:   <serial>1f1a7080-9228-4c04-afc2-2907210007ec</serial>
May 19 04:43:53.142518 np0000001025 nova-compute[97981]: </disk>
May 19 04:43:53.142518 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:43:53.218071 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:53.321210 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:53.340839 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165833.340464, 9563147c-542a-4b2c-8944-8961cfb68132 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:53.341016 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] VM Started (Lifecycle Event)
May 19 04:43:53.368335 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Creating config drive at /opt/stack/data/nova/instances/73d8ac91-6ca4-4ec9-81ce-c708d25f68dd/disk.config
May 19 04:43:53.372592 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/73d8ac91-6ca4-4ec9-81ce-c708d25f68dd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9bbycjb4 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:43:53.395297 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84cab01d-24f8-4a34-a879-9994aa945817 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 3.033s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:53.401714 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.409s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:53.411153 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:43:53.411153 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Claim successful on node np0000001025
May 19 04:43:53.437703 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/73d8ac91-6ca4-4ec9-81ce-c708d25f68dd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9bbycjb4" returned: 0 in 0.065s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:43:53.508083 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Took 2.52 seconds to destroy the instance on the hypervisor.
May 19 04:43:53.508918 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:43:53.512131 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:43:53.512131 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:43:53.512131 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:53.608314 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:53.843967 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:53.851900 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165833.8510287, 9563147c-542a-4b2c-8944-8961cfb68132 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:53.852611 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] VM Paused (Lifecycle Event)
May 19 04:43:53.905372 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d0af1147-e416-40e9-97ca-bd628ae039e1 req-8462104a-cbf3-4130-a06f-0e8b702ebbfc service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Received event network-vif-deleted-0da752b6-6eef-4ad0-8bd2-315518fbea60 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:53.905372 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-d0af1147-e416-40e9-97ca-bd628ae039e1 req-8462104a-cbf3-4130-a06f-0e8b702ebbfc service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Neutron deleted interface 0da752b6-6eef-4ad0-8bd2-315518fbea60; detaching it from the instance and deleting it from the info cache
May 19 04:43:53.905372 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d0af1147-e416-40e9-97ca-bd628ae039e1 req-8462104a-cbf3-4130-a06f-0e8b702ebbfc service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:53.961899 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:53.990015 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:54.092443 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:54.125158 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-84cab01d-24f8-4a34-a879-9994aa945817 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Deleted allocation for migration 22841eb6-38a9-46df-8c9d-aa8e46ab8cc3
May 19 04:43:54.133121 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d0746a47-9259-4335-bd49-b69b066401f7 req-2fa79b6a-1c28-4fd7-ac35-e8eca4dd965a service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Received event network-vif-plugged-0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:54.133396 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d0746a47-9259-4335-bd49-b69b066401f7 req-2fa79b6a-1c28-4fd7-ac35-e8eca4dd965a service nova] Acquiring lock "9563147c-542a-4b2c-8944-8961cfb68132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:54.133661 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d0746a47-9259-4335-bd49-b69b066401f7 req-2fa79b6a-1c28-4fd7-ac35-e8eca4dd965a service nova] Lock "9563147c-542a-4b2c-8944-8961cfb68132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:54.134221 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d0746a47-9259-4335-bd49-b69b066401f7 req-2fa79b6a-1c28-4fd7-ac35-e8eca4dd965a service nova] Lock "9563147c-542a-4b2c-8944-8961cfb68132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:54.134221 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d0746a47-9259-4335-bd49-b69b066401f7 req-2fa79b6a-1c28-4fd7-ac35-e8eca4dd965a service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Processing event network-vif-plugged-0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:43:54.134363 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d0746a47-9259-4335-bd49-b69b066401f7 req-2fa79b6a-1c28-4fd7-ac35-e8eca4dd965a service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Received event network-vif-plugged-0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:54.134987 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d0746a47-9259-4335-bd49-b69b066401f7 req-2fa79b6a-1c28-4fd7-ac35-e8eca4dd965a service nova] Acquiring lock "9563147c-542a-4b2c-8944-8961cfb68132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:54.135059 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d0746a47-9259-4335-bd49-b69b066401f7 req-2fa79b6a-1c28-4fd7-ac35-e8eca4dd965a service nova] Lock "9563147c-542a-4b2c-8944-8961cfb68132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:54.135207 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d0746a47-9259-4335-bd49-b69b066401f7 req-2fa79b6a-1c28-4fd7-ac35-e8eca4dd965a service nova] Lock "9563147c-542a-4b2c-8944-8961cfb68132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:54.136734 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:43:54.136990 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d0746a47-9259-4335-bd49-b69b066401f7 req-2fa79b6a-1c28-4fd7-ac35-e8eca4dd965a service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] No waiting events found dispatching network-vif-plugged-0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:54.137205 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-d0746a47-9259-4335-bd49-b69b066401f7 req-2fa79b6a-1c28-4fd7-ac35-e8eca4dd965a service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Received unexpected event network-vif-plugged-0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4 for instance with vm_state building and task_state spawning.
May 19 04:43:54.143125 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:43:54.154412 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Instance spawned successfully.
May 19 04:43:54.154737 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:43:54.167278 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:54.167626 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:54.344156 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:54.358319 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:54.363142 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:54.374212 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165834.37379, 9563147c-542a-4b2c-8944-8961cfb68132 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:54.374342 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] VM Resumed (Lifecycle Event)
May 19 04:43:54.388011 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:54.409126 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d0af1147-e416-40e9-97ca-bd628ae039e1 req-8462104a-cbf3-4130-a06f-0e8b702ebbfc service nova] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Detach interface failed, port_id=0da752b6-6eef-4ad0-8bd2-315518fbea60, reason: Instance 48bdc405-dd40-4f80-a701-c25ee025d9a6 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:43:54.632694 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84cab01d-24f8-4a34-a879-9994aa945817 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 7.656s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:54.673368 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Took 8.94 seconds to spawn the instance on the hypervisor.
May 19 04:43:54.675836 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:54.808663 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:43:54.808663 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:43:54.808663 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:43:54.808663 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No VIF found with MAC fa:16:3e:08:04:9d, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:43:54.846512 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Took 1.34 seconds to deallocate network for instance.
May 19 04:43:54.877803 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:54.885876 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:43:55.192668 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Took 19.82 seconds to build instance.
May 19 04:43:55.395860 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165835.395569, 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:55.395983 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] VM Started (Lifecycle Event)
May 19 04:43:55.412894 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Took 0.57 seconds to detach 1 volumes for instance.
May 19 04:43:55.430630 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:43:55.430630 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:43:55.693170 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "9563147c-542a-4b2c-8944-8961cfb68132" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.335s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:55.903242 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:55.906532 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165835.9062424, 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:55.906678 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] VM Paused (Lifecycle Event)
May 19 04:43:55.918361 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:55.933589 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:43:55.981757 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Received event network-vif-plugged-cae1ad91-b98a-4f8e-b208-20159307d77d {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:55.982663 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] Acquiring lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:55.982899 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] Lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:55.983062 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] Lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:55.983247 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Processing event network-vif-plugged-cae1ad91-b98a-4f8e-b208-20159307d77d {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:43:55.983430 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Received event network-vif-plugged-cae1ad91-b98a-4f8e-b208-20159307d77d {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:55.983784 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] Acquiring lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:55.984173 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:43:55.984479 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] Lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:55.985840 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] Lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:55.985840 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] No waiting events found dispatching network-vif-plugged-cae1ad91-b98a-4f8e-b208-20159307d77d {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:55.985840 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Received unexpected event network-vif-plugged-cae1ad91-b98a-4f8e-b208-20159307d77d for instance with vm_state building and task_state spawning.
May 19 04:43:55.985840 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Received event network-changed-9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:55.985840 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Refreshing instance network info cache due to event network-changed-9791a107-963b-4608-9092-2df622d06125. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:43:55.986051 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] Acquiring lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:55.986051 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] Acquired lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:55.986472 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Refreshing network info cache for port 9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:43:55.993133 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:43:55.995264 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Instance spawned successfully.
May 19 04:43:55.996378 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:43:56.261866 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5608ab4f-5d68-4fe4-9829-cff054ae4682 req-21795d60-5e09-42c4-b6b9-39d86d3d60d6 service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Received event network-changed-0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:56.263920 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5608ab4f-5d68-4fe4-9829-cff054ae4682 req-21795d60-5e09-42c4-b6b9-39d86d3d60d6 service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Refreshing instance network info cache due to event network-changed-0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:43:56.267382 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5608ab4f-5d68-4fe4-9829-cff054ae4682 req-21795d60-5e09-42c4-b6b9-39d86d3d60d6 service nova] Acquiring lock "refresh_cache-9563147c-542a-4b2c-8944-8961cfb68132" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:56.267382 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5608ab4f-5d68-4fe4-9829-cff054ae4682 req-21795d60-5e09-42c4-b6b9-39d86d3d60d6 service nova] Acquired lock "refresh_cache-9563147c-542a-4b2c-8944-8961cfb68132" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:56.267382 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5608ab4f-5d68-4fe4-9829-cff054ae4682 req-21795d60-5e09-42c4-b6b9-39d86d3d60d6 service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Refreshing network info cache for port 0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:43:56.371067 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1dd340b9-264a-4fc1-8cd7-e4aef905145b tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.532s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:56.409557 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:56.411667 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165836.411471, 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:43:56.411763 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] VM Resumed (Lifecycle Event)
May 19 04:43:56.440018 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.039s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:56.440447 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:43:56.443160 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.525s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:56.488295 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:56.507554 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:56.507554 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:56.507554 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:56.507554 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:56.507554 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:56.507554 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:43:56.661132 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a4c43f21-375d-429e-bf7c-1c8fdd61a1b3 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "80436afa-9cd9-41cd-b589-629da01b6bfe" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:56.661270 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a4c43f21-375d-429e-bf7c-1c8fdd61a1b3 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:56.661416 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a4c43f21-375d-429e-bf7c-1c8fdd61a1b3 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:56.671560 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a4c43f21-375d-429e-bf7c-1c8fdd61a1b3 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=97981) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 19 04:43:56.671560 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-a4c43f21-375d-429e-bf7c-1c8fdd61a1b3 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'flavor' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:56.768656 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-5608ab4f-5d68-4fe4-9829-cff054ae4682 req-21795d60-5e09-42c4-b6b9-39d86d3d60d6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:56.869134 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:56.915404 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:56.921179 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:43:56.948614 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:43:56.948718 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:43:56.948994 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:56.949244 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:56.971745 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:57.014470 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Took 8.76 seconds to spawn the instance on the hypervisor.
May 19 04:43:57.014470 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:57.088170 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5885f1561f394d46bd4c1b48e7323c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7465b5668be4eb9b75c1ddc876e7eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:43:57.203675 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-5608ab4f-5d68-4fe4-9829-cff054ae4682 req-21795d60-5e09-42c4-b6b9-39d86d3d60d6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:57.226777 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Updated VIF entry in instance network info cache for port 9791a107-963b-4608-9092-2df622d06125. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:43:57.226777 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Updating instance_info_cache with network_info: [{"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:57.370500 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:57.391950 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5608ab4f-5d68-4fe4-9829-cff054ae4682 req-21795d60-5e09-42c4-b6b9-39d86d3d60d6 service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Updated VIF entry in instance network info cache for port 0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:43:57.392357 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5608ab4f-5d68-4fe4-9829-cff054ae4682 req-21795d60-5e09-42c4-b6b9-39d86d3d60d6 service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Updating instance_info_cache with network_info: [{"id": "0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4", "address": "fa:16:3e:c9:1d:95", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a95c435-6c", "ovs_interfaceid": "0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:57.424469 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:43:57.449342 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:43:57.523574 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Successfully created port: a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:43:57.526050 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Took 14.87 seconds to build instance.
May 19 04:43:57.642260 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:43:57.642425 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:43:57.698063 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:57.701984 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:57.727522 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:57.728745 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] Releasing lock "refresh_cache-6f26313e-2659-4687-84da-96cf2da9a4e2" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:57.728946 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Received event network-changed-d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:57.729050 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Refreshing instance network info cache due to event network-changed-d51c757a-3333-4e40-8d5f-3c2d35a128b2. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:43:57.729227 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] Acquiring lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:57.729341 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] Acquired lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:57.729440 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Refreshing network info cache for port d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:43:57.751936 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:57.753421 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:57.894551 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5608ab4f-5d68-4fe4-9829-cff054ae4682 req-21795d60-5e09-42c4-b6b9-39d86d3d60d6 service nova] Releasing lock "refresh_cache-9563147c-542a-4b2c-8944-8961cfb68132" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:57.957045 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:43:58.031715 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74388ca6-6511-4e34-bf14-888083cb39f5 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.397s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:58.039332 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999653803000001 future=<Future at 0x7218344596d0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:43:58.043440 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Instance destroyed successfully.
May 19 04:43:58.043894 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-a4c43f21-375d-429e-bf7c-1c8fdd61a1b3 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'numa_topology' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:58.144844 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:43:58.234258 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:58.320608 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:43:58.459232 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Booting with volume-backed-image 76f2afbb-2235-45f3-9168-d64aadd6e71e at /dev/vda
May 19 04:43:58.546861 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-a4c43f21-375d-429e-bf7c-1c8fdd61a1b3 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Object Instance<80436afa-9cd9-41cd-b589-629da01b6bfe> lazy-loaded attributes: flavor,numa_topology {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:43:58.548149 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a4c43f21-375d-429e-bf7c-1c8fdd61a1b3 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:43:58.565068 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fe334f69-5a58-481c-987c-4f583837461e req-91aa2bf1-d6d6-4545-85b1-07c7e28e5d0e service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received event network-vif-unplugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:58.565316 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fe334f69-5a58-481c-987c-4f583837461e req-91aa2bf1-d6d6-4545-85b1-07c7e28e5d0e service nova] Acquiring lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:43:58.566305 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fe334f69-5a58-481c-987c-4f583837461e req-91aa2bf1-d6d6-4545-85b1-07c7e28e5d0e service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:43:58.566305 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fe334f69-5a58-481c-987c-4f583837461e req-91aa2bf1-d6d6-4545-85b1-07c7e28e5d0e service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:58.568199 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fe334f69-5a58-481c-987c-4f583837461e req-91aa2bf1-d6d6-4545-85b1-07c7e28e5d0e service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] No waiting events found dispatching network-vif-unplugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:43:58.568376 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-fe334f69-5a58-481c-987c-4f583837461e req-91aa2bf1-d6d6-4545-85b1-07c7e28e5d0e service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received unexpected event network-vif-unplugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 for instance with vm_state active and task_state powering-off.
May 19 04:43:58.596989 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:58.651387 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.208s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:58.703791 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Deleted allocations for instance 48bdc405-dd40-4f80-a701-c25ee025d9a6
May 19 04:43:58.788643 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Updated VIF entry in instance network info cache for port d51c757a-3333-4e40-8d5f-3c2d35a128b2. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:43:58.789034 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Updating instance_info_cache with network_info: [{"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:43:58.840234 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Successfully updated port: a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:43:59.042625 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7c637a02-8a90-493f-857e-35d1f562e91d req-0d15e48a-daa8-4ab8-93bc-0c1898454bb3 service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Received event network-changed-cae1ad91-b98a-4f8e-b208-20159307d77d {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:43:59.043010 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7c637a02-8a90-493f-857e-35d1f562e91d req-0d15e48a-daa8-4ab8-93bc-0c1898454bb3 service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Refreshing instance network info cache due to event network-changed-cae1ad91-b98a-4f8e-b208-20159307d77d. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:43:59.043010 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7c637a02-8a90-493f-857e-35d1f562e91d req-0d15e48a-daa8-4ab8-93bc-0c1898454bb3 service nova] Acquiring lock "refresh_cache-73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:59.043099 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7c637a02-8a90-493f-857e-35d1f562e91d req-0d15e48a-daa8-4ab8-93bc-0c1898454bb3 service nova] Acquired lock "refresh_cache-73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:59.043401 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-7c637a02-8a90-493f-857e-35d1f562e91d req-0d15e48a-daa8-4ab8-93bc-0c1898454bb3 service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Refreshing network info cache for port cae1ad91-b98a-4f8e-b208-20159307d77d {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:43:59.053889 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a4c43f21-375d-429e-bf7c-1c8fdd61a1b3 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.393s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:59.291422 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5bf47f8d-74c2-4927-b1ca-356f1b99c4d8 req-b9de74c6-9264-40ed-9ac6-8d60019ec2a1 service nova] Releasing lock "refresh_cache-417861ee-dcf2-458b-8782-2ec22d2f5421" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:43:59.346496 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "refresh_cache-1674daae-17fb-49d5-9305-c9d53a88ecde" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:43:59.346654 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquired lock "refresh_cache-1674daae-17fb-49d5-9305-c9d53a88ecde" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:43:59.346758 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:43:59.496658 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'flavor' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:43:59.546196 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-7c637a02-8a90-493f-857e-35d1f562e91d req-0d15e48a-daa8-4ab8-93bc-0c1898454bb3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:59.712160 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-174080fe-e841-4898-b485-4cf53dee5061 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Lock "48bdc405-dd40-4f80-a701-c25ee025d9a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.233s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:43:59.910272 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-7c637a02-8a90-493f-857e-35d1f562e91d req-0d15e48a-daa8-4ab8-93bc-0c1898454bb3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:43:59.953122 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:44:00.002147 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "refresh_cache-80436afa-9cd9-41cd-b589-629da01b6bfe" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:44:00.002362 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquired lock "refresh_cache-80436afa-9cd9-41cd-b589-629da01b6bfe" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:44:00.002603 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:44:00.002825 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'info_cache' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:00.077463 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-7c637a02-8a90-493f-857e-35d1f562e91d req-0d15e48a-daa8-4ab8-93bc-0c1898454bb3 service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Updated VIF entry in instance network info cache for port cae1ad91-b98a-4f8e-b208-20159307d77d. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:44:00.077883 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-7c637a02-8a90-493f-857e-35d1f562e91d req-0d15e48a-daa8-4ab8-93bc-0c1898454bb3 service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Updating instance_info_cache with network_info: [{"id": "cae1ad91-b98a-4f8e-b208-20159307d77d", "address": "fa:16:3e:ec:99:36", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae1ad91-b9", "ovs_interfaceid": "cae1ad91-b98a-4f8e-b208-20159307d77d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:00.139583 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:00.278644 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Updating instance_info_cache with network_info: [{"id": "a3647067-1ff5-4354-84b6-98056ab51353", "address": "fa:16:3e:a5:fd:be", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3647067-1f", "ovs_interfaceid": "a3647067-1ff5-4354-84b6-98056ab51353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:00.507160 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Object Instance<80436afa-9cd9-41cd-b589-629da01b6bfe> lazy-loaded attributes: flavor,info_cache {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:44:00.580050 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7c637a02-8a90-493f-857e-35d1f562e91d req-0d15e48a-daa8-4ab8-93bc-0c1898454bb3 service nova] Releasing lock "refresh_cache-73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:44:00.634984 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-61dd5e51-4571-4476-b118-6c46e19c7067 req-f2c3cd37-2287-480f-9bca-47b9a38f3e8e service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received event network-vif-unplugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:00.635231 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-61dd5e51-4571-4476-b118-6c46e19c7067 req-f2c3cd37-2287-480f-9bca-47b9a38f3e8e service nova] Acquiring lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:00.635452 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-61dd5e51-4571-4476-b118-6c46e19c7067 req-f2c3cd37-2287-480f-9bca-47b9a38f3e8e service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:00.635620 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-61dd5e51-4571-4476-b118-6c46e19c7067 req-f2c3cd37-2287-480f-9bca-47b9a38f3e8e service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:00.635780 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-61dd5e51-4571-4476-b118-6c46e19c7067 req-f2c3cd37-2287-480f-9bca-47b9a38f3e8e service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] No waiting events found dispatching network-vif-unplugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:00.635976 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-61dd5e51-4571-4476-b118-6c46e19c7067 req-f2c3cd37-2287-480f-9bca-47b9a38f3e8e service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received unexpected event network-vif-unplugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 for instance with vm_state stopped and task_state powering-on.
May 19 04:44:00.637317 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-61dd5e51-4571-4476-b118-6c46e19c7067 req-f2c3cd37-2287-480f-9bca-47b9a38f3e8e service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received event network-changed-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:00.637455 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-61dd5e51-4571-4476-b118-6c46e19c7067 req-f2c3cd37-2287-480f-9bca-47b9a38f3e8e service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Refreshing instance network info cache due to event network-changed-a3647067-1ff5-4354-84b6-98056ab51353. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:44:00.637605 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-61dd5e51-4571-4476-b118-6c46e19c7067 req-f2c3cd37-2287-480f-9bca-47b9a38f3e8e service nova] Acquiring lock "refresh_cache-1674daae-17fb-49d5-9305-c9d53a88ecde" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:44:00.780733 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Releasing lock "refresh_cache-1674daae-17fb-49d5-9305-c9d53a88ecde" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:44:00.781038 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Instance network_info: |[{"id": "a3647067-1ff5-4354-84b6-98056ab51353", "address": "fa:16:3e:a5:fd:be", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3647067-1f", "ovs_interfaceid": "a3647067-1ff5-4354-84b6-98056ab51353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:44:00.781287 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-61dd5e51-4571-4476-b118-6c46e19c7067 req-f2c3cd37-2287-480f-9bca-47b9a38f3e8e service nova] Acquired lock "refresh_cache-1674daae-17fb-49d5-9305-c9d53a88ecde" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:44:00.781423 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-61dd5e51-4571-4476-b118-6c46e19c7067 req-f2c3cd37-2287-480f-9bca-47b9a38f3e8e service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Refreshing network info cache for port a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:44:01.010352 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:01.283391 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-61dd5e51-4571-4476-b118-6c46e19c7067 req-f2c3cd37-2287-480f-9bca-47b9a38f3e8e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:01.336753 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:01.492071 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Updating instance_info_cache with network_info: [{"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:01.601222 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-61dd5e51-4571-4476-b118-6c46e19c7067 req-f2c3cd37-2287-480f-9bca-47b9a38f3e8e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:01.774567 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-61dd5e51-4571-4476-b118-6c46e19c7067 req-f2c3cd37-2287-480f-9bca-47b9a38f3e8e service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Updated VIF entry in instance network info cache for port a3647067-1ff5-4354-84b6-98056ab51353. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:44:01.774936 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-61dd5e51-4571-4476-b118-6c46e19c7067 req-f2c3cd37-2287-480f-9bca-47b9a38f3e8e service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Updating instance_info_cache with network_info: [{"id": "a3647067-1ff5-4354-84b6-98056ab51353", "address": "fa:16:3e:a5:fd:be", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3647067-1f", "ovs_interfaceid": "a3647067-1ff5-4354-84b6-98056ab51353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:01.870173 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:01.997503 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Releasing lock "refresh_cache-80436afa-9cd9-41cd-b589-629da01b6bfe" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:44:02.006937 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:44:02.018851 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:44:02.040133 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:02.087295 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:44:02.088214 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:44:02.101209 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:44:02.101489 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fea1:aa43', 'fe80::fc16:3eff:fe1d:f0b2', 'fe80::4cb5:1dff:fe2d:31dc', 'fe80::fc16:3eff:fefb:c3a3', 'fe80::2c2c:57ff:feff:64a5', 'fe80::fc16:3eff:feb6:da78', 'fe80::bc20:d2ff:fef5:7278', 'fe80::fc16:3eff:fefa:d4f0', 'fe80::fc16:3eff:fe8e:f53b', 'fe80::fc16:3eff:fe1f:1450', 'fe80::fc16:3eff:febf:9241', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:feea:4891', 'fe80::fc16:3eff:feb0:9e6f', 'fe80::fc16:3eff:fec9:1d95', 'fe80::fc16:3eff:feec:9936', 'fe80::808a:12ff:fe91:c161'] 
May 19 04:44:02.101839 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:44:02.102069 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:44:02.102408 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:44:02.102704 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Updating existing volume attachment record: 4dd15768-a21d-4184-82e0-487949a92e96 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:44:02.277746 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-61dd5e51-4571-4476-b118-6c46e19c7067 req-f2c3cd37-2287-480f-9bca-47b9a38f3e8e service nova] Releasing lock "refresh_cache-1674daae-17fb-49d5-9305-c9d53a88ecde" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:44:02.591844 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:03.019618 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Instance destroyed successfully.
May 19 04:44:03.020188 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'numa_topology' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:03.323147 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:03.522264 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Object Instance<80436afa-9cd9-41cd-b589-629da01b6bfe> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:44:03.522487 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'resources' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:04.024429 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Object Instance<80436afa-9cd9-41cd-b589-629da01b6bfe> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:44:04.025866 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-640764006',display_name='tempest-AttachVolumeTestJSON-server-640764006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumetestjson-server-640764006',id=45,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2tj8xzpEQbsFz0KUREQNWmpjZhzzIU4JsBBAhR6kXLneAex6Ogc6JmA+zSTxW3EHqpPyo/1HFfxr+XwLCwn6E7c5wL4jf0HNaUzjvIvGdUt6TsdBS845t/ZQ77wWohcw==',key_name='tempest-keypair-402968852',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:43:06Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='662c1a9b25e44aff8242f468232af7f3',ramdisk_id='',reservation_id='r-bmmqkbkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1215369469',owner_user_name='tempest-AttachVolumeTestJSON-1215369469-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:43:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f7f84eb55d44e89c2ed500098135e0',uuid=80436afa-9cd9-41cd-b589-629da01b6bfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:44:04.025866 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converting VIF {"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:44:04.026414 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:04:9d,bridge_name='br-int',has_traffic_filtering=True,id=15e6bc86-13bd-43b9-ad28-342f33dbdeb8,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6bc86-13') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:44:04.026703 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:04:9d,bridge_name='br-int',has_traffic_filtering=True,id=15e6bc86-13bd-43b9-ad28-342f33dbdeb8,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6bc86-13') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:44:04.029844 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:04.030069 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15e6bc86-13, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:04.032049 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:04.032458 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:04.035290 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:04.037273 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:04.037475 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4711b7c2-73dc-4983-81f3-9be1c01a48ec) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:04.040131 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:04.041793 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:04.045423 np0000001025 nova-compute[97981]: INFO os_vif [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:04:9d,bridge_name='br-int',has_traffic_filtering=True,id=15e6bc86-13bd-43b9-ad28-342f33dbdeb8,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6bc86-13')
May 19 04:44:04.046978 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:44:04.048062 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1f1a7080-9228-4c04-afc2-2907210007ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:44:04.048927 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:04.049724 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:04.050254 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1f1a7080-9228-4c04-afc2-2907210007ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:44:04.050525 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:04.095144 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', '108'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '109'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '110'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '98')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:44:04.095144 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '109')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:44:04.097626 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '110')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:44:04.101433 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185085cd60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec'): ({'sdj'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:44:04.101433 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Removing multipathed devices sdk, sdj {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:44:04.102749 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Flush multipath device 3300000002344c80c {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:44:04.137905 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:44:04.193029 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:44:04.221870 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:44:04.223316 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:44:04.223609 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Creating image(s)
May 19 04:44:04.223980 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:44:04.224632 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Ensure instance console log exists: /opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:44:04.224930 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:04.225290 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:04.225493 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:04.226116 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Start _get_guest_xml network_info=[{"id": "a3647067-1ff5-4354-84b6-98056ab51353", "address": "fa:16:3e:a5:fd:be", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3647067-1f", "ovs_interfaceid": "a3647067-1ff5-4354-84b6-98056ab51353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '4dd15768-a21d-4184-82e0-487949a92e96', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58ce508e-69cc-472e-8537-ec295ae01e9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1674daae-17fb-49d5-9305-c9d53a88ecde', 'attached_at': '', 'detached_at': '', 'volume_id': '58ce508e-69cc-472e-8537-ec295ae01e9e', 'serial': '58ce508e-69cc-472e-8537-ec295ae01e9e'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:44:04.228172 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:44:04.229408 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1532378913', uuid='1674daae-17fb-49d5-9305-c9d53a88ecde'), owner=OwnerMeta(userid='5885f1561f394d46bd4c1b48e7323c1e', username='tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member', projectid='f7465b5668be4eb9b75c1ddc876e7eac', projectname='tempest-ServerBootFromVolumeStableRescueTest-96916496'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a3647067-1ff5-4354-84b6-98056ab51353", "address": "fa:16:3e:a5:fd:be", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3647067-1f", "ovs_interfaceid": "a3647067-1ff5-4354-84b6-98056ab51353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165844.229076) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:44:04.232252 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:44:04.232252 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:44:04.232252 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:44:04.232252 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:44:04.233353 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:44:04.233353 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:44:04.233353 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:44:04.233353 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:44:04.233567 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:44:04.233567 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:44:04.233567 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:44:04.233673 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:44:04.233944 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:44:04.233944 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:44:04.233944 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:44:04.234200 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:44:04.243812 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:44:04.244120 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58ce508e-69cc-472e-8537-ec295ae01e9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:44:04.244423 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:04.244812 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:44:04.244889 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:44:04.247127 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:44:04.264118 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:44:04.264379 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:44:04.280952 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:04.335748 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 109, target: iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec, portal: 192.168.40.100,3260]
May 19 04:44:04.335748 np0000001025 nova-compute[97981]: Logout of [sid: 109, target: iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec, portal: 192.168.40.100,3260] successful.
May 19 04:44:04.335748 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:04.361377 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:04.382374 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:04.427666 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 110, target: iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec, portal: 192.168.50.100,3260]
May 19 04:44:04.427666 np0000001025 nova-compute[97981]: Logout of [sid: 110, target: iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec, portal: 192.168.50.100,3260] successful.
May 19 04:44:04.427666 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:04.459161 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:04.459474 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:04.459793 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] <== disconnect_volume: return (411ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:44:04.460046 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:44:04.460553 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.216s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:04.460857 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58ce508e-69cc-472e-8537-ec295ae01e9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:44:04.467476 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Start _get_guest_xml network_info=[{"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '6a4e1471-7423-4609-b6c6-62976a0bdab6', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1f1a7080-9228-4c04-afc2-2907210007ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'}, 'status': 'reserved', 'instance': '80436afa-9cd9-41cd-b589-629da01b6bfe', 'attached_at': '', 'detached_at': '', 'volume_id': '1f1a7080-9228-4c04-afc2-2907210007ec', 'serial': '1f1a7080-9228-4c04-afc2-2907210007ec'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:44:04.474769 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:04.480041 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:04.481204 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:04.481873 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:44:04.488293 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-640764006', uuid='80436afa-9cd9-41cd-b589-629da01b6bfe'), owner=OwnerMeta(userid='96f7f84eb55d44e89c2ed500098135e0', username='tempest-AttachVolumeTestJSON-1215369469-project-member', projectid='662c1a9b25e44aff8242f468232af7f3', projectname='tempest-AttachVolumeTestJSON-1215369469'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165844.4874904) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:44:04.489167 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:04.489459 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:44:04.489837 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.009s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:04.490078 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:44:04.491770 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:44:04.492907 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:44:04.496056 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:44:04.496056 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:44:04.496056 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:44:04.496056 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:44:04.496056 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:44:04.496056 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:44:04.496056 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:44:04.496418 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:44:04.496418 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:44:04.496418 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:44:04.496505 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:44:04.496638 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:44:04.496759 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:44:04.496970 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:44:04.497208 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'vcpu_model' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:04.504610 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:44:04.504610 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:04.514048 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:44:04.514048 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:04.521016 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e] added
May 19 04:44:04.521016 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:44:04.521016 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:04.521016 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:04.521016 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:04.521016 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:04.521016 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:04.521253 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:44:04.521722 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.032(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:44:04.521722 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:44:04.526703 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e] added
May 19 04:44:04.526703 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:44:04.526703 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:04.526703 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:04.526703 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:04.526703 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:04.526703 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:04.526910 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:44:04.527732 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0369(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:44:04.527876 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:44:05.001038 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Object Instance<80436afa-9cd9-41cd-b589-629da01b6bfe> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:44:05.020807 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk.config --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:05.125895 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk.config --force-share --output=json" returned: 0 in 0.105s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:05.126397 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "/opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:05.126628 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "/opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:05.127186 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "/opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:05.127591 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:44:05.128017 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1f1a7080-9228-4c04-afc2-2907210007ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:44:05.128251 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:05.522092 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:44:05.528287 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:44:05.537359 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:44:05.537359 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:44:05.542855 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:44:05.542855 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:05.553625 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:05.560883 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:05.573547 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:05.573547 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:05.573547 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:05.573547 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:05.573547 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:05.573547 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:05.573547 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:05.573547 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:05.573547 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:05.573547 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:05.573547 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:05.574021 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:05.574021 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:05.574021 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:05.574021 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:05.574021 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:05.574021 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:05.574021 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:05.574021 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:05.574021 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:05.574021 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:05.574021 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:05.582887 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:05.582887 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:05.582887 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:05.582887 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:05.582887 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:05.582887 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:05.582887 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:05.582887 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:05.582887 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:05.582887 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:05.582887 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:05.582887 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:05.582887 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:05.582887 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:05.582887 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:05.582887 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:05.582887 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:05.582887 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:05.582887 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:05.582887 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:05.582887 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:05.582887 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:05.623054 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e, portal: 192.168.50.100,3260]
May 19 04:44:05.623054 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e, portal: 192.168.50.100,3260] successful.
May 19 04:44:05.623054 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:05.630322 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e, portal: 192.168.40.100,3260]
May 19 04:44:05.630322 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e, portal: 192.168.40.100,3260] successful.
May 19 04:44:05.630322 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:05.639302 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:05.645135 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:05.663652 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:05.663652 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:05.663652 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:05.663652 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:05.663652 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:05.663652 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:05.663652 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:05.663652 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:05.663652 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:05.663652 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:05.663652 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:05.663652 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:05.663652 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:05.666066 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:05.666066 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:05.666066 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:05.666066 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:05.666066 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:05.666066 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:05.666066 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:05.666066 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:05.666066 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:05.666066 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:05.666066 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:05.666066 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:05.666066 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:05.666066 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:05.666066 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:05.667062 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:05.667708 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:05.667708 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:44:05.668319 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] HCTL ('7', '-', '-', 0) found on session 111 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:44:05.668669 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:44:05.669444 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] HCTL ('8', '-', '-', 0) found on session 112 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:44:05.672088 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:44:05.711296 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Searching for a device in session 111 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:44:05.711296 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '58ce508e-69cc-472e-8537-ec295ae01e9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:44:05.711296 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Searching for a device in session 112 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:44:05.711296 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58ce508e-69cc-472e-8537-ec295ae01e9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:44:06.326607 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0004733720002150221 future=<Future at 0x7218505c4ad0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:06.327259 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Emitting event <LifecycleEvent: 1779165831.3260224, 48bdc405-dd40-4f80-a701-c25ee025d9a6 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:44:06.327526 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:06.327622 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] VM Stopped (Lifecycle Event)
May 19 04:44:06.329672 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=6.709241153999756 future=<Future at 0x7218344596d0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:06.330502 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=6.708384031999685 future=<Future at 0x7218344596d0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:06.482380 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:44:06.831849 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 48bdc405-dd40-4f80-a701-c25ee025d9a6] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:07.504732 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Found WWN 330000000c76e17ba for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:44:07.505672 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:07.505940 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] <== connect_volume: return (3261ms) {'type': 'block', 'scsi_wwn': '330000000c76e17ba', 'path': '/dev/dm-0', 'multipath_id': '330000000c76e17ba'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:44:07.506205 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c76e17ba', 'path': '/dev/dm-0', 'multipath_id': '330000000c76e17ba'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:44:07.506497 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.378s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:07.506820 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1f1a7080-9228-4c04-afc2-2907210007ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:44:07.525907 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:07.526639 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:07.527204 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:07.527532 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:44:07.531936 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:07.531936 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:44:07.545961 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:44:07.545961 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:07.554638 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:44:07.554638 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:07.563801 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec] added
May 19 04:44:07.563801 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:44:07.563801 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:07.563801 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:07.563801 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:07.563801 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:07.563801 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:07.564339 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:44:07.564339 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0368(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:44:07.564887 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:44:07.571125 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec] added
May 19 04:44:07.571125 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:44:07.571125 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:07.571125 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:07.571125 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:07.571125 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:07.571125 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:07.571400 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:44:07.571632 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0417(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:44:07.571820 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:44:08.012997 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1532378913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverbootfromvolumestablerescuetest-server-1532378913',id=52,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7465b5668be4eb9b75c1ddc876e7eac',ramdisk_id='',reservation_id='r-1h9f0mim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-96916496',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:43:58Z,user_data=None,user_id='5885f1561f394d46bd4c1b48e7323c1e',uuid=1674daae-17fb-49d5-9305-c9d53a88ecde,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3647067-1ff5-4354-84b6-98056ab51353", "address": "fa:16:3e:a5:fd:be", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3647067-1f", "ovs_interfaceid": "a3647067-1ff5-4354-84b6-98056ab51353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:44:08.013489 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converting VIF {"id": "a3647067-1ff5-4354-84b6-98056ab51353", "address": "fa:16:3e:a5:fd:be", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3647067-1f", "ovs_interfaceid": "a3647067-1ff5-4354-84b6-98056ab51353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:44:08.014015 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:fd:be,bridge_name='br-int',has_traffic_filtering=True,id=a3647067-1ff5-4354-84b6-98056ab51353,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3647067-1f') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:44:08.014725 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'pci_devices' on Instance uuid 1674daae-17fb-49d5-9305-c9d53a88ecde {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:08.326303 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:08.520772 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] End _get_guest_xml xml=<domain type="qemu">
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:   <uuid>1674daae-17fb-49d5-9305-c9d53a88ecde</uuid>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:   <name>instance-00000034</name>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1532378913</nova:name>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:44:04</nova:creationTime>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:         <nova:user uuid="5885f1561f394d46bd4c1b48e7323c1e">tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member</nova:user>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:         <nova:project uuid="f7465b5668be4eb9b75c1ddc876e7eac">tempest-ServerBootFromVolumeStableRescueTest-96916496</nova:project>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:         <nova:port uuid="a3647067-1ff5-4354-84b6-98056ab51353">
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     <system>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <entry name="serial">1674daae-17fb-49d5-9305-c9d53a88ecde</entry>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <entry name="uuid">1674daae-17fb-49d5-9305-c9d53a88ecde</entry>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     </system>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:   <os>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:   </os>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:   <features>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:   </features>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:   <devices>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde/disk.config"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     </disk>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <alias name="ua-58ce508e-69cc-472e-8537-ec295ae01e9e"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-0"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <serial>58ce508e-69cc-472e-8537-ec295ae01e9e</serial>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     </disk>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:a5:fd:be"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <target dev="tapa3647067-1f"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     </interface>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde/console.log" append="off"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     </serial>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     <video>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     </video>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     </rng>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:   </devices>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]: </domain>
May 19 04:44:08.520772 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:44:08.523847 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Preparing to wait for external event network-vif-plugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:44:08.523847 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:08.523847 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:08.523847 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:08.523847 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1532378913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverbootfromvolumestablerescuetest-server-1532378913',id=52,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7465b5668be4eb9b75c1ddc876e7eac',ramdisk_id='',reservation_id='r-1h9f0mim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-96916496',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:43:58Z,user_data=None,user_id='5885f1561f394d46bd4c1b48e7323c1e',uuid=1674daae-17fb-49d5-9305-c9d53a88ecde,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3647067-1ff5-4354-84b6-98056ab51353", "address": "fa:16:3e:a5:fd:be", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3647067-1f", "ovs_interfaceid": "a3647067-1ff5-4354-84b6-98056ab51353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:44:08.523847 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converting VIF {"id": "a3647067-1ff5-4354-84b6-98056ab51353", "address": "fa:16:3e:a5:fd:be", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3647067-1f", "ovs_interfaceid": "a3647067-1ff5-4354-84b6-98056ab51353", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:44:08.523847 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:fd:be,bridge_name='br-int',has_traffic_filtering=True,id=a3647067-1ff5-4354-84b6-98056ab51353,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3647067-1f') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:44:08.525437 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:fd:be,bridge_name='br-int',has_traffic_filtering=True,id=a3647067-1ff5-4354-84b6-98056ab51353,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3647067-1f') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:44:08.525437 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:08.525437 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:08.525437 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:44:08.526472 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:08.526701 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16f6cf95-1d42-5747-a0e8-3bf4b24c3eec', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:08.527929 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:08.529360 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:08.531082 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:08.531300 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3647067-1f, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:08.531678 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3647067-1f, col_values=(('qos', UUID('4a4a2f30-4dce-4d4e-8419-2469ec403dc9')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:08.531834 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3647067-1f, col_values=(('external_ids', {'iface-id': 'a3647067-1ff5-4354-84b6-98056ab51353', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:fd:be', 'vm-uuid': '1674daae-17fb-49d5-9305-c9d53a88ecde'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:08.535076 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:08.539035 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:08.540906 np0000001025 nova-compute[97981]: INFO os_vif [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:fd:be,bridge_name='br-int',has_traffic_filtering=True,id=a3647067-1ff5-4354-84b6-98056ab51353,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3647067-1f')
May 19 04:44:08.565303 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:44:08.572516 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:44:08.581062 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:44:08.581062 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:44:08.591900 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:44:08.591900 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:08.604241 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:08.612663 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:08.627463 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:08.627463 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:08.627463 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:08.627463 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:08.627463 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:08.627463 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:08.627463 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:08.627463 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:08.627463 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:08.627463 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:08.627463 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:08.627463 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:08.627463 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:08.627933 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:08.627933 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:08.627933 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:08.627933 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:08.627933 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:08.627933 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:08.627933 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:08.627933 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:08.627933 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:08.627933 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:08.627933 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:08.627933 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:08.627933 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:08.635548 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:08.635548 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:08.635548 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:08.635548 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:08.635548 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:08.635548 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:08.635548 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:08.635548 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:08.635548 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:08.635548 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:08.635548 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:08.635548 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:08.635548 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:08.635854 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:08.635854 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:08.635854 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:08.635854 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:08.635854 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:08.635854 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:08.635854 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:08.635854 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:08.635854 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:08.635854 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:08.635854 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:08.635854 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:08.635854 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:08.690189 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec, portal: 192.168.40.100,3260]
May 19 04:44:08.690189 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec, portal: 192.168.40.100,3260] successful.
May 19 04:44:08.690189 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:08.703445 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:08.705656 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec, portal: 192.168.50.100,3260]
May 19 04:44:08.705656 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec, portal: 192.168.50.100,3260] successful.
May 19 04:44:08.705656 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:08.723723 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:08.732663 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:08.732663 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:08.732663 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:08.732663 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:08.732663 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:08.732663 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:08.732663 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:08.732663 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:08.732663 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:08.732663 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:08.732663 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:08.732663 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:08.732663 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:08.732663 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:08.732663 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:08.733187 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:08.733187 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:08.733187 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:08.733187 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:08.733187 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:08.733187 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:08.733187 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:08.733187 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:08.733187 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:08.733187 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:08.733187 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:08.733187 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:08.733187 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:08.733187 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:08.733187 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:08.733554 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.206s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:08.733554 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:44:08.734964 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] HCTL ('15', '-', '-', 0) found on session 113 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:44:08.735124 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:44:08.743936 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:08.743936 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:08.743936 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:08.743936 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:08.743936 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:08.743936 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:08.743936 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:08.743936 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:08.743936 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:08.743936 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:08.743936 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:08.743936 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:08.743936 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:08.743936 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:08.743936 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:08.744460 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:08.744460 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:08.744460 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:08.744460 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:08.744460 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:08.744460 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:08.744460 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:08.744460 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:08.744460 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:08.744460 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:08.744460 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:08.744460 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:08.744460 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:08.744460 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:08.744460 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:08.744460 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.215s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:08.744887 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:44:08.745626 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] HCTL ('16', '-', '-', 0) found on session 114 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:44:08.745862 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:44:08.756120 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Searching for a device in session 113 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:44:08.756517 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1f1a7080-9228-4c04-afc2-2907210007ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:44:08.764032 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Searching for a device in session 114 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:44:08.764032 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1f1a7080-9228-4c04-afc2-2907210007ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:44:09.531093 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:44:10.061655 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:44:10.061881 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:44:10.062074 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] No VIF found with MAC fa:16:3e:a5:fd:be, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:44:10.062706 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Using config drive
May 19 04:44:10.547452 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Found WWN 3300000002344c80c for multipath device dm-15 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:44:10.547881 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:10.547980 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] <== connect_volume: return (5419ms) {'type': 'block', 'scsi_wwn': '3300000002344c80c', 'path': '/dev/dm-15', 'multipath_id': '3300000002344c80c'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:44:10.548126 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002344c80c', 'path': '/dev/dm-15', 'multipath_id': '3300000002344c80c'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:44:10.569348 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:10.796625 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Creating config drive at /opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde/disk.config
May 19 04:44:10.799483 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw6zmsq8l {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:10.856616 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw6zmsq8l" returned: 0 in 0.057s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:11.053619 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-640764006',display_name='tempest-AttachVolumeTestJSON-server-640764006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumetestjson-server-640764006',id=45,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2tj8xzpEQbsFz0KUREQNWmpjZhzzIU4JsBBAhR6kXLneAex6Ogc6JmA+zSTxW3EHqpPyo/1HFfxr+XwLCwn6E7c5wL4jf0HNaUzjvIvGdUt6TsdBS845t/ZQ77wWohcw==',key_name='tempest-keypair-402968852',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:43:06Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='662c1a9b25e44aff8242f468232af7f3',ramdisk_id='',reservation_id='r-bmmqkbkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1215369469',owner_user_name='tempest-AttachVolumeTestJSON-1215369469-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:43:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f7f84eb55d44e89c2ed500098135e0',uuid=80436afa-9cd9-41cd-b589-629da01b6bfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:44:11.053839 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converting VIF {"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:44:11.054587 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:04:9d,bridge_name='br-int',has_traffic_filtering=True,id=15e6bc86-13bd-43b9-ad28-342f33dbdeb8,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6bc86-13') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:44:11.055263 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'pci_devices' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:11.265649 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:11.296031 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:11.300666 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:11.398145 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:11.398145 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:11.401617 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:11.459374 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ec1c2886-9639-447d-959b-be4a83f17108 req-45a10704-051c-4d6f-b046-ab744fbe223f service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received event network-vif-plugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:11.459622 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ec1c2886-9639-447d-959b-be4a83f17108 req-45a10704-051c-4d6f-b046-ab744fbe223f service nova] Acquiring lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:11.462532 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ec1c2886-9639-447d-959b-be4a83f17108 req-45a10704-051c-4d6f-b046-ab744fbe223f service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:11.462749 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ec1c2886-9639-447d-959b-be4a83f17108 req-45a10704-051c-4d6f-b046-ab744fbe223f service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:11.462916 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ec1c2886-9639-447d-959b-be4a83f17108 req-45a10704-051c-4d6f-b046-ab744fbe223f service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Processing event network-vif-plugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:44:11.557650 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Object Instance<80436afa-9cd9-41cd-b589-629da01b6bfe> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:44:11.559088 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] End _get_guest_xml xml=<domain type="qemu">
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:   <uuid>80436afa-9cd9-41cd-b589-629da01b6bfe</uuid>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:   <name>instance-0000002d</name>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <nova:name>tempest-AttachVolumeTestJSON-server-640764006</nova:name>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:44:04</nova:creationTime>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:           <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:           <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:         <nova:user uuid="96f7f84eb55d44e89c2ed500098135e0">tempest-AttachVolumeTestJSON-1215369469-project-member</nova:user>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:         <nova:project uuid="662c1a9b25e44aff8242f468232af7f3">tempest-AttachVolumeTestJSON-1215369469</nova:project>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:         <nova:port uuid="15e6bc86-13bd-43b9-ad28-342f33dbdeb8">
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     <system>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <entry name="serial">80436afa-9cd9-41cd-b589-629da01b6bfe</entry>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <entry name="uuid">80436afa-9cd9-41cd-b589-629da01b6bfe</entry>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     </system>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:   <os>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:   </os>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:   <features>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:   </features>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:   <devices>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     </disk>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk.config"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     </disk>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <alias name="ua-1f1a7080-9228-4c04-afc2-2907210007ec"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-15"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <target dev="vdb" bus="virtio"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <serial>1f1a7080-9228-4c04-afc2-2907210007ec</serial>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     </disk>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:08:04:9d"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <target dev="tap15e6bc86-13"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     </interface>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/console.log" append="off"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     </serial>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     <video>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     </video>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     </rng>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:   </devices>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]: </domain>
May 19 04:44:11.559088 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:44:11.561268 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:11.665580 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:11.666086 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:11.763616 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:11.764182 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] skipping disk /dev/dm-15 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:44:11.764935 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'trusted_certs' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:12.068457 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165852.0679667, 1674daae-17fb-49d5-9305-c9d53a88ecde => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:44:12.069013 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:44:12.069214 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] VM Started (Lifecycle Event)
May 19 04:44:12.072803 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:44:12.074672 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Instance spawned successfully.
May 19 04:44:12.074951 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:44:12.267493 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Object Instance<80436afa-9cd9-41cd-b589-629da01b6bfe> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:44:12.267941 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:12.386422 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.118s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:12.387045 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:44:12.387555 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:12.455029 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "e991af6e-6fc9-4286-a848-84682121bbb1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:12.455633 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "e991af6e-6fc9-4286-a848-84682121bbb1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:12.477665 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:12.478081 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Cannot resize image /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:44:12.478309 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'migration_context' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:12.572514 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:12.575751 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:44:12.582272 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:44:12.582454 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:44:12.582825 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:44:12.583118 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:44:12.583485 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:44:12.583797 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:44:12.961389 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lazy-loading 'flavor' on Instance uuid e991af6e-6fc9-4286-a848-84682121bbb1 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:12.980174 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Object Instance<80436afa-9cd9-41cd-b589-629da01b6bfe> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:44:12.981624 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-640764006',display_name='tempest-AttachVolumeTestJSON-server-640764006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumetestjson-server-640764006',id=45,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2tj8xzpEQbsFz0KUREQNWmpjZhzzIU4JsBBAhR6kXLneAex6Ogc6JmA+zSTxW3EHqpPyo/1HFfxr+XwLCwn6E7c5wL4jf0HNaUzjvIvGdUt6TsdBS845t/ZQ77wWohcw==',key_name='tempest-keypair-402968852',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:43:06Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='662c1a9b25e44aff8242f468232af7f3',ramdisk_id='',reservation_id='r-bmmqkbkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1215369469',owner_user_name='tempest-AttachVolumeTestJSON-1215369469-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:43:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f7f84eb55d44e89c2ed500098135e0',uuid=80436afa-9cd9-41cd-b589-629da01b6bfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:44:12.981931 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converting VIF {"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:44:12.982772 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:04:9d,bridge_name='br-int',has_traffic_filtering=True,id=15e6bc86-13bd-43b9-ad28-342f33dbdeb8,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6bc86-13') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:44:12.983069 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:04:9d,bridge_name='br-int',has_traffic_filtering=True,id=15e6bc86-13bd-43b9-ad28-342f33dbdeb8,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6bc86-13') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:44:12.983526 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:12.983833 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:12.984348 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:44:12.985916 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:12.985916 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51c35113-096a-5174-9894-21a7513c268b', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:12.987702 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:12.988755 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:12.990552 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:12.990755 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15e6bc86-13, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:12.991065 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15e6bc86-13, col_values=(('qos', UUID('8e3352f3-545a-4e72-aeef-54dc5e5c1061')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:12.991318 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15e6bc86-13, col_values=(('external_ids', {'iface-id': '15e6bc86-13bd-43b9-ad28-342f33dbdeb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:04:9d', 'vm-uuid': '80436afa-9cd9-41cd-b589-629da01b6bfe'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:12.993431 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:12.998252 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:12.999244 np0000001025 nova-compute[97981]: INFO os_vif [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:04:9d,bridge_name='br-int',has_traffic_filtering=True,id=15e6bc86-13bd-43b9-ad28-342f33dbdeb8,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6bc86-13')
May 19 04:44:13.040979 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.002049360999990313 future=<Future at 0x7218344596d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:13.044729 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Emitting event <LifecycleEvent: 1779165838.0388217, 80436afa-9cd9-41cd-b589-629da01b6bfe => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:44:13.044928 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:13.045088 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] VM Stopped (Lifecycle Event)
May 19 04:44:13.080044 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:44:13.080320 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165853.0801253, 1674daae-17fb-49d5-9305-c9d53a88ecde => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:44:13.080445 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] VM Paused (Lifecycle Event)
May 19 04:44:13.089910 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Took 8.87 seconds to spawn the instance on the hypervisor.
May 19 04:44:13.090056 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:13.328373 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:13.424920 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:13.452420 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:13.458774 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:13.544263 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-358726c8-e5b5-431c-ad0c-7194c0dd6f3c req-31ed936a-290a-454f-9809-708dc64c7f29 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received event network-vif-plugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:13.544263 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-358726c8-e5b5-431c-ad0c-7194c0dd6f3c req-31ed936a-290a-454f-9809-708dc64c7f29 service nova] Acquiring lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:13.544263 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-358726c8-e5b5-431c-ad0c-7194c0dd6f3c req-31ed936a-290a-454f-9809-708dc64c7f29 service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:13.544263 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-358726c8-e5b5-431c-ad0c-7194c0dd6f3c req-31ed936a-290a-454f-9809-708dc64c7f29 service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:13.544263 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-358726c8-e5b5-431c-ad0c-7194c0dd6f3c req-31ed936a-290a-454f-9809-708dc64c7f29 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] No waiting events found dispatching network-vif-plugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:13.544263 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-358726c8-e5b5-431c-ad0c-7194c0dd6f3c req-31ed936a-290a-454f-9809-708dc64c7f29 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received unexpected event network-vif-plugged-a3647067-1ff5-4354-84b6-98056ab51353 for instance with vm_state active and task_state None.
May 19 04:44:13.548129 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:13.564008 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:13.584466 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:13.589309 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165853.5887454, 1674daae-17fb-49d5-9305-c9d53a88ecde => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:44:13.589513 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] VM Resumed (Lifecycle Event)
May 19 04:44:13.601323 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Took 20.67 seconds to build instance.
May 19 04:44:13.627611 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1d95dec1-d65c-4ebf-97c6-8fd3eec911eb req-68e76d8a-d02a-4c13-8b09-6ea5eaa1755e service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received event network-vif-plugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:13.628490 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1d95dec1-d65c-4ebf-97c6-8fd3eec911eb req-68e76d8a-d02a-4c13-8b09-6ea5eaa1755e service nova] Acquiring lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:13.628765 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1d95dec1-d65c-4ebf-97c6-8fd3eec911eb req-68e76d8a-d02a-4c13-8b09-6ea5eaa1755e service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:13.628969 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1d95dec1-d65c-4ebf-97c6-8fd3eec911eb req-68e76d8a-d02a-4c13-8b09-6ea5eaa1755e service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:13.629180 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1d95dec1-d65c-4ebf-97c6-8fd3eec911eb req-68e76d8a-d02a-4c13-8b09-6ea5eaa1755e service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] No waiting events found dispatching network-vif-plugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:13.629369 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-1d95dec1-d65c-4ebf-97c6-8fd3eec911eb req-68e76d8a-d02a-4c13-8b09-6ea5eaa1755e service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received unexpected event network-vif-plugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 for instance with vm_state stopped and task_state powering-on.
May 19 04:44:13.810313 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:13.813524 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:13.816248 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:13.842236 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:13.844201 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:13.971817 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "e991af6e-6fc9-4286-a848-84682121bbb1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:14.092051 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:14.096131 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:44:14.104853 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.182s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:14.299780 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Instance event wait completed in 0 seconds for  {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:44:14.301796 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Instance rebooted successfully.
May 19 04:44:14.600090 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165854.5986414, 80436afa-9cd9-41cd-b589-629da01b6bfe => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:44:14.600617 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] VM Resumed (Lifecycle Event)
May 19 04:44:15.031557 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "e991af6e-6fc9-4286-a848-84682121bbb1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:15.031765 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "e991af6e-6fc9-4286-a848-84682121bbb1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:15.031953 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Attaching volume 09e64dca-4306-4e66-a256-39ac748120ec to /dev/vdb
May 19 04:44:15.086191 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:44:15.103485 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:44:15.104575 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:15.115947 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:44:15.134936 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:15.204842 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:44:15.204842 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:44:15.213498 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:44:15.215229 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fea1:aa43', 'fe80::fc16:3eff:fe1d:f0b2', 'fe80::4cb5:1dff:fe2d:31dc', 'fe80::fc16:3eff:fefb:c3a3', 'fe80::2c2c:57ff:feff:64a5', 'fe80::fc16:3eff:feb6:da78', 'fe80::bc20:d2ff:fef5:7278', 'fe80::fc16:3eff:fefa:d4f0', 'fe80::fc16:3eff:fe8e:f53b', 'fe80::fc16:3eff:fe1f:1450', 'fe80::fc16:3eff:febf:9241', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:feea:4891', 'fe80::fc16:3eff:feb0:9e6f', 'fe80::fc16:3eff:fec9:1d95', 'fe80::fc16:3eff:feec:9936', 'fe80::808a:12ff:fe91:c161', 'fe80::fc16:3eff:fea5:fdbe', 'fe80::fc16:3eff:fe08:49d', 'fe80::bc2a:1ff:fe94:f24f'] 
May 19 04:44:15.215360 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:44:15.215620 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:44:15.215891 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:44:15.216170 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Updating existing volume attachment record: ff4d44f1-c1aa-485d-bebc-9ede4c406cc3 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:44:15.401294 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Rescuing
May 19 04:44:15.401595 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "refresh_cache-1674daae-17fb-49d5-9305-c9d53a88ecde" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:44:15.401702 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquired lock "refresh_cache-1674daae-17fb-49d5-9305-c9d53a88ecde" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:44:15.401849 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:44:15.621020 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] During sync_power_state the instance has a pending task (powering-on). Skip.
May 19 04:44:15.621532 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165855.6211054, 80436afa-9cd9-41cd-b589-629da01b6bfe => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:44:15.621532 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] VM Started (Lifecycle Event)
May 19 04:44:15.688022 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0170941f-113a-4ff9-8a39-ffd170df566b req-86567008-9708-4202-9365-85995bf85a36 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received event network-vif-plugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:15.689166 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0170941f-113a-4ff9-8a39-ffd170df566b req-86567008-9708-4202-9365-85995bf85a36 service nova] Acquiring lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:15.689166 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0170941f-113a-4ff9-8a39-ffd170df566b req-86567008-9708-4202-9365-85995bf85a36 service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:15.689166 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0170941f-113a-4ff9-8a39-ffd170df566b req-86567008-9708-4202-9365-85995bf85a36 service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:15.689166 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0170941f-113a-4ff9-8a39-ffd170df566b req-86567008-9708-4202-9365-85995bf85a36 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] No waiting events found dispatching network-vif-plugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:15.689166 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-0170941f-113a-4ff9-8a39-ffd170df566b req-86567008-9708-4202-9365-85995bf85a36 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received unexpected event network-vif-plugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 for instance with vm_state stopped and task_state powering-on.
May 19 04:44:15.774582 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:44:15.774898 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec', 'iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '09e64dca-4306-4e66-a256-39ac748120ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:44:15.775055 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:15.775468 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:15.775707 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec', 'iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '09e64dca-4306-4e66-a256-39ac748120ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:44:15.787322 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:15.788065 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:15.788670 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:15.788908 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:44:15.789333 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:15.789572 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:44:15.802384 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:44:15.802384 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:15.806876 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:44:15.806876 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:15.814808 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec] added
May 19 04:44:15.814808 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:44:15.814808 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:15.814808 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:15.814808 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:15.814808 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:15.814808 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:15.815358 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:44:15.815417 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0265(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:44:15.815589 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:44:15.817980 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:44:15.818139 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:44:15.818268 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:44:15.818422 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No VIF found with MAC fa:16:3e:08:04:9d, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:44:15.818974 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-63543f03-afb4-4104-b25c-b23d4362a193 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:15.820074 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec] added
May 19 04:44:15.820074 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:44:15.820074 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:15.820074 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:15.820074 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:15.820074 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:15.820074 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:15.820074 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:44:15.820074 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:44:15.820318 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:44:15.868441 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-594d1c56-abd7-43e3-97de-05926fdbbaec tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "6f26313e-2659-4687-84da-96cf2da9a4e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:15.868605 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-594d1c56-abd7-43e3-97de-05926fdbbaec tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:15.903991 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:16.124346 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:16.129533 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:44:16.228665 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:16.370819 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-594d1c56-abd7-43e3-97de-05926fdbbaec tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Detaching volume 405ea65f-8d17-42c7-922a-dac27a17a488
May 19 04:44:16.391801 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:16.391874 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:16.414737 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Updating instance_info_cache with network_info: [{"id": "a3647067-1ff5-4354-84b6-98056ab51353", "address": "fa:16:3e:a5:fd:be", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3647067-1f", "ovs_interfaceid": "a3647067-1ff5-4354-84b6-98056ab51353", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:16.421685 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-594d1c56-abd7-43e3-97de-05926fdbbaec tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Attempting to driver detach volume 405ea65f-8d17-42c7-922a-dac27a17a488 from mountpoint /dev/vdb
May 19 04:44:16.431546 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-594d1c56-abd7-43e3-97de-05926fdbbaec tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Found disk vdb by alias ua-405ea65f-8d17-42c7-922a-dac27a17a488 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:44:16.433550 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-594d1c56-abd7-43e3-97de-05926fdbbaec tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Found disk vdb by alias ua-405ea65f-8d17-42c7-922a-dac27a17a488 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:44:16.433699 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-594d1c56-abd7-43e3-97de-05926fdbbaec tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Attempting to detach device vdb from instance 6f26313e-2659-4687-84da-96cf2da9a4e2 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:44:16.435226 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-594d1c56-abd7-43e3-97de-05926fdbbaec tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:44:16.435226 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:44:16.435226 np0000001025 nova-compute[97981]:   <alias name="ua-405ea65f-8d17-42c7-922a-dac27a17a488"/>
May 19 04:44:16.435226 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-11"/>
May 19 04:44:16.435226 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:44:16.435226 np0000001025 nova-compute[97981]:   <serial>405ea65f-8d17-42c7-922a-dac27a17a488</serial>
May 19 04:44:16.435226 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:44:16.435226 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 19 04:44:16.435226 np0000001025 nova-compute[97981]: </disk>
May 19 04:44:16.435226 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:44:16.444081 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-594d1c56-abd7-43e3-97de-05926fdbbaec tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully detached device vdb from instance 6f26313e-2659-4687-84da-96cf2da9a4e2 from the persistent domain config.
May 19 04:44:16.444231 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-594d1c56-abd7-43e3-97de-05926fdbbaec tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] (1/8): Attempting to detach device vdb with device alias ua-405ea65f-8d17-42c7-922a-dac27a17a488 from instance 6f26313e-2659-4687-84da-96cf2da9a4e2 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:44:16.444500 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-594d1c56-abd7-43e3-97de-05926fdbbaec tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:44:16.444500 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:44:16.444500 np0000001025 nova-compute[97981]:   <alias name="ua-405ea65f-8d17-42c7-922a-dac27a17a488"/>
May 19 04:44:16.444500 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-11"/>
May 19 04:44:16.444500 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:44:16.444500 np0000001025 nova-compute[97981]:   <serial>405ea65f-8d17-42c7-922a-dac27a17a488</serial>
May 19 04:44:16.444500 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:44:16.444500 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 19 04:44:16.444500 np0000001025 nova-compute[97981]: </disk>
May 19 04:44:16.444500 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:44:16.815992 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:44:16.820785 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:44:16.828841 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:44:16.828841 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:44:16.837316 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:44:16.837316 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:16.840808 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:16.852058 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:16.862656 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:16.862656 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:16.862656 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:16.862656 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:16.862656 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:16.862656 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:16.862656 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:16.862656 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:16.862656 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:16.862656 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:16.862656 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:16.862656 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:16.862656 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:16.862656 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:16.862656 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:16.863335 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:16.863335 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:16.863335 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:16.863335 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:16.863335 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:16.863335 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:16.863335 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:16.863335 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:16.863335 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:16.863335 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:16.863335 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:16.863335 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:16.863335 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:16.863335 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:16.863335 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:16.874487 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:16.874487 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:16.874487 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:16.874487 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:16.874487 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:16.874487 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:16.874487 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:16.874487 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:16.874487 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:16.874487 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:16.874487 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:16.874487 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:16.874487 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:16.874487 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:16.874487 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:16.874858 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:16.874858 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:16.874858 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:16.874858 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:16.874858 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:16.874858 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:16.874858 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:16.874858 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:16.874858 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:16.874858 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:16.874858 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:16.874858 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:16.874858 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:16.874858 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:16.874858 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:16.896357 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lazy-loading 'flavor' on Instance uuid 035dd3e2-1951-4cb3-8cda-691019c0c9cb {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:16.917748 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Releasing lock "refresh_cache-1674daae-17fb-49d5-9305-c9d53a88ecde" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:44:16.936890 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec, portal: 192.168.40.100,3260]
May 19 04:44:16.936890 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec, portal: 192.168.40.100,3260] successful.
May 19 04:44:16.936890 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:16.942686 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec, portal: 192.168.50.100,3260]
May 19 04:44:16.942686 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec, portal: 192.168.50.100,3260] successful.
May 19 04:44:16.942686 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:16.952407 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:16.962131 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:16.962462 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165856.9622416, 6f26313e-2659-4687-84da-96cf2da9a4e2 => ua-405ea65f-8d17-42c7-922a-dac27a17a488> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:44:16.963579 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-594d1c56-abd7-43e3-97de-05926fdbbaec tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-405ea65f-8d17-42c7-922a-dac27a17a488 for instance 6f26313e-2659-4687-84da-96cf2da9a4e2 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:44:16.966215 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-594d1c56-abd7-43e3-97de-05926fdbbaec tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully detached device vdb from instance 6f26313e-2659-4687-84da-96cf2da9a4e2 from the live domain config.
May 19 04:44:16.975999 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:16.975999 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:16.975999 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:16.975999 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:16.975999 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:16.975999 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:16.975999 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:16.975999 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:16.975999 np0000001025 nova-compute[97981]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:16.975999 np0000001025 nova-compute[97981]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:16.975999 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:16.975999 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:16.975999 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:16.975999 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:16.975999 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:16.975999 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:16.975999 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:16.977662 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:16.977662 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:16.977662 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:16.977662 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:16.977662 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:16.977662 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:16.977662 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:16.977662 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:16.977662 np0000001025 nova-compute[97981]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:16.977662 np0000001025 nova-compute[97981]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:16.977662 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:16.977662 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:16.977662 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:16.977662 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:16.977662 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:16.977662 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:16.977662 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:16.978589 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:16.978763 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:44:16.981443 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] HCTL ('20', '-', '-', 0) found on session 115 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:44:16.981921 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:44:16.984338 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:16.984338 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:16.984338 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:16.984338 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:16.984338 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:16.984338 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:16.984338 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:16.984338 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:16.984338 np0000001025 nova-compute[97981]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:16.984338 np0000001025 nova-compute[97981]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:16.984338 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:16.984338 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:16.984338 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:16.984338 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:16.984338 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:16.984338 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:16.984338 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:16.984824 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:16.984824 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:16.984824 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:16.984824 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:16.984824 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:16.984824 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:16.984824 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:16.984824 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:16.984824 np0000001025 nova-compute[97981]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:16.984824 np0000001025 nova-compute[97981]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:16.984824 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:16.984824 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:16.984824 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:16.984824 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:16.984824 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:16.984824 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:16.984824 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:16.984824 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.196s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:16.985307 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:44:16.986084 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] HCTL ('22', '-', '-', 0) found on session 116 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:44:16.986223 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:44:17.014470 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Searching for a device in session 116 and hctl ['22', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:44:17.014470 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Searching for a device in session 115 and hctl ['20', '*', '*', 0] yield: sdq {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:44:17.014470 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '09e64dca-4306-4e66-a256-39ac748120ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:44:17.514217 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-594d1c56-abd7-43e3-97de-05926fdbbaec tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Detected multiple connections on this host for volume: 405ea65f-8d17-42c7-922a-dac27a17a488, skipping target disconnect.
May 19 04:44:17.921588 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.529s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:17.992816 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:18.002617 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Searching for a device in session 116 and hctl ['22', '*', '*', 0] yield: sdo {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:44:18.002777 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '09e64dca-4306-4e66-a256-39ac748120ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:44:18.066016 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-594d1c56-abd7-43e3-97de-05926fdbbaec tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'flavor' on Instance uuid 6f26313e-2659-4687-84da-96cf2da9a4e2 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:18.340539 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:18.551872 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:18.555689 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:18.587728 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:18.704327 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:18.710766 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:18.785084 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d0d553b1-ad52-4705-b9d1-7f87324f2f43 req-08ac3dc0-4fe5-42ed-a0f8-ad2125fe9c01 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received event network-vif-unplugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:18.785371 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d0d553b1-ad52-4705-b9d1-7f87324f2f43 req-08ac3dc0-4fe5-42ed-a0f8-ad2125fe9c01 service nova] Acquiring lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:18.785551 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d0d553b1-ad52-4705-b9d1-7f87324f2f43 req-08ac3dc0-4fe5-42ed-a0f8-ad2125fe9c01 service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:18.785697 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d0d553b1-ad52-4705-b9d1-7f87324f2f43 req-08ac3dc0-4fe5-42ed-a0f8-ad2125fe9c01 service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:18.785804 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d0d553b1-ad52-4705-b9d1-7f87324f2f43 req-08ac3dc0-4fe5-42ed-a0f8-ad2125fe9c01 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] No waiting events found dispatching network-vif-unplugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:18.785957 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-d0d553b1-ad52-4705-b9d1-7f87324f2f43 req-08ac3dc0-4fe5-42ed-a0f8-ad2125fe9c01 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received unexpected event network-vif-unplugged-a3647067-1ff5-4354-84b6-98056ab51353 for instance with vm_state active and task_state rescuing.
May 19 04:44:18.810877 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Found WWN 3300000005b7885f0 for multipath device dm-16 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:44:18.811205 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:18.811396 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000005b7885f0', 'path': '/dev/dm-16', 'multipath_id': '3300000005b7885f0'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:44:18.811541 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005b7885f0', 'path': '/dev/dm-16', 'multipath_id': '3300000005b7885f0'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:44:18.815014 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lazy-loading 'flavor' on Instance uuid e991af6e-6fc9-4286-a848-84682121bbb1 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:18.870833 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999698470000112 future=<Future at 0x721834178c50 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:18.871350 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999160704000133 future=<Future at 0x721834178c50 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:18.871491 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999004950000199 future=<Future at 0x721834178c50 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:18.872743 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Instance destroyed successfully.
May 19 04:44:18.873026 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'numa_topology' on Instance uuid 1674daae-17fb-49d5-9305-c9d53a88ecde {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:18.963655 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:18.964104 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:18.964104 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Attaching volume 0aa14fdc-2ba2-4370-9ef6-b15062dc7121 to /dev/vdb
May 19 04:44:18.996811 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:44:19.006520 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:44:19.023894 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:19.064975 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:44:19.065637 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:44:19.073376 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:44:19.075119 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fea1:aa43', 'fe80::fc16:3eff:fe1d:f0b2', 'fe80::4cb5:1dff:fe2d:31dc', 'fe80::fc16:3eff:fefb:c3a3', 'fe80::2c2c:57ff:feff:64a5', 'fe80::fc16:3eff:feb6:da78', 'fe80::bc20:d2ff:fef5:7278', 'fe80::fc16:3eff:fefa:d4f0', 'fe80::fc16:3eff:fe8e:f53b', 'fe80::fc16:3eff:fe1f:1450', 'fe80::fc16:3eff:febf:9241', 'fe80::10c9:1fff:feec:a6bf', 'fe80::fc16:3eff:feea:4891', 'fe80::fc16:3eff:feb0:9e6f', 'fe80::fc16:3eff:fec9:1d95', 'fe80::fc16:3eff:feec:9936', 'fe80::808a:12ff:fe91:c161', 'fe80::fc16:3eff:fe08:49d', 'fe80::bc2a:1ff:fe94:f24f'] 
May 19 04:44:19.075253 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:44:19.075973 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-594d1c56-abd7-43e3-97de-05926fdbbaec tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.207s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:19.077175 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:44:19.077494 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:44:19.077835 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Updating existing volume attachment record: 35efaf94-bf37-4310-a16e-ba802c8ca9ed {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:44:19.221755 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "417861ee-dcf2-458b-8782-2ec22d2f5421" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:19.221960 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:19.320015 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Attempting to attach volume 09e64dca-4306-4e66-a256-39ac748120ec with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:44:19.322445 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:44:19.322445 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:44:19.322445 np0000001025 nova-compute[97981]:   <alias name="ua-09e64dca-4306-4e66-a256-39ac748120ec"/>
May 19 04:44:19.322445 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-16"/>
May 19 04:44:19.322445 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:44:19.322445 np0000001025 nova-compute[97981]:   <serial>09e64dca-4306-4e66-a256-39ac748120ec</serial>
May 19 04:44:19.322445 np0000001025 nova-compute[97981]: </disk>
May 19 04:44:19.322445 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:44:19.377672 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Attempting a stable device rescue
May 19 04:44:19.459784 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=97981) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 19 04:44:19.469758 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Instance directory exists: not creating {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 19 04:44:19.469873 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Creating image(s)
May 19 04:44:19.470572 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "/opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:19.470739 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "/opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:19.471212 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "/opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:19.471370 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1674daae-17fb-49d5-9305-c9d53a88ecde {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:19.628507 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:44:19.628836 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121', 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0aa14fdc-2ba2-4370-9ef6-b15062dc7121', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:44:19.629036 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:19.629399 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:19.629602 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121', 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0aa14fdc-2ba2-4370-9ef6-b15062dc7121', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:44:19.642009 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:19.642593 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:19.643018 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:19.643225 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:44:19.643552 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:19.643769 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:44:19.654603 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:44:19.654603 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:19.658882 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:44:19.658882 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:19.666569 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121] added
May 19 04:44:19.666569 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:44:19.666569 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:19.666569 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:19.666569 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:19.666569 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:19.666569 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:19.666723 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:44:19.666968 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0237(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:44:19.667180 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:44:19.671579 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121] added
May 19 04:44:19.671579 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:44:19.671579 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:19.671579 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:19.671579 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:19.671579 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:19.671579 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:19.671741 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:44:19.671940 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0281(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:44:19.672120 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:44:19.724384 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Detaching volume 405ea65f-8d17-42c7-922a-dac27a17a488
May 19 04:44:19.757915 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Attempting to driver detach volume 405ea65f-8d17-42c7-922a-dac27a17a488 from mountpoint /dev/vdb
May 19 04:44:19.762320 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Found disk vdb by alias ua-405ea65f-8d17-42c7-922a-dac27a17a488 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:44:19.763284 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Found disk vdb by alias ua-405ea65f-8d17-42c7-922a-dac27a17a488 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:44:19.763408 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Attempting to detach device vdb from instance 417861ee-dcf2-458b-8782-2ec22d2f5421 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:44:19.763749 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:44:19.763749 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:44:19.763749 np0000001025 nova-compute[97981]:   <alias name="ua-405ea65f-8d17-42c7-922a-dac27a17a488"/>
May 19 04:44:19.763749 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-11"/>
May 19 04:44:19.763749 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:44:19.763749 np0000001025 nova-compute[97981]:   <serial>405ea65f-8d17-42c7-922a-dac27a17a488</serial>
May 19 04:44:19.763749 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:44:19.763749 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 19 04:44:19.763749 np0000001025 nova-compute[97981]: </disk>
May 19 04:44:19.763749 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:44:19.771189 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully detached device vdb from instance 417861ee-dcf2-458b-8782-2ec22d2f5421 from the persistent domain config.
May 19 04:44:19.771386 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] (1/8): Attempting to detach device vdb with device alias ua-405ea65f-8d17-42c7-922a-dac27a17a488 from instance 417861ee-dcf2-458b-8782-2ec22d2f5421 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:44:19.771748 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:44:19.771748 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:44:19.771748 np0000001025 nova-compute[97981]:   <alias name="ua-405ea65f-8d17-42c7-922a-dac27a17a488"/>
May 19 04:44:19.771748 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-11"/>
May 19 04:44:19.771748 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:44:19.771748 np0000001025 nova-compute[97981]:   <serial>405ea65f-8d17-42c7-922a-dac27a17a488</serial>
May 19 04:44:19.771748 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:44:19.771748 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 19 04:44:19.771748 np0000001025 nova-compute[97981]: </disk>
May 19 04:44:19.771748 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:44:20.140439 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Object Instance<1674daae-17fb-49d5-9305-c9d53a88ecde> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:44:20.156521 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "cf2bac476d870bb23b58852e34c68f16c959f8c3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:20.157032 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "cf2bac476d870bb23b58852e34c68f16c959f8c3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:20.666995 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:44:20.671022 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:44:20.671385 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf2bac476d870bb23b58852e34c68f16c959f8c3.part --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:20.671944 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:44:20.686711 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:44:20.690223 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:44:20.690223 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:44:20.700364 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:44:20.700364 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:20.704732 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:20.712600 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:20.725435 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:20.725435 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:20.725435 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:20.725435 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:20.725435 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:20.725435 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:20.725435 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:20.725435 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:20.725435 np0000001025 nova-compute[97981]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:20.725435 np0000001025 nova-compute[97981]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:20.725435 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:20.725435 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:20.725435 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:20.725435 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:20.725435 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:20.725435 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:20.725435 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:20.725855 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:20.725855 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:20.725855 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:20.725855 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:20.725855 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:20.725855 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:20.725855 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:20.725855 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:20.725855 np0000001025 nova-compute[97981]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:20.725855 np0000001025 nova-compute[97981]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:20.725855 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:20.725855 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:20.725855 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:20.725855 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:20.725855 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:20.725855 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:20.725855 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:20.731850 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:20.731850 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:20.731850 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:20.731850 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:20.731850 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:20.731850 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:20.731850 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:20.731850 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:20.731850 np0000001025 nova-compute[97981]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:20.731850 np0000001025 nova-compute[97981]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:20.731850 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:20.731850 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:20.731850 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:20.731850 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:20.731850 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:20.731850 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:20.731850 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:20.732193 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:20.732193 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:20.732193 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:20.732193 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:20.732193 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:20.732193 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:20.732193 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:20.732193 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:20.732193 np0000001025 nova-compute[97981]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:20.732193 np0000001025 nova-compute[97981]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:20.732193 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:20.732193 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:20.732193 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:20.732193 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:20.732193 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:20.732193 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:20.732193 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:20.761420 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf2bac476d870bb23b58852e34c68f16c959f8c3.part --force-share --output=json" returned: 0 in 0.090s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:20.761812 np0000001025 nova-compute[97981]: DEBUG nova.virt.images [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] 2ed8afb6-d183-4f70-a1b5-e4adcdd13812 was qcow2, converting to raw {{(pid=97981) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 19 04:44:20.762683 np0000001025 nova-compute[97981]: DEBUG nova.privsep.utils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97981) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 19 04:44:20.763019 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cf2bac476d870bb23b58852e34c68f16c959f8c3.part /opt/stack/data/nova/instances/_base/cf2bac476d870bb23b58852e34c68f16c959f8c3.converted {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:20.784898 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121, portal: 192.168.40.100,3260]
May 19 04:44:20.784898 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121, portal: 192.168.40.100,3260] successful.
May 19 04:44:20.784898 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:20.790764 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121, portal: 192.168.50.100,3260]
May 19 04:44:20.790764 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121, portal: 192.168.50.100,3260] successful.
May 19 04:44:20.790764 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:20.802853 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:20.814803 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:20.825325 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:20.825325 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:44:20.827052 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] HCTL ('23', '-', '-', 0) found on session 117 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:44:20.827189 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Scanning host 23 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:44:20.844163 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Searching for a device in session 117 and hctl ['23', '*', '*', 0] yield: sdr {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:44:20.844313 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connected to sdr using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0aa14fdc-2ba2-4370-9ef6-b15062dc7121', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:20.845331 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:20.846148 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:20.846148 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:44:20.847364 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] HCTL ('24', '-', '-', 0) found on session 118 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:44:20.847538 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Scanning host 24 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:44:20.856481 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-32d28d10-eab6-4bf7-8323-605b29a14a3d req-f35a395a-0c61-4888-b4eb-c31f8abadfe0 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received event network-vif-unplugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:20.856481 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-32d28d10-eab6-4bf7-8323-605b29a14a3d req-f35a395a-0c61-4888-b4eb-c31f8abadfe0 service nova] Acquiring lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:20.856481 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-32d28d10-eab6-4bf7-8323-605b29a14a3d req-f35a395a-0c61-4888-b4eb-c31f8abadfe0 service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:20.856481 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-32d28d10-eab6-4bf7-8323-605b29a14a3d req-f35a395a-0c61-4888-b4eb-c31f8abadfe0 service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:20.856481 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-32d28d10-eab6-4bf7-8323-605b29a14a3d req-f35a395a-0c61-4888-b4eb-c31f8abadfe0 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] No waiting events found dispatching network-vif-unplugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:20.856481 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-32d28d10-eab6-4bf7-8323-605b29a14a3d req-f35a395a-0c61-4888-b4eb-c31f8abadfe0 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received unexpected event network-vif-unplugged-a3647067-1ff5-4354-84b6-98056ab51353 for instance with vm_state active and task_state rescuing.
May 19 04:44:20.859126 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cf2bac476d870bb23b58852e34c68f16c959f8c3.part /opt/stack/data/nova/instances/_base/cf2bac476d870bb23b58852e34c68f16c959f8c3.converted" returned: 0 in 0.096s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:20.863288 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Searching for a device in session 118 and hctl ['24', '*', '*', 0] yield: sds {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:44:20.865272 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Connected to sds using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0aa14fdc-2ba2-4370-9ef6-b15062dc7121', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:44:20.868229 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf2bac476d870bb23b58852e34c68f16c959f8c3.converted --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:20.977441 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf2bac476d870bb23b58852e34c68f16c959f8c3.converted --force-share --output=json" returned: 0 in 0.109s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:20.978085 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "cf2bac476d870bb23b58852e34c68f16c959f8c3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.821s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:20.978551 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:44:20.981349 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:44:20.982869 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "cf2bac476d870bb23b58852e34c68f16c959f8c3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:20.983252 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "cf2bac476d870bb23b58852e34c68f16c959f8c3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:20.983583 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:44:20.985857 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:44:20.986450 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf2bac476d870bb23b58852e34c68f16c959f8c3 --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:21.070406 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf2bac476d870bb23b58852e34c68f16c959f8c3 --force-share --output=json" returned: 0 in 0.084s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:21.070813 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cf2bac476d870bb23b58852e34c68f16c959f8c3,backing_fmt=raw /opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde/disk.rescue {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:21.122372 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cf2bac476d870bb23b58852e34c68f16c959f8c3,backing_fmt=raw /opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde/disk.rescue" returned: 0 in 0.051s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:21.122793 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "cf2bac476d870bb23b58852e34c68f16c959f8c3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.140s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:21.123120 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'migration_context' on Instance uuid 1674daae-17fb-49d5-9305-c9d53a88ecde {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:21.165365 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:44:21.165766 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:44:21.165766 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:44:21.165874 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] No VIF found with MAC fa:16:3e:1f:14:50, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:44:21.625679 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Object Instance<1674daae-17fb-49d5-9305-c9d53a88ecde> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:44:21.625976 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:44:21.626782 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Start _get_guest_xml network_info=[{"id": "a3647067-1ff5-4354-84b6-98056ab51353", "address": "fa:16:3e:a5:fd:be", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "vif_mac": "fa:16:3e:a5:fd:be"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3647067-1f", "ovs_interfaceid": "a3647067-1ff5-4354-84b6-98056ab51353", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2ed8afb6-d183-4f70-a1b5-e4adcdd13812', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '4dd15768-a21d-4184-82e0-487949a92e96', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58ce508e-69cc-472e-8537-ec295ae01e9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': '1674daae-17fb-49d5-9305-c9d53a88ecde', 'attached_at': '', 'detached_at': '', 'volume_id': '58ce508e-69cc-472e-8537-ec295ae01e9e', 'serial': '58ce508e-69cc-472e-8537-ec295ae01e9e'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:44:21.627007 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'resources' on Instance uuid 1674daae-17fb-49d5-9305-c9d53a88ecde {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:21.643679 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:44:22.129573 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Object Instance<1674daae-17fb-49d5-9305-c9d53a88ecde> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:44:22.132149 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:44:22.133593 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1532378913', uuid='1674daae-17fb-49d5-9305-c9d53a88ecde'), owner=OwnerMeta(userid='5885f1561f394d46bd4c1b48e7323c1e', username='tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member', projectid='f7465b5668be4eb9b75c1ddc876e7eac', projectname='tempest-ServerBootFromVolumeStableRescueTest-96916496'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a3647067-1ff5-4354-84b6-98056ab51353", "address": "fa:16:3e:a5:fd:be", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "vif_mac": "fa:16:3e:a5:fd:be"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3647067-1f", "ovs_interfaceid": "a3647067-1ff5-4354-84b6-98056ab51353", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165862.1332102) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:44:22.134803 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:44:22.135140 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:44:22.136411 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:44:22.136578 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:44:22.137656 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:44:22.137952 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:44:22.138083 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:44:22.138292 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:44:22.138447 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:44:22.138559 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:44:22.138687 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:44:22.138843 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:44:22.138970 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:44:22.139118 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:44:22.139315 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:44:22.139666 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:44:22.139819 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1674daae-17fb-49d5-9305-c9d53a88ecde {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:22.642708 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Object Instance<1674daae-17fb-49d5-9305-c9d53a88ecde> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:44:22.652885 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde/disk.config --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:22.666884 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Found WWN 330000000bf9da20d for multipath device dm-17 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:44:22.667904 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:22.668147 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000bf9da20d', 'path': '/dev/dm-17', 'multipath_id': '330000000bf9da20d'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:44:22.668368 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bf9da20d', 'path': '/dev/dm-17', 'multipath_id': '330000000bf9da20d'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:44:22.674903 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lazy-loading 'flavor' on Instance uuid 035dd3e2-1951-4cb3-8cda-691019c0c9cb {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:22.717124 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-85617805-9a49-4766-b9e5-90245654e96f tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "e991af6e-6fc9-4286-a848-84682121bbb1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.685s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:22.747015 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde/disk.config --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:22.747754 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "/opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:22.747754 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "/opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:22.749140 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "/opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:22.750182 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:44:22.750182 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58ce508e-69cc-472e-8537-ec295ae01e9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:44:22.750182 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:22.750537 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:22.750864 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58ce508e-69cc-472e-8537-ec295ae01e9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:44:22.763280 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:22.763921 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:22.764560 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:22.764893 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:44:22.765743 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:22.765975 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.startup = automatic
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.scan = manual
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:44:22.777503 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:44:22.777503 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.startup = automatic
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.scan = manual
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:44:22.783144 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:44:22.783144 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:22.790350 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:22.797058 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:22.816144 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:22.816144 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:22.816144 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:22.816144 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:22.816144 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:22.816144 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:22.816144 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:22.816144 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:22.816144 np0000001025 nova-compute[97981]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:22.816144 np0000001025 nova-compute[97981]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:22.816144 np0000001025 nova-compute[97981]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:22.816144 np0000001025 nova-compute[97981]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:22.816144 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:22.816144 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:22.816144 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:22.816144 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:22.816144 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:22.816144 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:22.816144 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:22.816635 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:22.816635 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:22.816635 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:22.816635 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:22.816635 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:22.816635 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:22.816635 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:22.816635 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:22.816635 np0000001025 nova-compute[97981]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:22.816635 np0000001025 nova-compute[97981]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:22.816635 np0000001025 nova-compute[97981]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:22.816635 np0000001025 nova-compute[97981]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:22.816635 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:22.816635 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:22.816635 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:22.816635 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:22.816635 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:22.816635 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:22.816635 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:22.816959 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.052s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:22.816959 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:44:22.818472 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] HCTL ('8', '0', '0', 0) found on session 112 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:44:22.818643 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:44:22.828544 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:22.828544 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:22.828544 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:22.828544 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:22.828544 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:22.828544 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:22.828544 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:22.828544 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:22.828544 np0000001025 nova-compute[97981]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:22.828544 np0000001025 nova-compute[97981]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:22.828544 np0000001025 nova-compute[97981]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:22.828544 np0000001025 nova-compute[97981]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:22.828544 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:22.828544 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:22.828544 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:22.828544 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:22.828544 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:22.828544 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:22.828544 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:22.829204 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:22.829204 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:22.829204 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:22.829204 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:22.829204 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:22.829204 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:22.829204 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:22.829204 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:22.829204 np0000001025 nova-compute[97981]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:22.829204 np0000001025 nova-compute[97981]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:22.829204 np0000001025 nova-compute[97981]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:22.829204 np0000001025 nova-compute[97981]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:22.829204 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:22.829204 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:22.829204 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:22.829204 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:22.829204 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:22.829204 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:22.829204 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:22.829204 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.064s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:22.829865 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:44:22.830001 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Searching for a device in session 112 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:44:22.830190 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58ce508e-69cc-472e-8537-ec295ae01e9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:44:22.831357 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] HCTL ('7', '0', '0', 0) found on session 111 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:44:22.831460 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:44:22.839725 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Searching for a device in session 111 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:44:22.839895 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '58ce508e-69cc-472e-8537-ec295ae01e9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:44:22.993429 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:23.179614 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165863.1791677, 417861ee-dcf2-458b-8782-2ec22d2f5421 => ua-405ea65f-8d17-42c7-922a-dac27a17a488> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:44:23.181708 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-405ea65f-8d17-42c7-922a-dac27a17a488 for instance 417861ee-dcf2-458b-8782-2ec22d2f5421 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:44:23.182657 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Attempting to attach volume 0aa14fdc-2ba2-4370-9ef6-b15062dc7121 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:44:23.185398 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:44:23.185398 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:44:23.185398 np0000001025 nova-compute[97981]:   <alias name="ua-0aa14fdc-2ba2-4370-9ef6-b15062dc7121"/>
May 19 04:44:23.185398 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-17"/>
May 19 04:44:23.185398 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:44:23.185398 np0000001025 nova-compute[97981]:   <serial>0aa14fdc-2ba2-4370-9ef6-b15062dc7121</serial>
May 19 04:44:23.185398 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:44:23.185398 np0000001025 nova-compute[97981]: </disk>
May 19 04:44:23.185398 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:44:23.186174 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully detached device vdb from instance 417861ee-dcf2-458b-8782-2ec22d2f5421 from the live domain config.
May 19 04:44:23.225386 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:44:23.225709 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '405ea65f-8d17-42c7-922a-dac27a17a488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:44:23.225858 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:23.343463 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:23.765608 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:44:24.787222 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Found WWN 330000000c76e17ba for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:44:24.787222 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.036s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:24.787222 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] <== connect_volume: return (2036ms) {'type': 'block', 'scsi_wwn': '330000000c76e17ba', 'path': '/dev/dm-0', 'multipath_id': '330000000c76e17ba'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:44:24.787222 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c76e17ba', 'path': '/dev/dm-0', 'multipath_id': '330000000c76e17ba'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:44:24.787222 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.561s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:24.787887 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '405ea65f-8d17-42c7-922a-dac27a17a488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:44:24.787887 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:44:24.830510 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:24.830510 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:24.830510 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:24.830510 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:24.830510 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:24.830510 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:24.830510 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:24.830510 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:24.830510 np0000001025 nova-compute[97981]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:24.830510 np0000001025 nova-compute[97981]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:24.830510 np0000001025 nova-compute[97981]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:24.830510 np0000001025 nova-compute[97981]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:24.830510 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:24.830510 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:24.830510 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:24.830510 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:24.830510 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:24.830510 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:24.830510 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:24.831140 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:24.831140 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:24.831140 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:24.831140 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:24.831140 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:24.831140 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:24.831140 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:24.831140 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:24.831140 np0000001025 nova-compute[97981]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:24.831140 np0000001025 nova-compute[97981]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:24.831140 np0000001025 nova-compute[97981]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:24.831140 np0000001025 nova-compute[97981]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:24.831140 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:24.831140 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:24.831140 np0000001025 nova-compute[97981]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:24.831140 np0000001025 nova-compute[97981]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488 (non-flash)
May 19 04:44:24.831140 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:24.831140 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:24.831140 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:24.831140 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', '108'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', '111'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', '112'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec', '116'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '98')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:44:24.831140 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '94')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:44:24.832846 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488', '95')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:44:24.833879 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218500f5300>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488'): ({'sdp'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488'): ({'sdn'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:44:24.834055 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Removing multipathed devices sdn, sdp {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:44:24.834292 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Flush multipath device 3300000009f63224e {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:44:24.841991 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:44:24.842127 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:44:24.842196 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:44:24.842298 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] No VIF found with MAC fa:16:3e:bf:92:41, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:44:24.870702 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:44:24.906609 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:44:24.966305 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Checking to see if SCSI volumes sdn, sdp have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:44:24.966472 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] SCSI volumes sdn, sdp have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:44:24.968056 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Checking to see if device paths {'sdn', 'sdp'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:44:24.978233 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Device paths {'sdn', 'sdp'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:44:24.978438 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:44:24.988616 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:25.024956 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 94, target: iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488, portal: 192.168.40.100,3260]
May 19 04:44:25.024956 np0000001025 nova-compute[97981]: Logout of [sid: 94, target: iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488, portal: 192.168.40.100,3260] successful.
May 19 04:44:25.024956 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:25.047956 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:25.060181 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:25.094998 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 95, target: iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488, portal: 192.168.50.100,3260]
May 19 04:44:25.094998 np0000001025 nova-compute[97981]: Logout of [sid: 95, target: iqn.2023-03.storpool.com:os--volume-405ea65f-8d17-42c7-922a-dac27a17a488, portal: 192.168.50.100,3260] successful.
May 19 04:44:25.094998 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:25.124070 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:25.124328 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:25.124440 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] <== disconnect_volume: return (1898ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:44:25.124553 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:44:25.296163 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1532378913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverbootfromvolumestablerescuetest-server-1532378913',id=52,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:44:13Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7465b5668be4eb9b75c1ddc876e7eac',ramdisk_id='',reservation_id='r-1h9f0mim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-96916496',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:44:13Z,user_data=None,user_id='5885f1561f394d46bd4c1b48e7323c1e',uuid=1674daae-17fb-49d5-9305-c9d53a88ecde,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3647067-1ff5-4354-84b6-98056ab51353", "address": "fa:16:3e:a5:fd:be", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "vif_mac": "fa:16:3e:a5:fd:be"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3647067-1f", "ovs_interfaceid": "a3647067-1ff5-4354-84b6-98056ab51353", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:44:25.296163 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converting VIF {"id": "a3647067-1ff5-4354-84b6-98056ab51353", "address": "fa:16:3e:a5:fd:be", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "vif_mac": "fa:16:3e:a5:fd:be"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3647067-1f", "ovs_interfaceid": "a3647067-1ff5-4354-84b6-98056ab51353", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:44:25.296163 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:fd:be,bridge_name='br-int',has_traffic_filtering=True,id=a3647067-1ff5-4354-84b6-98056ab51353,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3647067-1f') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:44:25.296163 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'pci_devices' on Instance uuid 1674daae-17fb-49d5-9305-c9d53a88ecde {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:25.306819 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "e991af6e-6fc9-4286-a848-84682121bbb1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:25.306964 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "e991af6e-6fc9-4286-a848-84682121bbb1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:25.668908 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'flavor' on Instance uuid 417861ee-dcf2-458b-8782-2ec22d2f5421 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:25.798380 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Object Instance<1674daae-17fb-49d5-9305-c9d53a88ecde> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:44:25.799556 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] End _get_guest_xml xml=<domain type="qemu">
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:   <uuid>1674daae-17fb-49d5-9305-c9d53a88ecde</uuid>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:   <name>instance-00000034</name>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1532378913</nova:name>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:44:22</nova:creationTime>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:           <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:           <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:         <nova:user uuid="5885f1561f394d46bd4c1b48e7323c1e">tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member</nova:user>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:         <nova:project uuid="f7465b5668be4eb9b75c1ddc876e7eac">tempest-ServerBootFromVolumeStableRescueTest-96916496</nova:project>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:         <nova:port uuid="a3647067-1ff5-4354-84b6-98056ab51353">
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     <system>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <entry name="serial">1674daae-17fb-49d5-9305-c9d53a88ecde</entry>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <entry name="uuid">1674daae-17fb-49d5-9305-c9d53a88ecde</entry>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     </system>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:   <os>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:   </os>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:   <features>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:   </features>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:   <devices>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde/disk.config"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     </disk>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <alias name="ua-58ce508e-69cc-472e-8537-ec295ae01e9e"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-0"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <serial>58ce508e-69cc-472e-8537-ec295ae01e9e</serial>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     </disk>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde/disk.rescue"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <target dev="vdb" bus="virtio"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <boot order="1"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     </disk>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:a5:fd:be"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <target dev="tapa3647067-1f"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     </interface>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde/console.log" append="off"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     </serial>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     <video>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     </video>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     </rng>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:   </devices>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]: </domain>
May 19 04:44:25.799556 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:44:25.807265 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Instance destroyed successfully.
May 19 04:44:25.809913 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Detaching volume 09e64dca-4306-4e66-a256-39ac748120ec
May 19 04:44:25.870700 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Attempting to driver detach volume 09e64dca-4306-4e66-a256-39ac748120ec from mountpoint /dev/vdb
May 19 04:44:25.875493 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Found disk vdb by alias ua-09e64dca-4306-4e66-a256-39ac748120ec {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:44:25.877006 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Found disk vdb by alias ua-09e64dca-4306-4e66-a256-39ac748120ec {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:44:25.878260 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Attempting to detach device vdb from instance e991af6e-6fc9-4286-a848-84682121bbb1 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:44:25.878736 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:44:25.878736 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:44:25.878736 np0000001025 nova-compute[97981]:   <alias name="ua-09e64dca-4306-4e66-a256-39ac748120ec"/>
May 19 04:44:25.878736 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-16"/>
May 19 04:44:25.878736 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:44:25.878736 np0000001025 nova-compute[97981]:   <serial>09e64dca-4306-4e66-a256-39ac748120ec</serial>
May 19 04:44:25.878736 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:44:25.878736 np0000001025 nova-compute[97981]: </disk>
May 19 04:44:25.878736 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:44:25.884800 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Successfully detached device vdb from instance e991af6e-6fc9-4286-a848-84682121bbb1 from the persistent domain config.
May 19 04:44:25.885083 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] (1/8): Attempting to detach device vdb with device alias ua-09e64dca-4306-4e66-a256-39ac748120ec from instance e991af6e-6fc9-4286-a848-84682121bbb1 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:44:25.885458 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:44:25.885458 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:44:25.885458 np0000001025 nova-compute[97981]:   <alias name="ua-09e64dca-4306-4e66-a256-39ac748120ec"/>
May 19 04:44:25.885458 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-16"/>
May 19 04:44:25.885458 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:44:25.885458 np0000001025 nova-compute[97981]:   <serial>09e64dca-4306-4e66-a256-39ac748120ec</serial>
May 19 04:44:25.885458 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:44:25.885458 np0000001025 nova-compute[97981]: </disk>
May 19 04:44:25.885458 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:44:26.412431 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cc3bdf54-59f5-4038-92d1-1a99ad84d583 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.449s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:26.481611 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165866.4812737, e991af6e-6fc9-4286-a848-84682121bbb1 => ua-09e64dca-4306-4e66-a256-39ac748120ec> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:44:26.482891 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-09e64dca-4306-4e66-a256-39ac748120ec for instance e991af6e-6fc9-4286-a848-84682121bbb1 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:44:26.485248 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Successfully detached device vdb from instance e991af6e-6fc9-4286-a848-84682121bbb1 from the live domain config.
May 19 04:44:26.486288 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:44:26.486636 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec', 'iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '09e64dca-4306-4e66-a256-39ac748120ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-16'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:44:26.486869 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:26.487263 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:26.487625 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec', 'iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '09e64dca-4306-4e66-a256-39ac748120ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-16'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:44:26.488054 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:44:26.518330 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:26.518330 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:26.518330 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:26.518330 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:26.518330 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:26.518330 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:26.518330 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:26.518330 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:26.518330 np0000001025 nova-compute[97981]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:26.518330 np0000001025 nova-compute[97981]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:26.518330 np0000001025 nova-compute[97981]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:26.518330 np0000001025 nova-compute[97981]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:26.518330 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:26.518330 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:26.518330 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:26.518330 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:26.518330 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:26.518847 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:26.518847 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:26.518847 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:26.518847 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:26.518847 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:26.518847 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:26.518847 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:26.518847 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:26.518847 np0000001025 nova-compute[97981]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:26.518847 np0000001025 nova-compute[97981]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec (non-flash)
May 19 04:44:26.518847 np0000001025 nova-compute[97981]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:26.518847 np0000001025 nova-compute[97981]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:26.518847 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:26.518847 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:26.518847 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:26.518847 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:26.518847 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:26.518847 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', '108'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', '111'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', '112'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec', '116'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '98')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:44:26.518847 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec', '115')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:44:26.520354 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec', '116')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:44:26.522066 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218500f7b00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec'): ({'sdq'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec'): ({'sdo'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:44:26.522352 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Removing multipathed devices sdq, sdo {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:44:26.522790 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Flush multipath device 3300000005b7885f0 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:44:26.553453 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:44:26.597602 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:44:26.637450 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Checking to see if SCSI volumes sdq, sdo have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:44:26.637631 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] SCSI volumes sdq, sdo have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:44:26.639183 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Checking to see if device paths {'sdq', 'sdo'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:44:26.652051 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Device paths {'sdq', 'sdo'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:44:26.652294 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:44:26.665768 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:26.674339 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-17f3052c-cdb9-4f69-9155-ec513580cc72 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.452s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:26.715299 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 115, target: iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec, portal: 192.168.40.100,3260]
May 19 04:44:26.715299 np0000001025 nova-compute[97981]: Logout of [sid: 115, target: iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec, portal: 192.168.40.100,3260] successful.
May 19 04:44:26.715299 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:26.737252 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:26.748173 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:26.787990 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 116, target: iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec, portal: 192.168.50.100,3260]
May 19 04:44:26.787990 np0000001025 nova-compute[97981]: Logout of [sid: 116, target: iqn.2023-03.storpool.com:os--volume-09e64dca-4306-4e66-a256-39ac748120ec, portal: 192.168.50.100,3260] successful.
May 19 04:44:26.787990 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:26.808273 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:26.808666 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:26.808666 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] <== disconnect_volume: return (321ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:44:26.808666 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:44:26.912519 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:26.912681 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:27.327612 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:44:27.327785 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:44:27.327862 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:44:27.327953 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] No VIF found with MAC fa:16:3e:a5:fd:be, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:44:27.328479 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Using config drive
May 19 04:44:27.357616 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lazy-loading 'flavor' on Instance uuid e991af6e-6fc9-4286-a848-84682121bbb1 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:27.415452 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Detaching volume 0aa14fdc-2ba2-4370-9ef6-b15062dc7121
May 19 04:44:27.470433 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Attempting to driver detach volume 0aa14fdc-2ba2-4370-9ef6-b15062dc7121 from mountpoint /dev/vdb
May 19 04:44:27.475582 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Found disk vdb by alias ua-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:44:27.477809 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Found disk vdb by alias ua-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:44:27.477809 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Attempting to detach device vdb from instance 035dd3e2-1951-4cb3-8cda-691019c0c9cb from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:44:27.477809 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:44:27.477809 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:44:27.477809 np0000001025 nova-compute[97981]:   <alias name="ua-0aa14fdc-2ba2-4370-9ef6-b15062dc7121"/>
May 19 04:44:27.477809 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-17"/>
May 19 04:44:27.477809 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:44:27.477809 np0000001025 nova-compute[97981]:   <serial>0aa14fdc-2ba2-4370-9ef6-b15062dc7121</serial>
May 19 04:44:27.477809 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:44:27.477809 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:44:27.477809 np0000001025 nova-compute[97981]: </disk>
May 19 04:44:27.477809 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:44:27.483443 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Successfully detached device vdb from instance 035dd3e2-1951-4cb3-8cda-691019c0c9cb from the persistent domain config.
May 19 04:44:27.483443 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] (1/8): Attempting to detach device vdb with device alias ua-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 from instance 035dd3e2-1951-4cb3-8cda-691019c0c9cb from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:44:27.483443 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:44:27.483443 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:44:27.483443 np0000001025 nova-compute[97981]:   <alias name="ua-0aa14fdc-2ba2-4370-9ef6-b15062dc7121"/>
May 19 04:44:27.483443 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-17"/>
May 19 04:44:27.483443 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:44:27.483443 np0000001025 nova-compute[97981]:   <serial>0aa14fdc-2ba2-4370-9ef6-b15062dc7121</serial>
May 19 04:44:27.483443 np0000001025 nova-compute[97981]:   <shareable/>
May 19 04:44:27.483443 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:44:27.483443 np0000001025 nova-compute[97981]: </disk>
May 19 04:44:27.483443 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:44:27.831287 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'ec2_ids' on Instance uuid 1674daae-17fb-49d5-9305-c9d53a88ecde {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:27.996989 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:27.998221 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165867.9978878, 035dd3e2-1951-4cb3-8cda-691019c0c9cb => ua-0aa14fdc-2ba2-4370-9ef6-b15062dc7121> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:44:27.999437 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 for instance 035dd3e2-1951-4cb3-8cda-691019c0c9cb {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:44:28.001403 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Successfully detached device vdb from instance 035dd3e2-1951-4cb3-8cda-691019c0c9cb from the live domain config.
May 19 04:44:28.033501 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:44:28.033888 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121', 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0aa14fdc-2ba2-4370-9ef6-b15062dc7121', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-17'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:44:28.034059 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:28.034450 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:28.034816 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121', 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0aa14fdc-2ba2-4370-9ef6-b15062dc7121', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-17'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:44:28.034982 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:44:28.064168 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:28.064168 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:28.064168 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:28.064168 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:28.064168 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:28.064168 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:28.064168 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:28.064168 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:28.064168 np0000001025 nova-compute[97981]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:28.064168 np0000001025 nova-compute[97981]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:28.064168 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:28.064168 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:28.064168 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:28.064168 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:28.064168 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:28.064602 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:28.064602 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:28.064602 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:28.064602 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:28.064602 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:28.064602 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:28.064602 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:28.064602 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:28.064602 np0000001025 nova-compute[97981]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:28.064602 np0000001025 nova-compute[97981]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121 (non-flash)
May 19 04:44:28.064602 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:28.064602 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:28.064602 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:28.064602 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:28.064602 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:28.064602 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', '108'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', '111'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', '112'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '98')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:44:28.065026 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121', '117')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:44:28.066225 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121', '118')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:44:28.070129 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721834354f40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121'): ({'sdr'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121'): ({'sds'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:44:28.070129 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Removing multipathed devices sdr, sds {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:44:28.070129 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Flush multipath device 330000000bf9da20d {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:44:28.097819 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Remove SCSI device /dev/sdr with /sys/block/sdr/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:44:28.150475 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Remove SCSI device /dev/sds with /sys/block/sds/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:44:28.191730 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Checking to see if SCSI volumes sdr, sds have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:44:28.191945 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] SCSI volumes sdr, sds have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:44:28.193948 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Checking to see if device paths {'sdr', 'sds'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:44:28.211819 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Device paths {'sdr', 'sds'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:44:28.211819 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:44:28.225573 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:28.264555 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 117, target: iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121, portal: 192.168.40.100,3260]
May 19 04:44:28.264555 np0000001025 nova-compute[97981]: Logout of [sid: 117, target: iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121, portal: 192.168.40.100,3260] successful.
May 19 04:44:28.264555 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:28.285093 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:28.299401 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d4e04735-676d-4347-ba97-bc97e864dbec req-33ff9e0b-59db-4996-a769-1e000804cf9c service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Received event network-changed-3ba06f13-fd8a-4116-a906-70f339d1b0ba {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:28.299444 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d4e04735-676d-4347-ba97-bc97e864dbec req-33ff9e0b-59db-4996-a769-1e000804cf9c service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Refreshing instance network info cache due to event network-changed-3ba06f13-fd8a-4116-a906-70f339d1b0ba. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:44:28.299615 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d4e04735-676d-4347-ba97-bc97e864dbec req-33ff9e0b-59db-4996-a769-1e000804cf9c service nova] Acquiring lock "refresh_cache-e991af6e-6fc9-4286-a848-84682121bbb1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:44:28.299717 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d4e04735-676d-4347-ba97-bc97e864dbec req-33ff9e0b-59db-4996-a769-1e000804cf9c service nova] Acquired lock "refresh_cache-e991af6e-6fc9-4286-a848-84682121bbb1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:44:28.299963 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d4e04735-676d-4347-ba97-bc97e864dbec req-33ff9e0b-59db-4996-a769-1e000804cf9c service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Refreshing network info cache for port 3ba06f13-fd8a-4116-a906-70f339d1b0ba {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:44:28.302891 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:28.335700 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Object Instance<1674daae-17fb-49d5-9305-c9d53a88ecde> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:44:28.335817 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'keypairs' on Instance uuid 1674daae-17fb-49d5-9305-c9d53a88ecde {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:28.343183 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 118, target: iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121, portal: 192.168.50.100,3260]
May 19 04:44:28.343183 np0000001025 nova-compute[97981]: Logout of [sid: 118, target: iqn.2023-03.storpool.com:os--volume-0aa14fdc-2ba2-4370-9ef6-b15062dc7121, portal: 192.168.50.100,3260] successful.
May 19 04:44:28.343183 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:28.346398 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:28.364174 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-382df039-473a-41bb-acae-c7d1d4b798c6 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "e991af6e-6fc9-4286-a848-84682121bbb1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.057s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:28.365284 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:28.365625 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:28.365749 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] <== disconnect_volume: return (332ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:44:28.365863 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:44:28.802425 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-d4e04735-676d-4347-ba97-bc97e864dbec req-33ff9e0b-59db-4996-a769-1e000804cf9c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:28.838342 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Object Instance<1674daae-17fb-49d5-9305-c9d53a88ecde> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:44:28.840479 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:28.844429 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "e991af6e-6fc9-4286-a848-84682121bbb1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:28.844657 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "e991af6e-6fc9-4286-a848-84682121bbb1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:28.844918 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "e991af6e-6fc9-4286-a848-84682121bbb1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:28.849729 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "e991af6e-6fc9-4286-a848-84682121bbb1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:28.849952 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "e991af6e-6fc9-4286-a848-84682121bbb1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.004s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:28.855795 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Terminating instance
May 19 04:44:28.925950 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lazy-loading 'flavor' on Instance uuid 035dd3e2-1951-4cb3-8cda-691019c0c9cb {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:29.014885 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Creating config drive at /opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde/disk.config.rescue
May 19 04:44:29.021808 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1u0yt0y5 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:29.082624 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1u0yt0y5" returned: 0 in 0.060s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:29.140457 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-d4e04735-676d-4347-ba97-bc97e864dbec req-33ff9e0b-59db-4996-a769-1e000804cf9c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:29.284447 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d4e04735-676d-4347-ba97-bc97e864dbec req-33ff9e0b-59db-4996-a769-1e000804cf9c service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Updated VIF entry in instance network info cache for port 3ba06f13-fd8a-4116-a906-70f339d1b0ba. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:44:29.284978 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d4e04735-676d-4347-ba97-bc97e864dbec req-33ff9e0b-59db-4996-a769-1e000804cf9c service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Updating instance_info_cache with network_info: [{"id": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "address": "fa:16:3e:1f:14:50", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba06f13-fd", "ovs_interfaceid": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:29.361441 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:44:29.389026 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:29.393046 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:29.418663 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:29.525920 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:29.536334 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:29.551373 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:29.590450 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:29.684642 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:29.742870 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:29.750221 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:29.788899 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d4e04735-676d-4347-ba97-bc97e864dbec req-33ff9e0b-59db-4996-a769-1e000804cf9c service nova] Releasing lock "refresh_cache-e991af6e-6fc9-4286-a848-84682121bbb1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:44:29.833557 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999623430000156 future=<Future at 0x721834213590 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:29.838455 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Instance destroyed successfully.
May 19 04:44:29.838988 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lazy-loading 'resources' on Instance uuid e991af6e-6fc9-4286-a848-84682121bbb1 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:29.948414 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-729eb43b-7855-42f5-8672-91ac4583dbb8 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.036s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:30.135804 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:30.136008 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:30.343805 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:43:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1103585281',display_name='tempest-TestStampPattern-server-1103585281',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-teststamppattern-server-1103585281',id=47,image_ref='753d6474-0abb-4f63-968d-d1e9ee5fab88',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKU2n0VcX8xMH+sW7ZCTVd5WzR5Ckycn9oGpkVd3uX9291bcgn3KJ8WDVGgJl9FiOS6puDyqsoALPmLm1PDDqcos+J/7xzJXkaCOlPt64B9ufpXMvpZcYNFqFdKYfiUbJw==',key_name='tempest-TestStampPattern-1529897663',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:43:32Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39155484b40c4c4fb5906c33b2682b3d',ramdisk_id='',reservation_id='r-8nt6racw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0b156bbc-f85d-4739-bf88-bc609d4f8052',image_min_disk='1',image_min_ram='0',image_owner_id='39155484b40c4c4fb5906c33b2682b3d',image_owner_project_name='tempest-TestStampPattern-1526088943',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1526088943-project-member',image_user_id='a2bee156928644e1a450ae7c480d04d0',owner_project_name='tempest-TestStampPattern-1526088943',owner_user_name='tempest-TestStampPattern-1526088943-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:43:33Z,user_data=None,user_id='a2bee156928644e1a450ae7c480d04d0',uuid=e991af6e-6fc9-4286-a848-84682121bbb1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "address": "fa:16:3e:1f:14:50", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba06f13-fd", "ovs_interfaceid": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:44:30.344615 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Converting VIF {"id": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "address": "fa:16:3e:1f:14:50", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba06f13-fd", "ovs_interfaceid": "3ba06f13-fd8a-4116-a906-70f339d1b0ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:44:30.345317 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:14:50,bridge_name='br-int',has_traffic_filtering=True,id=3ba06f13-fd8a-4116-a906-70f339d1b0ba,network=Network(61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba06f13-fd') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:44:30.345526 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:14:50,bridge_name='br-int',has_traffic_filtering=True,id=3ba06f13-fd8a-4116-a906-70f339d1b0ba,network=Network(61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba06f13-fd') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:44:30.346685 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:30.346876 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ba06f13-fd, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:30.349497 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:30.352063 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:30.352063 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:30.352364 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:30.352364 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bf0e6d69-9db9-4eb4-ac0a-c7c0f83bc65b) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:30.352679 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:30.353532 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:30.353976 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:30.355939 np0000001025 nova-compute[97981]: INFO os_vif [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:14:50,bridge_name='br-int',has_traffic_filtering=True,id=3ba06f13-fd8a-4116-a906-70f339d1b0ba,network=Network(61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba06f13-fd')
May 19 04:44:30.356265 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Deleting instance files /opt/stack/data/nova/instances/e991af6e-6fc9-4286-a848-84682121bbb1_del
May 19 04:44:30.356920 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Deletion of /opt/stack/data/nova/instances/e991af6e-6fc9-4286-a848-84682121bbb1_del complete
May 19 04:44:30.361063 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Received event network-vif-unplugged-3ba06f13-fd8a-4116-a906-70f339d1b0ba {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:30.361239 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] Acquiring lock "e991af6e-6fc9-4286-a848-84682121bbb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:30.361845 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] Lock "e991af6e-6fc9-4286-a848-84682121bbb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:30.361983 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] Lock "e991af6e-6fc9-4286-a848-84682121bbb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:30.362097 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] No waiting events found dispatching network-vif-unplugged-3ba06f13-fd8a-4116-a906-70f339d1b0ba {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:30.365335 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Received event network-vif-unplugged-3ba06f13-fd8a-4116-a906-70f339d1b0ba for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:44:30.365335 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Received event network-vif-unplugged-3ba06f13-fd8a-4116-a906-70f339d1b0ba {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:30.365335 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] Acquiring lock "e991af6e-6fc9-4286-a848-84682121bbb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:30.365335 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] Lock "e991af6e-6fc9-4286-a848-84682121bbb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:30.365335 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] Lock "e991af6e-6fc9-4286-a848-84682121bbb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:30.365335 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] No waiting events found dispatching network-vif-unplugged-3ba06f13-fd8a-4116-a906-70f339d1b0ba {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:30.365335 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Received event network-vif-unplugged-3ba06f13-fd8a-4116-a906-70f339d1b0ba for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:44:30.365335 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received event network-vif-plugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:30.365335 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] Acquiring lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:30.365335 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:30.365335 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:30.365335 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] No waiting events found dispatching network-vif-plugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:30.365335 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received unexpected event network-vif-plugged-a3647067-1ff5-4354-84b6-98056ab51353 for instance with vm_state active and task_state rescuing.
May 19 04:44:30.365335 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received event network-vif-plugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:30.365335 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] Acquiring lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:30.366050 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:30.366050 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:30.366050 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] No waiting events found dispatching network-vif-plugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:30.366050 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-33d337f6-23e4-4ff2-ab0e-9ebe8ecaf36a req-639f5ff3-bdf3-43a1-9ccd-cc9b504d9ac9 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received unexpected event network-vif-plugged-a3647067-1ff5-4354-84b6-98056ab51353 for instance with vm_state active and task_state rescuing.
May 19 04:44:30.490435 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Removed pending STOPPED event for 1674daae-17fb-49d5-9305-c9d53a88ecde due to new event <LifecycleEvent: 1779165870.490038, 1674daae-17fb-49d5-9305-c9d53a88ecde => Resumed> {{(pid=97981) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 19 04:44:30.490596 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165870.490038, 1674daae-17fb-49d5-9305-c9d53a88ecde => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:44:30.493154 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] VM Resumed (Lifecycle Event)
May 19 04:44:30.495207 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cac346fd-1ea0-46c9-8182-664309d0b217 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:30.638786 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:44:30.865353 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Took 1.50 seconds to destroy the instance on the hypervisor.
May 19 04:44:30.865949 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:44:30.866162 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:44:30.866250 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:44:30.866449 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:30.930402 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:30.996205 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:30.997722 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:44:31.218501 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:31.218778 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:31.222035 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:44:31.222283 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Claim successful on node np0000001025
May 19 04:44:31.318021 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2c479870-6203-49f2-bfab-9841b08a3598 req-3e26eca0-5003-4815-9b74-e2303772bc34 service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Received event network-vif-deleted-3ba06f13-fd8a-4116-a906-70f339d1b0ba {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:31.318209 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-2c479870-6203-49f2-bfab-9841b08a3598 req-3e26eca0-5003-4815-9b74-e2303772bc34 service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Neutron deleted interface 3ba06f13-fd8a-4116-a906-70f339d1b0ba; detaching it from the instance and deleting it from the info cache
May 19 04:44:31.318773 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2c479870-6203-49f2-bfab-9841b08a3598 req-3e26eca0-5003-4815-9b74-e2303772bc34 service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:31.377979 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:31.378190 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:31.378391 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:31.378553 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:31.378711 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:31.380815 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Terminating instance
May 19 04:44:31.500315 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165871.4998853, 1674daae-17fb-49d5-9305-c9d53a88ecde => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:44:31.500559 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] VM Started (Lifecycle Event)
May 19 04:44:31.650028 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-fe635466-7af7-4a3c-8150-a5c77c59e91a tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Unrescuing
May 19 04:44:31.650228 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe635466-7af7-4a3c-8150-a5c77c59e91a tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "refresh_cache-1674daae-17fb-49d5-9305-c9d53a88ecde" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:44:31.650283 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe635466-7af7-4a3c-8150-a5c77c59e91a tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquired lock "refresh_cache-1674daae-17fb-49d5-9305-c9d53a88ecde" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:44:31.650380 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-fe635466-7af7-4a3c-8150-a5c77c59e91a tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:44:31.737759 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:31.822640 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2c479870-6203-49f2-bfab-9841b08a3598 req-3e26eca0-5003-4815-9b74-e2303772bc34 service nova] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Detach interface failed, port_id=3ba06f13-fd8a-4116-a906-70f339d1b0ba, reason: Instance e991af6e-6fc9-4286-a848-84682121bbb1 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:44:31.884179 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:44:31.902933 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:31.907297 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:31.924866 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:31.930738 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:31.952816 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:31.958565 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:32.003432 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:32.010270 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:44:32.152738 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-fe635466-7af7-4a3c-8150-a5c77c59e91a tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:32.208393 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Instance destroyed successfully.
May 19 04:44:32.210930 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lazy-loading 'resources' on Instance uuid 035dd3e2-1951-4cb3-8cda-691019c0c9cb {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:32.238812 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Took 1.37 seconds to deallocate network for instance.
May 19 04:44:32.445435 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d747bb48-b7e8-416a-a901-0e3c573b1df5 req-8b06a28d-c37f-4978-a807-4dd68f5f95f3 service nova] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Received event network-vif-unplugged-0e304a34-15bb-43c9-b664-3ceb8240b8ae {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:32.445435 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d747bb48-b7e8-416a-a901-0e3c573b1df5 req-8b06a28d-c37f-4978-a807-4dd68f5f95f3 service nova] Acquiring lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:32.445435 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d747bb48-b7e8-416a-a901-0e3c573b1df5 req-8b06a28d-c37f-4978-a807-4dd68f5f95f3 service nova] Lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:32.445435 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d747bb48-b7e8-416a-a901-0e3c573b1df5 req-8b06a28d-c37f-4978-a807-4dd68f5f95f3 service nova] Lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:32.445435 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d747bb48-b7e8-416a-a901-0e3c573b1df5 req-8b06a28d-c37f-4978-a807-4dd68f5f95f3 service nova] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] No waiting events found dispatching network-vif-unplugged-0e304a34-15bb-43c9-b664-3ceb8240b8ae {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:32.445435 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d747bb48-b7e8-416a-a901-0e3c573b1df5 req-8b06a28d-c37f-4978-a807-4dd68f5f95f3 service nova] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Received event network-vif-unplugged-0e304a34-15bb-43c9-b664-3ceb8240b8ae for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:44:32.445435 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d747bb48-b7e8-416a-a901-0e3c573b1df5 req-8b06a28d-c37f-4978-a807-4dd68f5f95f3 service nova] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Received event network-vif-unplugged-0e304a34-15bb-43c9-b664-3ceb8240b8ae {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:32.445435 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d747bb48-b7e8-416a-a901-0e3c573b1df5 req-8b06a28d-c37f-4978-a807-4dd68f5f95f3 service nova] Acquiring lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:32.445435 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d747bb48-b7e8-416a-a901-0e3c573b1df5 req-8b06a28d-c37f-4978-a807-4dd68f5f95f3 service nova] Lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:32.445435 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d747bb48-b7e8-416a-a901-0e3c573b1df5 req-8b06a28d-c37f-4978-a807-4dd68f5f95f3 service nova] Lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:32.445435 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d747bb48-b7e8-416a-a901-0e3c573b1df5 req-8b06a28d-c37f-4978-a807-4dd68f5f95f3 service nova] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] No waiting events found dispatching network-vif-unplugged-0e304a34-15bb-43c9-b664-3ceb8240b8ae {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:32.445435 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d747bb48-b7e8-416a-a901-0e3c573b1df5 req-8b06a28d-c37f-4978-a807-4dd68f5f95f3 service nova] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Received event network-vif-unplugged-0e304a34-15bb-43c9-b664-3ceb8240b8ae for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:44:32.501257 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-fe635466-7af7-4a3c-8150-a5c77c59e91a tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:32.511787 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 19 04:44:32.512091 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999858783000036 future=<Future at 0x721850737830 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:32.639527 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-fe635466-7af7-4a3c-8150-a5c77c59e91a tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Updating instance_info_cache with network_info: [{"id": "a3647067-1ff5-4354-84b6-98056ab51353", "address": "fa:16:3e:a5:fd:be", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3647067-1f", "ovs_interfaceid": "a3647067-1ff5-4354-84b6-98056ab51353", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:32.714323 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:43:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1964855574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumemultiattachtests-server-1964855574',id=48,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjFouPpPO7vShqGexlsyxCbcJupWN8W08CArgg9PiFIml458N7wqc5CZAN0wkqP6rLcVICsrsq+oDBM6In3A2goh8llqsdZqWD/jfCCd+sViF8rwXnvN3XA3rP4jvYotw==',key_name='tempest-keypair-899081243',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:43:36Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e0c7a19a41a44fba4c0fca71022a5a1',ramdisk_id='',reservation_id='r-boedkpxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1349332830',owner_user_name='tempest-VolumeMultiattachTests-1349332830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:43:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93a5d16bed8c474fa58e1982fa784db9',uuid=035dd3e2-1951-4cb3-8cda-691019c0c9cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e304a34-15bb-43c9-b664-3ceb8240b8ae", "address": "fa:16:3e:bf:92:41", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e304a34-15", "ovs_interfaceid": "0e304a34-15bb-43c9-b664-3ceb8240b8ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:44:32.714583 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Converting VIF {"id": "0e304a34-15bb-43c9-b664-3ceb8240b8ae", "address": "fa:16:3e:bf:92:41", "network": {"id": "c948b992-32a1-4652-a328-d2d326ea9148", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2101587095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e0c7a19a41a44fba4c0fca71022a5a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e304a34-15", "ovs_interfaceid": "0e304a34-15bb-43c9-b664-3ceb8240b8ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:44:32.715076 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:92:41,bridge_name='br-int',has_traffic_filtering=True,id=0e304a34-15bb-43c9-b664-3ceb8240b8ae,network=Network(c948b992-32a1-4652-a328-d2d326ea9148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e304a34-15') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:44:32.715367 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:92:41,bridge_name='br-int',has_traffic_filtering=True,id=0e304a34-15bb-43c9-b664-3ceb8240b8ae,network=Network(c948b992-32a1-4652-a328-d2d326ea9148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e304a34-15') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:44:32.716661 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:32.716913 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e304a34-15, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:32.717903 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:32.718717 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:32.719858 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:32.720120 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:32.720273 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5bec3b6-517c-466e-bcf9-f14a99ebf7c5) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:32.721689 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:32.721689 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:32.722039 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:32.723590 np0000001025 nova-compute[97981]: INFO os_vif [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:92:41,bridge_name='br-int',has_traffic_filtering=True,id=0e304a34-15bb-43c9-b664-3ceb8240b8ae,network=Network(c948b992-32a1-4652-a328-d2d326ea9148),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e304a34-15')
May 19 04:44:32.723791 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Deleting instance files /opt/stack/data/nova/instances/035dd3e2-1951-4cb3-8cda-691019c0c9cb_del
May 19 04:44:32.724481 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Deletion of /opt/stack/data/nova/instances/035dd3e2-1951-4cb3-8cda-691019c0c9cb_del complete
May 19 04:44:32.751610 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:33.092469 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:44:33.092901 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:44:33.144312 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe635466-7af7-4a3c-8150-a5c77c59e91a tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Releasing lock "refresh_cache-1674daae-17fb-49d5-9305-c9d53a88ecde" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:44:33.144777 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-fe635466-7af7-4a3c-8150-a5c77c59e91a tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'flavor' on Instance uuid 1674daae-17fb-49d5-9305-c9d53a88ecde {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:33.229409 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Took 1.34 seconds to destroy the instance on the hypervisor.
May 19 04:44:33.229908 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:44:33.230069 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:44:33.230166 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:44:33.230368 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:33.303656 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "9563147c-542a-4b2c-8944-8961cfb68132" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:33.303827 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "9563147c-542a-4b2c-8944-8961cfb68132" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:33.304011 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "9563147c-542a-4b2c-8944-8961cfb68132-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:33.304210 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "9563147c-542a-4b2c-8944-8961cfb68132-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:33.304258 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "9563147c-542a-4b2c-8944-8961cfb68132-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:33.308146 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Terminating instance
May 19 04:44:33.325826 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:33.347653 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:33.595434 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:44:33.670024 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:33.691665 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:33.794893 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:33.799885 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:33.813063 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:44:33.838670 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:33.842745 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:33.863078 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:33.870979 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0004299669999454636 future=<Future at 0x721834178c50 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:33.871132 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:33.871311 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=10.96184213000015 future=<Future at 0x721834213590 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:33.871411 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=10.96173016900002 future=<Future at 0x721834213590 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:33.973658 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:33.989779 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:33.990248 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999772441000005 future=<Future at 0x72183415eba0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:33.995341 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cf735c6c-9746-4b96-83e9-bb75babeac94 req-4bd93fcd-4d87-4492-a448-eaffa1dc4b72 service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Received event network-vif-unplugged-0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:33.995341 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cf735c6c-9746-4b96-83e9-bb75babeac94 req-4bd93fcd-4d87-4492-a448-eaffa1dc4b72 service nova] Acquiring lock "9563147c-542a-4b2c-8944-8961cfb68132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:33.995341 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cf735c6c-9746-4b96-83e9-bb75babeac94 req-4bd93fcd-4d87-4492-a448-eaffa1dc4b72 service nova] Lock "9563147c-542a-4b2c-8944-8961cfb68132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:33.995341 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cf735c6c-9746-4b96-83e9-bb75babeac94 req-4bd93fcd-4d87-4492-a448-eaffa1dc4b72 service nova] Lock "9563147c-542a-4b2c-8944-8961cfb68132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:33.995341 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cf735c6c-9746-4b96-83e9-bb75babeac94 req-4bd93fcd-4d87-4492-a448-eaffa1dc4b72 service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] No waiting events found dispatching network-vif-unplugged-0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:33.995341 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cf735c6c-9746-4b96-83e9-bb75babeac94 req-4bd93fcd-4d87-4492-a448-eaffa1dc4b72 service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Received event network-vif-unplugged-0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:44:33.998245 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Instance destroyed successfully.
May 19 04:44:33.998245 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-fe635466-7af7-4a3c-8150-a5c77c59e91a tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'numa_topology' on Instance uuid 1674daae-17fb-49d5-9305-c9d53a88ecde {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:34.103364 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.884s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:34.103906 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.352s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:34.104097 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:44:34.139353 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999426257999858 future=<Future at 0x7218344abd40 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:34.143222 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Instance destroyed successfully.
May 19 04:44:34.143428 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'resources' on Instance uuid 9563147c-542a-4b2c-8944-8961cfb68132 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:34.228172 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:34.495606 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8692fb56-a7e6-400c-b660-4bfc7f46e192 req-0b014dd3-31b3-47fc-a042-0163227c00e7 service nova] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Received event network-vif-deleted-0e304a34-15bb-43c9-b664-3ceb8240b8ae {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:34.495986 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8692fb56-a7e6-400c-b660-4bfc7f46e192 req-0b014dd3-31b3-47fc-a042-0163227c00e7 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received event network-vif-unplugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:34.496151 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8692fb56-a7e6-400c-b660-4bfc7f46e192 req-0b014dd3-31b3-47fc-a042-0163227c00e7 service nova] Acquiring lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:34.496307 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8692fb56-a7e6-400c-b660-4bfc7f46e192 req-0b014dd3-31b3-47fc-a042-0163227c00e7 service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:34.496413 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8692fb56-a7e6-400c-b660-4bfc7f46e192 req-0b014dd3-31b3-47fc-a042-0163227c00e7 service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:34.496522 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8692fb56-a7e6-400c-b660-4bfc7f46e192 req-0b014dd3-31b3-47fc-a042-0163227c00e7 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] No waiting events found dispatching network-vif-unplugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:34.496594 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-8692fb56-a7e6-400c-b660-4bfc7f46e192 req-0b014dd3-31b3-47fc-a042-0163227c00e7 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received unexpected event network-vif-unplugged-a3647067-1ff5-4354-84b6-98056ab51353 for instance with vm_state rescued and task_state unrescuing.
May 19 04:44:34.496692 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8692fb56-a7e6-400c-b660-4bfc7f46e192 req-0b014dd3-31b3-47fc-a042-0163227c00e7 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received event network-vif-unplugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:34.496793 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8692fb56-a7e6-400c-b660-4bfc7f46e192 req-0b014dd3-31b3-47fc-a042-0163227c00e7 service nova] Acquiring lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:34.496925 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8692fb56-a7e6-400c-b660-4bfc7f46e192 req-0b014dd3-31b3-47fc-a042-0163227c00e7 service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:34.497011 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8692fb56-a7e6-400c-b660-4bfc7f46e192 req-0b014dd3-31b3-47fc-a042-0163227c00e7 service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:34.497101 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8692fb56-a7e6-400c-b660-4bfc7f46e192 req-0b014dd3-31b3-47fc-a042-0163227c00e7 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] No waiting events found dispatching network-vif-unplugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:34.497234 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-8692fb56-a7e6-400c-b660-4bfc7f46e192 req-0b014dd3-31b3-47fc-a042-0163227c00e7 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received unexpected event network-vif-unplugged-a3647067-1ff5-4354-84b6-98056ab51353 for instance with vm_state rescued and task_state unrescuing.
May 19 04:44:34.499652 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-fe635466-7af7-4a3c-8150-a5c77c59e91a tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Object Instance<1674daae-17fb-49d5-9305-c9d53a88ecde> lazy-loaded attributes: flavor,numa_topology {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:44:34.610181 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:44:34.610279 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:44:34.610641 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:34.611943 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:34.646137 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:43:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1988812583',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1988812583',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-image-snapshot-server-1988812583',id=50,image_ref='ba03f1aa-ba87-41bd-89cc-2741970fa40a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgr7SMT8BWfh6MJcinCdeGmtSN+Aa8qHvBbg4DMzICQ6cJnv5e5eKj6HniXhzej9h7h7emvyEHVN1O5QnKX5QLJ4iHdjfi/hMR+C1bikTkbvRoJxzl/2ciAUKvy2QmcEA==',key_name='tempest-keypair-900032320',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:43:54Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-gxns44g3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1071176852',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:43:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c46088fb3e74b819bb456461716a801',uuid=9563147c-542a-4b2c-8944-8961cfb68132,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4", "address": "fa:16:3e:c9:1d:95", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a95c435-6c", "ovs_interfaceid": "0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:44:34.646137 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4", "address": "fa:16:3e:c9:1d:95", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a95c435-6c", "ovs_interfaceid": "0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:44:34.646615 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:1d:95,bridge_name='br-int',has_traffic_filtering=True,id=0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a95c435-6c') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:44:34.646814 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:1d:95,bridge_name='br-int',has_traffic_filtering=True,id=0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a95c435-6c') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:44:34.647603 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:34.647761 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a95c435-6c, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:34.648767 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:34.649467 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:34.654999 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:34.655498 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:34.655608 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e29b20a3-bfbf-4968-8d30-65552791e842) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:34.656029 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:34.656437 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:34.661628 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:34.664136 np0000001025 nova-compute[97981]: INFO os_vif [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:1d:95,bridge_name='br-int',has_traffic_filtering=True,id=0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a95c435-6c')
May 19 04:44:34.668383 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:44:34.668685 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:44:34.668812 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:34.669184 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:34.669479 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:44:34.669719 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:44:34.702498 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:34.702498 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:34.702498 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:34.702498 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:34.702498 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:34.702498 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:34.702498 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:34.702498 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:34.702498 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:34.702498 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:34.702498 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:34.702498 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:34.702498 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:34.702815 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:34.702815 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:34.702815 np0000001025 nova-compute[97981]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:34.702815 np0000001025 nova-compute[97981]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 (non-flash)
May 19 04:44:34.702815 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:34.702815 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:34.702815 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:34.702815 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:34.702815 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:34.702815 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:34.702815 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:34.702815 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:34.702815 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:34.703043 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', '108'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', '111'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', '112'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '98')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:44:34.703161 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', '108')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:44:34.704457 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326', '107')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:44:34.705593 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721834279620>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326'): ({'sdd'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:44:34.705815 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Removing multipathed devices sdg, sdd {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:44:34.706091 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flush multipath device 330000000303a3c3c {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:44:34.715600 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa432d60cb324c6d87818107e05e0053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490151decdde445593a86a16976f6b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:44:34.731726 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Took 1.50 seconds to deallocate network for instance.
May 19 04:44:34.757582 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:44:34.809265 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:44:34.855781 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Checking to see if SCSI volumes sdg, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:44:34.856046 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] SCSI volumes sdg, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:44:34.860067 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Checking to see if device paths {'sdg', 'sdd'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:44:34.865587 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:44:34.865724 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:44:34.872630 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Device paths {'sdg', 'sdd'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:44:34.872862 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:44:34.885060 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:34.908243 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:34.926810 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 108, target: iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326, portal: 192.168.40.100,3260]
May 19 04:44:34.926810 np0000001025 nova-compute[97981]: Logout of [sid: 108, target: iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326, portal: 192.168.40.100,3260] successful.
May 19 04:44:34.926810 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:34.935180 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:34.936051 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:34.950095 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:34.962258 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:35.008593 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 107, target: iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326, portal: 192.168.50.100,3260]
May 19 04:44:35.008593 np0000001025 nova-compute[97981]: Logout of [sid: 107, target: iqn.2023-03.storpool.com:os--volume-1ad4b0bd-ec3b-444c-8754-f26cfb2c7326, portal: 192.168.50.100,3260] successful.
May 19 04:44:35.008593 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:35.020207 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:35.027336 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:35.027631 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:35.027795 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== disconnect_volume: return (359ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:44:35.028017 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:44:35.028258 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Deleting instance files /opt/stack/data/nova/instances/9563147c-542a-4b2c-8944-8961cfb68132_del
May 19 04:44:35.028697 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Deletion of /opt/stack/data/nova/instances/9563147c-542a-4b2c-8944-8961cfb68132_del complete
May 19 04:44:35.051088 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:35.051592 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:35.115333 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:44:35.237953 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:35.304880 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Successfully created port: 582f56fa-1ad0-4404-b010-20ae6d98ade1 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:44:35.369989 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:44:35.419231 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:35.419617 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:35.534340 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Took 1.72 seconds to destroy the instance on the hypervisor.
May 19 04:44:35.535480 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:44:35.535798 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:44:35.535950 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:44:35.536199 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:35.597728 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:35.621014 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:44:35.652237 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Removed pending STOPPED event for 1674daae-17fb-49d5-9305-c9d53a88ecde due to new event <LifecycleEvent: 1779165875.6517534, 1674daae-17fb-49d5-9305-c9d53a88ecde => Resumed> {{(pid=97981) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 19 04:44:35.652966 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165875.6517534, 1674daae-17fb-49d5-9305-c9d53a88ecde => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:44:35.652966 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] VM Resumed (Lifecycle Event)
May 19 04:44:35.653794 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-fe635466-7af7-4a3c-8150-a5c77c59e91a tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:35.786164 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Successfully updated port: 582f56fa-1ad0-4404-b010-20ae6d98ade1 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:44:35.877562 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.774s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:35.879364 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.640s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:35.922554 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lazy-loading 'flavor' on Instance uuid 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:35.953071 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Deleted allocations for instance e991af6e-6fc9-4286-a848-84682121bbb1
May 19 04:44:36.057819 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5fe7b523-c0ff-4d87-bbed-5fee20d7103b req-0cae3913-1518-439c-ae4a-00700122c552 service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Received event network-vif-unplugged-0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:36.058041 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5fe7b523-c0ff-4d87-bbed-5fee20d7103b req-0cae3913-1518-439c-ae4a-00700122c552 service nova] Acquiring lock "9563147c-542a-4b2c-8944-8961cfb68132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:36.058194 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5fe7b523-c0ff-4d87-bbed-5fee20d7103b req-0cae3913-1518-439c-ae4a-00700122c552 service nova] Lock "9563147c-542a-4b2c-8944-8961cfb68132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:36.058378 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5fe7b523-c0ff-4d87-bbed-5fee20d7103b req-0cae3913-1518-439c-ae4a-00700122c552 service nova] Lock "9563147c-542a-4b2c-8944-8961cfb68132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:36.058676 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5fe7b523-c0ff-4d87-bbed-5fee20d7103b req-0cae3913-1518-439c-ae4a-00700122c552 service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] No waiting events found dispatching network-vif-unplugged-0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:36.058676 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5fe7b523-c0ff-4d87-bbed-5fee20d7103b req-0cae3913-1518-439c-ae4a-00700122c552 service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Received event network-vif-unplugged-0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:44:36.058740 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5fe7b523-c0ff-4d87-bbed-5fee20d7103b req-0cae3913-1518-439c-ae4a-00700122c552 service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Received event network-vif-deleted-0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:36.058828 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-5fe7b523-c0ff-4d87-bbed-5fee20d7103b req-0cae3913-1518-439c-ae4a-00700122c552 service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Neutron deleted interface 0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4; detaching it from the instance and deleting it from the info cache
May 19 04:44:36.058964 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5fe7b523-c0ff-4d87-bbed-5fee20d7103b req-0cae3913-1518-439c-ae4a-00700122c552 service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:36.125778 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Booting with volume b188d67b-c930-4cf9-9595-3ad1a6018ea5 at /dev/vda
May 19 04:44:36.154779 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:36.157171 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:44:36.170403 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:44:36.182749 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:44:36.207597 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:36.264935 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:44:36.265227 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:44:36.277836 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:44:36.279690 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fea1:aa43', 'fe80::fc16:3eff:fe1d:f0b2', 'fe80::4cb5:1dff:fe2d:31dc', 'fe80::fc16:3eff:fefb:c3a3', 'fe80::2c2c:57ff:feff:64a5', 'fe80::fc16:3eff:feb6:da78', 'fe80::bc20:d2ff:fef5:7278', 'fe80::fc16:3eff:fefa:d4f0', 'fe80::fc16:3eff:fe8e:f53b', 'fe80::fc16:3eff:feea:4891', 'fe80::fc16:3eff:feb0:9e6f', 'fe80::fc16:3eff:feec:9936', 'fe80::808a:12ff:fe91:c161', 'fe80::fc16:3eff:fe08:49d', 'fe80::bc2a:1ff:fe94:f24f', 'fe80::fc16:3eff:fea5:fdbe'] 
May 19 04:44:36.279830 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:44:36.280219 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:44:36.283069 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:44:36.283353 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Updating existing volume attachment record: 38b350a1-3032-4954-9c39-4c6548801f8e {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:44:36.288506 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "refresh_cache-af8a1b96-6f1d-4148-b9b2-36662e1051a3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:44:36.288647 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquired lock "refresh_cache-af8a1b96-6f1d-4148-b9b2-36662e1051a3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:44:36.288808 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:44:36.465546 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:36.564230 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5fe7b523-c0ff-4d87-bbed-5fee20d7103b req-0cae3913-1518-439c-ae4a-00700122c552 service nova] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Detach interface failed, port_id=0a95c435-6cdb-4ef0-a2c8-6fcec18dfea4, reason: Instance 9563147c-542a-4b2c-8944-8961cfb68132 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:44:36.665989 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165876.6656144, 1674daae-17fb-49d5-9305-c9d53a88ecde => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:44:36.666250 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] VM Started (Lifecycle Event)
May 19 04:44:36.749149 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3b2f8bd4-d1b8-49b3-889a-994a89085b96 req-8ace1acb-1e71-448a-a874-4db0df84f58a service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received event network-vif-plugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:36.749351 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3b2f8bd4-d1b8-49b3-889a-994a89085b96 req-8ace1acb-1e71-448a-a874-4db0df84f58a service nova] Acquiring lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:36.749543 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3b2f8bd4-d1b8-49b3-889a-994a89085b96 req-8ace1acb-1e71-448a-a874-4db0df84f58a service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:36.749663 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3b2f8bd4-d1b8-49b3-889a-994a89085b96 req-8ace1acb-1e71-448a-a874-4db0df84f58a service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:36.749937 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3b2f8bd4-d1b8-49b3-889a-994a89085b96 req-8ace1acb-1e71-448a-a874-4db0df84f58a service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] No waiting events found dispatching network-vif-plugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:36.749937 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-3b2f8bd4-d1b8-49b3-889a-994a89085b96 req-8ace1acb-1e71-448a-a874-4db0df84f58a service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received unexpected event network-vif-plugged-a3647067-1ff5-4354-84b6-98056ab51353 for instance with vm_state active and task_state deleting.
May 19 04:44:36.750025 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3b2f8bd4-d1b8-49b3-889a-994a89085b96 req-8ace1acb-1e71-448a-a874-4db0df84f58a service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received event network-vif-plugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:36.753016 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3b2f8bd4-d1b8-49b3-889a-994a89085b96 req-8ace1acb-1e71-448a-a874-4db0df84f58a service nova] Acquiring lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:36.753260 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3b2f8bd4-d1b8-49b3-889a-994a89085b96 req-8ace1acb-1e71-448a-a874-4db0df84f58a service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:36.753573 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3b2f8bd4-d1b8-49b3-889a-994a89085b96 req-8ace1acb-1e71-448a-a874-4db0df84f58a service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:36.753573 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3b2f8bd4-d1b8-49b3-889a-994a89085b96 req-8ace1acb-1e71-448a-a874-4db0df84f58a service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] No waiting events found dispatching network-vif-plugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:36.753756 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-3b2f8bd4-d1b8-49b3-889a-994a89085b96 req-8ace1acb-1e71-448a-a874-4db0df84f58a service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received unexpected event network-vif-plugged-a3647067-1ff5-4354-84b6-98056ab51353 for instance with vm_state active and task_state deleting.
May 19 04:44:36.753756 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3b2f8bd4-d1b8-49b3-889a-994a89085b96 req-8ace1acb-1e71-448a-a874-4db0df84f58a service nova] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Received event network-changed-582f56fa-1ad0-4404-b010-20ae6d98ade1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:36.753821 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3b2f8bd4-d1b8-49b3-889a-994a89085b96 req-8ace1acb-1e71-448a-a874-4db0df84f58a service nova] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Refreshing instance network info cache due to event network-changed-582f56fa-1ad0-4404-b010-20ae6d98ade1. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:44:36.753977 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3b2f8bd4-d1b8-49b3-889a-994a89085b96 req-8ace1acb-1e71-448a-a874-4db0df84f58a service nova] Acquiring lock "refresh_cache-af8a1b96-6f1d-4148-b9b2-36662e1051a3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:44:36.755793 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:44:36.756028 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:44:36.874760 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:44:36.908982 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "1674daae-17fb-49d5-9305-c9d53a88ecde" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:36.909216 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:36.909441 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:36.909586 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:36.909706 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:36.912067 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Terminating instance
May 19 04:44:36.927513 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:36.963871 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-1d29fd7d-2341-45c2-ba53-f70b29b3bd09 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "e991af6e-6fc9-4286-a848-84682121bbb1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.119s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:36.968202 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Took 1.43 seconds to deallocate network for instance.
May 19 04:44:37.033243 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:37.169434 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:37.171797 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:44:37.175457 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Updating instance_info_cache with network_info: [{"id": "582f56fa-1ad0-4404-b010-20ae6d98ade1", "address": "fa:16:3e:0c:9e:56", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap582f56fa-1a", "ovs_interfaceid": "582f56fa-1ad0-4404-b010-20ae6d98ade1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:37.258579 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:44:37.415352 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:44:37.440721 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:37.444206 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:37.473791 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:37.534206 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Took 0.56 seconds to detach 1 volumes for instance.
May 19 04:44:37.534995 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Deleting volume: 1ad4b0bd-ec3b-444c-8754-f26cfb2c7326 {{(pid=97981) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 19 04:44:37.583127 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:37.584440 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:37.676809 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] During sync_power_state the instance has a pending task (deleting). Skip.
May 19 04:44:37.678172 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Releasing lock "refresh_cache-af8a1b96-6f1d-4148-b9b2-36662e1051a3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:44:37.678172 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Instance network_info: |[{"id": "582f56fa-1ad0-4404-b010-20ae6d98ade1", "address": "fa:16:3e:0c:9e:56", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap582f56fa-1a", "ovs_interfaceid": "582f56fa-1ad0-4404-b010-20ae6d98ade1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:44:37.678360 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3b2f8bd4-d1b8-49b3-889a-994a89085b96 req-8ace1acb-1e71-448a-a874-4db0df84f58a service nova] Acquired lock "refresh_cache-af8a1b96-6f1d-4148-b9b2-36662e1051a3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:44:37.678539 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3b2f8bd4-d1b8-49b3-889a-994a89085b96 req-8ace1acb-1e71-448a-a874-4db0df84f58a service nova] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Refreshing network info cache for port 582f56fa-1ad0-4404-b010-20ae6d98ade1 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:44:37.755509 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999667674000193 future=<Future at 0x7218501994c0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:37.764852 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.887s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:37.767431 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Instance destroyed successfully.
May 19 04:44:37.769457 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'resources' on Instance uuid 1674daae-17fb-49d5-9305-c9d53a88ecde {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:37.828767 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Deleted allocations for instance 035dd3e2-1951-4cb3-8cda-691019c0c9cb
May 19 04:44:38.010950 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:38.011174 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:38.011382 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Attaching volume 68cdfcc1-d3ae-43e8-b315-401ff0c24546 to /dev/vdb
May 19 04:44:38.061427 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:44:38.071851 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:44:38.083359 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:38.083545 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:38.089040 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:38.136757 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:44:38.137229 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:44:38.144919 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:44:38.146639 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fea1:aa43', 'fe80::fc16:3eff:fe1d:f0b2', 'fe80::4cb5:1dff:fe2d:31dc', 'fe80::fc16:3eff:fefb:c3a3', 'fe80::2c2c:57ff:feff:64a5', 'fe80::fc16:3eff:feb6:da78', 'fe80::bc20:d2ff:fef5:7278', 'fe80::fc16:3eff:fefa:d4f0', 'fe80::fc16:3eff:fe8e:f53b', 'fe80::fc16:3eff:feea:4891', 'fe80::fc16:3eff:feb0:9e6f', 'fe80::fc16:3eff:feec:9936', 'fe80::808a:12ff:fe91:c161', 'fe80::fc16:3eff:fe08:49d', 'fe80::bc2a:1ff:fe94:f24f'] 
May 19 04:44:38.146803 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:44:38.146941 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:44:38.147505 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:44:38.148352 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Updating existing volume attachment record: 1c2b2c33-c165-4fda-9885-534017d24e97 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:44:38.180980 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-3b2f8bd4-d1b8-49b3-889a-994a89085b96 req-8ace1acb-1e71-448a-a874-4db0df84f58a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:38.274571 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1532378913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverbootfromvolumestablerescuetest-server-1532378913',id=52,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:44:30Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7465b5668be4eb9b75c1ddc876e7eac',ramdisk_id='',reservation_id='r-1h9f0mim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-96916496',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:44:36Z,user_data=None,user_id='5885f1561f394d46bd4c1b48e7323c1e',uuid=1674daae-17fb-49d5-9305-c9d53a88ecde,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3647067-1ff5-4354-84b6-98056ab51353", "address": "fa:16:3e:a5:fd:be", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3647067-1f", "ovs_interfaceid": "a3647067-1ff5-4354-84b6-98056ab51353", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:44:38.274571 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converting VIF {"id": "a3647067-1ff5-4354-84b6-98056ab51353", "address": "fa:16:3e:a5:fd:be", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3647067-1f", "ovs_interfaceid": "a3647067-1ff5-4354-84b6-98056ab51353", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:44:38.275667 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:fd:be,bridge_name='br-int',has_traffic_filtering=True,id=a3647067-1ff5-4354-84b6-98056ab51353,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3647067-1f') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:44:38.275667 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:fd:be,bridge_name='br-int',has_traffic_filtering=True,id=a3647067-1ff5-4354-84b6-98056ab51353,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3647067-1f') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:44:38.279778 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:38.280677 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3647067-1f, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:38.286276 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:38.287102 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:38.288578 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:38.288735 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a4a2f30-4dce-4d4e-8419-2469ec403dc9) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:38.290949 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:38.294811 np0000001025 nova-compute[97981]: INFO os_vif [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:fd:be,bridge_name='br-int',has_traffic_filtering=True,id=a3647067-1ff5-4354-84b6-98056ab51353,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3647067-1f')
May 19 04:44:38.297444 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:44:38.297780 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58ce508e-69cc-472e-8537-ec295ae01e9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:44:38.297919 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:38.298366 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:38.298647 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58ce508e-69cc-472e-8537-ec295ae01e9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:44:38.298775 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:44:38.339191 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:38.339191 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:38.339191 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:38.339191 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:38.339191 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:38.339191 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:38.339191 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:38.339191 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:38.339191 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:38.339191 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:38.339191 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:38.339639 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:38.339639 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:38.339639 np0000001025 nova-compute[97981]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:38.339639 np0000001025 nova-compute[97981]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e (non-flash)
May 19 04:44:38.339639 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:38.339639 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:38.339639 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:38.339639 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:38.339639 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:38.339639 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:38.339639 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:38.339639 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', '111'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', '112'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '98')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:44:38.340117 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', '112')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:44:38.341049 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e', '111')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:44:38.342001 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185085f420>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e'): ({'sdb'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:44:38.342240 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Removing multipathed devices sdc, sdb {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:44:38.342459 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Flush multipath device 330000000c76e17ba {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:44:38.353777 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:38.397290 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:44:38.398671 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:44:38.399217 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Creating image(s)
May 19 04:44:38.399525 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:44:38.399663 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Ensure instance console log exists: /opt/stack/data/nova/instances/af8a1b96-6f1d-4148-b9b2-36662e1051a3/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:44:38.399920 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:38.400134 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:38.400311 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:38.400859 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Start _get_guest_xml network_info=[{"id": "582f56fa-1ad0-4404-b010-20ae6d98ade1", "address": "fa:16:3e:0c:9e:56", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap582f56fa-1a", "ovs_interfaceid": "582f56fa-1ad0-4404-b010-20ae6d98ade1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '38b350a1-3032-4954-9c39-4c6548801f8e', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5', 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b188d67b-c930-4cf9-9595-3ad1a6018ea5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'af8a1b96-6f1d-4148-b9b2-36662e1051a3', 'attached_at': '', 'detached_at': '', 'volume_id': 'b188d67b-c930-4cf9-9595-3ad1a6018ea5', 'serial': 'b188d67b-c930-4cf9-9595-3ad1a6018ea5', 'multiattach': True}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:44:38.402627 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:44:38.405946 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:44:38.407175 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-434248312', uuid='af8a1b96-6f1d-4148-b9b2-36662e1051a3'), owner=OwnerMeta(userid='aa432d60cb324c6d87818107e05e0053', username='tempest-AttachVolumeMultiAttachTest-1659172696-project-member', projectid='490151decdde445593a86a16976f6b34', projectname='tempest-AttachVolumeMultiAttachTest-1659172696'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "582f56fa-1ad0-4404-b010-20ae6d98ade1", "address": "fa:16:3e:0c:9e:56", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap582f56fa-1a", "ovs_interfaceid": "582f56fa-1ad0-4404-b010-20ae6d98ade1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165878.4067838) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:44:38.408150 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:44:38.408518 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:44:38.409370 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:44:38.409557 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:44:38.410575 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:44:38.410908 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:44:38.411097 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:44:38.411241 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:44:38.411383 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:44:38.411508 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:44:38.411602 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:44:38.411800 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:44:38.411907 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:44:38.412062 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:44:38.412210 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:44:38.412342 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:44:38.425984 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:44:38.426370 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5', 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b188d67b-c930-4cf9-9595-3ad1a6018ea5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:44:38.426483 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:38.452610 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:44:38.503794 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:44:38.503794 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:44:38.505010 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:44:38.518496 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:44:38.518681 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:44:38.531527 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:38.566954 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-3b2f8bd4-d1b8-49b3-889a-994a89085b96 req-8ace1acb-1e71-448a-a874-4db0df84f58a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:38.575377 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 112, target: iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e, portal: 192.168.40.100,3260]
May 19 04:44:38.575377 np0000001025 nova-compute[97981]: Logout of [sid: 112, target: iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e, portal: 192.168.40.100,3260] successful.
May 19 04:44:38.575377 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:38.593672 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:38.605014 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:38.642129 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 111, target: iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e, portal: 192.168.50.100,3260]
May 19 04:44:38.642129 np0000001025 nova-compute[97981]: Logout of [sid: 111, target: iqn.2023-03.storpool.com:os--volume-58ce508e-69cc-472e-8537-ec295ae01e9e, portal: 192.168.50.100,3260] successful.
May 19 04:44:38.642129 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:38.658660 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:38.658887 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:38.659024 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] <== disconnect_volume: return (361ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:44:38.659161 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:44:38.659733 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.233s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:38.659985 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5', 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b188d67b-c930-4cf9-9595-3ad1a6018ea5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:44:38.660371 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Deleting instance files /opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde_del
May 19 04:44:38.660885 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Deletion of /opt/stack/data/nova/instances/1674daae-17fb-49d5-9305-c9d53a88ecde_del complete
May 19 04:44:38.673456 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:38.674038 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:38.674547 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:38.675526 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:44:38.676100 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:38.676479 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:44:38.691717 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:44:38.691717 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:38.699567 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:44:38.699567 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:38.710473 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5] added
May 19 04:44:38.710473 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:44:38.710473 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:38.710473 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:38.710473 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:38.710473 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:38.710473 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:38.711595 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:44:38.711595 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0366(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:44:38.711595 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:44:38.712661 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5] added
May 19 04:44:38.712661 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:44:38.712661 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:38.712661 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:38.712661 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:38.712661 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:38.712661 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:38.712841 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:44:38.713540 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0366(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:44:38.713540 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:44:38.739528 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3b2f8bd4-d1b8-49b3-889a-994a89085b96 req-8ace1acb-1e71-448a-a874-4db0df84f58a service nova] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Updated VIF entry in instance network info cache for port 582f56fa-1ad0-4404-b010-20ae6d98ade1. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:44:38.739810 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3b2f8bd4-d1b8-49b3-889a-994a89085b96 req-8ace1acb-1e71-448a-a874-4db0df84f58a service nova] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Updating instance_info_cache with network_info: [{"id": "582f56fa-1ad0-4404-b010-20ae6d98ade1", "address": "fa:16:3e:0c:9e:56", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap582f56fa-1a", "ovs_interfaceid": "582f56fa-1ad0-4404-b010-20ae6d98ade1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:38.745935 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '73d8ac91-6ca4-4ec9-81ce-c708d25f68dd', 'attached_at': '', 'detached_at': '', 'volume_id': '68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'serial': '68cdfcc1-d3ae-43e8-b315-401ff0c24546'} {{(pid=97981) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 19 04:44:38.747736 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:44:38.747965 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:44:38.748194 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:38.803415 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8911a512-6f8e-496d-8a1e-f9cf4904ef3e req-719a3c4c-39b8-404c-8cac-37590eb0f7c9 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received event network-vif-unplugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:38.803823 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8911a512-6f8e-496d-8a1e-f9cf4904ef3e req-719a3c4c-39b8-404c-8cac-37590eb0f7c9 service nova] Acquiring lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:38.803999 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8911a512-6f8e-496d-8a1e-f9cf4904ef3e req-719a3c4c-39b8-404c-8cac-37590eb0f7c9 service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:38.804120 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8911a512-6f8e-496d-8a1e-f9cf4904ef3e req-719a3c4c-39b8-404c-8cac-37590eb0f7c9 service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:38.804287 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8911a512-6f8e-496d-8a1e-f9cf4904ef3e req-719a3c4c-39b8-404c-8cac-37590eb0f7c9 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] No waiting events found dispatching network-vif-unplugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:38.804389 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8911a512-6f8e-496d-8a1e-f9cf4904ef3e req-719a3c4c-39b8-404c-8cac-37590eb0f7c9 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received event network-vif-unplugged-a3647067-1ff5-4354-84b6-98056ab51353 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:44:38.804488 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8911a512-6f8e-496d-8a1e-f9cf4904ef3e req-719a3c4c-39b8-404c-8cac-37590eb0f7c9 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received event network-vif-unplugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:38.804598 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8911a512-6f8e-496d-8a1e-f9cf4904ef3e req-719a3c4c-39b8-404c-8cac-37590eb0f7c9 service nova] Acquiring lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:38.804717 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8911a512-6f8e-496d-8a1e-f9cf4904ef3e req-719a3c4c-39b8-404c-8cac-37590eb0f7c9 service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:38.804826 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8911a512-6f8e-496d-8a1e-f9cf4904ef3e req-719a3c4c-39b8-404c-8cac-37590eb0f7c9 service nova] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:38.804935 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8911a512-6f8e-496d-8a1e-f9cf4904ef3e req-719a3c4c-39b8-404c-8cac-37590eb0f7c9 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] No waiting events found dispatching network-vif-unplugged-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:38.805048 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8911a512-6f8e-496d-8a1e-f9cf4904ef3e req-719a3c4c-39b8-404c-8cac-37590eb0f7c9 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received event network-vif-unplugged-a3647067-1ff5-4354-84b6-98056ab51353 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:44:38.837363 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b38594a5-7bca-470d-b2a9-74efcc0c919b tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Lock "035dd3e2-1951-4cb3-8cda-691019c0c9cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.459s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:38.934290 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:44:38.934428 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:44:39.167134 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Took 1.75 seconds to destroy the instance on the hypervisor.
May 19 04:44:39.168170 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:44:39.168361 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:44:39.168445 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:44:39.168641 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:39.225625 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:39.242750 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3b2f8bd4-d1b8-49b3-889a-994a89085b96 req-8ace1acb-1e71-448a-a874-4db0df84f58a service nova] Releasing lock "refresh_cache-af8a1b96-6f1d-4148-b9b2-36662e1051a3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:44:39.437230 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:44:39.516752 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8ef9cc14-f581-41a0-8d0f-7991af39d4db req-86497b2d-772c-4406-b1cf-36a92ac3cb87 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Received event network-vif-deleted-a3647067-1ff5-4354-84b6-98056ab51353 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:39.517019 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-8ef9cc14-f581-41a0-8d0f-7991af39d4db req-86497b2d-772c-4406-b1cf-36a92ac3cb87 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Neutron deleted interface a3647067-1ff5-4354-84b6-98056ab51353; detaching it from the instance and deleting it from the info cache
May 19 04:44:39.517251 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-8ef9cc14-f581-41a0-8d0f-7991af39d4db req-86497b2d-772c-4406-b1cf-36a92ac3cb87 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:39.712100 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:44:39.713809 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:44:39.726054 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:44:39.726054 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:44:39.736414 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:44:39.736414 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:39.745559 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:39.749864 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:39.765493 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:39.765493 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:39.765493 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:39.765493 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:39.765493 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:39.765493 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:39.765493 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:39.765493 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:39.765493 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:39.765493 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:39.765493 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:39.765493 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:39.765493 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:39.765493 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:39.765493 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:39.765493 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:39.765493 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:39.765493 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:39.775845 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:39.775845 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:39.775845 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:39.775845 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:39.775845 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:39.775845 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:39.775845 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:39.775845 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:39.775845 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:39.776059 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:39.776059 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:39.776059 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:39.776059 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:39.776059 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:39.776059 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:39.776059 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:39.776059 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:39.776059 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:39.810705 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5, portal: 192.168.50.100,3260]
May 19 04:44:39.810705 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5, portal: 192.168.50.100,3260] successful.
May 19 04:44:39.810705 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:39.821902 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:39.828147 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5, portal: 192.168.40.100,3260]
May 19 04:44:39.828147 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5, portal: 192.168.40.100,3260] successful.
May 19 04:44:39.828147 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:39.839804 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:39.839804 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:39.839804 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:39.839804 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:39.839804 np0000001025 nova-compute[97981]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:39.839804 np0000001025 nova-compute[97981]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:39.839804 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:39.839804 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:39.839804 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:39.839804 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:39.839804 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:39.840050 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:39.840050 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:39.840050 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:39.840050 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:39.840050 np0000001025 nova-compute[97981]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:39.840050 np0000001025 nova-compute[97981]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:39.840050 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:39.840050 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:39.840050 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:39.840050 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:39.840050 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:39.840459 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:39.840459 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:44:39.841316 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:39.842387 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] HCTL ('7', '-', '-', 0) found on session 119 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:44:39.842495 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:44:39.861989 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:39.861989 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:39.861989 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:39.861989 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:39.861989 np0000001025 nova-compute[97981]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:39.861989 np0000001025 nova-compute[97981]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:39.861989 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:39.861989 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:39.861989 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:39.861989 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:39.861989 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:39.861989 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:39.861989 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:39.861989 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:39.861989 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:39.861989 np0000001025 nova-compute[97981]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:39.861989 np0000001025 nova-compute[97981]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:39.861989 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:39.861989 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:39.861989 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:39.861989 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:39.861989 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:39.861989 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:39.861989 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:44:39.861989 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] HCTL ('8', '-', '-', 0) found on session 120 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:44:39.862544 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:44:39.862916 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching for a device in session 119 and hctl ['7', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:44:39.878074 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching for a device in session 120 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:44:39.878074 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b188d67b-c930-4cf9-9595-3ad1a6018ea5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:44:39.934190 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:39.945450 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.862s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:40.007453 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Deleted allocations for instance 9563147c-542a-4b2c-8944-8961cfb68132
May 19 04:44:40.027028 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8ef9cc14-f581-41a0-8d0f-7991af39d4db req-86497b2d-772c-4406-b1cf-36a92ac3cb87 service nova] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Detach interface failed, port_id=a3647067-1ff5-4354-84b6-98056ab51353, reason: Instance 1674daae-17fb-49d5-9305-c9d53a88ecde could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:44:40.237264 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "0b156bbc-f85d-4739-bf88-bc609d4f8052" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:40.237669 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:40.237669 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "0b156bbc-f85d-4739-bf88-bc609d4f8052-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:40.237775 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:40.237890 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:40.239698 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Terminating instance
May 19 04:44:40.440027 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Took 1.27 seconds to deallocate network for instance.
May 19 04:44:40.742733 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:44:40.760859 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:40.763469 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:40.777342 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:40.785297 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:40.803587 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:40.809854 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:40.862124 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c36c2007-37df-45ae-8c7a-badaa9df3b02 req-cc91c828-3836-4729-b64a-a15d427d114e service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Received event network-changed-0b031766-34d0-453f-b350-2582e74d0600 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:40.862271 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c36c2007-37df-45ae-8c7a-badaa9df3b02 req-cc91c828-3836-4729-b64a-a15d427d114e service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Refreshing instance network info cache due to event network-changed-0b031766-34d0-453f-b350-2582e74d0600. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:44:40.862415 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c36c2007-37df-45ae-8c7a-badaa9df3b02 req-cc91c828-3836-4729-b64a-a15d427d114e service nova] Acquiring lock "refresh_cache-0b156bbc-f85d-4739-bf88-bc609d4f8052" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:44:40.862498 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c36c2007-37df-45ae-8c7a-badaa9df3b02 req-cc91c828-3836-4729-b64a-a15d427d114e service nova] Acquired lock "refresh_cache-0b156bbc-f85d-4739-bf88-bc609d4f8052" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:44:40.862599 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c36c2007-37df-45ae-8c7a-badaa9df3b02 req-cc91c828-3836-4729-b64a-a15d427d114e service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Refreshing network info cache for port 0b031766-34d0-453f-b350-2582e74d0600 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:44:40.864769 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Searching for a device in session 119 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:44:40.865078 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b188d67b-c930-4cf9-9595-3ad1a6018ea5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:44:40.996267 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Took 0.56 seconds to detach 1 volumes for instance.
May 19 04:44:40.998179 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Deleting volume: 58ce508e-69cc-472e-8537-ec295ae01e9e {{(pid=97981) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 19 04:44:41.026133 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baa68232-ac07-4c2d-a5e7-b954853869ae tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "9563147c-542a-4b2c-8944-8961cfb68132" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.722s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:41.063005 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:41.092053 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999595869000132 future=<Future at 0x721850735580 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:41.098191 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Instance destroyed successfully.
May 19 04:44:41.098604 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lazy-loading 'resources' on Instance uuid 0b156bbc-f85d-4739-bf88-bc609d4f8052 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:41.292217 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:41.365781 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-c36c2007-37df-45ae-8c7a-badaa9df3b02 req-cc91c828-3836-4729-b64a-a15d427d114e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:41.570628 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ae9e2dbb-007a-48f1-b04c-885fbf6d6721 req-9614362c-a04c-44a9-aae5-eaf71bc2dfe3 service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Received event network-vif-unplugged-0b031766-34d0-453f-b350-2582e74d0600 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:41.572467 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:41.572719 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ae9e2dbb-007a-48f1-b04c-885fbf6d6721 req-9614362c-a04c-44a9-aae5-eaf71bc2dfe3 service nova] Acquiring lock "0b156bbc-f85d-4739-bf88-bc609d4f8052-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:41.572911 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:41.574256 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ae9e2dbb-007a-48f1-b04c-885fbf6d6721 req-9614362c-a04c-44a9-aae5-eaf71bc2dfe3 service nova] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:41.574589 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ae9e2dbb-007a-48f1-b04c-885fbf6d6721 req-9614362c-a04c-44a9-aae5-eaf71bc2dfe3 service nova] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:41.574754 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ae9e2dbb-007a-48f1-b04c-885fbf6d6721 req-9614362c-a04c-44a9-aae5-eaf71bc2dfe3 service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] No waiting events found dispatching network-vif-unplugged-0b031766-34d0-453f-b350-2582e74d0600 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:41.575061 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ae9e2dbb-007a-48f1-b04c-885fbf6d6721 req-9614362c-a04c-44a9-aae5-eaf71bc2dfe3 service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Received event network-vif-unplugged-0b031766-34d0-453f-b350-2582e74d0600 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:44:41.575219 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ae9e2dbb-007a-48f1-b04c-885fbf6d6721 req-9614362c-a04c-44a9-aae5-eaf71bc2dfe3 service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Received event network-vif-unplugged-0b031766-34d0-453f-b350-2582e74d0600 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:41.575424 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ae9e2dbb-007a-48f1-b04c-885fbf6d6721 req-9614362c-a04c-44a9-aae5-eaf71bc2dfe3 service nova] Acquiring lock "0b156bbc-f85d-4739-bf88-bc609d4f8052-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:41.575565 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ae9e2dbb-007a-48f1-b04c-885fbf6d6721 req-9614362c-a04c-44a9-aae5-eaf71bc2dfe3 service nova] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:41.575724 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ae9e2dbb-007a-48f1-b04c-885fbf6d6721 req-9614362c-a04c-44a9-aae5-eaf71bc2dfe3 service nova] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:41.579539 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ae9e2dbb-007a-48f1-b04c-885fbf6d6721 req-9614362c-a04c-44a9-aae5-eaf71bc2dfe3 service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] No waiting events found dispatching network-vif-unplugged-0b031766-34d0-453f-b350-2582e74d0600 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:41.579689 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ae9e2dbb-007a-48f1-b04c-885fbf6d6721 req-9614362c-a04c-44a9-aae5-eaf71bc2dfe3 service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Received event network-vif-unplugged-0b031766-34d0-453f-b350-2582e74d0600 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:44:41.600924 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:41:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1597235226',display_name='tempest-TestStampPattern-server-1597235226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-teststamppattern-server-1597235226',id=42,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKU2n0VcX8xMH+sW7ZCTVd5WzR5Ckycn9oGpkVd3uX9291bcgn3KJ8WDVGgJl9FiOS6puDyqsoALPmLm1PDDqcos+J/7xzJXkaCOlPt64B9ufpXMvpZcYNFqFdKYfiUbJw==',key_name='tempest-TestStampPattern-1529897663',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:42:01Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39155484b40c4c4fb5906c33b2682b3d',ramdisk_id='',reservation_id='r-1ooanmzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1526088943',owner_user_name='tempest-TestStampPattern-1526088943-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:43:15Z,user_data=None,user_id='a2bee156928644e1a450ae7c480d04d0',uuid=0b156bbc-f85d-4739-bf88-bc609d4f8052,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b031766-34d0-453f-b350-2582e74d0600", "address": "fa:16:3e:1d:f0:b2", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b031766-34", "ovs_interfaceid": "0b031766-34d0-453f-b350-2582e74d0600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:44:41.601235 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Converting VIF {"id": "0b031766-34d0-453f-b350-2582e74d0600", "address": "fa:16:3e:1d:f0:b2", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b031766-34", "ovs_interfaceid": "0b031766-34d0-453f-b350-2582e74d0600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:44:41.601683 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:f0:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b031766-34d0-453f-b350-2582e74d0600,network=Network(61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b031766-34') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:44:41.601861 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:f0:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b031766-34d0-453f-b350-2582e74d0600,network=Network(61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b031766-34') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:44:41.602715 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:41.602929 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b031766-34, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:41.604512 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:41.605157 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:41.605838 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:41.606632 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:41.606741 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=02e0ec15-88ac-4a9b-9daf-2c702dff3785) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:41.607130 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:41.607545 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:41.608013 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:41.609506 np0000001025 nova-compute[97981]: INFO os_vif [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:f0:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b031766-34d0-453f-b350-2582e74d0600,network=Network(61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b031766-34')
May 19 04:44:41.609737 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Deleting instance files /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052_del
May 19 04:44:41.610474 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Deletion of /opt/stack/data/nova/instances/0b156bbc-f85d-4739-bf88-bc609d4f8052_del complete
May 19 04:44:41.693814 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Found WWN 330000000366f6401 for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:44:41.694090 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:41.694371 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] <== connect_volume: return (3267ms) {'type': 'block', 'scsi_wwn': '330000000366f6401', 'path': '/dev/dm-0', 'multipath_id': '330000000366f6401'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:44:41.694492 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000366f6401', 'path': '/dev/dm-0', 'multipath_id': '330000000366f6401'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:44:41.694708 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.947s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:41.694878 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:44:41.704930 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-c36c2007-37df-45ae-8c7a-badaa9df3b02 req-cc91c828-3836-4729-b64a-a15d427d114e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:41.712236 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:41.713096 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:41.713414 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:44:41.714506 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:41.715284 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:41.715469 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:44:41.726001 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:44:41.726001 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:41.732390 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:44:41.732390 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:41.740326 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546] added
May 19 04:44:41.740326 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:44:41.740326 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:41.740326 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:41.740326 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:41.740326 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:41.740326 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:41.740326 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:44:41.740326 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0267(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:44:41.740326 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:44:41.743373 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546] added
May 19 04:44:41.743373 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:44:41.743373 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:41.743373 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:41.743373 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:44:41.743373 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:44:41.743373 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:41.743530 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:44:41.743683 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0282(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:44:41.743822 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:44:41.849790 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c36c2007-37df-45ae-8c7a-badaa9df3b02 req-cc91c828-3836-4729-b64a-a15d427d114e service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Updated VIF entry in instance network info cache for port 0b031766-34d0-453f-b350-2582e74d0600. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:44:41.849969 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c36c2007-37df-45ae-8c7a-badaa9df3b02 req-cc91c828-3836-4729-b64a-a15d427d114e service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Updating instance_info_cache with network_info: [{"id": "0b031766-34d0-453f-b350-2582e74d0600", "address": "fa:16:3e:1d:f0:b2", "network": {"id": "61a1eba8-8ec2-4a6a-ac3e-ca98a80d6445", "bridge": "br-int", "label": "tempest-TestStampPattern-1341594450-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39155484b40c4c4fb5906c33b2682b3d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b031766-34", "ovs_interfaceid": "0b031766-34d0-453f-b350-2582e74d0600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:42.014248 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:44:42.014537 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:44:42.014947 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:44:42.014947 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:44:42.015024 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:44:42.015185 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:44:42.015345 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:44:42.015445 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:44:42.015599 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:44:42.116254 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Took 1.37 seconds to destroy the instance on the hypervisor.
May 19 04:44:42.117215 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:44:42.117568 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:44:42.120088 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:44:42.120376 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:42.183463 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:42.200442 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:44:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-434248312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumemultiattachtest-server-434248312',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-i7zdgobn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:44:36Z,user_data=None,user_id='aa432d60cb324c6d87818107e05e0053',uuid=af8a1b96-6f1d-4148-b9b2-36662e1051a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "582f56fa-1ad0-4404-b010-20ae6d98ade1", "address": "fa:16:3e:0c:9e:56", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap582f56fa-1a", "ovs_interfaceid": "582f56fa-1ad0-4404-b010-20ae6d98ade1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:44:42.200688 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "582f56fa-1ad0-4404-b010-20ae6d98ade1", "address": "fa:16:3e:0c:9e:56", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap582f56fa-1a", "ovs_interfaceid": "582f56fa-1ad0-4404-b010-20ae6d98ade1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:44:42.201540 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:9e:56,bridge_name='br-int',has_traffic_filtering=True,id=582f56fa-1ad0-4404-b010-20ae6d98ade1,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap582f56fa-1a') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:44:42.201715 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'pci_devices' on Instance uuid af8a1b96-6f1d-4148-b9b2-36662e1051a3 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:42.303290 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:44:42.303640 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:44:42.352294 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c36c2007-37df-45ae-8c7a-badaa9df3b02 req-cc91c828-3836-4729-b64a-a15d427d114e service nova] Releasing lock "refresh_cache-0b156bbc-f85d-4739-bf88-bc609d4f8052" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:44:42.521872 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:42.623357 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:42.623597 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:42.623842 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:42.624067 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:42.624245 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:42.627127 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Terminating instance
May 19 04:44:42.704643 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] End _get_guest_xml xml=<domain type="qemu">
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:   <uuid>af8a1b96-6f1d-4148-b9b2-36662e1051a3</uuid>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:   <name>instance-00000035</name>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-434248312</nova:name>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:44:38</nova:creationTime>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:         <nova:user uuid="aa432d60cb324c6d87818107e05e0053">tempest-AttachVolumeMultiAttachTest-1659172696-project-member</nova:user>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:         <nova:project uuid="490151decdde445593a86a16976f6b34">tempest-AttachVolumeMultiAttachTest-1659172696</nova:project>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:         <nova:port uuid="582f56fa-1ad0-4404-b010-20ae6d98ade1">
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     <system>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <entry name="serial">af8a1b96-6f1d-4148-b9b2-36662e1051a3</entry>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <entry name="uuid">af8a1b96-6f1d-4148-b9b2-36662e1051a3</entry>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     </system>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:   <os>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:   </os>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:   <features>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:   </features>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:   <devices>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/af8a1b96-6f1d-4148-b9b2-36662e1051a3/disk.config"/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     </disk>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <alias name="ua-b188d67b-c930-4cf9-9595-3ad1a6018ea5"/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-0"/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <serial>b188d67b-c930-4cf9-9595-3ad1a6018ea5</serial>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <shareable/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     </disk>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:0c:9e:56"/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <target dev="tap582f56fa-1a"/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     </interface>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/af8a1b96-6f1d-4148-b9b2-36662e1051a3/console.log" append="off"/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     </serial>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     <video>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     </video>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     </rng>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:   </devices>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]: </domain>
May 19 04:44:42.704643 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:44:42.706918 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Preparing to wait for external event network-vif-plugged-582f56fa-1ad0-4404-b010-20ae6d98ade1 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:44:42.706918 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:42.706918 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:42.706918 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:42.707177 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:44:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-434248312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumemultiattachtest-server-434248312',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-i7zdgobn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:44:36Z,user_data=None,user_id='aa432d60cb324c6d87818107e05e0053',uuid=af8a1b96-6f1d-4148-b9b2-36662e1051a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "582f56fa-1ad0-4404-b010-20ae6d98ade1", "address": "fa:16:3e:0c:9e:56", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap582f56fa-1a", "ovs_interfaceid": "582f56fa-1ad0-4404-b010-20ae6d98ade1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:44:42.707271 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "582f56fa-1ad0-4404-b010-20ae6d98ade1", "address": "fa:16:3e:0c:9e:56", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap582f56fa-1a", "ovs_interfaceid": "582f56fa-1ad0-4404-b010-20ae6d98ade1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:44:42.707991 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:9e:56,bridge_name='br-int',has_traffic_filtering=True,id=582f56fa-1ad0-4404-b010-20ae6d98ade1,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap582f56fa-1a') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:44:42.708282 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:9e:56,bridge_name='br-int',has_traffic_filtering=True,id=582f56fa-1ad0-4404-b010-20ae6d98ade1,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap582f56fa-1a') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:44:42.708578 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:42.708793 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:42.708974 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:44:42.711126 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:42.711126 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07a17f1a-3a19-5922-bd5f-e6df86293694', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:42.711126 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:42.711477 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:42.711991 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:42.713993 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:42.714186 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap582f56fa-1a, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:42.714586 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap582f56fa-1a, col_values=(('qos', UUID('13aa3a8f-f3a2-475f-830d-cb9359edc744')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:42.714735 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap582f56fa-1a, col_values=(('external_ids', {'iface-id': '582f56fa-1ad0-4404-b010-20ae6d98ade1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:9e:56', 'vm-uuid': 'af8a1b96-6f1d-4148-b9b2-36662e1051a3'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:42.715528 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:42.717353 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:42.721649 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:42.722796 np0000001025 nova-compute[97981]: INFO os_vif [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:9e:56,bridge_name='br-int',has_traffic_filtering=True,id=582f56fa-1ad0-4404-b010-20ae6d98ade1,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap582f56fa-1a')
May 19 04:44:42.740705 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:44:42.744299 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:44:42.755716 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:44:42.755716 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:44:42.762402 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:44:42.762402 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:42.770753 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:42.777320 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:42.792396 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:42.792396 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:42.792396 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:42.792396 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:42.792396 np0000001025 nova-compute[97981]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:42.792396 np0000001025 nova-compute[97981]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:42.792396 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:42.792396 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:42.792396 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:42.792396 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:42.792396 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:42.792716 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:42.792716 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:42.792716 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:42.792716 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:42.792716 np0000001025 nova-compute[97981]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:42.792716 np0000001025 nova-compute[97981]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:42.792716 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:42.792716 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:42.792716 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:42.792716 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:42.792716 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:42.797273 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:42.797273 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:42.797273 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:42.797273 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:42.797273 np0000001025 nova-compute[97981]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:42.797273 np0000001025 nova-compute[97981]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:42.797273 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:42.797273 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:42.797273 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:42.797273 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:42.797273 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:42.797677 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:42.797677 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:42.797677 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:42.797677 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:42.797677 np0000001025 nova-compute[97981]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:42.797677 np0000001025 nova-compute[97981]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:42.797677 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:42.797677 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:42.797677 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:42.797677 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:42.797677 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:42.805632 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:44:42.838550 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546, portal: 192.168.40.100,3260]
May 19 04:44:42.838550 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546, portal: 192.168.40.100,3260] successful.
May 19 04:44:42.838550 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:42.849887 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:42.854885 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546, portal: 192.168.50.100,3260]
May 19 04:44:42.854885 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546, portal: 192.168.50.100,3260] successful.
May 19 04:44:42.854885 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:42.867306 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:42.868704 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:42.868704 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:42.868704 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:42.868704 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:42.868704 np0000001025 nova-compute[97981]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:42.868704 np0000001025 nova-compute[97981]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:42.868704 np0000001025 nova-compute[97981]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546 (non-flash)
May 19 04:44:42.868704 np0000001025 nova-compute[97981]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546 (non-flash)
May 19 04:44:42.868704 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:42.868704 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:42.868704 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:42.868704 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:42.868704 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:42.868992 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:42.868992 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:42.868992 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:42.868992 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:42.868992 np0000001025 nova-compute[97981]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:42.868992 np0000001025 nova-compute[97981]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:42.868992 np0000001025 nova-compute[97981]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546 (non-flash)
May 19 04:44:42.868992 np0000001025 nova-compute[97981]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546 (non-flash)
May 19 04:44:42.868992 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:42.868992 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:42.868992 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:42.868992 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:42.868992 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:42.869224 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:42.869341 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:44:42.870739 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] HCTL ('9', '-', '-', 0) found on session 121 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:44:42.870847 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:44:42.886781 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Searching for a device in session 121 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:44:42.886781 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:44:42.892007 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:42.892007 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:42.892007 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:42.892007 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:42.892007 np0000001025 nova-compute[97981]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:42.892007 np0000001025 nova-compute[97981]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:42.892007 np0000001025 nova-compute[97981]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546 (non-flash)
May 19 04:44:42.892007 np0000001025 nova-compute[97981]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546 (non-flash)
May 19 04:44:42.892007 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:42.892007 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:42.892007 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:42.892007 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:42.892007 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:42.892390 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:42.892390 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:42.892390 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:42.892390 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:42.892390 np0000001025 nova-compute[97981]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:42.892390 np0000001025 nova-compute[97981]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:42.892390 np0000001025 nova-compute[97981]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546 (non-flash)
May 19 04:44:42.892390 np0000001025 nova-compute[97981]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546 (non-flash)
May 19 04:44:42.892390 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:42.892390 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:42.892390 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:42.892390 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:42.892390 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:42.892390 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:42.892797 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:44:42.893514 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] HCTL ('12', '-', '-', 0) found on session 122 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:44:42.893617 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:44:42.894228 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:42.907413 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Searching for a device in session 122 and hctl ['12', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:44:42.920395 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-dc41fcfb-d200-469e-8397-e087dc1d6faa req-4ed76dfc-d7a6-4061-a848-0049966aa721 service nova] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Received event network-vif-deleted-0b031766-34d0-453f-b350-2582e74d0600 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:43.131024 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:44:43.154896 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:43.157549 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:43.173844 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:43.179666 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:43.197015 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:43.206694 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:43.311867 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.739s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:43.313603 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.790s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:43.314027 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:43.314224 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:44:43.360935 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:43.381935 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Deleted allocations for instance 1674daae-17fb-49d5-9305-c9d53a88ecde
May 19 04:44:43.396210 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Took 1.28 seconds to deallocate network for instance.
May 19 04:44:43.460467 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999737184999958 future=<Future at 0x7218345e6cc0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:43.463667 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Instance destroyed successfully.
May 19 04:44:43.464387 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'resources' on Instance uuid 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:43.635327 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:43.901659 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:43.901865 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:43.908012 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Searching for a device in session 122 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:44:43.908282 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:44:43.967050 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:41:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-900232716',display_name='tempest-TestVolumeBootPattern-volume-backed-server-900232716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-volume-backed-server-900232716',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFth9htvMi69kNWeSArcbfgCWnicUtKvp6jsYhgNYCet3tKtaBGZ8ukz18dYhkilEPUOYMWTrHKI0EM8sUqd7xeejIZ3OGJ32wBcgSaeAbpmew7BO3B2PSkHexJHAgFNqQ==',key_name='tempest-keypair-1008715844',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:42:50Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-2tajyhyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c46088fb3e74b819bb456461716a801',uuid=54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de", "address": "fa:16:3e:b6:da:78", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3cbfbfe-4f", "ovs_interfaceid": "b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:44:43.967275 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de", "address": "fa:16:3e:b6:da:78", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3cbfbfe-4f", "ovs_interfaceid": "b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:44:43.967726 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:da:78,bridge_name='br-int',has_traffic_filtering=True,id=b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3cbfbfe-4f') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:44:43.967914 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:da:78,bridge_name='br-int',has_traffic_filtering=True,id=b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3cbfbfe-4f') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:44:43.968812 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:43.969070 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3cbfbfe-4f, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:43.970999 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:43.972008 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:43.978817 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:43.980135 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:43.981100 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86047afd-d56d-498d-8604-a2cc7077d022) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:43.981560 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:43.982418 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:43.987571 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:43.989045 np0000001025 nova-compute[97981]: INFO os_vif [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:da:78,bridge_name='br-int',has_traffic_filtering=True,id=b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3cbfbfe-4f')
May 19 04:44:43.994764 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:44:43.995049 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97cb7b11-9118-4b51-9829-98f5aa82dbfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:44:43.995236 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:44.238769 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:44:44.238902 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:44:44.239006 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] No VIF found with MAC fa:16:3e:0c:9e:56, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:44:44.239354 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Using config drive
May 19 04:44:44.390673 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5873adb8-1c29-4c30-aaac-b2bf4a4b90f2 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "1674daae-17fb-49d5-9305-c9d53a88ecde" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.481s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:44.459935 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:44:44.460161 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:44:44.484240 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Periodic task is updating the host stat, it is trying to get disk instance-00000035, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/af8a1b96-6f1d-4148-b9b2-36662e1051a3/disk.config'
May 19 04:44:44.485764 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:44.577772 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:44.578299 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:44.673657 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:44.678007 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:44.733266 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Found WWN 330000000f97313ae for multipath device dm-11 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:44:44.733790 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:44.734610 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.739s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:44.735070 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97cb7b11-9118-4b51-9829-98f5aa82dbfd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:44:44.735256 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:44:44.737443 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] <== connect_volume: return (5989ms) {'type': 'block', 'scsi_wwn': '330000000f97313ae', 'path': '/dev/disk/by-id/os-brick+dev+dm-11', 'multipath_id': '330000000f97313ae'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:44:44.737678 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f97313ae', 'path': '/dev/disk/by-id/os-brick+dev+dm-11', 'multipath_id': '330000000f97313ae'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:44:44.747355 np0000001025 nova-compute[97981]: WARNING stevedore.named [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 19 04:44:44.749715 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:44.752667 np0000001025 nova-compute[97981]: WARNING castellan.key_manager [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:44:44.752874 np0000001025 nova-compute[97981]: WARNING nova.keymgr.conf_key_mgr [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:44:44.754377 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x721834416ea0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-11'}, 'status': 'reserved', 'instance': '73d8ac91-6ca4-4ec9-81ce-c708d25f68dd', 'attached_at': '', 'detached_at': '', 'volume_id': '68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'serial': '68cdfcc1-d3ae-43e8-b315-401ff0c24546'} {{(pid=97981) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 19 04:44:44.754627 np0000001025 nova-compute[97981]: WARNING os_brick.encryptors.cryptsetup [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Deprecated: The plain CryptsetupEncryptor is deprecated and will be removed in a future release. Existing users are encouraged to retype any existing volumes using this encryptor to the 'luks' LuksEncryptor or 'luks2' Luks2Encryptor encryptors as soon as possible.
May 19 04:44:44.754816 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=97981) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 19 04:44:44.754933 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors.cryptsetup [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] opening encrypted volume /dev/dm-11 {{(pid=97981) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:104}}
May 19 04:44:44.770183 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:44.770183 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:44.770183 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:44.770183 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:44.770183 np0000001025 nova-compute[97981]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:44.770183 np0000001025 nova-compute[97981]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:44.770183 np0000001025 nova-compute[97981]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546 (non-flash)
May 19 04:44:44.770183 np0000001025 nova-compute[97981]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546 (non-flash)
May 19 04:44:44.770183 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:44.770183 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:44.770183 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:44.770183 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:44.770183 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:44.770755 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:44.770755 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:44.770755 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:44.770755 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:44.770755 np0000001025 nova-compute[97981]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:44.770755 np0000001025 nova-compute[97981]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:44.770755 np0000001025 nova-compute[97981]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546 (non-flash)
May 19 04:44:44.770755 np0000001025 nova-compute[97981]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546 (non-flash)
May 19 04:44:44.770755 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:44.770755 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:44.770755 np0000001025 nova-compute[97981]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:44.770755 np0000001025 nova-compute[97981]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd (non-flash)
May 19 04:44:44.770755 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:44.770755 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '102'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', '122'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '98')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:44:44.770755 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '97')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:44:44.772201 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:44.772651 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:44.772970 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd', '98')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:44:44.791577 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218343568e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd'): ({'sde'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:44:44.792580 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Removing multipathed devices sdf, sde {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:44:44.793013 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flush multipath device 330000000c2ce7d1a {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:44:44.834823 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0016378770001210796 future=<Future at 0x721834213590 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:44.838299 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Emitting event <LifecycleEvent: 1779165869.8330534, e991af6e-6fc9-4286-a848-84682121bbb1 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:44:44.841988 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:44.842150 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=2.6698184570000194 future=<Future at 0x721850737830 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:44.842262 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=2.6696990830000686 future=<Future at 0x721850737830 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:44.842652 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] VM Stopped (Lifecycle Event)
May 19 04:44:44.845005 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lazy-loading 'flavor' on Instance uuid 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:44.848777 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:44:44.874693 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:44.877173 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:44.904491 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Creating config drive at /opt/stack/data/nova/instances/af8a1b96-6f1d-4148-b9b2-36662e1051a3/disk.config
May 19 04:44:44.909320 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/af8a1b96-6f1d-4148-b9b2-36662e1051a3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9t4kl2go {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:44.909656 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:44:44.955064 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:44:44.955312 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] SCSI volumes sdf, sde have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:44:44.957227 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:44:44.964709 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:44:44.976761 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:44:44.977991 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:44.978427 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:44:44.979690 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/af8a1b96-6f1d-4148-b9b2-36662e1051a3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9t4kl2go" returned: 0 in 0.068s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:44.980811 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:44.998848 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:45.009269 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5c04bd31-35fb-4f58-92ea-be6f0c4c4e8b req-665f588b-4f2b-4415-b5d4-6b34a41da170 service nova] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Received event network-vif-unplugged-b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:45.009856 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5c04bd31-35fb-4f58-92ea-be6f0c4c4e8b req-665f588b-4f2b-4415-b5d4-6b34a41da170 service nova] Acquiring lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:45.010306 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5c04bd31-35fb-4f58-92ea-be6f0c4c4e8b req-665f588b-4f2b-4415-b5d4-6b34a41da170 service nova] Lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:45.011368 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5c04bd31-35fb-4f58-92ea-be6f0c4c4e8b req-665f588b-4f2b-4415-b5d4-6b34a41da170 service nova] Lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:45.011723 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5c04bd31-35fb-4f58-92ea-be6f0c4c4e8b req-665f588b-4f2b-4415-b5d4-6b34a41da170 service nova] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] No waiting events found dispatching network-vif-unplugged-b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:45.011935 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5c04bd31-35fb-4f58-92ea-be6f0c4c4e8b req-665f588b-4f2b-4415-b5d4-6b34a41da170 service nova] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Received event network-vif-unplugged-b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:44:45.012138 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5c04bd31-35fb-4f58-92ea-be6f0c4c4e8b req-665f588b-4f2b-4415-b5d4-6b34a41da170 service nova] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Received event network-vif-unplugged-b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:45.012331 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5c04bd31-35fb-4f58-92ea-be6f0c4c4e8b req-665f588b-4f2b-4415-b5d4-6b34a41da170 service nova] Acquiring lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:45.012519 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5c04bd31-35fb-4f58-92ea-be6f0c4c4e8b req-665f588b-4f2b-4415-b5d4-6b34a41da170 service nova] Lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:45.012711 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5c04bd31-35fb-4f58-92ea-be6f0c4c4e8b req-665f588b-4f2b-4415-b5d4-6b34a41da170 service nova] Lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:45.012910 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5c04bd31-35fb-4f58-92ea-be6f0c4c4e8b req-665f588b-4f2b-4415-b5d4-6b34a41da170 service nova] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] No waiting events found dispatching network-vif-unplugged-b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:45.013093 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5c04bd31-35fb-4f58-92ea-be6f0c4c4e8b req-665f588b-4f2b-4415-b5d4-6b34a41da170 service nova] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Received event network-vif-unplugged-b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:44:45.043923 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 97, target: iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd, portal: 192.168.40.100,3260]
May 19 04:44:45.043923 np0000001025 nova-compute[97981]: Logout of [sid: 97, target: iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd, portal: 192.168.40.100,3260] successful.
May 19 04:44:45.043923 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:45.072872 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:45.079630 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:45.082503 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:44:45.084267 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:45.096974 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:45.135843 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 98, target: iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd, portal: 192.168.50.100,3260]
May 19 04:44:45.135843 np0000001025 nova-compute[97981]: Logout of [sid: 98, target: iqn.2023-03.storpool.com:os--volume-97cb7b11-9118-4b51-9829-98f5aa82dbfd, portal: 192.168.50.100,3260] successful.
May 19 04:44:45.135843 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:45.159853 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:45.160299 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.426s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:45.160444 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== disconnect_volume: return (1164ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:44:45.160643 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:44:45.161009 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Deleting instance files /opt/stack/data/nova/instances/54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8_del
May 19 04:44:45.161524 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Deletion of /opt/stack/data/nova/instances/54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8_del complete
May 19 04:44:45.196431 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:45.196861 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:45.285390 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:45.289721 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:44:45.291337 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:45.347558 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: e991af6e-6fc9-4286-a848-84682121bbb1] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:45.349341 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Attempting to attach volume 68cdfcc1-d3ae-43e8-b315-401ff0c24546 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:44:45.351516 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:44:45.351516 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:44:45.351516 np0000001025 nova-compute[97981]:   <alias name="ua-68cdfcc1-d3ae-43e8-b315-401ff0c24546"/>
May 19 04:44:45.351516 np0000001025 nova-compute[97981]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-11"/>
May 19 04:44:45.351516 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:44:45.351516 np0000001025 nova-compute[97981]:   <serial>68cdfcc1-d3ae-43e8-b315-401ff0c24546</serial>
May 19 04:44:45.351516 np0000001025 nova-compute[97981]: </disk>
May 19 04:44:45.351516 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:44:45.380694 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:45.381097 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:45.428789 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:45.451538 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:45.456977 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:45.470529 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:45.482150 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.580s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:45.531390 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Deleted allocations for instance 0b156bbc-f85d-4739-bf88-bc609d4f8052
May 19 04:44:45.550940 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d8ac91-6ca4-4ec9-81ce-c708d25f68dd/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:45.562100 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:45.602852 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1e0432b1-ff53-4335-833c-df24a2633df2 req-367fb72a-2242-40a8-9201-5fcc3aa7d604 service nova] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Received event network-vif-plugged-582f56fa-1ad0-4404-b010-20ae6d98ade1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:45.603098 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1e0432b1-ff53-4335-833c-df24a2633df2 req-367fb72a-2242-40a8-9201-5fcc3aa7d604 service nova] Acquiring lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:45.603399 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1e0432b1-ff53-4335-833c-df24a2633df2 req-367fb72a-2242-40a8-9201-5fcc3aa7d604 service nova] Lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:45.603999 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1e0432b1-ff53-4335-833c-df24a2633df2 req-367fb72a-2242-40a8-9201-5fcc3aa7d604 service nova] Lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:45.604569 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1e0432b1-ff53-4335-833c-df24a2633df2 req-367fb72a-2242-40a8-9201-5fcc3aa7d604 service nova] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Processing event network-vif-plugged-582f56fa-1ad0-4404-b010-20ae6d98ade1 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:44:45.637994 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d8ac91-6ca4-4ec9-81ce-c708d25f68dd/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:45.638582 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d8ac91-6ca4-4ec9-81ce-c708d25f68dd/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:45.655922 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:45.676496 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Took 2.55 seconds to destroy the instance on the hypervisor.
May 19 04:44:45.677963 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:44:45.678284 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:44:45.678468 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:44:45.679967 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:45.757143 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d8ac91-6ca4-4ec9-81ce-c708d25f68dd/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:45.763316 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:45.780828 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:45.836233 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "3aa0ffed-decc-493c-8735-aba1d221571d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:45.836477 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "3aa0ffed-decc-493c-8735-aba1d221571d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:45.836734 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "3aa0ffed-decc-493c-8735-aba1d221571d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:45.836885 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "3aa0ffed-decc-493c-8735-aba1d221571d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:45.837049 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "3aa0ffed-decc-493c-8735-aba1d221571d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:45.840903 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Terminating instance
May 19 04:44:45.863260 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:45.863827 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:45.955708 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:45.956490 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-15 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:44:45.962127 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:46.048745 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:46.052133 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:46.146398 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:46.149209 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Error from libvirt while getting description of instance-00000029: [Error Code 42] Domain not found: no domain with matching uuid '54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8' (instance-00000029): libvirt.libvirtError: Domain not found: no domain with matching uuid '54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8' (instance-00000029)
May 19 04:44:46.151572 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:44:46.153163 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:44:46.198493 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:44:46.198989 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=11190MB free_disk=72.82064819335938GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:44:46.199176 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:46.199440 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:46.310444 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165886.3099942, af8a1b96-6f1d-4148-b9b2-36662e1051a3 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:44:46.310614 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] VM Started (Lifecycle Event)
May 19 04:44:46.312061 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:44:46.314212 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:44:46.316650 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Instance spawned successfully.
May 19 04:44:46.317035 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:44:46.344472 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:44:46.361414 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:46.363734 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:46.383881 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:46.486986 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:46.490703 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5d0374c5-2059-47f7-8802-009f91eeaa0b req-3391e896-2a83-4286-a1dd-58dcea71043d service nova] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Received event network-vif-unplugged-e7186e58-a62a-4993-ac19-98c145d5ef47 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:46.491215 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5d0374c5-2059-47f7-8802-009f91eeaa0b req-3391e896-2a83-4286-a1dd-58dcea71043d service nova] Acquiring lock "3aa0ffed-decc-493c-8735-aba1d221571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:46.491495 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5d0374c5-2059-47f7-8802-009f91eeaa0b req-3391e896-2a83-4286-a1dd-58dcea71043d service nova] Lock "3aa0ffed-decc-493c-8735-aba1d221571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:46.491678 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5d0374c5-2059-47f7-8802-009f91eeaa0b req-3391e896-2a83-4286-a1dd-58dcea71043d service nova] Lock "3aa0ffed-decc-493c-8735-aba1d221571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:46.491829 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5d0374c5-2059-47f7-8802-009f91eeaa0b req-3391e896-2a83-4286-a1dd-58dcea71043d service nova] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] No waiting events found dispatching network-vif-unplugged-e7186e58-a62a-4993-ac19-98c145d5ef47 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:46.492012 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5d0374c5-2059-47f7-8802-009f91eeaa0b req-3391e896-2a83-4286-a1dd-58dcea71043d service nova] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Received event network-vif-unplugged-e7186e58-a62a-4993-ac19-98c145d5ef47 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:44:46.493704 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:46.546873 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5c5d2ec-ac79-4864-9acd-2b499f1572bb tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Lock "0b156bbc-f85d-4739-bf88-bc609d4f8052" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.308s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:46.688465 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Instance destroyed successfully.
May 19 04:44:46.688833 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'resources' on Instance uuid 3aa0ffed-decc-493c-8735-aba1d221571d {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:46.694840 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:46.813324 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:46.815337 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:44:46.827092 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:44:46.832698 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:44:46.833189 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:44:46.833451 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:44:46.833837 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:44:46.834137 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:44:47.089759 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:44:47.089881 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:44:47.089961 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:44:47.090060 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] No VIF found with MAC fa:16:3e:ec:99:36, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:44:47.191378 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1624420279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverbootfromvolumestablerescuetest-server-1624420279',id=49,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:43:41Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7465b5668be4eb9b75c1ddc876e7eac',ramdisk_id='',reservation_id='r-79g9f53r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-96916496',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:43:50Z,user_data=None,user_id='5885f1561f394d46bd4c1b48e7323c1e',uuid=3aa0ffed-decc-493c-8735-aba1d221571d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7186e58-a62a-4993-ac19-98c145d5ef47", "address": "fa:16:3e:ea:48:91", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7186e58-a6", "ovs_interfaceid": "e7186e58-a62a-4993-ac19-98c145d5ef47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:44:47.191618 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converting VIF {"id": "e7186e58-a62a-4993-ac19-98c145d5ef47", "address": "fa:16:3e:ea:48:91", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7186e58-a6", "ovs_interfaceid": "e7186e58-a62a-4993-ac19-98c145d5ef47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:44:47.192278 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:48:91,bridge_name='br-int',has_traffic_filtering=True,id=e7186e58-a62a-4993-ac19-98c145d5ef47,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7186e58-a6') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:44:47.192648 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:48:91,bridge_name='br-int',has_traffic_filtering=True,id=e7186e58-a62a-4993-ac19-98c145d5ef47,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7186e58-a6') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:44:47.194227 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:47.194636 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7186e58-a6, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:47.197699 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Took 1.52 seconds to deallocate network for instance.
May 19 04:44:47.198229 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:47.201183 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:47.201409 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85ccb54b-5980-48db-816c-668a1e3095ba) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:47.203031 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:47.205595 np0000001025 nova-compute[97981]: INFO os_vif [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:48:91,bridge_name='br-int',has_traffic_filtering=True,id=e7186e58-a62a-4993-ac19-98c145d5ef47,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7186e58-a6')
May 19 04:44:47.205947 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Deleting instance files /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d_del
May 19 04:44:47.207144 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Deletion of /opt/stack/data/nova/instances/3aa0ffed-decc-493c-8735-aba1d221571d_del complete
May 19 04:44:47.269090 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 32cc5240-7a56-4cee-9b41-54e17386b39f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:44:47.269211 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance b32b8038-72c4-443c-aea3-07cd61ad67f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:44:47.269348 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance e644a772-cf7c-4b15-b21b-ea54e773a1f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:44:47.269445 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 6f26313e-2659-4687-84da-96cf2da9a4e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:44:47.269524 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:44:47.269608 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance a73d6831-b1cd-4d69-a78c-16d3ac8010c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:44:47.269679 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 92b3fb19-741d-476b-9d2f-83654a17aa0e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:44:47.269756 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 80436afa-9cd9-41cd-b589-629da01b6bfe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:44:47.269830 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 417861ee-dcf2-458b-8782-2ec22d2f5421 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:44:47.269904 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 3aa0ffed-decc-493c-8735-aba1d221571d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:44:47.269984 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:44:47.270063 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance af8a1b96-6f1d-4148-b9b2-36662e1051a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:44:47.271394 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:44:47.271524 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=2944MB phys_disk=95GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:44:46 up 35 min,  2 users,  load average: 6.50, 6.20, 4.10\n', 'num_instances': '12', 'num_vm_active': '11', 'num_task_None': '9', 'num_os_type_None': '12', 'num_proj_490151decdde445593a86a16976f6b34': '6', 'io_workload': '1', 'num_task_deleting': '2', 'num_proj_28b3c0fa8f894ed2a7c3bcfac99ce74c': '1', 'num_proj_f7465b5668be4eb9b75c1ddc876e7eac': '3', 'num_proj_662c1a9b25e44aff8242f468232af7f3': '1', 'num_proj_7041ddbe11174207bbc7363b3bf08af5': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:44:47.317501 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:44:47.317819 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165887.3176057, af8a1b96-6f1d-4148-b9b2-36662e1051a3 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:44:47.317980 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] VM Paused (Lifecycle Event)
May 19 04:44:47.338710 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Took 8.94 seconds to spawn the instance on the hypervisor.
May 19 04:44:47.338927 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:47.512576 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0004829730000892596 future=<Future at 0x721850737830 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:47.512965 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:47.512965 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=1.4772301699999844 future=<Future at 0x72183415eba0 state=cancelled>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:47.512965 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=1.4771567429997958 future=<Future at 0x72183415eba0 state=cancelled>) was cancelled while queued, skipping {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:47.512965 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:47.513061 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=1.6257142810000005 future=<Future at 0x7218344abd40 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:47.513087 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=1.6256263049999689 future=<Future at 0x7218344abd40 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:47.513484 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Emitting event <LifecycleEvent: 1779165872.5118897, 035dd3e2-1951-4cb3-8cda-691019c0c9cb => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:44:47.513643 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] VM Stopped (Lifecycle Event)
May 19 04:44:47.657511 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d76f3aea-b295-4bf4-b273-204af8f16ec8 req-a85982ca-769b-4570-be23-eae37218079d service nova] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Received event network-vif-plugged-582f56fa-1ad0-4404-b010-20ae6d98ade1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:47.658212 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d76f3aea-b295-4bf4-b273-204af8f16ec8 req-a85982ca-769b-4570-be23-eae37218079d service nova] Acquiring lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:47.658419 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d76f3aea-b295-4bf4-b273-204af8f16ec8 req-a85982ca-769b-4570-be23-eae37218079d service nova] Lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:47.658576 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d76f3aea-b295-4bf4-b273-204af8f16ec8 req-a85982ca-769b-4570-be23-eae37218079d service nova] Lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:47.658753 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d76f3aea-b295-4bf4-b273-204af8f16ec8 req-a85982ca-769b-4570-be23-eae37218079d service nova] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] No waiting events found dispatching network-vif-plugged-582f56fa-1ad0-4404-b010-20ae6d98ade1 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:47.658921 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-d76f3aea-b295-4bf4-b273-204af8f16ec8 req-a85982ca-769b-4570-be23-eae37218079d service nova] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Received unexpected event network-vif-plugged-582f56fa-1ad0-4404-b010-20ae6d98ade1 for instance with vm_state active and task_state None.
May 19 04:44:47.658998 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d76f3aea-b295-4bf4-b273-204af8f16ec8 req-a85982ca-769b-4570-be23-eae37218079d service nova] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Received event network-vif-deleted-b3cbfbfe-4fb8-4609-a81d-ce9d40d6e6de {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:47.714438 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Took 1.37 seconds to destroy the instance on the hypervisor.
May 19 04:44:47.714438 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:44:47.714438 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:44:47.714438 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:44:47.714758 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:47.757236 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Took 0.56 seconds to detach 1 volumes for instance.
May 19 04:44:47.759994 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Deleting volume: 97cb7b11-9118-4b51-9829-98f5aa82dbfd {{(pid=97981) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 19 04:44:47.785363 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:47.823279 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:47.825553 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165887.8253386, af8a1b96-6f1d-4148-b9b2-36662e1051a3 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:44:47.825700 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] VM Resumed (Lifecycle Event)
May 19 04:44:47.847267 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Took 16.70 seconds to build instance.
May 19 04:44:47.858289 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:44:47.858666 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:44:48.015732 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 035dd3e2-1951-4cb3-8cda-691019c0c9cb] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:48.302697 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:48.327850 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:48.336464 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:44:48.352364 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-daede47a-370c-41f1-933c-a75010e77c31 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.216s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:48.361560 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:44:48.366737 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:48.500520 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:48.560636 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9fa2d2fe-aadf-4f97-9303-bee4148c7204 req-ef6291a7-09b5-4d01-bbc9-8533977e01ba service nova] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Received event network-vif-unplugged-e7186e58-a62a-4993-ac19-98c145d5ef47 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:48.561051 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9fa2d2fe-aadf-4f97-9303-bee4148c7204 req-ef6291a7-09b5-4d01-bbc9-8533977e01ba service nova] Acquiring lock "3aa0ffed-decc-493c-8735-aba1d221571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:48.561247 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9fa2d2fe-aadf-4f97-9303-bee4148c7204 req-ef6291a7-09b5-4d01-bbc9-8533977e01ba service nova] Lock "3aa0ffed-decc-493c-8735-aba1d221571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:48.561355 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9fa2d2fe-aadf-4f97-9303-bee4148c7204 req-ef6291a7-09b5-4d01-bbc9-8533977e01ba service nova] Lock "3aa0ffed-decc-493c-8735-aba1d221571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:48.561465 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9fa2d2fe-aadf-4f97-9303-bee4148c7204 req-ef6291a7-09b5-4d01-bbc9-8533977e01ba service nova] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] No waiting events found dispatching network-vif-unplugged-e7186e58-a62a-4993-ac19-98c145d5ef47 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:48.561564 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9fa2d2fe-aadf-4f97-9303-bee4148c7204 req-ef6291a7-09b5-4d01-bbc9-8533977e01ba service nova] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Received event network-vif-unplugged-e7186e58-a62a-4993-ac19-98c145d5ef47 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:44:48.635131 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3d451800-5a8c-41e1-bb8f-d61dfd9a3c5e tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.622s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:48.839628 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999754538000161 future=<Future at 0x7218503dffb0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:48.869118 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:44:48.869270 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.670s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:48.869749 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.567s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:48.873565 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 54.59 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:44:48.989498 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:48.992135 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:49.002394 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Took 1.29 seconds to deallocate network for instance.
May 19 04:44:49.139099 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00031106200003705453 future=<Future at 0x7218344abd40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:49.139587 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Emitting event <LifecycleEvent: 1779165874.1386616, 9563147c-542a-4b2c-8944-8961cfb68132 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:44:49.141350 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:49.141350 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] VM Stopped (Lifecycle Event)
May 19 04:44:49.141350 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=3.614208822999899 future=<Future at 0x7218501994c0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:49.141350 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=3.614033943999857 future=<Future at 0x7218501994c0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:49.494156 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Detaching volume 68cdfcc1-d3ae-43e8-b315-401ff0c24546
May 19 04:44:49.507797 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:49.527831 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:44:49.527995 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:44:49.557344 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Attempting to driver detach volume 68cdfcc1-d3ae-43e8-b315-401ff0c24546 from mountpoint /dev/vdb
May 19 04:44:49.593915 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-11'}, 'status': 'reserved', 'instance': '73d8ac91-6ca4-4ec9-81ce-c708d25f68dd', 'attached_at': '', 'detached_at': '', 'volume_id': '68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'serial': '68cdfcc1-d3ae-43e8-b315-401ff0c24546'} {{(pid=97981) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 19 04:44:49.598649 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Found disk vdb by alias ua-68cdfcc1-d3ae-43e8-b315-401ff0c24546 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:44:49.601573 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Found disk vdb by alias ua-68cdfcc1-d3ae-43e8-b315-401ff0c24546 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:44:49.601573 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Attempting to detach device vdb from instance 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:44:49.601664 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:44:49.601664 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:44:49.601664 np0000001025 nova-compute[97981]:   <alias name="ua-68cdfcc1-d3ae-43e8-b315-401ff0c24546"/>
May 19 04:44:49.601664 np0000001025 nova-compute[97981]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-11"/>
May 19 04:44:49.601664 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:44:49.601664 np0000001025 nova-compute[97981]:   <serial>68cdfcc1-d3ae-43e8-b315-401ff0c24546</serial>
May 19 04:44:49.601664 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:44:49.601664 np0000001025 nova-compute[97981]: </disk>
May 19 04:44:49.601664 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:44:49.609485 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Successfully detached device vdb from instance 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd from the persistent domain config.
May 19 04:44:49.609696 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] (1/8): Attempting to detach device vdb with device alias ua-68cdfcc1-d3ae-43e8-b315-401ff0c24546 from instance 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:44:49.610012 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:44:49.610012 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:44:49.610012 np0000001025 nova-compute[97981]:   <alias name="ua-68cdfcc1-d3ae-43e8-b315-401ff0c24546"/>
May 19 04:44:49.610012 np0000001025 nova-compute[97981]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-11"/>
May 19 04:44:49.610012 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:44:49.610012 np0000001025 nova-compute[97981]:   <serial>68cdfcc1-d3ae-43e8-b315-401ff0c24546</serial>
May 19 04:44:49.610012 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:44:49.610012 np0000001025 nova-compute[97981]: </disk>
May 19 04:44:49.610012 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:44:49.643322 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-783f0152-d27c-4b59-8d18-3e139d25813b tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 9563147c-542a-4b2c-8944-8961cfb68132] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:49.674643 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:49.741032 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-585fe114-e00a-4afb-9a93-3923691aec21 req-ee72b85c-2c3e-4cf4-bea2-5beda8223f8b service nova] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Received event network-vif-deleted-e7186e58-a62a-4993-ac19-98c145d5ef47 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:50.035786 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:44:50.134413 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165890.133986, 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd => ua-68cdfcc1-d3ae-43e8-b315-401ff0c24546> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:44:50.136079 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-68cdfcc1-d3ae-43e8-b315-401ff0c24546 for instance 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:44:50.138739 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Successfully detached device vdb from instance 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd from the live domain config.
May 19 04:44:50.140182 np0000001025 nova-compute[97981]: WARNING stevedore.named [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 19 04:44:50.140410 np0000001025 nova-compute[97981]: WARNING castellan.key_manager [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:44:50.140582 np0000001025 nova-compute[97981]: WARNING nova.keymgr.conf_key_mgr [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:44:50.141270 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x72183418ef30>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-11'}, 'status': 'reserved', 'instance': '73d8ac91-6ca4-4ec9-81ce-c708d25f68dd', 'attached_at': '', 'detached_at': '', 'volume_id': '68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'serial': '68cdfcc1-d3ae-43e8-b315-401ff0c24546'} {{(pid=97981) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 19 04:44:50.141413 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors.cryptsetup [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] closing encrypted volume /dev/dm-12 {{(pid=97981) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:153}}
May 19 04:44:50.163204 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:44:50.163321 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:44:50.163482 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:50.163943 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:50.164292 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68cdfcc1-d3ae-43e8-b315-401ff0c24546', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:44:50.164678 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:44:50.193541 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:50.193541 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:50.193541 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:50.193541 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:50.193541 np0000001025 nova-compute[97981]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:50.193541 np0000001025 nova-compute[97981]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:50.193541 np0000001025 nova-compute[97981]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546 (non-flash)
May 19 04:44:50.193541 np0000001025 nova-compute[97981]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546 (non-flash)
May 19 04:44:50.193541 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:50.193541 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:50.193541 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:50.193843 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:50.193843 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:50.193843 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:50.193843 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:50.193843 np0000001025 nova-compute[97981]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:50.193843 np0000001025 nova-compute[97981]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:50.193843 np0000001025 nova-compute[97981]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546 (non-flash)
May 19 04:44:50.193843 np0000001025 nova-compute[97981]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546 (non-flash)
May 19 04:44:50.193843 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:50.193843 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:50.193843 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:50.193843 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '102'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', '122'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:44:50.194146 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', '121')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:44:50.194989 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546', '122')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:44:50.196064 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218500f5760>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546'): ({'sdg'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:44:50.196452 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Removing multipathed devices sdg, sdd {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:44:50.196711 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Flush multipath device 330000000f97313ae {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:44:50.231046 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:44:50.300039 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:44:50.342617 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Checking to see if SCSI volumes sdg, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:44:50.342779 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] SCSI volumes sdg, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:44:50.343969 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Checking to see if device paths {'sdg', 'sdd'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:44:50.356156 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Device paths {'sdg', 'sdd'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:44:50.356403 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:44:50.373384 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:50.416559 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 121, target: iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546, portal: 192.168.40.100,3260]
May 19 04:44:50.416559 np0000001025 nova-compute[97981]: Logout of [sid: 121, target: iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546, portal: 192.168.40.100,3260] successful.
May 19 04:44:50.416559 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:50.440539 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:50.453837 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:50.497686 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 122, target: iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546, portal: 192.168.50.100,3260]
May 19 04:44:50.497686 np0000001025 nova-compute[97981]: Logout of [sid: 122, target: iqn.2023-03.storpool.com:os--volume-68cdfcc1-d3ae-43e8-b315-401ff0c24546, portal: 192.168.50.100,3260] successful.
May 19 04:44:50.497686 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:50.520200 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:50.521952 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:50.522082 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] <== disconnect_volume: return (358ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:44:50.522187 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:44:50.544152 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.675s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:50.545464 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.037s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:50.621973 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Deleted allocations for instance 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8
May 19 04:44:51.075930 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lazy-loading 'flavor' on Instance uuid 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:51.171520 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:44:51.172368 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:44:51.639241 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-22e963b9-757a-4aba-9c61-0912bbac0358 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.015s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:51.656900 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:51.678330 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:44:52.085063 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-85db9be3-08a0-4255-8a1c-407af1c2b204 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.095s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:52.185671 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.641s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:52.215027 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:52.224492 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:52.224734 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:52.224950 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:52.225138 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:52.225313 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:52.229799 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Terminating instance
May 19 04:44:52.259418 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Deleted allocations for instance 3aa0ffed-decc-493c-8735-aba1d221571d
May 19 04:44:52.369572 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:52.369887 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:52.370540 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:52.370540 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:52.370540 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:52.372406 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Terminating instance
May 19 04:44:52.735188 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:44:52.751983 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:52.755812 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0005503200000021025 future=<Future at 0x7218501994c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:52.755954 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:52.756324 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=3.3353489969999828 future=<Future at 0x721850735580 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:52.756929 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=3.335217269000168 future=<Future at 0x721850735580 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:52.756929 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:52.758608 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Emitting event <LifecycleEvent: 1779165877.7550254, 1674daae-17fb-49d5-9305-c9d53a88ecde => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:44:52.758916 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] VM Stopped (Lifecycle Event)
May 19 04:44:52.775458 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:52.875395 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:44:52.876047 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:52.881085 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:52.895745 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:52.898458 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:52.917101 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:52.920087 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:52.949799 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:52.988944 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8ee454f4-28da-4ae4-850d-89e96833d942 req-87097d0c-e566-4730-bfd6-9e593ddf7337 service nova] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Received event network-vif-unplugged-582f56fa-1ad0-4404-b010-20ae6d98ade1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:52.989099 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8ee454f4-28da-4ae4-850d-89e96833d942 req-87097d0c-e566-4730-bfd6-9e593ddf7337 service nova] Acquiring lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:52.990864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8ee454f4-28da-4ae4-850d-89e96833d942 req-87097d0c-e566-4730-bfd6-9e593ddf7337 service nova] Lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:52.991360 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8ee454f4-28da-4ae4-850d-89e96833d942 req-87097d0c-e566-4730-bfd6-9e593ddf7337 service nova] Lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:52.991477 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8ee454f4-28da-4ae4-850d-89e96833d942 req-87097d0c-e566-4730-bfd6-9e593ddf7337 service nova] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] No waiting events found dispatching network-vif-unplugged-582f56fa-1ad0-4404-b010-20ae6d98ade1 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:52.991592 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8ee454f4-28da-4ae4-850d-89e96833d942 req-87097d0c-e566-4730-bfd6-9e593ddf7337 service nova] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Received event network-vif-unplugged-582f56fa-1ad0-4404-b010-20ae6d98ade1 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:44:53.056710 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b66ecdb1-4d83-4399-b716-a824176e6fd1 req-fb05e941-c9e3-4653-b053-42985348bbaa service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Received event network-vif-unplugged-cae1ad91-b98a-4f8e-b208-20159307d77d {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:53.056710 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b66ecdb1-4d83-4399-b716-a824176e6fd1 req-fb05e941-c9e3-4653-b053-42985348bbaa service nova] Acquiring lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:53.057857 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b66ecdb1-4d83-4399-b716-a824176e6fd1 req-fb05e941-c9e3-4653-b053-42985348bbaa service nova] Lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:53.057857 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b66ecdb1-4d83-4399-b716-a824176e6fd1 req-fb05e941-c9e3-4653-b053-42985348bbaa service nova] Lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:53.057857 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b66ecdb1-4d83-4399-b716-a824176e6fd1 req-fb05e941-c9e3-4653-b053-42985348bbaa service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] No waiting events found dispatching network-vif-unplugged-cae1ad91-b98a-4f8e-b208-20159307d77d {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:53.057857 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b66ecdb1-4d83-4399-b716-a824176e6fd1 req-fb05e941-c9e3-4653-b053-42985348bbaa service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Received event network-vif-unplugged-cae1ad91-b98a-4f8e-b208-20159307d77d for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:44:53.078392 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999682352000036 future=<Future at 0x7218506f95b0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:53.084872 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Instance destroyed successfully.
May 19 04:44:53.085497 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'resources' on Instance uuid af8a1b96-6f1d-4148-b9b2-36662e1051a3 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:53.172228 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "80436afa-9cd9-41cd-b589-629da01b6bfe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:53.172228 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:53.222544 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.99963268900001 future=<Future at 0x7218342cc080 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:53.223828 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Instance destroyed successfully.
May 19 04:44:53.224218 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lazy-loading 'resources' on Instance uuid 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:53.262078 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 1674daae-17fb-49d5-9305-c9d53a88ecde] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:53.268752 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-026ab61e-da0c-4c87-bb00-1b3fc73b7f71 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "3aa0ffed-decc-493c-8735-aba1d221571d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.432s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:53.366139 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:53.587885 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:44:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-434248312',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumemultiattachtest-server-434248312',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:44:47Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-i7zdgobn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:44:47Z,user_data=None,user_id='aa432d60cb324c6d87818107e05e0053',uuid=af8a1b96-6f1d-4148-b9b2-36662e1051a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "582f56fa-1ad0-4404-b010-20ae6d98ade1", "address": "fa:16:3e:0c:9e:56", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap582f56fa-1a", "ovs_interfaceid": "582f56fa-1ad0-4404-b010-20ae6d98ade1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:44:53.588101 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "582f56fa-1ad0-4404-b010-20ae6d98ade1", "address": "fa:16:3e:0c:9e:56", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap582f56fa-1a", "ovs_interfaceid": "582f56fa-1ad0-4404-b010-20ae6d98ade1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:44:53.588617 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:9e:56,bridge_name='br-int',has_traffic_filtering=True,id=582f56fa-1ad0-4404-b010-20ae6d98ade1,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap582f56fa-1a') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:44:53.588865 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:9e:56,bridge_name='br-int',has_traffic_filtering=True,id=582f56fa-1ad0-4404-b010-20ae6d98ade1,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap582f56fa-1a') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:44:53.591661 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:53.592132 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap582f56fa-1a, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:53.592962 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:53.593866 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:53.598528 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:53.599759 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:53.599759 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13aa3a8f-f3a2-475f-830d-cb9359edc744) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:53.600396 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:53.600518 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:53.605158 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:53.607033 np0000001025 nova-compute[97981]: INFO os_vif [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:9e:56,bridge_name='br-int',has_traffic_filtering=True,id=582f56fa-1ad0-4404-b010-20ae6d98ade1,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap582f56fa-1a')
May 19 04:44:53.641065 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:44:53.641383 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5', 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b188d67b-c930-4cf9-9595-3ad1a6018ea5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:44:53.641505 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:53.641809 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:53.642046 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5', 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b188d67b-c930-4cf9-9595-3ad1a6018ea5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:44:53.642189 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:44:53.673096 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:53.673096 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:53.673096 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:53.673096 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:53.673096 np0000001025 nova-compute[97981]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:53.673096 np0000001025 nova-compute[97981]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:53.673096 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:53.673096 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:53.673096 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:53.673527 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:53.673527 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:53.673527 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:53.673527 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:53.673527 np0000001025 nova-compute[97981]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:53.673527 np0000001025 nova-compute[97981]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5 (non-flash)
May 19 04:44:53.673527 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:53.673527 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:53.673527 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:53.673527 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '102'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5', '120'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:44:53.673946 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5', '120')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:44:53.674550 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5', '119')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:44:53.675756 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Detaching volume 1f1a7080-9228-4c04-afc2-2907210007ec
May 19 04:44:53.677958 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185025de40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5'): ({'sdb'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:44:53.678896 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Removing multipathed devices sdc, sdb {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:44:53.678896 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Flush multipath device 330000000366f6401 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:44:53.718979 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Attempting to driver detach volume 1f1a7080-9228-4c04-afc2-2907210007ec from mountpoint /dev/vdb
May 19 04:44:53.724395 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Found disk vdb by alias ua-1f1a7080-9228-4c04-afc2-2907210007ec {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:44:53.724739 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:44:53.725431 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Found disk vdb by alias ua-1f1a7080-9228-4c04-afc2-2907210007ec {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:44:53.725550 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Attempting to detach device vdb from instance 80436afa-9cd9-41cd-b589-629da01b6bfe from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:44:53.726716 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-663938824',display_name='tempest-TestEncryptedCinderVolumes-server-663938824',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testencryptedcindervolumes-server-663938824',id=51,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIavdP3Q5NRCoqt8IuXxLAxBF1OYoWySY8rtnV6JB6amawlmuOMFFOc1nfw3in4xS0pC4iLbxjjY+hfEKqCmN11FwW0eKSB4YFteLI4WTo3fS/UvEkSjjPkwrUeqktCsnA==',key_name='tempest-keypair-1613029429',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:43:57Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7041ddbe11174207bbc7363b3bf08af5',ramdisk_id='',reservation_id='r-k71fj25u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-324201327',owner_user_name='tempest-TestEncryptedCinderVolumes-324201327-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada528b0c5c740799599a2b163709a87',uuid=73d8ac91-6ca4-4ec9-81ce-c708d25f68dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cae1ad91-b98a-4f8e-b208-20159307d77d", "address": "fa:16:3e:ec:99:36", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae1ad91-b9", "ovs_interfaceid": "cae1ad91-b98a-4f8e-b208-20159307d77d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:44:53.727365 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:44:53.727365 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:44:53.727365 np0000001025 nova-compute[97981]:   <alias name="ua-1f1a7080-9228-4c04-afc2-2907210007ec"/>
May 19 04:44:53.727365 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-15"/>
May 19 04:44:53.727365 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:44:53.727365 np0000001025 nova-compute[97981]:   <serial>1f1a7080-9228-4c04-afc2-2907210007ec</serial>
May 19 04:44:53.727365 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 19 04:44:53.727365 np0000001025 nova-compute[97981]: </disk>
May 19 04:44:53.727365 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:44:53.728123 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Converting VIF {"id": "cae1ad91-b98a-4f8e-b208-20159307d77d", "address": "fa:16:3e:ec:99:36", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae1ad91-b9", "ovs_interfaceid": "cae1ad91-b98a-4f8e-b208-20159307d77d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:44:53.728377 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:99:36,bridge_name='br-int',has_traffic_filtering=True,id=cae1ad91-b98a-4f8e-b208-20159307d77d,network=Network(1eda8fb0-3870-4644-873a-b485fff9e767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcae1ad91-b9') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:44:53.728649 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:99:36,bridge_name='br-int',has_traffic_filtering=True,id=cae1ad91-b98a-4f8e-b208-20159307d77d,network=Network(1eda8fb0-3870-4644-873a-b485fff9e767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcae1ad91-b9') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:44:53.729576 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:53.729760 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcae1ad91-b9, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:53.730692 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:53.731394 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:53.732214 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:53.733127 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:53.733333 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=693f9be3-5c5d-480a-9b66-b5769b918590) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:53.734092 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:53.734697 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:53.735578 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:53.736372 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Successfully detached device vdb from instance 80436afa-9cd9-41cd-b589-629da01b6bfe from the persistent domain config.
May 19 04:44:53.736547 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] (1/8): Attempting to detach device vdb with device alias ua-1f1a7080-9228-4c04-afc2-2907210007ec from instance 80436afa-9cd9-41cd-b589-629da01b6bfe from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:44:53.736782 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:44:53.736782 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:44:53.736782 np0000001025 nova-compute[97981]:   <alias name="ua-1f1a7080-9228-4c04-afc2-2907210007ec"/>
May 19 04:44:53.736782 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-15"/>
May 19 04:44:53.736782 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:44:53.736782 np0000001025 nova-compute[97981]:   <serial>1f1a7080-9228-4c04-afc2-2907210007ec</serial>
May 19 04:44:53.736782 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 19 04:44:53.736782 np0000001025 nova-compute[97981]: </disk>
May 19 04:44:53.736782 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:44:53.738707 np0000001025 nova-compute[97981]: INFO os_vif [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:99:36,bridge_name='br-int',has_traffic_filtering=True,id=cae1ad91-b98a-4f8e-b208-20159307d77d,network=Network(1eda8fb0-3870-4644-873a-b485fff9e767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcae1ad91-b9')
May 19 04:44:53.738950 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Deleting instance files /opt/stack/data/nova/instances/73d8ac91-6ca4-4ec9-81ce-c708d25f68dd_del
May 19 04:44:53.740143 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Deletion of /opt/stack/data/nova/instances/73d8ac91-6ca4-4ec9-81ce-c708d25f68dd_del complete
May 19 04:44:53.768800 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:44:53.822605 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:44:53.822748 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:44:53.823603 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:44:53.834388 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:44:53.834521 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:44:53.848101 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:53.880391 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 120, target: iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5, portal: 192.168.40.100,3260]
May 19 04:44:53.880391 np0000001025 nova-compute[97981]: Logout of [sid: 120, target: iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5, portal: 192.168.40.100,3260] successful.
May 19 04:44:53.880391 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:53.897470 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:53.912705 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:53.945969 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 119, target: iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5, portal: 192.168.50.100,3260]
May 19 04:44:53.945969 np0000001025 nova-compute[97981]: Logout of [sid: 119, target: iqn.2023-03.storpool.com:os--volume-b188d67b-c930-4cf9-9595-3ad1a6018ea5, portal: 192.168.50.100,3260] successful.
May 19 04:44:53.945969 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:53.961331 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:53.961564 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:53.961711 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] <== disconnect_volume: return (320ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:44:53.961859 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:44:53.962118 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Deleting instance files /opt/stack/data/nova/instances/af8a1b96-6f1d-4148-b9b2-36662e1051a3_del
May 19 04:44:53.962609 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Deletion of /opt/stack/data/nova/instances/af8a1b96-6f1d-4148-b9b2-36662e1051a3_del complete
May 19 04:44:54.188342 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "92b3fb19-741d-476b-9d2f-83654a17aa0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:54.188547 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:54.188686 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:54.188816 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:54.188925 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:54.190770 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Terminating instance
May 19 04:44:54.227488 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165894.2270932, 80436afa-9cd9-41cd-b589-629da01b6bfe => ua-1f1a7080-9228-4c04-afc2-2907210007ec> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:44:54.228626 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-1f1a7080-9228-4c04-afc2-2907210007ec for instance 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:44:54.230776 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Successfully detached device vdb from instance 80436afa-9cd9-41cd-b589-629da01b6bfe from the live domain config.
May 19 04:44:54.232195 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:44:54.232508 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1f1a7080-9228-4c04-afc2-2907210007ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:44:54.232624 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:54.232924 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:54.233193 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1f1a7080-9228-4c04-afc2-2907210007ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:44:54.233332 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:44:54.245433 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Took 1.37 seconds to destroy the instance on the hypervisor.
May 19 04:44:54.245956 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:44:54.246369 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:44:54.246548 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:44:54.247248 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:54.260034 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:54.260034 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:54.260034 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:54.260034 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:54.260034 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:54.260034 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:54.260034 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:54.260034 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:54.260034 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:54.260034 np0000001025 nova-compute[97981]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:54.260034 np0000001025 nova-compute[97981]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec (non-flash)
May 19 04:44:54.260034 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:54.260034 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:54.260034 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:54.260354 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '102'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:44:54.260354 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '113')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:44:54.261485 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec', '114')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:44:54.262854 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218500f7600>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec'): ({'sdk'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:44:54.263220 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Removing multipathed devices sdk, sdj {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:44:54.263421 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Flush multipath device 3300000002344c80c {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:44:54.303900 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:44:54.314364 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:54.370821 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:44:54.418887 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:44:54.419298 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:44:54.421151 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:44:54.431886 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:44:54.431886 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:44:54.443780 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:54.468070 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Took 1.73 seconds to destroy the instance on the hypervisor.
May 19 04:44:54.468691 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:44:54.468974 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:44:54.469067 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:44:54.469317 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:54.479461 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 113, target: iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec, portal: 192.168.40.100,3260]
May 19 04:44:54.479461 np0000001025 nova-compute[97981]: Logout of [sid: 113, target: iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec, portal: 192.168.40.100,3260] successful.
May 19 04:44:54.479461 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:54.493959 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:54.507883 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:54.530025 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:54.544848 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 114, target: iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec, portal: 192.168.50.100,3260]
May 19 04:44:54.544848 np0000001025 nova-compute[97981]: Logout of [sid: 114, target: iqn.2023-03.storpool.com:os--volume-1f1a7080-9228-4c04-afc2-2907210007ec, portal: 192.168.50.100,3260] successful.
May 19 04:44:54.544848 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:54.566688 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:54.566688 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:54.566688 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] <== disconnect_volume: return (332ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:44:54.566688 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:44:54.694846 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:44:54.713722 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:54.716667 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:54.738708 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:54.850782 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:54.856466 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:54.899529 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-bb48219f-bc04-4cab-b7bc-5e84911a582f req-c40697f0-61a0-43ef-91c3-bf263560941d service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received event network-vif-unplugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:54.899721 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bb48219f-bc04-4cab-b7bc-5e84911a582f req-c40697f0-61a0-43ef-91c3-bf263560941d service nova] Acquiring lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:54.899834 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bb48219f-bc04-4cab-b7bc-5e84911a582f req-c40697f0-61a0-43ef-91c3-bf263560941d service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:54.899949 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bb48219f-bc04-4cab-b7bc-5e84911a582f req-c40697f0-61a0-43ef-91c3-bf263560941d service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:54.900073 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-bb48219f-bc04-4cab-b7bc-5e84911a582f req-c40697f0-61a0-43ef-91c3-bf263560941d service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] No waiting events found dispatching network-vif-unplugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:54.900253 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-bb48219f-bc04-4cab-b7bc-5e84911a582f req-c40697f0-61a0-43ef-91c3-bf263560941d service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received event network-vif-unplugged-29504364-b589-4dde-a783-4b3bcaea9e02 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:44:55.019139 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999608021999848 future=<Future at 0x7218342ccce0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:55.021936 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Instance destroyed successfully.
May 19 04:44:55.023338 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'resources' on Instance uuid 92b3fb19-741d-476b-9d2f-83654a17aa0e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:55.063303 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ce35b93b-1ace-4521-ad30-a77152573392 req-077a6d9c-ddd2-4b82-bdb7-2895728a0c33 service nova] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Received event network-vif-unplugged-582f56fa-1ad0-4404-b010-20ae6d98ade1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:55.063518 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ce35b93b-1ace-4521-ad30-a77152573392 req-077a6d9c-ddd2-4b82-bdb7-2895728a0c33 service nova] Acquiring lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:55.063649 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ce35b93b-1ace-4521-ad30-a77152573392 req-077a6d9c-ddd2-4b82-bdb7-2895728a0c33 service nova] Lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:55.063753 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ce35b93b-1ace-4521-ad30-a77152573392 req-077a6d9c-ddd2-4b82-bdb7-2895728a0c33 service nova] Lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:55.063865 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ce35b93b-1ace-4521-ad30-a77152573392 req-077a6d9c-ddd2-4b82-bdb7-2895728a0c33 service nova] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] No waiting events found dispatching network-vif-unplugged-582f56fa-1ad0-4404-b010-20ae6d98ade1 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:55.063976 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ce35b93b-1ace-4521-ad30-a77152573392 req-077a6d9c-ddd2-4b82-bdb7-2895728a0c33 service nova] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Received event network-vif-unplugged-582f56fa-1ad0-4404-b010-20ae6d98ade1 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:44:55.064079 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ce35b93b-1ace-4521-ad30-a77152573392 req-077a6d9c-ddd2-4b82-bdb7-2895728a0c33 service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Received event network-vif-deleted-cae1ad91-b98a-4f8e-b208-20159307d77d {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:55.064217 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-ce35b93b-1ace-4521-ad30-a77152573392 req-077a6d9c-ddd2-4b82-bdb7-2895728a0c33 service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Neutron deleted interface cae1ad91-b98a-4f8e-b208-20159307d77d; detaching it from the instance and deleting it from the info cache
May 19 04:44:55.064343 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-ce35b93b-1ace-4521-ad30-a77152573392 req-077a6d9c-ddd2-4b82-bdb7-2895728a0c33 service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:55.116036 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'flavor' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:55.121294 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a5f5fc25-f381-4803-85da-dcc8cac0c966 req-0c3c6a72-d0e1-42eb-9ca8-d63676e357b2 service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Received event network-vif-unplugged-cae1ad91-b98a-4f8e-b208-20159307d77d {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:55.121495 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a5f5fc25-f381-4803-85da-dcc8cac0c966 req-0c3c6a72-d0e1-42eb-9ca8-d63676e357b2 service nova] Acquiring lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:55.123792 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a5f5fc25-f381-4803-85da-dcc8cac0c966 req-0c3c6a72-d0e1-42eb-9ca8-d63676e357b2 service nova] Lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:55.123792 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a5f5fc25-f381-4803-85da-dcc8cac0c966 req-0c3c6a72-d0e1-42eb-9ca8-d63676e357b2 service nova] Lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:55.123792 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a5f5fc25-f381-4803-85da-dcc8cac0c966 req-0c3c6a72-d0e1-42eb-9ca8-d63676e357b2 service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] No waiting events found dispatching network-vif-unplugged-cae1ad91-b98a-4f8e-b208-20159307d77d {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:55.123792 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a5f5fc25-f381-4803-85da-dcc8cac0c966 req-0c3c6a72-d0e1-42eb-9ca8-d63676e357b2 service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Received event network-vif-unplugged-cae1ad91-b98a-4f8e-b208-20159307d77d for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:44:55.123792 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a5f5fc25-f381-4803-85da-dcc8cac0c966 req-0c3c6a72-d0e1-42eb-9ca8-d63676e357b2 service nova] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Received event network-vif-deleted-582f56fa-1ad0-4404-b010-20ae6d98ade1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:55.123792 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-a5f5fc25-f381-4803-85da-dcc8cac0c966 req-0c3c6a72-d0e1-42eb-9ca8-d63676e357b2 service nova] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Neutron deleted interface 582f56fa-1ad0-4404-b010-20ae6d98ade1; detaching it from the instance and deleting it from the info cache
May 19 04:44:55.123792 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a5f5fc25-f381-4803-85da-dcc8cac0c966 req-0c3c6a72-d0e1-42eb-9ca8-d63676e357b2 service nova] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:55.298811 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:55.307668 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:55.525571 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-690448989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverbootfromvolumestablerescuetest-server-690448989',id=44,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:43:15Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7465b5668be4eb9b75c1ddc876e7eac',ramdisk_id='',reservation_id='r-8ma0qp1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-96916496',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:43:21Z,user_data=None,user_id='5885f1561f394d46bd4c1b48e7323c1e',uuid=92b3fb19-741d-476b-9d2f-83654a17aa0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29504364-b589-4dde-a783-4b3bcaea9e02", "address": "fa:16:3e:8e:f5:3b", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29504364-b5", "ovs_interfaceid": "29504364-b589-4dde-a783-4b3bcaea9e02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:44:55.525750 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converting VIF {"id": "29504364-b589-4dde-a783-4b3bcaea9e02", "address": "fa:16:3e:8e:f5:3b", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29504364-b5", "ovs_interfaceid": "29504364-b589-4dde-a783-4b3bcaea9e02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:44:55.526276 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:f5:3b,bridge_name='br-int',has_traffic_filtering=True,id=29504364-b589-4dde-a783-4b3bcaea9e02,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29504364-b5') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:44:55.526482 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:f5:3b,bridge_name='br-int',has_traffic_filtering=True,id=29504364-b589-4dde-a783-4b3bcaea9e02,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29504364-b5') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:44:55.527860 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:55.528099 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29504364-b5, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:55.531079 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:55.531696 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:55.531872 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22721980-0a5f-4110-8823-357498f40c99) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:44:55.533846 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:44:55.535276 np0000001025 nova-compute[97981]: INFO os_vif [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:f5:3b,bridge_name='br-int',has_traffic_filtering=True,id=29504364-b589-4dde-a783-4b3bcaea9e02,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29504364-b5')
May 19 04:44:55.536798 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:44:55.537084 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:44:55.537334 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:44:55.537572 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:44:55.537820 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e4db490-fa07-43c8-8325-b0028b4b6ecc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:44:55.537940 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:44:55.563465 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:55.563465 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:55.563465 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:55.563465 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:55.563465 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:44:55.563669 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:55.563669 np0000001025 nova-compute[97981]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc (non-flash)
May 19 04:44:55.563669 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:55.563669 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:44:55.563669 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:44:55.563829 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:44:55.564006 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '101')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:44:55.564797 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc', '102')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:44:55.565542 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185025f880>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc'): ({'sdm'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:44:55.565737 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Removing multipathed devices sdm, sdl {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:44:55.566234 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Flush multipath device 330000000d723aaaa {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:44:55.567523 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ce35b93b-1ace-4521-ad30-a77152573392 req-077a6d9c-ddd2-4b82-bdb7-2895728a0c33 service nova] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Detach interface failed, port_id=cae1ad91-b98a-4f8e-b208-20159307d77d, reason: Instance 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:44:55.601035 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:44:55.626673 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a5f5fc25-f381-4803-85da-dcc8cac0c966 req-0c3c6a72-d0e1-42eb-9ca8-d63676e357b2 service nova] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Detach interface failed, port_id=582f56fa-1ad0-4404-b010-20ae6d98ade1, reason: Instance af8a1b96-6f1d-4148-b9b2-36662e1051a3 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:44:55.646734 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:44:55.699632 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:44:55.699841 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:44:55.700653 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:44:55.713766 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:44:55.713939 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:44:55.724430 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:55.756388 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 101, target: iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc, portal: 192.168.40.100,3260]
May 19 04:44:55.756388 np0000001025 nova-compute[97981]: Logout of [sid: 101, target: iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc, portal: 192.168.40.100,3260] successful.
May 19 04:44:55.756388 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:55.769215 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:55.782047 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:55.800844 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Took 1.55 seconds to deallocate network for instance.
May 19 04:44:55.809062 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Took 1.34 seconds to deallocate network for instance.
May 19 04:44:55.819668 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 102, target: iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc, portal: 192.168.50.100,3260]
May 19 04:44:55.819668 np0000001025 nova-compute[97981]: Logout of [sid: 102, target: iqn.2023-03.storpool.com:os--volume-0e4db490-fa07-43c8-8325-b0028b4b6ecc, portal: 192.168.50.100,3260] successful.
May 19 04:44:55.819668 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:55.835070 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:44:55.835373 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:44:55.835531 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] <== disconnect_volume: return (297ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:44:55.835663 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:44:55.835975 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Deleting instance files /opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e_del
May 19 04:44:55.837098 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Deletion of /opt/stack/data/nova/instances/92b3fb19-741d-476b-9d2f-83654a17aa0e_del complete
May 19 04:44:56.091974 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00034642599985090783 future=<Future at 0x721850735580 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:56.092462 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Emitting event <LifecycleEvent: 1779165881.091508, 0b156bbc-f85d-4739-bf88-bc609d4f8052 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:44:56.092620 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:56.092831 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] VM Stopped (Lifecycle Event)
May 19 04:44:56.093386 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=2.3668346819999897 future=<Future at 0x7218345e6cc0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:56.093493 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=2.366677037000045 future=<Future at 0x7218345e6cc0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:56.121701 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9de7b66d-fe4a-4c65-9191-aa33e48be77d tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.950s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:56.307286 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:56.307493 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:56.343650 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Took 1.65 seconds to destroy the instance on the hypervisor.
May 19 04:44:56.344841 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:44:56.345049 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:44:56.345200 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:44:56.345415 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:56.360215 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Took 0.55 seconds to detach 1 volumes for instance.
May 19 04:44:56.394923 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-70a70712-6e6e-4904-8eb7-0bac6ee08160 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "80436afa-9cd9-41cd-b589-629da01b6bfe" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:56.395156 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-70a70712-6e6e-4904-8eb7-0bac6ee08160 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:56.395326 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-70a70712-6e6e-4904-8eb7-0bac6ee08160 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:56.397707 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-70a70712-6e6e-4904-8eb7-0bac6ee08160 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=97981) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 19 04:44:56.398743 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-70a70712-6e6e-4904-8eb7-0bac6ee08160 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'flavor' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:56.413951 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:44:56.597513 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 0b156bbc-f85d-4739-bf88-bc609d4f8052] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:56.815933 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:44:56.817247 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:44:56.867189 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:56.887988 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "fecd576c-4027-4b39-a92a-91d1e3248949" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:56.888167 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "fecd576c-4027-4b39-a92a-91d1e3248949" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:56.955289 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c8ee782c-cecb-4dff-81d7-7f581887aa0f req-d5e17211-a4e8-4ad5-bec5-fe59687f6be2 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received event network-vif-unplugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:56.955451 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c8ee782c-cecb-4dff-81d7-7f581887aa0f req-d5e17211-a4e8-4ad5-bec5-fe59687f6be2 service nova] Acquiring lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:56.955833 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c8ee782c-cecb-4dff-81d7-7f581887aa0f req-d5e17211-a4e8-4ad5-bec5-fe59687f6be2 service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:56.955970 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c8ee782c-cecb-4dff-81d7-7f581887aa0f req-d5e17211-a4e8-4ad5-bec5-fe59687f6be2 service nova] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:56.956121 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c8ee782c-cecb-4dff-81d7-7f581887aa0f req-d5e17211-a4e8-4ad5-bec5-fe59687f6be2 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] No waiting events found dispatching network-vif-unplugged-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:56.956188 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c8ee782c-cecb-4dff-81d7-7f581887aa0f req-d5e17211-a4e8-4ad5-bec5-fe59687f6be2 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received event network-vif-unplugged-29504364-b589-4dde-a783-4b3bcaea9e02 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:44:57.174565 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:57.177415 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7f641b35-5d49-4dc8-98a2-6fc62fa0e357 req-f838f5b3-0e62-4fe3-bb74-9286942e4195 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Received event network-vif-deleted-29504364-b589-4dde-a783-4b3bcaea9e02 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:57.177561 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-7f641b35-5d49-4dc8-98a2-6fc62fa0e357 req-f838f5b3-0e62-4fe3-bb74-9286942e4195 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Neutron deleted interface 29504364-b589-4dde-a783-4b3bcaea9e02; detaching it from the instance and deleting it from the info cache
May 19 04:44:57.177658 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-7f641b35-5d49-4dc8-98a2-6fc62fa0e357 req-f838f5b3-0e62-4fe3-bb74-9286942e4195 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:44:57.319529 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:44:57.389742 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:44:57.419610 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:57.422749 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:57.439579 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:57.441932 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:57.464241 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:57.465192 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:57.676623 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Took 1.33 seconds to deallocate network for instance.
May 19 04:44:57.682587 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7f641b35-5d49-4dc8-98a2-6fc62fa0e357 req-f838f5b3-0e62-4fe3-bb74-9286942e4195 service nova] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Detach interface failed, port_id=29504364-b589-4dde-a783-4b3bcaea9e02, reason: Instance 92b3fb19-741d-476b-9d2f-83654a17aa0e could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:44:57.726000 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999465977 future=<Future at 0x721834335010 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:57.727736 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Instance destroyed successfully.
May 19 04:44:57.728068 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-70a70712-6e6e-4904-8eb7-0bac6ee08160 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'numa_topology' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:57.827166 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.520s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:57.828666 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.961s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:57.890519 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Deleted allocations for instance 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd
May 19 04:44:57.941231 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:58.229727 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-70a70712-6e6e-4904-8eb7-0bac6ee08160 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Object Instance<80436afa-9cd9-41cd-b589-629da01b6bfe> lazy-loaded attributes: flavor,numa_topology {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:44:58.229972 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-70a70712-6e6e-4904-8eb7-0bac6ee08160 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:58.233960 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Took 0.56 seconds to detach 1 volumes for instance.
May 19 04:44:58.236043 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Deleting volume: 0e4db490-fa07-43c8-8325-b0028b4b6ecc {{(pid=97981) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 19 04:44:58.364261 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:44:58.364483 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:44:58.461036 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0008345360001840163 future=<Future at 0x7218345e6cc0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:58.461853 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Emitting event <LifecycleEvent: 1779165883.4601016, 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:44:58.462037 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:58.462308 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] VM Stopped (Lifecycle Event)
May 19 04:44:58.463337 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=5.376021190999836 future=<Future at 0x7218503dffb0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:58.463510 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=5.375844860000143 future=<Future at 0x7218503dffb0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:44:58.737865 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-70a70712-6e6e-4904-8eb7-0bac6ee08160 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.343s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:58.774565 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:58.866693 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:44:58.898082 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9c1eabb3-a034-4d45-9e2c-a41f53aa683f tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "73d8ac91-6ca4-4ec9-81ce-c708d25f68dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.528s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:58.965050 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 54feb5d9-cb02-4aa2-b5a2-72fdfbb3f1b8] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:44:58.998387 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'flavor' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:44:59.218172 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:44:59.245662 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f19ce54f-5f7b-4bcf-ac00-e8f89bc3008f req-7448d679-b2c0-4a3e-ae2d-1602b0c27220 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received event network-vif-unplugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:59.246029 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f19ce54f-5f7b-4bcf-ac00-e8f89bc3008f req-7448d679-b2c0-4a3e-ae2d-1602b0c27220 service nova] Acquiring lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:59.246287 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f19ce54f-5f7b-4bcf-ac00-e8f89bc3008f req-7448d679-b2c0-4a3e-ae2d-1602b0c27220 service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:59.246538 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f19ce54f-5f7b-4bcf-ac00-e8f89bc3008f req-7448d679-b2c0-4a3e-ae2d-1602b0c27220 service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:59.246658 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f19ce54f-5f7b-4bcf-ac00-e8f89bc3008f req-7448d679-b2c0-4a3e-ae2d-1602b0c27220 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] No waiting events found dispatching network-vif-unplugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:59.246777 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-f19ce54f-5f7b-4bcf-ac00-e8f89bc3008f req-7448d679-b2c0-4a3e-ae2d-1602b0c27220 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received unexpected event network-vif-unplugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 for instance with vm_state stopped and task_state powering-on.
May 19 04:44:59.246875 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f19ce54f-5f7b-4bcf-ac00-e8f89bc3008f req-7448d679-b2c0-4a3e-ae2d-1602b0c27220 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received event network-vif-unplugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:44:59.246994 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f19ce54f-5f7b-4bcf-ac00-e8f89bc3008f req-7448d679-b2c0-4a3e-ae2d-1602b0c27220 service nova] Acquiring lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:44:59.247102 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f19ce54f-5f7b-4bcf-ac00-e8f89bc3008f req-7448d679-b2c0-4a3e-ae2d-1602b0c27220 service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:59.247225 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f19ce54f-5f7b-4bcf-ac00-e8f89bc3008f req-7448d679-b2c0-4a3e-ae2d-1602b0c27220 service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:59.247316 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f19ce54f-5f7b-4bcf-ac00-e8f89bc3008f req-7448d679-b2c0-4a3e-ae2d-1602b0c27220 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] No waiting events found dispatching network-vif-unplugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:44:59.247424 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-f19ce54f-5f7b-4bcf-ac00-e8f89bc3008f req-7448d679-b2c0-4a3e-ae2d-1602b0c27220 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received unexpected event network-vif-unplugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 for instance with vm_state stopped and task_state powering-on.
May 19 04:44:59.373075 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.544s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:44:59.375228 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.432s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:44:59.379206 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:44:59.379402 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Claim successful on node np0000001025
May 19 04:44:59.424478 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Deleted allocations for instance af8a1b96-6f1d-4148-b9b2-36662e1051a3
May 19 04:44:59.502333 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "refresh_cache-80436afa-9cd9-41cd-b589-629da01b6bfe" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:44:59.502474 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquired lock "refresh_cache-80436afa-9cd9-41cd-b589-629da01b6bfe" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:44:59.502617 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:44:59.502779 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'info_cache' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:45:00.005122 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Object Instance<80436afa-9cd9-41cd-b589-629da01b6bfe> lazy-loaded attributes: flavor,info_cache {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:45:00.432260 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a25be931-ba34-4b93-b8f2-1a300f2e01a1 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "af8a1b96-6f1d-4148-b9b2-36662e1051a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.207s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:00.507032 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:00.533865 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:00.875583 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:00.891952 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:45:00.892129 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:45:01.008517 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Updating instance_info_cache with network_info: [{"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:01.394670 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:45:01.510121 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Releasing lock "refresh_cache-80436afa-9cd9-41cd-b589-629da01b6bfe" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:45:01.901771 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.528s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:01.902435 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.128s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:01.902733 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:45:02.358346 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:45:02.358875 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:45:02.409229 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:45:02.409534 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:45:02.409796 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:02.410005 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:02.477190 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c46088fb3e74b819bb456461716a801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b3c0fa8f894ed2a7c3bcfac99ce74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:45:02.521280 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Instance destroyed successfully.
May 19 04:45:02.521494 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'numa_topology' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:45:02.860754 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:45:02.896154 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "26edba3f-dd65-4651-8cc3-3939541dae32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:02.896395 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "26edba3f-dd65-4651-8cc3-3939541dae32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:02.912239 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:45:02.948479 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Successfully created port: f08ea0ed-d928-47ba-b313-41b12b79708a {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:45:03.023144 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Object Instance<80436afa-9cd9-41cd-b589-629da01b6bfe> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:45:03.023866 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'resources' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:45:03.369986 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.468s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:03.376934 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Successfully updated port: f08ea0ed-d928-47ba-b313-41b12b79708a {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:45:03.398581 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:45:03.415034 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:45:03.425293 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-74711acb-c49e-47f5-adaf-0d4603f46ac9 req-be66e4d0-298d-46f3-9a63-9b972b5f3ac1 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Received event network-changed-f08ea0ed-d928-47ba-b313-41b12b79708a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:03.425642 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-74711acb-c49e-47f5-adaf-0d4603f46ac9 req-be66e4d0-298d-46f3-9a63-9b972b5f3ac1 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Refreshing instance network info cache due to event network-changed-f08ea0ed-d928-47ba-b313-41b12b79708a. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:45:03.425793 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-74711acb-c49e-47f5-adaf-0d4603f46ac9 req-be66e4d0-298d-46f3-9a63-9b972b5f3ac1 service nova] Acquiring lock "refresh_cache-fecd576c-4027-4b39-a92a-91d1e3248949" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:45:03.425879 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-74711acb-c49e-47f5-adaf-0d4603f46ac9 req-be66e4d0-298d-46f3-9a63-9b972b5f3ac1 service nova] Acquired lock "refresh_cache-fecd576c-4027-4b39-a92a-91d1e3248949" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:45:03.426258 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-74711acb-c49e-47f5-adaf-0d4603f46ac9 req-be66e4d0-298d-46f3-9a63-9b972b5f3ac1 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Refreshing network info cache for port f08ea0ed-d928-47ba-b313-41b12b79708a {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:45:03.437196 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Deleted allocations for instance 92b3fb19-741d-476b-9d2f-83654a17aa0e
May 19 04:45:03.525533 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Object Instance<80436afa-9cd9-41cd-b589-629da01b6bfe> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:45:03.526159 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-640764006',display_name='tempest-AttachVolumeTestJSON-server-640764006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumetestjson-server-640764006',id=45,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2tj8xzpEQbsFz0KUREQNWmpjZhzzIU4JsBBAhR6kXLneAex6Ogc6JmA+zSTxW3EHqpPyo/1HFfxr+XwLCwn6E7c5wL4jf0HNaUzjvIvGdUt6TsdBS845t/ZQ77wWohcw==',key_name='tempest-keypair-402968852',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:43:06Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='662c1a9b25e44aff8242f468232af7f3',ramdisk_id='',reservation_id='r-bmmqkbkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1215369469',owner_user_name='tempest-AttachVolumeTestJSON-1215369469-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f7f84eb55d44e89c2ed500098135e0',uuid=80436afa-9cd9-41cd-b589-629da01b6bfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:45:03.526388 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converting VIF {"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:45:03.526948 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:04:9d,bridge_name='br-int',has_traffic_filtering=True,id=15e6bc86-13bd-43b9-ad28-342f33dbdeb8,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6bc86-13') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:45:03.527538 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:04:9d,bridge_name='br-int',has_traffic_filtering=True,id=15e6bc86-13bd-43b9-ad28-342f33dbdeb8,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6bc86-13') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:45:03.528090 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:03.528305 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15e6bc86-13, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:03.529597 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:03.530828 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:03.531407 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:03.531535 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e3352f3-545a-4e72-aeef-54dc5e5c1061) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:03.532071 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:03.532630 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:03.533076 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:03.534618 np0000001025 nova-compute[97981]: INFO os_vif [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:04:9d,bridge_name='br-int',has_traffic_filtering=True,id=15e6bc86-13bd-43b9-ad28-342f33dbdeb8,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6bc86-13')
May 19 04:45:03.538553 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Start _get_guest_xml network_info=[{"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:45:03.540152 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:45:03.541051 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-640764006', uuid='80436afa-9cd9-41cd-b589-629da01b6bfe'), owner=OwnerMeta(userid='96f7f84eb55d44e89c2ed500098135e0', username='tempest-AttachVolumeTestJSON-1215369469-project-member', projectid='662c1a9b25e44aff8242f468232af7f3', projectname='tempest-AttachVolumeTestJSON-1215369469'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165903.5407662) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:45:03.542151 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:45:03.542469 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:45:03.543345 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:45:03.543597 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:45:03.544581 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:45:03.544840 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:45:03.545019 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:45:03.545165 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:45:03.545325 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:45:03.545454 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:45:03.545586 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:45:03.545772 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:45:03.545905 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:45:03.546041 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:45:03.546191 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:45:03.546344 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:45:03.546514 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'vcpu_model' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:45:03.839788 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00039320499990935787 future=<Future at 0x7218503dffb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:03.840148 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Emitting event <LifecycleEvent: 1779165888.839274, 3aa0ffed-decc-493c-8735-aba1d221571d => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:03.840311 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:03.840487 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] VM Stopped (Lifecycle Event)
May 19 04:45:03.841459 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=4.236653562999891 future=<Future at 0x7218506f95b0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:03.841579 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=4.236491088999628 future=<Future at 0x7218506f95b0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:03.879409 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "refresh_cache-fecd576c-4027-4b39-a92a-91d1e3248949" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:45:03.920257 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Booting with volume 1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 at /dev/vda
May 19 04:45:03.928606 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-74711acb-c49e-47f5-adaf-0d4603f46ac9 req-be66e4d0-298d-46f3-9a63-9b972b5f3ac1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:03.956359 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:03.956556 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:03.959896 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:45:03.962753 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:45:03.962961 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Claim successful on node np0000001025
May 19 04:45:03.972339 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:45:03.996265 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:04.016082 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-74711acb-c49e-47f5-adaf-0d4603f46ac9 req-be66e4d0-298d-46f3-9a63-9b972b5f3ac1 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:45:04.046751 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:45:04.046939 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:45:04.048596 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Object Instance<80436afa-9cd9-41cd-b589-629da01b6bfe> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:45:04.056612 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:45:04.057873 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:feed:8d89', 'fe80::b81f:e5ff:fe32:2cdc', 'fe80::fc16:3eff:fe0e:aa6f', 'fe80::fc16:3eff:fea1:aa43', 'fe80::fc16:3eff:fefb:c3a3', 'fe80::2c2c:57ff:feff:64a5', 'fe80::fc16:3eff:fefa:d4f0', 'fe80::fc16:3eff:feb0:9e6f'] 
May 19 04:45:04.057991 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:45:04.058173 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:45:04.058601 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:45:04.058950 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Updating existing volume attachment record: 3437d8ef-2c56-4dd5-8f06-310e1cbbd4a1 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:45:04.067036 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-640764006',display_name='tempest-AttachVolumeTestJSON-server-640764006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumetestjson-server-640764006',id=45,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2tj8xzpEQbsFz0KUREQNWmpjZhzzIU4JsBBAhR6kXLneAex6Ogc6JmA+zSTxW3EHqpPyo/1HFfxr+XwLCwn6E7c5wL4jf0HNaUzjvIvGdUt6TsdBS845t/ZQ77wWohcw==',key_name='tempest-keypair-402968852',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:43:06Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='662c1a9b25e44aff8242f468232af7f3',ramdisk_id='',reservation_id='r-bmmqkbkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1215369469',owner_user_name='tempest-AttachVolumeTestJSON-1215369469-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f7f84eb55d44e89c2ed500098135e0',uuid=80436afa-9cd9-41cd-b589-629da01b6bfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:45:04.067781 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converting VIF {"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:45:04.068193 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:04:9d,bridge_name='br-int',has_traffic_filtering=True,id=15e6bc86-13bd-43b9-ad28-342f33dbdeb8,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6bc86-13') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:45:04.069142 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'pci_devices' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:45:04.173943 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-74711acb-c49e-47f5-adaf-0d4603f46ac9 req-be66e4d0-298d-46f3-9a63-9b972b5f3ac1 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:04.175336 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "417861ee-dcf2-458b-8782-2ec22d2f5421" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:04.175653 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:04.175850 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:04.176020 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:04.176382 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:04.178903 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Terminating instance
May 19 04:45:04.343254 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: 3aa0ffed-decc-493c-8735-aba1d221571d] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:04.445983 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c42a2b91-e7d3-4953-bcfc-0bdc497d91a4 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "92b3fb19-741d-476b-9d2f-83654a17aa0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.257s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:04.571502 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Object Instance<80436afa-9cd9-41cd-b589-629da01b6bfe> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:45:04.572631 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] End _get_guest_xml xml=<domain type="qemu">
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:   <uuid>80436afa-9cd9-41cd-b589-629da01b6bfe</uuid>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:   <name>instance-0000002d</name>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <nova:name>tempest-AttachVolumeTestJSON-server-640764006</nova:name>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:45:03</nova:creationTime>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:           <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:           <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:         <nova:user uuid="96f7f84eb55d44e89c2ed500098135e0">tempest-AttachVolumeTestJSON-1215369469-project-member</nova:user>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:         <nova:project uuid="662c1a9b25e44aff8242f468232af7f3">tempest-AttachVolumeTestJSON-1215369469</nova:project>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:         <nova:port uuid="15e6bc86-13bd-43b9-ad28-342f33dbdeb8">
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     <system>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <entry name="serial">80436afa-9cd9-41cd-b589-629da01b6bfe</entry>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <entry name="uuid">80436afa-9cd9-41cd-b589-629da01b6bfe</entry>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     </system>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:   <os>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:   </os>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:   <features>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:   </features>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:   <devices>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk"/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     </disk>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk.config"/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     </disk>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:08:04:9d"/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <target dev="tap15e6bc86-13"/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     </interface>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/console.log" append="off"/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     </serial>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     <video>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     </video>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     </rng>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:   </devices>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]: </domain>
May 19 04:45:04.572631 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:45:04.574624 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:04.669832 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:04.670514 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:04.689583 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-74711acb-c49e-47f5-adaf-0d4603f46ac9 req-be66e4d0-298d-46f3-9a63-9b972b5f3ac1 service nova] Releasing lock "refresh_cache-fecd576c-4027-4b39-a92a-91d1e3248949" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:45:04.692323 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:45:04.694559 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquired lock "refresh_cache-fecd576c-4027-4b39-a92a-91d1e3248949" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:45:04.697258 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:45:04.725297 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:04.728127 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:04.750561 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:04.789934 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:04.791286 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'trusted_certs' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:45:04.874405 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:04.880148 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:04.890497 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-44d7ed26-9158-412e-88dd-f55a4fc02011 req-bf6fc275-40cd-4c8d-8d52-dfb046ddc730 service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Received event network-vif-unplugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:04.890922 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-44d7ed26-9158-412e-88dd-f55a4fc02011 req-bf6fc275-40cd-4c8d-8d52-dfb046ddc730 service nova] Acquiring lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:04.891148 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-44d7ed26-9158-412e-88dd-f55a4fc02011 req-bf6fc275-40cd-4c8d-8d52-dfb046ddc730 service nova] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:04.891340 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-44d7ed26-9158-412e-88dd-f55a4fc02011 req-bf6fc275-40cd-4c8d-8d52-dfb046ddc730 service nova] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:04.891454 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-44d7ed26-9158-412e-88dd-f55a4fc02011 req-bf6fc275-40cd-4c8d-8d52-dfb046ddc730 service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] No waiting events found dispatching network-vif-unplugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:45:04.891598 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-44d7ed26-9158-412e-88dd-f55a4fc02011 req-bf6fc275-40cd-4c8d-8d52-dfb046ddc730 service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Received event network-vif-unplugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:45:04.937966 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:04.938214 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:04.938398 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:04.938579 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:04.938725 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:04.941405 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Terminating instance
May 19 04:45:05.022246 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999661705000108 future=<Future at 0x7218344179e0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:05.023118 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Instance destroyed successfully.
May 19 04:45:05.024156 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'resources' on Instance uuid 417861ee-dcf2-458b-8782-2ec22d2f5421 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:45:05.275832 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:45:05.295769 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Object Instance<80436afa-9cd9-41cd-b589-629da01b6bfe> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:45:05.296287 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:05.403949 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.107s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:05.404422 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:45:05.404728 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:05.445995 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:45:05.495860 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:05.499459 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:05.506305 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:05.511368 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:05.512354 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Cannot resize image /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:45:05.512686 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'migration_context' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:45:05.523046 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:05.525974 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001025',hostname='multiattach-server-1',id=38,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9kq9UfoFPrqlSUYASLa2M8/KXwpiWIksTRz6r+vXFFf5G7djO79flSW+4jvUEBmYvioxzxvTch1hKVIwlMIaMSuT3AyUPlX/5ZPn59wF6pdcyyqAHuNzAVPjAjiGd+6A==',key_name='tempest-keypair-818275091',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:43:45Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-56qgb0gs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:43:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa432d60cb324c6d87818107e05e0053',uuid=417861ee-dcf2-458b-8782-2ec22d2f5421,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:45:05.528331 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "address": "fa:16:3e:b0:9e:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51c757a-33", "ovs_interfaceid": "d51c757a-3333-4e40-8d5f-3c2d35a128b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:45:05.528783 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:9e:6f,bridge_name='br-int',has_traffic_filtering=True,id=d51c757a-3333-4e40-8d5f-3c2d35a128b2,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51c757a-33') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:45:05.529048 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:9e:6f,bridge_name='br-int',has_traffic_filtering=True,id=d51c757a-3333-4e40-8d5f-3c2d35a128b2,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51c757a-33') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:45:05.529974 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:05.531145 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:05.531352 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd51c757a-33, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:05.532363 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:05.533118 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:05.535432 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:45:05.535751 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:45:05.557746 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:05.564387 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:05.567293 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:05.567293 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=226f16ce-1add-490c-8309-45a363891445) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:05.567815 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:05.568812 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:05.574682 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:05.577088 np0000001025 nova-compute[97981]: INFO os_vif [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:9e:6f,bridge_name='br-int',has_traffic_filtering=True,id=d51c757a-3333-4e40-8d5f-3c2d35a128b2,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51c757a-33')
May 19 04:45:05.577463 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Deleting instance files /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421_del
May 19 04:45:05.585515 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Deletion of /opt/stack/data/nova/instances/417861ee-dcf2-458b-8782-2ec22d2f5421_del complete
May 19 04:45:05.656755 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Updating instance_info_cache with network_info: [{"id": "f08ea0ed-d928-47ba-b313-41b12b79708a", "address": "fa:16:3e:3d:b3:c8", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf08ea0ed-d9", "ovs_interfaceid": "f08ea0ed-d928-47ba-b313-41b12b79708a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:05.788955 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999670312000035 future=<Future at 0x7218506f8ce0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:05.789609 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Instance destroyed successfully.
May 19 04:45:05.790209 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lazy-loading 'resources' on Instance uuid a73d6831-b1cd-4d69-a78c-16d3ac8010c7 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:45:05.930618 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:05.934054 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a941946b-ef1c-46d9-a355-4e40f2c8fac3 req-9a06b1f7-464c-480f-af4e-375d113031ae service nova] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Received event network-vif-unplugged-d7084fd1-d136-4a21-81fc-df65be57d7ca {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:05.934373 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a941946b-ef1c-46d9-a355-4e40f2c8fac3 req-9a06b1f7-464c-480f-af4e-375d113031ae service nova] Acquiring lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:05.934606 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a941946b-ef1c-46d9-a355-4e40f2c8fac3 req-9a06b1f7-464c-480f-af4e-375d113031ae service nova] Lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:05.934745 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a941946b-ef1c-46d9-a355-4e40f2c8fac3 req-9a06b1f7-464c-480f-af4e-375d113031ae service nova] Lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:05.934932 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a941946b-ef1c-46d9-a355-4e40f2c8fac3 req-9a06b1f7-464c-480f-af4e-375d113031ae service nova] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] No waiting events found dispatching network-vif-unplugged-d7084fd1-d136-4a21-81fc-df65be57d7ca {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:45:05.935078 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a941946b-ef1c-46d9-a355-4e40f2c8fac3 req-9a06b1f7-464c-480f-af4e-375d113031ae service nova] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Received event network-vif-unplugged-d7084fd1-d136-4a21-81fc-df65be57d7ca for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:45:06.015035 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Object Instance<80436afa-9cd9-41cd-b589-629da01b6bfe> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:45:06.016188 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-640764006',display_name='tempest-AttachVolumeTestJSON-server-640764006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumetestjson-server-640764006',id=45,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2tj8xzpEQbsFz0KUREQNWmpjZhzzIU4JsBBAhR6kXLneAex6Ogc6JmA+zSTxW3EHqpPyo/1HFfxr+XwLCwn6E7c5wL4jf0HNaUzjvIvGdUt6TsdBS845t/ZQ77wWohcw==',key_name='tempest-keypair-402968852',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:43:06Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='662c1a9b25e44aff8242f468232af7f3',ramdisk_id='',reservation_id='r-bmmqkbkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1215369469',owner_user_name='tempest-AttachVolumeTestJSON-1215369469-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f7f84eb55d44e89c2ed500098135e0',uuid=80436afa-9cd9-41cd-b589-629da01b6bfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:45:06.016792 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converting VIF {"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:45:06.017363 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:04:9d,bridge_name='br-int',has_traffic_filtering=True,id=15e6bc86-13bd-43b9-ad28-342f33dbdeb8,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6bc86-13') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:45:06.017587 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:04:9d,bridge_name='br-int',has_traffic_filtering=True,id=15e6bc86-13bd-43b9-ad28-342f33dbdeb8,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6bc86-13') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:45:06.018380 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:06.018380 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:06.018380 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:45:06.019307 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:06.019307 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51c35113-096a-5174-9894-21a7513c268b', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:06.020510 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:06.020763 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:06.026533 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:06.028484 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:06.028642 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15e6bc86-13, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:06.028956 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15e6bc86-13, col_values=(('qos', UUID('60e2e370-a142-4517-95a1-7740974487fd')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:06.029305 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15e6bc86-13, col_values=(('external_ids', {'iface-id': '15e6bc86-13bd-43b9-ad28-342f33dbdeb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:04:9d', 'vm-uuid': '80436afa-9cd9-41cd-b589-629da01b6bfe'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:06.030324 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:06.030931 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:06.040311 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:45:06.045922 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:06.049555 np0000001025 nova-compute[97981]: INFO os_vif [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:04:9d,bridge_name='br-int',has_traffic_filtering=True,id=15e6bc86-13bd-43b9-ad28-342f33dbdeb8,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6bc86-13')
May 19 04:45:06.092303 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Took 1.40 seconds to destroy the instance on the hypervisor.
May 19 04:45:06.093007 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:45:06.093467 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:45:06.093655 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:45:06.093955 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:06.160376 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Releasing lock "refresh_cache-fecd576c-4027-4b39-a92a-91d1e3248949" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:45:06.161100 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Instance network_info: |[{"id": "f08ea0ed-d928-47ba-b313-41b12b79708a", "address": "fa:16:3e:3d:b3:c8", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf08ea0ed-d9", "ovs_interfaceid": "f08ea0ed-d928-47ba-b313-41b12b79708a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:45:06.172321 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:45:06.173886 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:45:06.174204 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Creating image(s)
May 19 04:45:06.174650 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:45:06.174833 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Ensure instance console log exists: /opt/stack/data/nova/instances/fecd576c-4027-4b39-a92a-91d1e3248949/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:45:06.175138 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:06.175344 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:06.175533 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:06.176172 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Start _get_guest_xml network_info=[{"id": "f08ea0ed-d928-47ba-b313-41b12b79708a", "address": "fa:16:3e:3d:b3:c8", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf08ea0ed-d9", "ovs_interfaceid": "f08ea0ed-d928-47ba-b313-41b12b79708a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '3437d8ef-2c56-4dd5-8f06-310e1cbbd4a1', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'fecd576c-4027-4b39-a92a-91d1e3248949', 'attached_at': '', 'detached_at': '', 'volume_id': '1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'serial': '1bdfa1a6-fb6c-4690-8dd6-a14e0926d531'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:45:06.179707 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:45:06.181226 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-631335083', uuid='fecd576c-4027-4b39-a92a-91d1e3248949'), owner=OwnerMeta(userid='5c46088fb3e74b819bb456461716a801', username='tempest-TestVolumeBootPattern-1071176852-project-member', projectid='28b3c0fa8f894ed2a7c3bcfac99ce74c', projectname='tempest-TestVolumeBootPattern-1071176852'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f08ea0ed-d928-47ba-b313-41b12b79708a", "address": "fa:16:3e:3d:b3:c8", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf08ea0ed-d9", "ovs_interfaceid": "f08ea0ed-d928-47ba-b313-41b12b79708a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165906.1807475) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:45:06.183821 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:45:06.184224 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:45:06.185675 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:45:06.185898 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:45:06.187115 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:45:06.187522 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:45:06.187719 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:45:06.187851 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:45:06.188019 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:45:06.188150 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:45:06.188282 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:45:06.188513 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:45:06.188657 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:45:06.188850 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:45:06.189021 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:45:06.189347 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:45:06.199795 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:06.204451 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:45:06.204451 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:45:06.204451 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:45:06.204451 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:45:06.204766 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:45:06.215702 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:45:06.216310 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:45:06.216818 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:45:06.217055 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:45:06.217593 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:45:06.217593 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:45:06.228391 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:45:06.228391 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:06.234146 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:45:06.234146 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:06.241361 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531] added
May 19 04:45:06.241361 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:45:06.241361 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:45:06.241361 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:45:06.241361 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:45:06.241361 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:45:06.241361 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:06.241653 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:45:06.241925 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0247(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:45:06.242050 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:45:06.251885 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531] added
May 19 04:45:06.251885 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:45:06.251885 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:45:06.251885 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:45:06.251885 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:45:06.251885 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:45:06.251885 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:06.252725 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:45:06.252725 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0348(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:45:06.252725 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:45:06.293667 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:41:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-462274281',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverbootfromvolumestablerescuetest-server-462274281',id=43,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:42:12Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7465b5668be4eb9b75c1ddc876e7eac',ramdisk_id='',reservation_id='r-7x6m52p4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-96916496',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:42:19Z,user_data=None,user_id='5885f1561f394d46bd4c1b48e7323c1e',uuid=a73d6831-b1cd-4d69-a78c-16d3ac8010c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7084fd1-d136-4a21-81fc-df65be57d7ca", "address": "fa:16:3e:fb:c3:a3", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7084fd1-d1", "ovs_interfaceid": "d7084fd1-d136-4a21-81fc-df65be57d7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:45:06.294053 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converting VIF {"id": "d7084fd1-d136-4a21-81fc-df65be57d7ca", "address": "fa:16:3e:fb:c3:a3", "network": {"id": "8bbb2654-8c58-43ff-8313-2bda3f3fbc5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-689772255-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7465b5668be4eb9b75c1ddc876e7eac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7084fd1-d1", "ovs_interfaceid": "d7084fd1-d136-4a21-81fc-df65be57d7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:45:06.294807 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c3:a3,bridge_name='br-int',has_traffic_filtering=True,id=d7084fd1-d136-4a21-81fc-df65be57d7ca,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7084fd1-d1') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:45:06.295039 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c3:a3,bridge_name='br-int',has_traffic_filtering=True,id=d7084fd1-d136-4a21-81fc-df65be57d7ca,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7084fd1-d1') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:45:06.296292 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:06.296473 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7084fd1-d1, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:06.297397 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:06.298564 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:06.305266 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:06.306847 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:06.306847 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7204aab0-003b-45ac-8c85-22f210085bd4) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:06.306847 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:06.307196 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:06.312717 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:06.315253 np0000001025 nova-compute[97981]: INFO os_vif [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c3:a3,bridge_name='br-int',has_traffic_filtering=True,id=d7084fd1-d136-4a21-81fc-df65be57d7ca,network=Network(8bbb2654-8c58-43ff-8313-2bda3f3fbc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7084fd1-d1')
May 19 04:45:06.315770 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Deleting instance files /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7_del
May 19 04:45:06.316662 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Deletion of /opt/stack/data/nova/instances/a73d6831-b1cd-4d69-a78c-16d3ac8010c7_del complete
May 19 04:45:06.518068 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:06.541719 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:06.554465 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.598s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:06.554870 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:45:06.642622 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:06.823698 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Took 1.38 seconds to destroy the instance on the hypervisor.
May 19 04:45:06.824615 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:45:06.825038 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:45:06.825156 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:45:06.825376 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:06.848196 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:06.850048 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:06.853633 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:06.875344 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:06.957540 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:06.971365 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-845cb25b-4919-4690-9f42-cf95f075fbcc req-a0b5c98c-1c83-4b73-9052-db52a55e1a46 service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Received event network-vif-unplugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:06.971605 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-845cb25b-4919-4690-9f42-cf95f075fbcc req-a0b5c98c-1c83-4b73-9052-db52a55e1a46 service nova] Acquiring lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:06.971822 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-845cb25b-4919-4690-9f42-cf95f075fbcc req-a0b5c98c-1c83-4b73-9052-db52a55e1a46 service nova] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:06.971981 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-845cb25b-4919-4690-9f42-cf95f075fbcc req-a0b5c98c-1c83-4b73-9052-db52a55e1a46 service nova] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:06.972599 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-845cb25b-4919-4690-9f42-cf95f075fbcc req-a0b5c98c-1c83-4b73-9052-db52a55e1a46 service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] No waiting events found dispatching network-vif-unplugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:45:06.972834 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-845cb25b-4919-4690-9f42-cf95f075fbcc req-a0b5c98c-1c83-4b73-9052-db52a55e1a46 service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Received event network-vif-unplugged-d51c757a-3333-4e40-8d5f-3c2d35a128b2 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:45:07.066175 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:45:07.066175 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:45:07.066362 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:07.066511 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:07.081973 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:07.203007 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ada528b0c5c740799599a2b163709a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041ddbe11174207bbc7363b3bf08af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:45:07.242509 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:45:07.253154 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:45:07.256209 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:45:07.256209 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:45:07.269028 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:45:07.269028 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:07.275171 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:07.281475 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:07.287833 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:45:07.287833 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:45:07.287833 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:45:07.288056 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:45:07.288056 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:45:07.288056 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:45:07.293806 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:45:07.293806 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:45:07.293806 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:45:07.293976 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:45:07.293976 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:45:07.293976 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:45:07.329808 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531, portal: 192.168.40.100,3260]
May 19 04:45:07.329808 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531, portal: 192.168.40.100,3260] successful.
May 19 04:45:07.329808 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:07.340002 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531, portal: 192.168.50.100,3260]
May 19 04:45:07.340002 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531, portal: 192.168.50.100,3260] successful.
May 19 04:45:07.340002 np0000001025 nova-compute[97981]:  stderr=iscsiadm: could not read session targetname: 5
May 19 04:45:07.340002 np0000001025 nova-compute[97981]: iscsiadm: could not find session info for session123
May 19 04:45:07.340002 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:07.341732 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Removed pending STOPPED event for 80436afa-9cd9-41cd-b589-629da01b6bfe due to new event <LifecycleEvent: 1779165907.341446, 80436afa-9cd9-41cd-b589-629da01b6bfe => Resumed> {{(pid=97981) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 19 04:45:07.341894 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165907.341446, 80436afa-9cd9-41cd-b589-629da01b6bfe => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:07.342020 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] VM Resumed (Lifecycle Event)
May 19 04:45:07.343247 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Instance event wait completed in 0 seconds for  {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:45:07.344144 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:07.350388 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Instance rebooted successfully.
May 19 04:45:07.356330 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:07.365383 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:45:07.365383 np0000001025 nova-compute[97981]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:45:07.365383 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:45:07.365383 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:45:07.365383 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:45:07.365659 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:45:07.365659 np0000001025 nova-compute[97981]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:45:07.365659 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:45:07.365659 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:45:07.365659 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:45:07.366136 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:45:07.366373 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:45:07.367238 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] HCTL ('7', '-', '-', 0) found on session 123 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:45:07.367379 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:45:07.373786 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:45:07.373786 np0000001025 nova-compute[97981]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:45:07.373786 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:45:07.373786 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:45:07.373786 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:45:07.374016 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:45:07.374016 np0000001025 nova-compute[97981]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:45:07.374016 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:45:07.374016 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:45:07.374016 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:45:07.374275 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:45:07.374391 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:45:07.374888 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] HCTL ('8', '-', '-', 0) found on session 124 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:45:07.374979 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:45:07.386632 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching for a device in session 123 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:45:07.386846 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:45:07.390660 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching for a device in session 124 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:45:07.390845 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:45:07.570206 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:45:07.585030 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Took 1.49 seconds to deallocate network for instance.
May 19 04:45:07.673377 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:07.749837 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:07.848962 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:07.851754 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:45:08.038617 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-68dd9f39-e609-4845-9ce2-f6082ce99067 req-e51cd5b4-dd44-4de7-b9d8-449eaa7fec93 service nova] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Received event network-vif-unplugged-d7084fd1-d136-4a21-81fc-df65be57d7ca {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:08.039130 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-68dd9f39-e609-4845-9ce2-f6082ce99067 req-e51cd5b4-dd44-4de7-b9d8-449eaa7fec93 service nova] Acquiring lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:08.039419 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-68dd9f39-e609-4845-9ce2-f6082ce99067 req-e51cd5b4-dd44-4de7-b9d8-449eaa7fec93 service nova] Lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:08.039552 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-68dd9f39-e609-4845-9ce2-f6082ce99067 req-e51cd5b4-dd44-4de7-b9d8-449eaa7fec93 service nova] Lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:08.040248 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-68dd9f39-e609-4845-9ce2-f6082ce99067 req-e51cd5b4-dd44-4de7-b9d8-449eaa7fec93 service nova] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] No waiting events found dispatching network-vif-unplugged-d7084fd1-d136-4a21-81fc-df65be57d7ca {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:45:08.040248 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-68dd9f39-e609-4845-9ce2-f6082ce99067 req-e51cd5b4-dd44-4de7-b9d8-449eaa7fec93 service nova] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Received event network-vif-unplugged-d7084fd1-d136-4a21-81fc-df65be57d7ca for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:45:08.040248 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-68dd9f39-e609-4845-9ce2-f6082ce99067 req-e51cd5b4-dd44-4de7-b9d8-449eaa7fec93 service nova] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Received event network-vif-deleted-d51c757a-3333-4e40-8d5f-3c2d35a128b2 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:08.040248 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-68dd9f39-e609-4845-9ce2-f6082ce99067 req-e51cd5b4-dd44-4de7-b9d8-449eaa7fec93 service nova] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Received event network-vif-deleted-d7084fd1-d136-4a21-81fc-df65be57d7ca {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:08.077367 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:45:08.080925 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0026613909999468888 future=<Future at 0x7218506f95b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:08.082705 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:08.083232 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] Emitting event <LifecycleEvent: 1779165893.0780022, af8a1b96-6f1d-4148-b9b2-36662e1051a3 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:08.083450 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=0.13869353199970647 future=<Future at 0x7218342cc080 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:08.083699 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] VM Stopped (Lifecycle Event)
May 19 04:45:08.085882 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=0.13657831000000442 future=<Future at 0x7218342cc080 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:08.092559 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:08.092815 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:08.175762 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Took 1.35 seconds to deallocate network for instance.
May 19 04:45:08.218511 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:45:08.222602 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0004150050003772776 future=<Future at 0x7218342cc080 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:08.222738 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:08.222863 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=1.7958897159996923 future=<Future at 0x7218342ccce0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:08.222909 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=1.7957813319999332 future=<Future at 0x7218342ccce0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:08.223216 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Emitting event <LifecycleEvent: 1779165893.2220683, 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:08.223389 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] VM Stopped (Lifecycle Event)
May 19 04:45:08.231862 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Successfully created port: 660d654e-68e9-48a7-8ba0-1947fccd007a {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:45:08.354972 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] During sync_power_state the instance has a pending task (powering-on). Skip.
May 19 04:45:08.355307 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165908.35508, 80436afa-9cd9-41cd-b589-629da01b6bfe => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:08.355455 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] VM Started (Lifecycle Event)
May 19 04:45:08.369148 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:08.587839 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a12e7160-c872-4ed2-948c-5f3ef6dada5d req-4df9639d-680e-48a3-8081-fb0719f29d91 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received event network-vif-plugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:08.590935 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-a1ad3573-6b72-410f-987e-ee25f9749ba1 tempest-VolumeMultiattachTests-1349332830 tempest-VolumeMultiattachTests-1349332830-project-member] [instance: af8a1b96-6f1d-4148-b9b2-36662e1051a3] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:08.593660 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a12e7160-c872-4ed2-948c-5f3ef6dada5d req-4df9639d-680e-48a3-8081-fb0719f29d91 service nova] Acquiring lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:08.594125 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a12e7160-c872-4ed2-948c-5f3ef6dada5d req-4df9639d-680e-48a3-8081-fb0719f29d91 service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:08.595465 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a12e7160-c872-4ed2-948c-5f3ef6dada5d req-4df9639d-680e-48a3-8081-fb0719f29d91 service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:08.597685 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a12e7160-c872-4ed2-948c-5f3ef6dada5d req-4df9639d-680e-48a3-8081-fb0719f29d91 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] No waiting events found dispatching network-vif-plugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:45:08.597865 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-a12e7160-c872-4ed2-948c-5f3ef6dada5d req-4df9639d-680e-48a3-8081-fb0719f29d91 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received unexpected event network-vif-plugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 for instance with vm_state stopped and task_state powering-on.
May 19 04:45:08.650594 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:45:08.650788 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:45:08.686464 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:08.738684 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 73d8ac91-6ca4-4ec9-81ce-c708d25f68dd] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:08.859002 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:08.862059 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:45:08.869370 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:45:08.869553 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:45:08.869802 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No VIF found with MAC fa:16:3e:08:04:9d, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:45:08.870129 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-25b4902d-4771-4ba6-8854-4308446d3ea1 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:09.091416 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:45:09.092633 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:45:09.092995 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Creating image(s)
May 19 04:45:09.093644 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "/opt/stack/data/nova/instances/26edba3f-dd65-4651-8cc3-3939541dae32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:09.093907 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "/opt/stack/data/nova/instances/26edba3f-dd65-4651-8cc3-3939541dae32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:09.094622 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "/opt/stack/data/nova/instances/26edba3f-dd65-4651-8cc3-3939541dae32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:09.096644 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:45:09.099622 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:45:09.100726 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:09.155194 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:45:09.188302 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Successfully updated port: 660d654e-68e9-48a7-8ba0-1947fccd007a {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:45:09.210177 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.109s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:09.213517 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:09.213517 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:09.213517 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:45:09.214334 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:45:09.214964 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:09.248776 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Found WWN 33000000039c706b0 for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:45:09.249808 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:45:09.250299 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '33000000039c706b0', 'path': '/dev/dm-0', 'multipath_id': '33000000039c706b0'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:45:09.250548 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000039c706b0', 'path': '/dev/dm-0', 'multipath_id': '33000000039c706b0'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:45:09.318025 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.103s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:09.318741 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/26edba3f-dd65-4651-8cc3-3939541dae32/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:09.367246 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] During sync_power_state the instance has a pending task (powering-on). Skip.
May 19 04:45:09.375119 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/26edba3f-dd65-4651-8cc3-3939541dae32/disk 1073741824" returned: 0 in 0.056s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:09.375665 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.164s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:09.376004 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:09.475925 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.100s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:09.476298 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Checking if we can resize image /opt/stack/data/nova/instances/26edba3f-dd65-4651-8cc3-3939541dae32/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:45:09.476515 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26edba3f-dd65-4651-8cc3-3939541dae32/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:09.585838 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26edba3f-dd65-4651-8cc3-3939541dae32/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:09.586331 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Cannot resize image /opt/stack/data/nova/instances/26edba3f-dd65-4651-8cc3-3939541dae32/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:45:09.586768 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:45:09.587077 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Ensure instance console log exists: /opt/stack/data/nova/instances/26edba3f-dd65-4651-8cc3-3939541dae32/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:45:09.587285 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:09.587621 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:09.587785 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:09.667715 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.574s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:09.670732 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.982s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:09.690457 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "refresh_cache-26edba3f-dd65-4651-8cc3-3939541dae32" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:45:09.690672 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquired lock "refresh_cache-26edba3f-dd65-4651-8cc3-3939541dae32" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:45:09.690834 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:45:09.736657 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Deleted allocations for instance 417861ee-dcf2-458b-8782-2ec22d2f5421
May 19 04:45:09.762561 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-631335083',display_name='tempest-TestVolumeBootPattern-server-631335083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-631335083',id=54,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN64hvrIGybIwAElinLKo/VbG9hSjSUs/ze49uyTKPWXsdeqEUWn/Lpvjt2B+Fess/qheYjdkiwQfjT63zoCE3gTtilbfESU8llxkXIh3KDQg4BSLPbR62uq8/NYye8VAw==',key_name='tempest-TestVolumeBootPattern-644793043',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-47pm5dmf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:45:03Z,user_data=None,user_id='5c46088fb3e74b819bb456461716a801',uuid=fecd576c-4027-4b39-a92a-91d1e3248949,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f08ea0ed-d928-47ba-b313-41b12b79708a", "address": "fa:16:3e:3d:b3:c8", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf08ea0ed-d9", "ovs_interfaceid": "f08ea0ed-d928-47ba-b313-41b12b79708a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:45:09.762785 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "f08ea0ed-d928-47ba-b313-41b12b79708a", "address": "fa:16:3e:3d:b3:c8", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf08ea0ed-d9", "ovs_interfaceid": "f08ea0ed-d928-47ba-b313-41b12b79708a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:45:09.763389 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:b3:c8,bridge_name='br-int',has_traffic_filtering=True,id=f08ea0ed-d928-47ba-b313-41b12b79708a,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf08ea0ed-d9') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:45:09.764197 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'pci_devices' on Instance uuid fecd576c-4027-4b39-a92a-91d1e3248949 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:45:10.021647 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.002894692000154464 future=<Future at 0x7218342ccce0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:10.021790 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:10.022442 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] Emitting event <LifecycleEvent: 1779165895.0186381, 92b3fb19-741d-476b-9d2f-83654a17aa0e => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:10.022679 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=2.7027646870001263 future=<Future at 0x721834335010 state=cancelled>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:10.022887 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] VM Stopped (Lifecycle Event)
May 19 04:45:10.023611 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=2.7018438780000906 future=<Future at 0x721834335010 state=cancelled>) was cancelled while queued, skipping {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:10.023725 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:10.024312 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=9.997562858000038 future=<Future at 0x7218344179e0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:10.024571 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=9.99729797100008 future=<Future at 0x7218344179e0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:10.113342 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:45:10.113679 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:45:10.251724 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:45:10.267683 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] End _get_guest_xml xml=<domain type="qemu">
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:   <uuid>fecd576c-4027-4b39-a92a-91d1e3248949</uuid>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:   <name>instance-00000036</name>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestVolumeBootPattern-server-631335083</nova:name>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:45:06</nova:creationTime>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:         <nova:user uuid="5c46088fb3e74b819bb456461716a801">tempest-TestVolumeBootPattern-1071176852-project-member</nova:user>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:         <nova:project uuid="28b3c0fa8f894ed2a7c3bcfac99ce74c">tempest-TestVolumeBootPattern-1071176852</nova:project>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:         <nova:port uuid="f08ea0ed-d928-47ba-b313-41b12b79708a">
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     <system>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <entry name="serial">fecd576c-4027-4b39-a92a-91d1e3248949</entry>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <entry name="uuid">fecd576c-4027-4b39-a92a-91d1e3248949</entry>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     </system>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:   <os>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:   </os>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:   <features>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:   </features>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:   <devices>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/fecd576c-4027-4b39-a92a-91d1e3248949/disk.config"/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     </disk>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <alias name="ua-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531"/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-0"/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <serial>1bdfa1a6-fb6c-4690-8dd6-a14e0926d531</serial>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     </disk>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:3d:b3:c8"/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <target dev="tapf08ea0ed-d9"/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     </interface>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/fecd576c-4027-4b39-a92a-91d1e3248949/console.log" append="off"/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     </serial>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     <video>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     </video>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     </rng>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:   </devices>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]: </domain>
May 19 04:45:10.267683 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:45:10.270442 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Preparing to wait for external event network-vif-plugged-f08ea0ed-d928-47ba-b313-41b12b79708a {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:45:10.270442 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "fecd576c-4027-4b39-a92a-91d1e3248949-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:10.270442 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "fecd576c-4027-4b39-a92a-91d1e3248949-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:10.270442 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "fecd576c-4027-4b39-a92a-91d1e3248949-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:10.270442 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-631335083',display_name='tempest-TestVolumeBootPattern-server-631335083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-631335083',id=54,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN64hvrIGybIwAElinLKo/VbG9hSjSUs/ze49uyTKPWXsdeqEUWn/Lpvjt2B+Fess/qheYjdkiwQfjT63zoCE3gTtilbfESU8llxkXIh3KDQg4BSLPbR62uq8/NYye8VAw==',key_name='tempest-TestVolumeBootPattern-644793043',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-47pm5dmf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:45:03Z,user_data=None,user_id='5c46088fb3e74b819bb456461716a801',uuid=fecd576c-4027-4b39-a92a-91d1e3248949,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f08ea0ed-d928-47ba-b313-41b12b79708a", "address": "fa:16:3e:3d:b3:c8", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf08ea0ed-d9", "ovs_interfaceid": "f08ea0ed-d928-47ba-b313-41b12b79708a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:45:10.270442 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "f08ea0ed-d928-47ba-b313-41b12b79708a", "address": "fa:16:3e:3d:b3:c8", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf08ea0ed-d9", "ovs_interfaceid": "f08ea0ed-d928-47ba-b313-41b12b79708a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:45:10.270805 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:b3:c8,bridge_name='br-int',has_traffic_filtering=True,id=f08ea0ed-d928-47ba-b313-41b12b79708a,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf08ea0ed-d9') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:45:10.271786 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:b3:c8,bridge_name='br-int',has_traffic_filtering=True,id=f08ea0ed-d928-47ba-b313-41b12b79708a,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf08ea0ed-d9') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:45:10.271786 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:10.271786 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:10.272051 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:45:10.272918 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:10.273066 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '397a10e7-2dd2-50cc-bfbe-1f705e96323b', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:10.273827 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:10.274434 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:10.276224 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:10.278179 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:10.278320 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf08ea0ed-d9, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:10.278607 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf08ea0ed-d9, col_values=(('qos', UUID('70cfabdd-a05e-4011-b917-6101c6245683')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:10.278758 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf08ea0ed-d9, col_values=(('external_ids', {'iface-id': 'f08ea0ed-d928-47ba-b313-41b12b79708a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:b3:c8', 'vm-uuid': 'fecd576c-4027-4b39-a92a-91d1e3248949'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:10.279431 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:10.280388 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:10.286032 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:10.286849 np0000001025 nova-compute[97981]: INFO os_vif [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:b3:c8,bridge_name='br-int',has_traffic_filtering=True,id=f08ea0ed-d928-47ba-b313-41b12b79708a,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf08ea0ed-d9')
May 19 04:45:10.404872 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:10.526416 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-05b1671d-5070-4409-9c55-1ffe925faf89 tempest-TestStampPattern-1526088943 tempest-TestStampPattern-1526088943-project-member] [instance: 92b3fb19-741d-476b-9d2f-83654a17aa0e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:10.540441 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Updating instance_info_cache with network_info: [{"id": "660d654e-68e9-48a7-8ba0-1947fccd007a", "address": "fa:16:3e:8f:bb:b0", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap660d654e-68", "ovs_interfaceid": "660d654e-68e9-48a7-8ba0-1947fccd007a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:10.616425 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:45:10.623358 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:10.683234 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0f8032c3-27b8-4864-8cb4-31c5d1cc8ca1 req-710c2833-aeaa-4eda-a5e6-c93425b84a83 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received event network-vif-plugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:10.683642 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0f8032c3-27b8-4864-8cb4-31c5d1cc8ca1 req-710c2833-aeaa-4eda-a5e6-c93425b84a83 service nova] Acquiring lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:10.683822 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0f8032c3-27b8-4864-8cb4-31c5d1cc8ca1 req-710c2833-aeaa-4eda-a5e6-c93425b84a83 service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:10.683947 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0f8032c3-27b8-4864-8cb4-31c5d1cc8ca1 req-710c2833-aeaa-4eda-a5e6-c93425b84a83 service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:10.684045 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0f8032c3-27b8-4864-8cb4-31c5d1cc8ca1 req-710c2833-aeaa-4eda-a5e6-c93425b84a83 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] No waiting events found dispatching network-vif-plugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:45:10.684182 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-0f8032c3-27b8-4864-8cb4-31c5d1cc8ca1 req-710c2833-aeaa-4eda-a5e6-c93425b84a83 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received unexpected event network-vif-plugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 for instance with vm_state active and task_state None.
May 19 04:45:10.684289 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0f8032c3-27b8-4864-8cb4-31c5d1cc8ca1 req-710c2833-aeaa-4eda-a5e6-c93425b84a83 service nova] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Received event network-changed-660d654e-68e9-48a7-8ba0-1947fccd007a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:10.684475 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0f8032c3-27b8-4864-8cb4-31c5d1cc8ca1 req-710c2833-aeaa-4eda-a5e6-c93425b84a83 service nova] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Refreshing instance network info cache due to event network-changed-660d654e-68e9-48a7-8ba0-1947fccd007a. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:45:10.684564 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0f8032c3-27b8-4864-8cb4-31c5d1cc8ca1 req-710c2833-aeaa-4eda-a5e6-c93425b84a83 service nova] Acquiring lock "refresh_cache-26edba3f-dd65-4651-8cc3-3939541dae32" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:45:10.746737 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9bcf1cb3-1910-4d67-bc7b-4a325cceff02 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "417861ee-dcf2-458b-8782-2ec22d2f5421" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.571s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:11.042766 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Releasing lock "refresh_cache-26edba3f-dd65-4651-8cc3-3939541dae32" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:45:11.046084 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Instance network_info: |[{"id": "660d654e-68e9-48a7-8ba0-1947fccd007a", "address": "fa:16:3e:8f:bb:b0", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap660d654e-68", "ovs_interfaceid": "660d654e-68e9-48a7-8ba0-1947fccd007a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:45:11.046084 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0f8032c3-27b8-4864-8cb4-31c5d1cc8ca1 req-710c2833-aeaa-4eda-a5e6-c93425b84a83 service nova] Acquired lock "refresh_cache-26edba3f-dd65-4651-8cc3-3939541dae32" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:45:11.046084 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-0f8032c3-27b8-4864-8cb4-31c5d1cc8ca1 req-710c2833-aeaa-4eda-a5e6-c93425b84a83 service nova] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Refreshing network info cache for port 660d654e-68e9-48a7-8ba0-1947fccd007a {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:45:11.050020 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Start _get_guest_xml network_info=[{"id": "660d654e-68e9-48a7-8ba0-1947fccd007a", "address": "fa:16:3e:8f:bb:b0", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap660d654e-68", "ovs_interfaceid": "660d654e-68e9-48a7-8ba0-1947fccd007a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:45:11.053235 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:45:11.054482 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-91523045', uuid='26edba3f-dd65-4651-8cc3-3939541dae32'), owner=OwnerMeta(userid='ada528b0c5c740799599a2b163709a87', username='tempest-TestEncryptedCinderVolumes-324201327-project-member', projectid='7041ddbe11174207bbc7363b3bf08af5', projectname='tempest-TestEncryptedCinderVolumes-324201327'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "660d654e-68e9-48a7-8ba0-1947fccd007a", "address": "fa:16:3e:8f:bb:b0", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap660d654e-68", "ovs_interfaceid": "660d654e-68e9-48a7-8ba0-1947fccd007a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165911.05409) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:45:11.056030 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:45:11.056665 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:45:11.058759 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:45:11.059058 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:45:11.060122 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:45:11.060574 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:45:11.060749 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:45:11.060899 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:45:11.060993 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:45:11.061365 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:45:11.061585 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:45:11.061908 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:45:11.062087 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:45:11.062327 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:45:11.062621 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:45:11.062809 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:45:11.074878 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:45:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-91523045',display_name='tempest-TestEncryptedCinderVolumes-server-91523045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testencryptedcindervolumes-server-91523045',id=55,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnhcvYkZhjIio0MyAW2vSDlqhQa3mxMW4rBWQXFhozErfngW3QNyz7O1lRBUF0Kicm1Bp75gm9pq/AQhAJbDmddp2sRAZylnVcnFeh1OniouvY7ntG/L/Rjqx8bSfxcRw==',key_name='tempest-keypair-623319440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7041ddbe11174207bbc7363b3bf08af5',ramdisk_id='',reservation_id='r-uum1f5xn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-324201327',owner_user_name='tempest-TestEncryptedCinderVolumes-324201327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:45:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada528b0c5c740799599a2b163709a87',uuid=26edba3f-dd65-4651-8cc3-3939541dae32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "660d654e-68e9-48a7-8ba0-1947fccd007a", "address": "fa:16:3e:8f:bb:b0", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap660d654e-68", "ovs_interfaceid": "660d654e-68e9-48a7-8ba0-1947fccd007a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:45:11.075058 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Converting VIF {"id": "660d654e-68e9-48a7-8ba0-1947fccd007a", "address": "fa:16:3e:8f:bb:b0", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap660d654e-68", "ovs_interfaceid": "660d654e-68e9-48a7-8ba0-1947fccd007a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:45:11.075855 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:bb:b0,bridge_name='br-int',has_traffic_filtering=True,id=660d654e-68e9-48a7-8ba0-1947fccd007a,network=Network(1eda8fb0-3870-4644-873a-b485fff9e767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660d654e-68') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:45:11.076429 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lazy-loading 'pci_devices' on Instance uuid 26edba3f-dd65-4651-8cc3-3939541dae32 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:45:11.123285 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.455s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:11.170748 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Deleted allocations for instance a73d6831-b1cd-4d69-a78c-16d3ac8010c7
May 19 04:45:11.311958 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "6f26313e-2659-4687-84da-96cf2da9a4e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:11.312138 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:11.312290 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:11.312410 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:11.312506 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:11.314214 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Terminating instance
May 19 04:45:11.550613 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-0f8032c3-27b8-4864-8cb4-31c5d1cc8ca1 req-710c2833-aeaa-4eda-a5e6-c93425b84a83 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:11.579232 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] End _get_guest_xml xml=<domain type="qemu">
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:   <uuid>26edba3f-dd65-4651-8cc3-3939541dae32</uuid>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:   <name>instance-00000037</name>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-91523045</nova:name>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:45:11</nova:creationTime>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:         <nova:user uuid="ada528b0c5c740799599a2b163709a87">tempest-TestEncryptedCinderVolumes-324201327-project-member</nova:user>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:         <nova:project uuid="7041ddbe11174207bbc7363b3bf08af5">tempest-TestEncryptedCinderVolumes-324201327</nova:project>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:         <nova:port uuid="660d654e-68e9-48a7-8ba0-1947fccd007a">
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     <system>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <entry name="serial">26edba3f-dd65-4651-8cc3-3939541dae32</entry>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <entry name="uuid">26edba3f-dd65-4651-8cc3-3939541dae32</entry>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     </system>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:   <os>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:   </os>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:   <features>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:   </features>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:   <devices>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/26edba3f-dd65-4651-8cc3-3939541dae32/disk"/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     </disk>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/26edba3f-dd65-4651-8cc3-3939541dae32/disk.config"/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     </disk>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:8f:bb:b0"/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <target dev="tap660d654e-68"/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     </interface>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/26edba3f-dd65-4651-8cc3-3939541dae32/console.log" append="off"/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     </serial>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     <video>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     </video>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     </rng>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:   </devices>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]: </domain>
May 19 04:45:11.579232 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:45:11.581135 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Preparing to wait for external event network-vif-plugged-660d654e-68e9-48a7-8ba0-1947fccd007a {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:45:11.581135 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "26edba3f-dd65-4651-8cc3-3939541dae32-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:11.581135 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "26edba3f-dd65-4651-8cc3-3939541dae32-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:11.581135 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "26edba3f-dd65-4651-8cc3-3939541dae32-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:11.581719 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:45:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-91523045',display_name='tempest-TestEncryptedCinderVolumes-server-91523045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testencryptedcindervolumes-server-91523045',id=55,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnhcvYkZhjIio0MyAW2vSDlqhQa3mxMW4rBWQXFhozErfngW3QNyz7O1lRBUF0Kicm1Bp75gm9pq/AQhAJbDmddp2sRAZylnVcnFeh1OniouvY7ntG/L/Rjqx8bSfxcRw==',key_name='tempest-keypair-623319440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7041ddbe11174207bbc7363b3bf08af5',ramdisk_id='',reservation_id='r-uum1f5xn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-324201327',owner_user_name='tempest-TestEncryptedCinderVolumes-324201327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:45:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada528b0c5c740799599a2b163709a87',uuid=26edba3f-dd65-4651-8cc3-3939541dae32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "660d654e-68e9-48a7-8ba0-1947fccd007a", "address": "fa:16:3e:8f:bb:b0", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap660d654e-68", "ovs_interfaceid": "660d654e-68e9-48a7-8ba0-1947fccd007a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:45:11.581898 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Converting VIF {"id": "660d654e-68e9-48a7-8ba0-1947fccd007a", "address": "fa:16:3e:8f:bb:b0", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap660d654e-68", "ovs_interfaceid": "660d654e-68e9-48a7-8ba0-1947fccd007a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:45:11.582497 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:bb:b0,bridge_name='br-int',has_traffic_filtering=True,id=660d654e-68e9-48a7-8ba0-1947fccd007a,network=Network(1eda8fb0-3870-4644-873a-b485fff9e767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660d654e-68') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:45:11.582748 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:bb:b0,bridge_name='br-int',has_traffic_filtering=True,id=660d654e-68e9-48a7-8ba0-1947fccd007a,network=Network(1eda8fb0-3870-4644-873a-b485fff9e767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660d654e-68') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:45:11.583364 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:11.583716 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:11.583966 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:45:11.584792 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:11.584993 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f9aa02e-af1f-57c0-9dc1-388dee94cdeb', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:11.585895 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:11.586737 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:11.592793 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:11.595254 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:11.595462 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap660d654e-68, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:11.595808 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap660d654e-68, col_values=(('qos', UUID('ec906e0a-1893-41a1-8103-a2f98e2d1756')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:11.595947 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap660d654e-68, col_values=(('external_ids', {'iface-id': '660d654e-68e9-48a7-8ba0-1947fccd007a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:bb:b0', 'vm-uuid': '26edba3f-dd65-4651-8cc3-3939541dae32'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:11.600398 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:11.611786 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:11.612423 np0000001025 nova-compute[97981]: INFO os_vif [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:bb:b0,bridge_name='br-int',has_traffic_filtering=True,id=660d654e-68e9-48a7-8ba0-1947fccd007a,network=Network(1eda8fb0-3870-4644-873a-b485fff9e767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660d654e-68')
May 19 04:45:11.807687 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:45:11.808241 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:45:11.808241 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No VIF found with MAC fa:16:3e:3d:b3:c8, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:45:11.808241 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Using config drive
May 19 04:45:11.819388 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:45:11.857366 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:11.888305 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:11.952029 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-0f8032c3-27b8-4864-8cb4-31c5d1cc8ca1 req-710c2833-aeaa-4eda-a5e6-c93425b84a83 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:12.001899 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:12.016975 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:12.166711 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999693655999636 future=<Future at 0x7218345ea960 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:12.168535 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Instance destroyed successfully.
May 19 04:45:12.168987 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'resources' on Instance uuid 6f26313e-2659-4687-84da-96cf2da9a4e2 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:45:12.180396 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cf964f4d-ebeb-4a4a-9c30-6a30c1bffd77 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Lock "a73d6831-b1cd-4d69-a78c-16d3ac8010c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.242s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:12.195095 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:12.315605 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:12.389063 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-0f8032c3-27b8-4864-8cb4-31c5d1cc8ca1 req-710c2833-aeaa-4eda-a5e6-c93425b84a83 service nova] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Updated VIF entry in instance network info cache for port 660d654e-68e9-48a7-8ba0-1947fccd007a. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:45:12.389429 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-0f8032c3-27b8-4864-8cb4-31c5d1cc8ca1 req-710c2833-aeaa-4eda-a5e6-c93425b84a83 service nova] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Updating instance_info_cache with network_info: [{"id": "660d654e-68e9-48a7-8ba0-1947fccd007a", "address": "fa:16:3e:8f:bb:b0", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap660d654e-68", "ovs_interfaceid": "660d654e-68e9-48a7-8ba0-1947fccd007a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:12.454337 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Creating config drive at /opt/stack/data/nova/instances/fecd576c-4027-4b39-a92a-91d1e3248949/disk.config
May 19 04:45:12.457539 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fecd576c-4027-4b39-a92a-91d1e3248949/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2bym7eou {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:12.509961 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fecd576c-4027-4b39-a92a-91d1e3248949/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2bym7eou" returned: 0 in 0.052s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:12.671997 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001025',hostname='multiattach-server-0',id=37,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9kq9UfoFPrqlSUYASLa2M8/KXwpiWIksTRz6r+vXFFf5G7djO79flSW+4jvUEBmYvioxzxvTch1hKVIwlMIaMSuT3AyUPlX/5ZPn59wF6pdcyyqAHuNzAVPjAjiGd+6A==',key_name='tempest-keypair-818275091',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:42:50Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-ksq0p58y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:43:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa432d60cb324c6d87818107e05e0053',uuid=6f26313e-2659-4687-84da-96cf2da9a4e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:45:12.672207 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "9791a107-963b-4608-9092-2df622d06125", "address": "fa:16:3e:fa:d4:f0", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9791a107-96", "ovs_interfaceid": "9791a107-963b-4608-9092-2df622d06125", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:45:12.672936 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:d4:f0,bridge_name='br-int',has_traffic_filtering=True,id=9791a107-963b-4608-9092-2df622d06125,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9791a107-96') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:45:12.673191 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:d4:f0,bridge_name='br-int',has_traffic_filtering=True,id=9791a107-963b-4608-9092-2df622d06125,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9791a107-96') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:45:12.674626 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:12.674925 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9791a107-96, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:12.676173 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:12.677067 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:12.688328 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:12.689579 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:12.689765 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27a9590d-4e68-4896-8078-bb847e85aa93) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:12.693722 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:12.704132 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:12.707193 np0000001025 nova-compute[97981]: INFO os_vif [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:d4:f0,bridge_name='br-int',has_traffic_filtering=True,id=9791a107-963b-4608-9092-2df622d06125,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9791a107-96')
May 19 04:45:12.707502 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Deleting instance files /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2_del
May 19 04:45:12.715612 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Deletion of /opt/stack/data/nova/instances/6f26313e-2659-4687-84da-96cf2da9a4e2_del complete
May 19 04:45:12.891783 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0f8032c3-27b8-4864-8cb4-31c5d1cc8ca1 req-710c2833-aeaa-4eda-a5e6-c93425b84a83 service nova] Releasing lock "refresh_cache-26edba3f-dd65-4651-8cc3-3939541dae32" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:45:12.963627 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:13.001430 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:13.090805 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:13.132981 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:45:13.132981 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:45:13.132981 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] No VIF found with MAC fa:16:3e:8f:bb:b0, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:45:13.132981 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Using config drive
May 19 04:45:13.222957 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Took 1.40 seconds to destroy the instance on the hypervisor.
May 19 04:45:13.224121 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:45:13.224619 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:45:13.224845 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:45:13.227964 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:13.310019 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:13.320974 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:13.373495 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:13.383371 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:13.385580 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:13.395362 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:13.413529 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:13.419344 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:13.607970 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3cdfc5ff-7567-4a6d-841e-d55cc6d58ff2 req-e0bbce7f-dbd7-4792-8f38-fc4448e8b938 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Received event network-vif-deleted-9791a107-963b-4608-9092-2df622d06125 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:13.608103 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-3cdfc5ff-7567-4a6d-841e-d55cc6d58ff2 req-e0bbce7f-dbd7-4792-8f38-fc4448e8b938 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Neutron deleted interface 9791a107-963b-4608-9092-2df622d06125; detaching it from the instance and deleting it from the info cache
May 19 04:45:13.608243 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3cdfc5ff-7567-4a6d-841e-d55cc6d58ff2 req-e0bbce7f-dbd7-4792-8f38-fc4448e8b938 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:13.643815 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:13.664517 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b972ad94-d958-4d76-84b2-10be03642f57 req-95cc6607-5f0f-4164-9ff8-a24b87e3f896 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Received event network-vif-plugged-f08ea0ed-d928-47ba-b313-41b12b79708a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:13.664783 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b972ad94-d958-4d76-84b2-10be03642f57 req-95cc6607-5f0f-4164-9ff8-a24b87e3f896 service nova] Acquiring lock "fecd576c-4027-4b39-a92a-91d1e3248949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:13.665013 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b972ad94-d958-4d76-84b2-10be03642f57 req-95cc6607-5f0f-4164-9ff8-a24b87e3f896 service nova] Lock "fecd576c-4027-4b39-a92a-91d1e3248949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:13.665150 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b972ad94-d958-4d76-84b2-10be03642f57 req-95cc6607-5f0f-4164-9ff8-a24b87e3f896 service nova] Lock "fecd576c-4027-4b39-a92a-91d1e3248949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:13.665273 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b972ad94-d958-4d76-84b2-10be03642f57 req-95cc6607-5f0f-4164-9ff8-a24b87e3f896 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Processing event network-vif-plugged-f08ea0ed-d928-47ba-b313-41b12b79708a {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:45:13.864470 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Creating config drive at /opt/stack/data/nova/instances/26edba3f-dd65-4651-8cc3-3939541dae32/disk.config
May 19 04:45:13.875389 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/26edba3f-dd65-4651-8cc3-3939541dae32/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpitdjytgq {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:13.911330 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165913.910042, fecd576c-4027-4b39-a92a-91d1e3248949 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:13.912405 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:45:13.912917 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] VM Started (Lifecycle Event)
May 19 04:45:13.919411 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:45:13.925048 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Instance spawned successfully.
May 19 04:45:13.925592 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:45:13.933123 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/26edba3f-dd65-4651-8cc3-3939541dae32/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpitdjytgq" returned: 0 in 0.058s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:14.057320 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:14.115688 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3cdfc5ff-7567-4a6d-841e-d55cc6d58ff2 req-e0bbce7f-dbd7-4792-8f38-fc4448e8b938 service nova] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Detach interface failed, port_id=9791a107-963b-4608-9092-2df622d06125, reason: Instance 6f26313e-2659-4687-84da-96cf2da9a4e2 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:45:14.396427 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:14.417087 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:14.424395 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:45:14.429281 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:14.438607 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:14.439425 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:14.439840 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:14.440120 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:14.440432 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:14.440701 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:14.535475 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:14.560289 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Took 1.34 seconds to deallocate network for instance.
May 19 04:45:14.772408 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:14.777140 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:14.777562 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:14.801614 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:14.930177 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:45:14.930502 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165914.93026, fecd576c-4027-4b39-a92a-91d1e3248949 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:14.930502 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] VM Paused (Lifecycle Event)
May 19 04:45:14.946835 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Took 8.77 seconds to spawn the instance on the hypervisor.
May 19 04:45:14.947321 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:15.070064 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:15.070297 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:15.432798 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:15.434865 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165915.4346485, fecd576c-4027-4b39-a92a-91d1e3248949 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:15.435022 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] VM Resumed (Lifecycle Event)
May 19 04:45:15.461009 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Took 17.57 seconds to build instance.
May 19 04:45:15.474138 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:45:15.474488 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:45:15.735504 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4f1c6e55-5f33-4ed2-a0b9-811db8b8283b req-1820bcea-f476-4d22-8d5b-ab1c962de5f8 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Received event network-vif-plugged-f08ea0ed-d928-47ba-b313-41b12b79708a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:15.736042 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4f1c6e55-5f33-4ed2-a0b9-811db8b8283b req-1820bcea-f476-4d22-8d5b-ab1c962de5f8 service nova] Acquiring lock "fecd576c-4027-4b39-a92a-91d1e3248949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:15.736283 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4f1c6e55-5f33-4ed2-a0b9-811db8b8283b req-1820bcea-f476-4d22-8d5b-ab1c962de5f8 service nova] Lock "fecd576c-4027-4b39-a92a-91d1e3248949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:15.736465 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4f1c6e55-5f33-4ed2-a0b9-811db8b8283b req-1820bcea-f476-4d22-8d5b-ab1c962de5f8 service nova] Lock "fecd576c-4027-4b39-a92a-91d1e3248949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:15.737350 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4f1c6e55-5f33-4ed2-a0b9-811db8b8283b req-1820bcea-f476-4d22-8d5b-ab1c962de5f8 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] No waiting events found dispatching network-vif-plugged-f08ea0ed-d928-47ba-b313-41b12b79708a {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:45:15.737533 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-4f1c6e55-5f33-4ed2-a0b9-811db8b8283b req-1820bcea-f476-4d22-8d5b-ab1c962de5f8 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Received unexpected event network-vif-plugged-f08ea0ed-d928-47ba-b313-41b12b79708a for instance with vm_state active and task_state None.
May 19 04:45:15.737716 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4f1c6e55-5f33-4ed2-a0b9-811db8b8283b req-1820bcea-f476-4d22-8d5b-ab1c962de5f8 service nova] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Received event network-vif-plugged-660d654e-68e9-48a7-8ba0-1947fccd007a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:15.737915 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4f1c6e55-5f33-4ed2-a0b9-811db8b8283b req-1820bcea-f476-4d22-8d5b-ab1c962de5f8 service nova] Acquiring lock "26edba3f-dd65-4651-8cc3-3939541dae32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:15.738320 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4f1c6e55-5f33-4ed2-a0b9-811db8b8283b req-1820bcea-f476-4d22-8d5b-ab1c962de5f8 service nova] Lock "26edba3f-dd65-4651-8cc3-3939541dae32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:15.738488 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4f1c6e55-5f33-4ed2-a0b9-811db8b8283b req-1820bcea-f476-4d22-8d5b-ab1c962de5f8 service nova] Lock "26edba3f-dd65-4651-8cc3-3939541dae32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:15.738677 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4f1c6e55-5f33-4ed2-a0b9-811db8b8283b req-1820bcea-f476-4d22-8d5b-ab1c962de5f8 service nova] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Processing event network-vif-plugged-660d654e-68e9-48a7-8ba0-1947fccd007a {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:45:15.738863 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4f1c6e55-5f33-4ed2-a0b9-811db8b8283b req-1820bcea-f476-4d22-8d5b-ab1c962de5f8 service nova] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Received event network-vif-plugged-660d654e-68e9-48a7-8ba0-1947fccd007a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:15.739199 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:45:15.739366 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4f1c6e55-5f33-4ed2-a0b9-811db8b8283b req-1820bcea-f476-4d22-8d5b-ab1c962de5f8 service nova] Acquiring lock "26edba3f-dd65-4651-8cc3-3939541dae32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:15.739541 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4f1c6e55-5f33-4ed2-a0b9-811db8b8283b req-1820bcea-f476-4d22-8d5b-ab1c962de5f8 service nova] Lock "26edba3f-dd65-4651-8cc3-3939541dae32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:15.739765 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4f1c6e55-5f33-4ed2-a0b9-811db8b8283b req-1820bcea-f476-4d22-8d5b-ab1c962de5f8 service nova] Lock "26edba3f-dd65-4651-8cc3-3939541dae32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:15.739916 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4f1c6e55-5f33-4ed2-a0b9-811db8b8283b req-1820bcea-f476-4d22-8d5b-ab1c962de5f8 service nova] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] No waiting events found dispatching network-vif-plugged-660d654e-68e9-48a7-8ba0-1947fccd007a {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:45:15.740068 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-4f1c6e55-5f33-4ed2-a0b9-811db8b8283b req-1820bcea-f476-4d22-8d5b-ab1c962de5f8 service nova] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Received unexpected event network-vif-plugged-660d654e-68e9-48a7-8ba0-1947fccd007a for instance with vm_state building and task_state spawning.
May 19 04:45:15.746286 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:45:15.749383 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Instance spawned successfully.
May 19 04:45:15.749923 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:45:15.939023 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:15.940946 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:45:15.962811 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-71b5c767-5b1f-4d47-b895-ff1cb753817b tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "fecd576c-4027-4b39-a92a-91d1e3248949" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.074s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:15.977526 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:45:16.262435 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:16.262435 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:16.262741 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:16.263041 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:16.263414 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:16.263769 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:16.443486 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165916.4431949, 26edba3f-dd65-4651-8cc3-3939541dae32 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:16.443683 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] VM Started (Lifecycle Event)
May 19 04:45:16.486670 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.416s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:16.534910 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Deleted allocations for instance 6f26313e-2659-4687-84da-96cf2da9a4e2
May 19 04:45:16.771060 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Took 7.68 seconds to spawn the instance on the hypervisor.
May 19 04:45:16.771060 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:16.946666 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:16.948419 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:45:17.110353 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:17.282055 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Took 13.38 seconds to build instance.
May 19 04:45:17.451586 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165917.4503782, 26edba3f-dd65-4651-8cc3-3939541dae32 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:17.451586 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] VM Paused (Lifecycle Event)
May 19 04:45:17.546002 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-354ca2bd-fc15-4d97-884c-8fedb538b819 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "6f26313e-2659-4687-84da-96cf2da9a4e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.234s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:17.691069 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:17.786230 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "26edba3f-dd65-4651-8cc3-3939541dae32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.890s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:17.826163 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f83dfb39-d531-4b6f-8459-e37544231fd9 req-d9d897a2-b2a4-4501-94eb-65686ac28951 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Received event network-changed-f08ea0ed-d928-47ba-b313-41b12b79708a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:17.826560 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f83dfb39-d531-4b6f-8459-e37544231fd9 req-d9d897a2-b2a4-4501-94eb-65686ac28951 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Refreshing instance network info cache due to event network-changed-f08ea0ed-d928-47ba-b313-41b12b79708a. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:45:17.826740 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f83dfb39-d531-4b6f-8459-e37544231fd9 req-d9d897a2-b2a4-4501-94eb-65686ac28951 service nova] Acquiring lock "refresh_cache-fecd576c-4027-4b39-a92a-91d1e3248949" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:45:17.826835 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f83dfb39-d531-4b6f-8459-e37544231fd9 req-d9d897a2-b2a4-4501-94eb-65686ac28951 service nova] Acquired lock "refresh_cache-fecd576c-4027-4b39-a92a-91d1e3248949" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:45:17.826939 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-f83dfb39-d531-4b6f-8459-e37544231fd9 req-d9d897a2-b2a4-4501-94eb-65686ac28951 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Refreshing network info cache for port f08ea0ed-d928-47ba-b313-41b12b79708a {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:45:17.953582 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:17.955761 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165917.9554868, 26edba3f-dd65-4651-8cc3-3939541dae32 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:17.957921 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] VM Resumed (Lifecycle Event)
May 19 04:45:18.328779 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-f83dfb39-d531-4b6f-8459-e37544231fd9 req-d9d897a2-b2a4-4501-94eb-65686ac28951 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:18.393136 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:18.460298 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:18.464677 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:45:18.532751 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4c50eac5-6e9b-446d-b326-011222425dd5 req-1e95f199-0fa6-442e-b92b-5e5bad5684c0 service nova] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Received event network-changed-660d654e-68e9-48a7-8ba0-1947fccd007a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:18.532962 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4c50eac5-6e9b-446d-b326-011222425dd5 req-1e95f199-0fa6-442e-b92b-5e5bad5684c0 service nova] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Refreshing instance network info cache due to event network-changed-660d654e-68e9-48a7-8ba0-1947fccd007a. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:45:18.534290 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4c50eac5-6e9b-446d-b326-011222425dd5 req-1e95f199-0fa6-442e-b92b-5e5bad5684c0 service nova] Acquiring lock "refresh_cache-26edba3f-dd65-4651-8cc3-3939541dae32" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:45:18.534515 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4c50eac5-6e9b-446d-b326-011222425dd5 req-1e95f199-0fa6-442e-b92b-5e5bad5684c0 service nova] Acquired lock "refresh_cache-26edba3f-dd65-4651-8cc3-3939541dae32" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:45:18.534706 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4c50eac5-6e9b-446d-b326-011222425dd5 req-1e95f199-0fa6-442e-b92b-5e5bad5684c0 service nova] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Refreshing network info cache for port 660d654e-68e9-48a7-8ba0-1947fccd007a {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:45:18.671543 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-f83dfb39-d531-4b6f-8459-e37544231fd9 req-d9d897a2-b2a4-4501-94eb-65686ac28951 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:18.821985 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-f83dfb39-d531-4b6f-8459-e37544231fd9 req-d9d897a2-b2a4-4501-94eb-65686ac28951 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Updated VIF entry in instance network info cache for port f08ea0ed-d928-47ba-b313-41b12b79708a. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:45:18.822277 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-f83dfb39-d531-4b6f-8459-e37544231fd9 req-d9d897a2-b2a4-4501-94eb-65686ac28951 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Updating instance_info_cache with network_info: [{"id": "f08ea0ed-d928-47ba-b313-41b12b79708a", "address": "fa:16:3e:3d:b3:c8", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf08ea0ed-d9", "ovs_interfaceid": "f08ea0ed-d928-47ba-b313-41b12b79708a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:19.040804 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-4c50eac5-6e9b-446d-b326-011222425dd5 req-1e95f199-0fa6-442e-b92b-5e5bad5684c0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:19.324152 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f83dfb39-d531-4b6f-8459-e37544231fd9 req-d9d897a2-b2a4-4501-94eb-65686ac28951 service nova] Releasing lock "refresh_cache-fecd576c-4027-4b39-a92a-91d1e3248949" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:45:19.466527 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:19.494843 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-4c50eac5-6e9b-446d-b326-011222425dd5 req-1e95f199-0fa6-442e-b92b-5e5bad5684c0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:19.626520 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4c50eac5-6e9b-446d-b326-011222425dd5 req-1e95f199-0fa6-442e-b92b-5e5bad5684c0 service nova] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Updated VIF entry in instance network info cache for port 660d654e-68e9-48a7-8ba0-1947fccd007a. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:45:19.626795 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4c50eac5-6e9b-446d-b326-011222425dd5 req-1e95f199-0fa6-442e-b92b-5e5bad5684c0 service nova] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Updating instance_info_cache with network_info: [{"id": "660d654e-68e9-48a7-8ba0-1947fccd007a", "address": "fa:16:3e:8f:bb:b0", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap660d654e-68", "ovs_interfaceid": "660d654e-68e9-48a7-8ba0-1947fccd007a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:19.810411 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:19.810545 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:19.810752 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:19.810885 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:19.810993 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:19.812739 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Terminating instance
May 19 04:45:20.022683 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0004686159995799244 future=<Future at 0x7218344179e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:20.022838 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:20.022925 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=0.7642081509998206 future=<Future at 0x7218506f8ce0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:20.023004 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=0.7641240839998318 future=<Future at 0x7218506f8ce0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:20.024763 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Emitting event <LifecycleEvent: 1779165905.0217938, 417861ee-dcf2-458b-8782-2ec22d2f5421 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:20.024763 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] VM Stopped (Lifecycle Event)
May 19 04:45:20.128553 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4c50eac5-6e9b-446d-b326-011222425dd5 req-1e95f199-0fa6-442e-b92b-5e5bad5684c0 service nova] Releasing lock "refresh_cache-26edba3f-dd65-4651-8cc3-3939541dae32" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:45:20.315440 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:45:20.342982 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:20.343472 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:20.363915 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:20.508987 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:20.516093 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:20.526467 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 417861ee-dcf2-458b-8782-2ec22d2f5421] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:20.648481 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999718743000358 future=<Future at 0x721834350440 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:20.649906 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Instance destroyed successfully.
May 19 04:45:20.650767 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'resources' on Instance uuid e644a772-cf7c-4b15-b21b-ea54e773a1f9 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:45:20.787463 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0002895669999816164 future=<Future at 0x7218506f8ce0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:20.787639 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:20.787639 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=6.378706243999659 future=<Future at 0x7218345ea960 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:20.787758 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=6.378619420999712 future=<Future at 0x7218345ea960 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:20.788633 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Emitting event <LifecycleEvent: 1779165905.787058, a73d6831-b1cd-4d69-a78c-16d3ac8010c7 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:20.788866 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] VM Stopped (Lifecycle Event)
May 19 04:45:21.155416 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:39:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='multiattach-server-1',id=33,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9kq9UfoFPrqlSUYASLa2M8/KXwpiWIksTRz6r+vXFFf5G7djO79flSW+4jvUEBmYvioxzxvTch1hKVIwlMIaMSuT3AyUPlX/5ZPn59wF6pdcyyqAHuNzAVPjAjiGd+6A==',key_name='tempest-keypair-818275091',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:39:59Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-uc510oti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:39:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa432d60cb324c6d87818107e05e0053',uuid=e644a772-cf7c-4b15-b21b-ea54e773a1f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "address": "fa:16:3e:a1:aa:43", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap451d5caa-1b", "ovs_interfaceid": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:45:21.155416 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "address": "fa:16:3e:a1:aa:43", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap451d5caa-1b", "ovs_interfaceid": "451d5caa-1b64-4a79-8aea-b1fa65cf3131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:45:21.155416 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:aa:43,bridge_name='br-int',has_traffic_filtering=True,id=451d5caa-1b64-4a79-8aea-b1fa65cf3131,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451d5caa-1b') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:45:21.155416 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:aa:43,bridge_name='br-int',has_traffic_filtering=True,id=451d5caa-1b64-4a79-8aea-b1fa65cf3131,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451d5caa-1b') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:45:21.157461 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:21.157748 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap451d5caa-1b, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:21.159343 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:21.160591 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:21.183670 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:21.184795 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:21.185234 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ddeb076a-67f4-4467-8930-b13e666fa350) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:21.185964 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:21.187092 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:21.187910 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:21.190602 np0000001025 nova-compute[97981]: INFO os_vif [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:aa:43,bridge_name='br-int',has_traffic_filtering=True,id=451d5caa-1b64-4a79-8aea-b1fa65cf3131,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451d5caa-1b')
May 19 04:45:21.190602 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Deleting instance files /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9_del
May 19 04:45:21.194220 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Deletion of /opt/stack/data/nova/instances/e644a772-cf7c-4b15-b21b-ea54e773a1f9_del complete
May 19 04:45:21.297353 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: a73d6831-b1cd-4d69-a78c-16d3ac8010c7] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:21.698813 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Took 1.38 seconds to destroy the instance on the hypervisor.
May 19 04:45:21.699646 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:45:21.700058 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:45:21.700188 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:45:21.700430 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:21.826636 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:22.134586 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-86fcab5d-f7d0-4d0f-b449-602097a1e347 req-b72747df-6702-4d75-8210-3d6366797a62 service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Received event network-vif-deleted-451d5caa-1b64-4a79-8aea-b1fa65cf3131 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:22.135054 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-86fcab5d-f7d0-4d0f-b449-602097a1e347 req-b72747df-6702-4d75-8210-3d6366797a62 service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Neutron deleted interface 451d5caa-1b64-4a79-8aea-b1fa65cf3131; detaching it from the instance and deleting it from the info cache
May 19 04:45:22.135279 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-86fcab5d-f7d0-4d0f-b449-602097a1e347 req-b72747df-6702-4d75-8210-3d6366797a62 service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:22.582591 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:22.642895 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-86fcab5d-f7d0-4d0f-b449-602097a1e347 req-b72747df-6702-4d75-8210-3d6366797a62 service nova] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Detach interface failed, port_id=451d5caa-1b64-4a79-8aea-b1fa65cf3131, reason: Instance e644a772-cf7c-4b15-b21b-ea54e773a1f9 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:45:22.675231 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "e2017472-4da3-4676-b614-3e7039fedef3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:22.675436 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "e2017472-4da3-4676-b614-3e7039fedef3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:23.086903 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Took 1.39 seconds to deallocate network for instance.
May 19 04:45:23.177987 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:45:23.398143 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:23.527104 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:23.592053 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:23.592471 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:23.735371 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:23.999543 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:45:23.999765 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:45:24.502192 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:45:25.008150 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.416s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:25.009683 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.273s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:25.013944 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:45:25.014305 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Claim successful on node np0000001025
May 19 04:45:25.056281 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Deleted allocations for instance e644a772-cf7c-4b15-b21b-ea54e773a1f9
May 19 04:45:26.066340 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4dd4dc75-3b75-4eb3-b719-5573066c9e04 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "e644a772-cf7c-4b15-b21b-ea54e773a1f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.256s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:26.187338 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:26.317669 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:45:26.317890 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:45:26.820317 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:45:27.024656 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "b32b8038-72c4-443c-aea3-07cd61ad67f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:27.024880 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:27.025094 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "b32b8038-72c4-443c-aea3-07cd61ad67f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:27.025261 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:27.025371 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:27.027550 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Terminating instance
May 19 04:45:27.166856 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00036222100015947944 future=<Future at 0x7218345ea960 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:27.167293 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Emitting event <LifecycleEvent: 1779165912.1662402, 6f26313e-2659-4687-84da-96cf2da9a4e2 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:27.167482 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:27.167704 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] VM Stopped (Lifecycle Event)
May 19 04:45:27.167854 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=8.480331949000174 future=<Future at 0x721834350440 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:27.167972 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=8.480195774000094 future=<Future at 0x721834350440 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:27.328243 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.320s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:27.328627 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:45:27.530351 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:45:27.550389 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:27.555242 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:27.572966 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:27.675142 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: 6f26313e-2659-4687-84da-96cf2da9a4e2] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:27.693934 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:27.699833 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:27.728033 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6ba8dd38-27c5-4eef-8fe4-42acc269b3b9 req-8e9ba8cf-d31c-401b-9778-e8f5a70d91ff service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Received event network-vif-unplugged-b9855804-ae85-4e19-b3c0-586032713aff {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:27.728306 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6ba8dd38-27c5-4eef-8fe4-42acc269b3b9 req-8e9ba8cf-d31c-401b-9778-e8f5a70d91ff service nova] Acquiring lock "b32b8038-72c4-443c-aea3-07cd61ad67f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:27.728472 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6ba8dd38-27c5-4eef-8fe4-42acc269b3b9 req-8e9ba8cf-d31c-401b-9778-e8f5a70d91ff service nova] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:27.728588 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6ba8dd38-27c5-4eef-8fe4-42acc269b3b9 req-8e9ba8cf-d31c-401b-9778-e8f5a70d91ff service nova] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:27.728721 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6ba8dd38-27c5-4eef-8fe4-42acc269b3b9 req-8e9ba8cf-d31c-401b-9778-e8f5a70d91ff service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] No waiting events found dispatching network-vif-unplugged-b9855804-ae85-4e19-b3c0-586032713aff {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:45:27.728857 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6ba8dd38-27c5-4eef-8fe4-42acc269b3b9 req-8e9ba8cf-d31c-401b-9778-e8f5a70d91ff service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Received event network-vif-unplugged-b9855804-ae85-4e19-b3c0-586032713aff for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:45:27.834144 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:45:27.834144 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:45:27.834144 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:27.834144 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:27.855789 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:27.862322 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:27.884519 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999671042000045 future=<Future at 0x72185027fa40 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:27.887295 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Instance destroyed successfully.
May 19 04:45:27.887753 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'resources' on Instance uuid b32b8038-72c4-443c-aea3-07cd61ad67f6 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:45:27.920143 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71fd665949ed42008ee194558e5a8f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f892ab02546d4b6295c6abf1e79121ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:45:28.339405 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:45:28.377235 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Successfully created port: 381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:45:28.392132 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:39:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='multiattach-server-0',id=31,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9kq9UfoFPrqlSUYASLa2M8/KXwpiWIksTRz6r+vXFFf5G7djO79flSW+4jvUEBmYvioxzxvTch1hKVIwlMIaMSuT3AyUPlX/5ZPn59wF6pdcyyqAHuNzAVPjAjiGd+6A==',key_name='tempest-keypair-818275091',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:39:40Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-dk1cxip1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:39:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa432d60cb324c6d87818107e05e0053',uuid=b32b8038-72c4-443c-aea3-07cd61ad67f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9855804-ae85-4e19-b3c0-586032713aff", "address": "fa:16:3e:0e:aa:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9855804-ae", "ovs_interfaceid": "b9855804-ae85-4e19-b3c0-586032713aff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:45:28.392132 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "b9855804-ae85-4e19-b3c0-586032713aff", "address": "fa:16:3e:0e:aa:6f", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9855804-ae", "ovs_interfaceid": "b9855804-ae85-4e19-b3c0-586032713aff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:45:28.392132 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:aa:6f,bridge_name='br-int',has_traffic_filtering=True,id=b9855804-ae85-4e19-b3c0-586032713aff,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9855804-ae') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:45:28.392132 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:aa:6f,bridge_name='br-int',has_traffic_filtering=True,id=b9855804-ae85-4e19-b3c0-586032713aff,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9855804-ae') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:45:28.392598 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:28.392598 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9855804-ae, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:28.393533 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:28.394394 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:28.395126 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:28.395815 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:28.396030 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed66ebc6-f5e2-41de-94c7-17b74a344702) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:28.396631 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:28.397156 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:28.398388 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:28.398995 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:28.400896 np0000001025 nova-compute[97981]: INFO os_vif [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:aa:6f,bridge_name='br-int',has_traffic_filtering=True,id=b9855804-ae85-4e19-b3c0-586032713aff,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9855804-ae')
May 19 04:45:28.401154 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Deleting instance files /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6_del
May 19 04:45:28.401827 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Deletion of /opt/stack/data/nova/instances/b32b8038-72c4-443c-aea3-07cd61ad67f6_del complete
May 19 04:45:28.842174 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:45:28.848505 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Successfully updated port: 381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:45:28.906829 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Took 1.38 seconds to destroy the instance on the hypervisor.
May 19 04:45:28.907333 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:45:28.909164 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:45:28.909164 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:45:28.909164 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:28.916018 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5d627b8c-0759-4a0c-b3f2-794f8b28b8a6 req-1174b600-6530-4267-a5bd-761df757239a service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received event network-changed-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:28.916519 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5d627b8c-0759-4a0c-b3f2-794f8b28b8a6 req-1174b600-6530-4267-a5bd-761df757239a service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Refreshing instance network info cache due to event network-changed-381aabe0-261a-4722-a473-90dd923ddd70. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:45:28.916644 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5d627b8c-0759-4a0c-b3f2-794f8b28b8a6 req-1174b600-6530-4267-a5bd-761df757239a service nova] Acquiring lock "refresh_cache-e2017472-4da3-4676-b614-3e7039fedef3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:45:28.916727 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5d627b8c-0759-4a0c-b3f2-794f8b28b8a6 req-1174b600-6530-4267-a5bd-761df757239a service nova] Acquired lock "refresh_cache-e2017472-4da3-4676-b614-3e7039fedef3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:45:28.916840 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5d627b8c-0759-4a0c-b3f2-794f8b28b8a6 req-1174b600-6530-4267-a5bd-761df757239a service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Refreshing network info cache for port 381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:45:29.006639 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:29.350612 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "refresh_cache-e2017472-4da3-4676-b614-3e7039fedef3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:45:29.419146 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-5d627b8c-0759-4a0c-b3f2-794f8b28b8a6 req-1174b600-6530-4267-a5bd-761df757239a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:29.476339 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5d627b8c-0759-4a0c-b3f2-794f8b28b8a6 req-1174b600-6530-4267-a5bd-761df757239a service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:45:29.598375 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5d627b8c-0759-4a0c-b3f2-794f8b28b8a6 req-1174b600-6530-4267-a5bd-761df757239a service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:29.763699 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:29.805376 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2e5f1c32-b46a-43ae-b966-1b9115e6de79 req-3a68f424-82bd-4685-846f-1addd497c404 service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Received event network-vif-unplugged-b9855804-ae85-4e19-b3c0-586032713aff {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:29.806022 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2e5f1c32-b46a-43ae-b966-1b9115e6de79 req-3a68f424-82bd-4685-846f-1addd497c404 service nova] Acquiring lock "b32b8038-72c4-443c-aea3-07cd61ad67f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:29.806526 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2e5f1c32-b46a-43ae-b966-1b9115e6de79 req-3a68f424-82bd-4685-846f-1addd497c404 service nova] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:29.806717 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2e5f1c32-b46a-43ae-b966-1b9115e6de79 req-3a68f424-82bd-4685-846f-1addd497c404 service nova] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:29.806907 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2e5f1c32-b46a-43ae-b966-1b9115e6de79 req-3a68f424-82bd-4685-846f-1addd497c404 service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] No waiting events found dispatching network-vif-unplugged-b9855804-ae85-4e19-b3c0-586032713aff {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:45:29.809138 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2e5f1c32-b46a-43ae-b966-1b9115e6de79 req-3a68f424-82bd-4685-846f-1addd497c404 service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Received event network-vif-unplugged-b9855804-ae85-4e19-b3c0-586032713aff for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:45:29.809138 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2e5f1c32-b46a-43ae-b966-1b9115e6de79 req-3a68f424-82bd-4685-846f-1addd497c404 service nova] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Received event network-vif-deleted-b9855804-ae85-4e19-b3c0-586032713aff {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:29.853376 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:45:29.854485 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:45:29.854758 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Creating image(s)
May 19 04:45:29.855524 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:29.855854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "/opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:29.856434 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "/opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:29.857064 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:45:29.860969 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:45:29.862163 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:29.954065 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.092s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:29.954644 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:29.955198 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:29.955671 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:45:29.958555 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:45:29.958947 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:30.068126 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.109s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:30.072193 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:30.101664 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5d627b8c-0759-4a0c-b3f2-794f8b28b8a6 req-1174b600-6530-4267-a5bd-761df757239a service nova] Releasing lock "refresh_cache-e2017472-4da3-4676-b614-3e7039fedef3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:45:30.102854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquired lock "refresh_cache-e2017472-4da3-4676-b614-3e7039fedef3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:45:30.103422 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:45:30.147693 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk 1073741824" returned: 0 in 0.079s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:30.151129 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:30.151129 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:30.234783 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.086s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:30.237133 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:45:30.237133 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:30.267196 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Took 1.36 seconds to deallocate network for instance.
May 19 04:45:30.328266 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:30.329500 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Cannot resize image /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:45:30.329949 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:45:30.330226 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Ensure instance console log exists: /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:45:30.330540 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:30.330822 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:30.331075 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:30.685651 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:45:30.781785 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:30.781785 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:30.829130 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "80436afa-9cd9-41cd-b589-629da01b6bfe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:30.829130 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:30.829130 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:30.829130 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:30.829130 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:30.831979 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Terminating instance
May 19 04:45:30.864127 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:31.030914 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Updating instance_info_cache with network_info: [{"id": "381aabe0-261a-4722-a473-90dd923ddd70", "address": "fa:16:3e:33:f8:14", "network": {"id": "502bb41d-fb0e-4491-9039-68b5fde2624f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-951372128-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f892ab02546d4b6295c6abf1e79121ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap381aabe0-26", "ovs_interfaceid": "381aabe0-261a-4722-a473-90dd923ddd70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:31.131472 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:45:31.131715 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:45:31.338984 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:45:31.356411 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:31.378680 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:31.382242 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:31.406172 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:31.407065 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:31.510956 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0c699df6-3bac-4f2d-97ba-e4919cf7ac01 req-8d2c2d4d-63ef-4b5c-a3fb-bea33f255028 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received event network-vif-unplugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:31.511222 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0c699df6-3bac-4f2d-97ba-e4919cf7ac01 req-8d2c2d4d-63ef-4b5c-a3fb-bea33f255028 service nova] Acquiring lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:31.511388 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0c699df6-3bac-4f2d-97ba-e4919cf7ac01 req-8d2c2d4d-63ef-4b5c-a3fb-bea33f255028 service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:31.512209 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0c699df6-3bac-4f2d-97ba-e4919cf7ac01 req-8d2c2d4d-63ef-4b5c-a3fb-bea33f255028 service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:31.512209 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0c699df6-3bac-4f2d-97ba-e4919cf7ac01 req-8d2c2d4d-63ef-4b5c-a3fb-bea33f255028 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] No waiting events found dispatching network-vif-unplugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:45:31.512209 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0c699df6-3bac-4f2d-97ba-e4919cf7ac01 req-8d2c2d4d-63ef-4b5c-a3fb-bea33f255028 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received event network-vif-unplugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:45:31.532888 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Releasing lock "refresh_cache-e2017472-4da3-4676-b614-3e7039fedef3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:45:31.533406 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Instance network_info: |[{"id": "381aabe0-261a-4722-a473-90dd923ddd70", "address": "fa:16:3e:33:f8:14", "network": {"id": "502bb41d-fb0e-4491-9039-68b5fde2624f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-951372128-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f892ab02546d4b6295c6abf1e79121ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap381aabe0-26", "ovs_interfaceid": "381aabe0-261a-4722-a473-90dd923ddd70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:45:31.536021 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Start _get_guest_xml network_info=[{"id": "381aabe0-261a-4722-a473-90dd923ddd70", "address": "fa:16:3e:33:f8:14", "network": {"id": "502bb41d-fb0e-4491-9039-68b5fde2624f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-951372128-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f892ab02546d4b6295c6abf1e79121ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap381aabe0-26", "ovs_interfaceid": "381aabe0-261a-4722-a473-90dd923ddd70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:45:31.540735 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:45:31.541979 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-1645383300', uuid='e2017472-4da3-4676-b614-3e7039fedef3'), owner=OwnerMeta(userid='71fd665949ed42008ee194558e5a8f1a', username='tempest-ServerStableDeviceRescueTest-1373788552-project-member', projectid='f892ab02546d4b6295c6abf1e79121ce', projectname='tempest-ServerStableDeviceRescueTest-1373788552'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "381aabe0-261a-4722-a473-90dd923ddd70", "address": "fa:16:3e:33:f8:14", "network": {"id": "502bb41d-fb0e-4491-9039-68b5fde2624f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-951372128-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f892ab02546d4b6295c6abf1e79121ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap381aabe0-26", "ovs_interfaceid": "381aabe0-261a-4722-a473-90dd923ddd70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165931.5416439) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:45:31.543595 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:45:31.543690 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:45:31.546566 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:45:31.546713 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:45:31.547583 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:45:31.547871 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:45:31.548019 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:45:31.548125 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:45:31.548236 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:45:31.548311 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:45:31.548396 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:45:31.548573 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:45:31.548663 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:45:31.548761 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:45:31.548867 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:45:31.549162 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:45:31.562919 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:45:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1645383300',display_name='tempest-ServerStableDeviceRescueTest-server-1645383300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverstabledevicerescuetest-server-1645383300',id=56,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmxK8WyxxhAZNJAGW9uj5RApz4FkMYnu+jzzwFf9ZoRxi4XmMIeQ6coYidX3UcBjBPKUfhayqmjiBIQ5+6lbotN9MsTrUqZ3reOtIllIXaAg6VTnfB25fPMIGjifc5wrA==',key_name='tempest-keypair-32905224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f892ab02546d4b6295c6abf1e79121ce',ramdisk_id='',reservation_id='r-7myclumk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1373788552',owner_user_name='tempest-ServerStableDeviceRescueTest-1373788552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:45:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71fd665949ed42008ee194558e5a8f1a',uuid=e2017472-4da3-4676-b614-3e7039fedef3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "381aabe0-261a-4722-a473-90dd923ddd70", "address": "fa:16:3e:33:f8:14", "network": {"id": "502bb41d-fb0e-4491-9039-68b5fde2624f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-951372128-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f892ab02546d4b6295c6abf1e79121ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap381aabe0-26", "ovs_interfaceid": "381aabe0-261a-4722-a473-90dd923ddd70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:45:31.562919 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Converting VIF {"id": "381aabe0-261a-4722-a473-90dd923ddd70", "address": "fa:16:3e:33:f8:14", "network": {"id": "502bb41d-fb0e-4491-9039-68b5fde2624f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-951372128-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f892ab02546d4b6295c6abf1e79121ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap381aabe0-26", "ovs_interfaceid": "381aabe0-261a-4722-a473-90dd923ddd70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:45:31.562919 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:f8:14,bridge_name='br-int',has_traffic_filtering=True,id=381aabe0-261a-4722-a473-90dd923ddd70,network=Network(502bb41d-fb0e-4491-9039-68b5fde2624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap381aabe0-26') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:45:31.562919 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lazy-loading 'pci_devices' on Instance uuid e2017472-4da3-4676-b614-3e7039fedef3 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:45:31.631788 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:31.635780 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:45:31.643134 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:31.661285 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999672116000056 future=<Future at 0x72183418d880 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:31.664402 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Instance destroyed successfully.
May 19 04:45:31.664997 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'resources' on Instance uuid 80436afa-9cd9-41cd-b589-629da01b6bfe {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:45:32.065089 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] End _get_guest_xml xml=<domain type="qemu">
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:   <uuid>e2017472-4da3-4676-b614-3e7039fedef3</uuid>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:   <name>instance-00000038</name>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1645383300</nova:name>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:45:31</nova:creationTime>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:         <nova:user uuid="71fd665949ed42008ee194558e5a8f1a">tempest-ServerStableDeviceRescueTest-1373788552-project-member</nova:user>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:         <nova:project uuid="f892ab02546d4b6295c6abf1e79121ce">tempest-ServerStableDeviceRescueTest-1373788552</nova:project>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:         <nova:port uuid="381aabe0-261a-4722-a473-90dd923ddd70">
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     <system>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <entry name="serial">e2017472-4da3-4676-b614-3e7039fedef3</entry>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <entry name="uuid">e2017472-4da3-4676-b614-3e7039fedef3</entry>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     </system>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:   <os>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:   </os>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:   <features>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:   </features>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:   <devices>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk"/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     </disk>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk.config"/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     </disk>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:33:f8:14"/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <target dev="tap381aabe0-26"/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     </interface>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/console.log" append="off"/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     </serial>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     <video>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     </video>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     </rng>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:   </devices>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]: </domain>
May 19 04:45:32.065089 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:45:32.068083 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Preparing to wait for external event network-vif-plugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:45:32.068083 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "e2017472-4da3-4676-b614-3e7039fedef3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:32.068083 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:32.068083 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:32.068083 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:45:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1645383300',display_name='tempest-ServerStableDeviceRescueTest-server-1645383300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverstabledevicerescuetest-server-1645383300',id=56,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmxK8WyxxhAZNJAGW9uj5RApz4FkMYnu+jzzwFf9ZoRxi4XmMIeQ6coYidX3UcBjBPKUfhayqmjiBIQ5+6lbotN9MsTrUqZ3reOtIllIXaAg6VTnfB25fPMIGjifc5wrA==',key_name='tempest-keypair-32905224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f892ab02546d4b6295c6abf1e79121ce',ramdisk_id='',reservation_id='r-7myclumk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1373788552',owner_user_name='tempest-ServerStableDeviceRescueTest-1373788552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:45:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71fd665949ed42008ee194558e5a8f1a',uuid=e2017472-4da3-4676-b614-3e7039fedef3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "381aabe0-261a-4722-a473-90dd923ddd70", "address": "fa:16:3e:33:f8:14", "network": {"id": "502bb41d-fb0e-4491-9039-68b5fde2624f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-951372128-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f892ab02546d4b6295c6abf1e79121ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap381aabe0-26", "ovs_interfaceid": "381aabe0-261a-4722-a473-90dd923ddd70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:45:32.068083 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Converting VIF {"id": "381aabe0-261a-4722-a473-90dd923ddd70", "address": "fa:16:3e:33:f8:14", "network": {"id": "502bb41d-fb0e-4491-9039-68b5fde2624f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-951372128-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f892ab02546d4b6295c6abf1e79121ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap381aabe0-26", "ovs_interfaceid": "381aabe0-261a-4722-a473-90dd923ddd70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:45:32.068083 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:f8:14,bridge_name='br-int',has_traffic_filtering=True,id=381aabe0-261a-4722-a473-90dd923ddd70,network=Network(502bb41d-fb0e-4491-9039-68b5fde2624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap381aabe0-26') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:45:32.068083 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:f8:14,bridge_name='br-int',has_traffic_filtering=True,id=381aabe0-261a-4722-a473-90dd923ddd70,network=Network(502bb41d-fb0e-4491-9039-68b5fde2624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap381aabe0-26') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:45:32.068083 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:32.068083 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:32.068083 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:45:32.068727 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:32.068907 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '93ab5979-c46b-582e-af8a-77a5143f38cc', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:32.069669 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:32.070330 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:32.075071 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:32.077016 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:32.077179 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap381aabe0-26, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:32.077471 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap381aabe0-26, col_values=(('qos', UUID('6a8a77d6-aa3b-4aa7-8ab9-a8641e543594')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:32.077616 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap381aabe0-26, col_values=(('external_ids', {'iface-id': '381aabe0-261a-4722-a473-90dd923ddd70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:f8:14', 'vm-uuid': 'e2017472-4da3-4676-b614-3e7039fedef3'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:32.078366 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:32.080004 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:32.087599 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:32.088849 np0000001025 nova-compute[97981]: INFO os_vif [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:f8:14,bridge_name='br-int',has_traffic_filtering=True,id=381aabe0-261a-4722-a473-90dd923ddd70,network=Network(502bb41d-fb0e-4491-9039-68b5fde2624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap381aabe0-26')
May 19 04:45:32.146717 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.365s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:32.167618 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-640764006',display_name='tempest-AttachVolumeTestJSON-server-640764006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumetestjson-server-640764006',id=45,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2tj8xzpEQbsFz0KUREQNWmpjZhzzIU4JsBBAhR6kXLneAex6Ogc6JmA+zSTxW3EHqpPyo/1HFfxr+XwLCwn6E7c5wL4jf0HNaUzjvIvGdUt6TsdBS845t/ZQ77wWohcw==',key_name='tempest-keypair-402968852',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:43:06Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='662c1a9b25e44aff8242f468232af7f3',ramdisk_id='',reservation_id='r-bmmqkbkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1215369469',owner_user_name='tempest-AttachVolumeTestJSON-1215369469-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:45:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f7f84eb55d44e89c2ed500098135e0',uuid=80436afa-9cd9-41cd-b589-629da01b6bfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:45:32.167792 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converting VIF {"id": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "address": "fa:16:3e:08:04:9d", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e6bc86-13", "ovs_interfaceid": "15e6bc86-13bd-43b9-ad28-342f33dbdeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:45:32.168350 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:04:9d,bridge_name='br-int',has_traffic_filtering=True,id=15e6bc86-13bd-43b9-ad28-342f33dbdeb8,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6bc86-13') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:45:32.168550 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:04:9d,bridge_name='br-int',has_traffic_filtering=True,id=15e6bc86-13bd-43b9-ad28-342f33dbdeb8,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6bc86-13') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:45:32.169610 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:32.169864 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15e6bc86-13, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:32.170822 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:32.171587 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:32.176344 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:32.177207 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:32.177414 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60e2e370-a142-4517-95a1-7740974487fd) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:32.177906 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:32.178521 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:32.183223 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:32.185142 np0000001025 nova-compute[97981]: INFO os_vif [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:04:9d,bridge_name='br-int',has_traffic_filtering=True,id=15e6bc86-13bd-43b9-ad28-342f33dbdeb8,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e6bc86-13')
May 19 04:45:32.185880 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Deleting instance files /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe_del
May 19 04:45:32.186300 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Deletion of /opt/stack/data/nova/instances/80436afa-9cd9-41cd-b589-629da01b6bfe_del complete
May 19 04:45:32.203389 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Deleted allocations for instance b32b8038-72c4-443c-aea3-07cd61ad67f6
May 19 04:45:32.692430 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Took 1.35 seconds to destroy the instance on the hypervisor.
May 19 04:45:32.694550 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:45:32.695087 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:45:32.695219 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:45:32.695472 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:32.780509 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:33.168408 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7e374352-fbe7-4947-80ba-3b296ec9dbd1 req-f8ac9c8e-44fa-4b28-8cbf-926e7353ed54 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received event network-vif-deleted-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:33.168745 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-7e374352-fbe7-4947-80ba-3b296ec9dbd1 req-f8ac9c8e-44fa-4b28-8cbf-926e7353ed54 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Neutron deleted interface 15e6bc86-13bd-43b9-ad28-342f33dbdeb8; detaching it from the instance and deleting it from the info cache
May 19 04:45:33.168852 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-7e374352-fbe7-4947-80ba-3b296ec9dbd1 req-f8ac9c8e-44fa-4b28-8cbf-926e7353ed54 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:33.210737 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-445db524-c2e2-4f62-aded-2cefa154d1d7 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "b32b8038-72c4-443c-aea3-07cd61ad67f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.186s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:33.401305 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:33.580266 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50a194b6-6973-4503-820d-b2745c91273a req-48c621b2-106d-47f4-8bf4-5ea67652eb10 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received event network-vif-unplugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:33.581196 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50a194b6-6973-4503-820d-b2745c91273a req-48c621b2-106d-47f4-8bf4-5ea67652eb10 service nova] Acquiring lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:33.581390 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50a194b6-6973-4503-820d-b2745c91273a req-48c621b2-106d-47f4-8bf4-5ea67652eb10 service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:33.581466 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-50a194b6-6973-4503-820d-b2745c91273a req-48c621b2-106d-47f4-8bf4-5ea67652eb10 service nova] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:33.581604 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50a194b6-6973-4503-820d-b2745c91273a req-48c621b2-106d-47f4-8bf4-5ea67652eb10 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] No waiting events found dispatching network-vif-unplugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:45:33.581657 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-50a194b6-6973-4503-820d-b2745c91273a req-48c621b2-106d-47f4-8bf4-5ea67652eb10 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Received event network-vif-unplugged-15e6bc86-13bd-43b9-ad28-342f33dbdeb8 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:45:33.607715 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:45:33.608395 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:45:33.608395 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] No VIF found with MAC fa:16:3e:33:f8:14, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:45:33.608677 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Using config drive
May 19 04:45:33.627150 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:33.672526 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7e374352-fbe7-4947-80ba-3b296ec9dbd1 req-f8ac9c8e-44fa-4b28-8cbf-926e7353ed54 service nova] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Detach interface failed, port_id=15e6bc86-13bd-43b9-ad28-342f33dbdeb8, reason: Instance 80436afa-9cd9-41cd-b589-629da01b6bfe could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:45:34.114895 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:34.129309 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Took 1.43 seconds to deallocate network for instance.
May 19 04:45:34.228168 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Creating config drive at /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk.config
May 19 04:45:34.231748 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd8_9xu_z {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:34.284283 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd8_9xu_z" returned: 0 in 0.052s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:34.458841 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "32cc5240-7a56-4cee-9b41-54e17386b39f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:34.459062 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "32cc5240-7a56-4cee-9b41-54e17386b39f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:34.459269 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "32cc5240-7a56-4cee-9b41-54e17386b39f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:34.459388 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "32cc5240-7a56-4cee-9b41-54e17386b39f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:34.459504 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "32cc5240-7a56-4cee-9b41-54e17386b39f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:34.462402 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Terminating instance
May 19 04:45:34.636595 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:34.636811 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:34.678591 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:34.702665 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:34.704406 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:34.800521 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:34.911743 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:45:34.912000 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:45:34.966039 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:45:34.981672 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:34.983852 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:35.001103 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:35.007422 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:35.009327 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:35.031834 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:35.038100 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:35.140990 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:35.167958 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:35.233806 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b6df6a0f-0224-44e9-b766-cdfe0e74bb4b req-51b0406e-023d-45de-88cf-501c0ff904da service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received event network-vif-plugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:35.234363 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b6df6a0f-0224-44e9-b766-cdfe0e74bb4b req-51b0406e-023d-45de-88cf-501c0ff904da service nova] Acquiring lock "e2017472-4da3-4676-b614-3e7039fedef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:35.234497 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b6df6a0f-0224-44e9-b766-cdfe0e74bb4b req-51b0406e-023d-45de-88cf-501c0ff904da service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:35.234634 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b6df6a0f-0224-44e9-b766-cdfe0e74bb4b req-51b0406e-023d-45de-88cf-501c0ff904da service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:35.234749 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b6df6a0f-0224-44e9-b766-cdfe0e74bb4b req-51b0406e-023d-45de-88cf-501c0ff904da service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Processing event network-vif-plugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:45:35.234870 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b6df6a0f-0224-44e9-b766-cdfe0e74bb4b req-51b0406e-023d-45de-88cf-501c0ff904da service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received event network-vif-plugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:35.235061 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b6df6a0f-0224-44e9-b766-cdfe0e74bb4b req-51b0406e-023d-45de-88cf-501c0ff904da service nova] Acquiring lock "e2017472-4da3-4676-b614-3e7039fedef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:35.235199 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b6df6a0f-0224-44e9-b766-cdfe0e74bb4b req-51b0406e-023d-45de-88cf-501c0ff904da service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:35.235288 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b6df6a0f-0224-44e9-b766-cdfe0e74bb4b req-51b0406e-023d-45de-88cf-501c0ff904da service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:35.235347 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b6df6a0f-0224-44e9-b766-cdfe0e74bb4b req-51b0406e-023d-45de-88cf-501c0ff904da service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] No waiting events found dispatching network-vif-plugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:45:35.235451 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-b6df6a0f-0224-44e9-b766-cdfe0e74bb4b req-51b0406e-023d-45de-88cf-501c0ff904da service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received unexpected event network-vif-plugged-381aabe0-261a-4722-a473-90dd923ddd70 for instance with vm_state building and task_state spawning.
May 19 04:45:35.235561 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b6df6a0f-0224-44e9-b766-cdfe0e74bb4b req-51b0406e-023d-45de-88cf-501c0ff904da service nova] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Received event network-vif-unplugged-074c374b-3c37-4167-a2d2-3316204ce080 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:35.235694 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b6df6a0f-0224-44e9-b766-cdfe0e74bb4b req-51b0406e-023d-45de-88cf-501c0ff904da service nova] Acquiring lock "32cc5240-7a56-4cee-9b41-54e17386b39f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:35.235792 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b6df6a0f-0224-44e9-b766-cdfe0e74bb4b req-51b0406e-023d-45de-88cf-501c0ff904da service nova] Lock "32cc5240-7a56-4cee-9b41-54e17386b39f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:35.235905 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b6df6a0f-0224-44e9-b766-cdfe0e74bb4b req-51b0406e-023d-45de-88cf-501c0ff904da service nova] Lock "32cc5240-7a56-4cee-9b41-54e17386b39f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:35.236007 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b6df6a0f-0224-44e9-b766-cdfe0e74bb4b req-51b0406e-023d-45de-88cf-501c0ff904da service nova] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] No waiting events found dispatching network-vif-unplugged-074c374b-3c37-4167-a2d2-3316204ce080 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:45:35.236155 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b6df6a0f-0224-44e9-b766-cdfe0e74bb4b req-51b0406e-023d-45de-88cf-501c0ff904da service nova] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Received event network-vif-unplugged-074c374b-3c37-4167-a2d2-3316204ce080 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:45:35.269050 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:35.277079 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:35.295662 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.99963004700021 future=<Future at 0x7218502a39e0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:35.298631 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Instance destroyed successfully.
May 19 04:45:35.299084 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lazy-loading 'resources' on Instance uuid 32cc5240-7a56-4cee-9b41-54e17386b39f {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:45:35.414429 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:45:35.443974 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165935.4436252, e2017472-4da3-4676-b614-3e7039fedef3 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:35.444172 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e2017472-4da3-4676-b614-3e7039fedef3] VM Started (Lifecycle Event)
May 19 04:45:35.445342 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:45:35.448489 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:45:35.450981 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Instance spawned successfully.
May 19 04:45:35.451264 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:45:35.648613 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0003917469998668821 future=<Future at 0x721834350440 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:35.648981 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] Emitting event <LifecycleEvent: 1779165920.6480894, e644a772-cf7c-4b15-b21b-ea54e773a1f9 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:35.649123 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:35.649379 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] VM Stopped (Lifecycle Event)
May 19 04:45:35.650360 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=7.233771490000436 future=<Future at 0x72185027fa40 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:35.650490 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=7.233633290000398 future=<Future at 0x72185027fa40 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:35.802238 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:39:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-998021487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumemultiattachtest-server-998021487',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:39:23Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='490151decdde445593a86a16976f6b34',ramdisk_id='',reservation_id='r-dy62941y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1659172696',owner_user_name='tempest-AttachVolumeMultiAttachTest-1659172696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:39:23Z,user_data=None,user_id='aa432d60cb324c6d87818107e05e0053',uuid=32cc5240-7a56-4cee-9b41-54e17386b39f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "074c374b-3c37-4167-a2d2-3316204ce080", "address": "fa:16:3e:ed:8d:89", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap074c374b-3c", "ovs_interfaceid": "074c374b-3c37-4167-a2d2-3316204ce080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:45:35.802494 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converting VIF {"id": "074c374b-3c37-4167-a2d2-3316204ce080", "address": "fa:16:3e:ed:8d:89", "network": {"id": "12ccb6d0-a5d7-43b3-b3cd-41106ed8e173", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1554582946-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "490151decdde445593a86a16976f6b34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap074c374b-3c", "ovs_interfaceid": "074c374b-3c37-4167-a2d2-3316204ce080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:45:35.802956 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:8d:89,bridge_name='br-int',has_traffic_filtering=True,id=074c374b-3c37-4167-a2d2-3316204ce080,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap074c374b-3c') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:45:35.803244 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:8d:89,bridge_name='br-int',has_traffic_filtering=True,id=074c374b-3c37-4167-a2d2-3316204ce080,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap074c374b-3c') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:45:35.804486 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:35.804717 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap074c374b-3c, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:35.805882 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:35.806589 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:35.806754 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:35.807671 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:35.807912 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=188da85c-14e4-4c23-9154-e7cdf8531c9e) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:35.808697 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:35.809022 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:35.810985 np0000001025 nova-compute[97981]: INFO os_vif [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:8d:89,bridge_name='br-int',has_traffic_filtering=True,id=074c374b-3c37-4167-a2d2-3316204ce080,network=Network(12ccb6d0-a5d7-43b3-b3cd-41106ed8e173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap074c374b-3c')
May 19 04:45:35.856297 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:45:35.856639 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '234422a2-4faa-4b84-9742-2491b748d237', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:45:35.856796 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:45:35.857147 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:45:35.857430 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '234422a2-4faa-4b84-9742-2491b748d237', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:45:35.857560 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:45:35.880721 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:45:35.880721 np0000001025 nova-compute[97981]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:45:35.880721 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:45:35.880721 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:45:35.880721 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:45:35.881052 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsi session list stdout=tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:45:35.881052 np0000001025 nova-compute[97981]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:45:35.881052 np0000001025 nova-compute[97981]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:45:35.881052 np0000001025 nova-compute[97981]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237 (non-flash)
May 19 04:45:35.881052 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:45:35.881052 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:45:35.881052 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '64')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:45:35.881881 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237', '63')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:45:35.882492 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185065db20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237'): ({'sdh'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:45:35.882680 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Removing multipathed devices sdh, sdi {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:45:35.882875 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Flush multipath device 33000000050cc254c {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:45:35.920539 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.284s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:35.945545 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:45:35.946813 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:35.949675 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:45:35.961514 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:35.961514 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:35.961514 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:35.961514 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:35.961514 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:35.961514 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:35.972281 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Deleted allocations for instance 80436afa-9cd9-41cd-b589-629da01b6bfe
May 19 04:45:35.985532 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:45:36.028343 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:45:36.028505 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:45:36.029387 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:45:36.039355 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:45:36.039545 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:45:36.049605 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:36.075565 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 64, target: iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237, portal: 192.168.40.100,3260]
May 19 04:45:36.075565 np0000001025 nova-compute[97981]: Logout of [sid: 64, target: iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237, portal: 192.168.40.100,3260] successful.
May 19 04:45:36.075565 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:36.090625 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:36.101215 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:36.135279 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237, portal: 192.168.50.100,3260]
May 19 04:45:36.135279 np0000001025 nova-compute[97981]: Logout of [sid: 63, target: iqn.2023-03.storpool.com:os--volume-234422a2-4faa-4b84-9742-2491b748d237, portal: 192.168.50.100,3260] successful.
May 19 04:45:36.135279 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:36.147634 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:36.147843 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:45:36.147964 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] <== disconnect_volume: return (291ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:45:36.148068 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:45:36.148368 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Deleting instance files /opt/stack/data/nova/instances/32cc5240-7a56-4cee-9b41-54e17386b39f_del
May 19 04:45:36.148791 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Deletion of /opt/stack/data/nova/instances/32cc5240-7a56-4cee-9b41-54e17386b39f_del complete
May 19 04:45:36.151444 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-dfa63ab9-84ba-4104-8ad4-1e59282f09c5 tempest-ServerBootFromVolumeStableRescueTest-96916496 tempest-ServerBootFromVolumeStableRescueTest-96916496-project-member] [instance: e644a772-cf7c-4b15-b21b-ea54e773a1f9] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:36.452871 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e2017472-4da3-4676-b614-3e7039fedef3] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:45:36.453326 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165936.4529636, e2017472-4da3-4676-b614-3e7039fedef3 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:36.453424 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e2017472-4da3-4676-b614-3e7039fedef3] VM Paused (Lifecycle Event)
May 19 04:45:36.466334 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Took 6.61 seconds to spawn the instance on the hypervisor.
May 19 04:45:36.466494 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:36.656397 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Took 1.69 seconds to destroy the instance on the hypervisor.
May 19 04:45:36.657016 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:45:36.657373 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:45:36.657595 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:45:36.657717 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:36.745053 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:36.955936 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:36.958202 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165936.9579566, e2017472-4da3-4676-b614-3e7039fedef3 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:36.958321 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e2017472-4da3-4676-b614-3e7039fedef3] VM Resumed (Lifecycle Event)
May 19 04:45:36.974830 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Took 13.29 seconds to build instance.
May 19 04:45:36.984379 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-de0e7193-cfc5-4bab-9763-9fca22a22f18 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "80436afa-9cd9-41cd-b589-629da01b6bfe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.156s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:37.015840 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-edfda0e0-bf9c-460f-8474-1a961b6be999 req-03823a73-3b57-46e6-86b6-abee9afa62e1 service nova] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Received event network-vif-deleted-074c374b-3c37-4167-a2d2-3316204ce080 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:37.016404 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-edfda0e0-bf9c-460f-8474-1a961b6be999 req-03823a73-3b57-46e6-86b6-abee9afa62e1 service nova] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Neutron deleted interface 074c374b-3c37-4167-a2d2-3316204ce080; detaching it from the instance and deleting it from the info cache
May 19 04:45:37.016583 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-edfda0e0-bf9c-460f-8474-1a961b6be999 req-03823a73-3b57-46e6-86b6-abee9afa62e1 service nova] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:37.294868 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0319efd4-86d3-4e6f-8dc4-997c33726d76 req-cc11f013-d30e-4148-ad94-afcff803cf9f service nova] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Received event network-vif-unplugged-074c374b-3c37-4167-a2d2-3316204ce080 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:37.295507 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0319efd4-86d3-4e6f-8dc4-997c33726d76 req-cc11f013-d30e-4148-ad94-afcff803cf9f service nova] Acquiring lock "32cc5240-7a56-4cee-9b41-54e17386b39f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:37.296430 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0319efd4-86d3-4e6f-8dc4-997c33726d76 req-cc11f013-d30e-4148-ad94-afcff803cf9f service nova] Lock "32cc5240-7a56-4cee-9b41-54e17386b39f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:37.296430 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0319efd4-86d3-4e6f-8dc4-997c33726d76 req-cc11f013-d30e-4148-ad94-afcff803cf9f service nova] Lock "32cc5240-7a56-4cee-9b41-54e17386b39f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:37.296430 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0319efd4-86d3-4e6f-8dc4-997c33726d76 req-cc11f013-d30e-4148-ad94-afcff803cf9f service nova] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] No waiting events found dispatching network-vif-unplugged-074c374b-3c37-4167-a2d2-3316204ce080 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:45:37.296430 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0319efd4-86d3-4e6f-8dc4-997c33726d76 req-cc11f013-d30e-4148-ad94-afcff803cf9f service nova] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Received event network-vif-unplugged-074c374b-3c37-4167-a2d2-3316204ce080 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:45:37.462685 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:37.463249 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:37.465911 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:45:37.476327 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "e2017472-4da3-4676-b614-3e7039fedef3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.801s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:37.519807 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-edfda0e0-bf9c-460f-8474-1a961b6be999 req-03823a73-3b57-46e6-86b6-abee9afa62e1 service nova] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Detach interface failed, port_id=074c374b-3c37-4167-a2d2-3316204ce080, reason: Instance 32cc5240-7a56-4cee-9b41-54e17386b39f could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:45:37.967601 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Took 1.31 seconds to deallocate network for instance.
May 19 04:45:38.403482 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:38.516288 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Took 0.55 seconds to detach 1 volumes for instance.
May 19 04:45:39.020957 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:39.021176 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:39.253579 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:45:39.253850 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:45:39.363565 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-bde61a74-ab63-4f05-bcc7-8c9eb2cead4d req-60a3642a-d8ba-444a-9a12-855f9630584a service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received event network-changed-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:39.364071 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-bde61a74-ab63-4f05-bcc7-8c9eb2cead4d req-60a3642a-d8ba-444a-9a12-855f9630584a service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Refreshing instance network info cache due to event network-changed-381aabe0-261a-4722-a473-90dd923ddd70. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:45:39.364349 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bde61a74-ab63-4f05-bcc7-8c9eb2cead4d req-60a3642a-d8ba-444a-9a12-855f9630584a service nova] Acquiring lock "refresh_cache-e2017472-4da3-4676-b614-3e7039fedef3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:45:39.364511 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bde61a74-ab63-4f05-bcc7-8c9eb2cead4d req-60a3642a-d8ba-444a-9a12-855f9630584a service nova] Acquired lock "refresh_cache-e2017472-4da3-4676-b614-3e7039fedef3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:45:39.364732 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-bde61a74-ab63-4f05-bcc7-8c9eb2cead4d req-60a3642a-d8ba-444a-9a12-855f9630584a service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Refreshing network info cache for port 381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:45:39.756462 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:45:39.804819 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:39.805056 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:39.869181 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-bde61a74-ab63-4f05-bcc7-8c9eb2cead4d req-60a3642a-d8ba-444a-9a12-855f9630584a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:40.131899 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-bde61a74-ab63-4f05-bcc7-8c9eb2cead4d req-60a3642a-d8ba-444a-9a12-855f9630584a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:40.253915 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-bde61a74-ab63-4f05-bcc7-8c9eb2cead4d req-60a3642a-d8ba-444a-9a12-855f9630584a service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Updated VIF entry in instance network info cache for port 381aabe0-261a-4722-a473-90dd923ddd70. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:45:40.254301 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-bde61a74-ab63-4f05-bcc7-8c9eb2cead4d req-60a3642a-d8ba-444a-9a12-855f9630584a service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Updating instance_info_cache with network_info: [{"id": "381aabe0-261a-4722-a473-90dd923ddd70", "address": "fa:16:3e:33:f8:14", "network": {"id": "502bb41d-fb0e-4491-9039-68b5fde2624f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-951372128-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f892ab02546d4b6295c6abf1e79121ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap381aabe0-26", "ovs_interfaceid": "381aabe0-261a-4722-a473-90dd923ddd70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:40.266187 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.245s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:40.306783 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:45:40.317727 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Deleted allocations for instance 32cc5240-7a56-4cee-9b41-54e17386b39f
May 19 04:45:40.756932 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bde61a74-ab63-4f05-bcc7-8c9eb2cead4d req-60a3642a-d8ba-444a-9a12-855f9630584a service nova] Releasing lock "refresh_cache-e2017472-4da3-4676-b614-3e7039fedef3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:45:40.826331 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:40.854089 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:40.854286 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:40.857623 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:45:40.857751 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Claim successful on node np0000001025
May 19 04:45:41.329856 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-82cad9ed-6a51-462b-9ea7-6f5a654d88d0 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Lock "32cc5240-7a56-4cee-9b41-54e17386b39f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.871s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:42.130300 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:45:42.131050 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:45:42.632726 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:45:42.884481 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00031132799995248206 future=<Future at 0x72185027fa40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:42.886884 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:42.886884 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=3.775364307000018 future=<Future at 0x72183418d880 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:42.886884 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=3.775281843000357 future=<Future at 0x72183418d880 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:42.886884 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Emitting event <LifecycleEvent: 1779165927.8840635, b32b8038-72c4-443c-aea3-07cd61ad67f6 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:42.886884 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] VM Stopped (Lifecycle Event)
May 19 04:45:43.140922 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.284s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:43.140922 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:45:43.388519 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: b32b8038-72c4-443c-aea3-07cd61ad67f6] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:43.405908 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:43.469195 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:45:43.469543 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:45:43.469732 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:45:43.469953 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:45:43.470167 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:45:43.470375 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:45:43.470572 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:45:43.470753 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:45:43.470860 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:45:43.471032 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:45:43.611499 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:43.644387 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:45:43.645264 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:45:43.645264 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:43.645481 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:43.728856 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96f7f84eb55d44e89c2ed500098135e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662c1a9b25e44aff8242f468232af7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:45:43.975570 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:43.975828 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:43.976045 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:43.976257 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:45:44.145665 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:45:44.176075 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Successfully created port: 10a1cfa6-e38d-42cf-903d-e78249ef211c {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:45:44.650241 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:45:44.698883 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Successfully updated port: 10a1cfa6-e38d-42cf-903d-e78249ef211c {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:45:44.768891 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7346df21-0150-4f6b-89cc-e4077003cc33 req-f2a69664-b215-4762-b5fe-1866517a94de service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Received event network-changed-10a1cfa6-e38d-42cf-903d-e78249ef211c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:44.769306 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7346df21-0150-4f6b-89cc-e4077003cc33 req-f2a69664-b215-4762-b5fe-1866517a94de service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Refreshing instance network info cache due to event network-changed-10a1cfa6-e38d-42cf-903d-e78249ef211c. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:45:44.770614 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7346df21-0150-4f6b-89cc-e4077003cc33 req-f2a69664-b215-4762-b5fe-1866517a94de service nova] Acquiring lock "refresh_cache-9df306ad-76ad-4edb-9c21-6efab9d0a26e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:45:44.770614 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7346df21-0150-4f6b-89cc-e4077003cc33 req-f2a69664-b215-4762-b5fe-1866517a94de service nova] Acquired lock "refresh_cache-9df306ad-76ad-4edb-9c21-6efab9d0a26e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:45:44.770614 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-7346df21-0150-4f6b-89cc-e4077003cc33 req-f2a69664-b215-4762-b5fe-1866517a94de service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Refreshing network info cache for port 10a1cfa6-e38d-42cf-903d-e78249ef211c {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:45:45.002393 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:45:45.003905 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26edba3f-dd65-4651-8cc3-3939541dae32/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:45.093738 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26edba3f-dd65-4651-8cc3-3939541dae32/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:45.094279 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26edba3f-dd65-4651-8cc3-3939541dae32/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:45.192527 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26edba3f-dd65-4651-8cc3-3939541dae32/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:45.197392 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:45.217877 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "refresh_cache-9df306ad-76ad-4edb-9c21-6efab9d0a26e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:45:45.276473 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-7346df21-0150-4f6b-89cc-e4077003cc33 req-f2a69664-b215-4762-b5fe-1866517a94de service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:45.312526 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:45.313086 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:45.341950 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-7346df21-0150-4f6b-89cc-e4077003cc33 req-f2a69664-b215-4762-b5fe-1866517a94de service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:45:45.413320 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:45.417772 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:45:45.419047 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:45.465225 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:45.467013 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=13379MB free_disk=73.0271987915039GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:45:45.467587 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:45.467951 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:45.531378 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-7346df21-0150-4f6b-89cc-e4077003cc33 req-f2a69664-b215-4762-b5fe-1866517a94de service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:45.662611 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:45:45.663797 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:45:45.664061 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Creating image(s)
May 19 04:45:45.665042 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "/opt/stack/data/nova/instances/9df306ad-76ad-4edb-9c21-6efab9d0a26e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:45.665343 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "/opt/stack/data/nova/instances/9df306ad-76ad-4edb-9c21-6efab9d0a26e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:45.665897 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "/opt/stack/data/nova/instances/9df306ad-76ad-4edb-9c21-6efab9d0a26e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:45.667223 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:45:45.670217 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:45:45.671409 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:45.781575 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.110s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:45.782378 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:45.783171 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:45.784220 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:45:45.788456 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:45:45.789187 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:45.834193 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:45.885455 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.096s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:45.885839 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/9df306ad-76ad-4edb-9c21-6efab9d0a26e/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:45.940948 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/9df306ad-76ad-4edb-9c21-6efab9d0a26e/disk 1073741824" returned: 0 in 0.055s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:45.941544 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.158s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:45.941861 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:46.035344 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7346df21-0150-4f6b-89cc-e4077003cc33 req-f2a69664-b215-4762-b5fe-1866517a94de service nova] Releasing lock "refresh_cache-9df306ad-76ad-4edb-9c21-6efab9d0a26e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:45:46.035910 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquired lock "refresh_cache-9df306ad-76ad-4edb-9c21-6efab9d0a26e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:45:46.036035 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:45:46.049940 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.108s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:46.050307 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9df306ad-76ad-4edb-9c21-6efab9d0a26e/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:45:46.050523 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df306ad-76ad-4edb-9c21-6efab9d0a26e/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:46.158897 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df306ad-76ad-4edb-9c21-6efab9d0a26e/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:46.159306 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Cannot resize image /opt/stack/data/nova/instances/9df306ad-76ad-4edb-9c21-6efab9d0a26e/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:45:46.159745 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:45:46.159982 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Ensure instance console log exists: /opt/stack/data/nova/instances/9df306ad-76ad-4edb-9c21-6efab9d0a26e/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:45:46.160326 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:46.160650 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:46.160819 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:46.531660 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance fecd576c-4027-4b39-a92a-91d1e3248949 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:45:46.532100 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 26edba3f-dd65-4651-8cc3-3939541dae32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:45:46.532100 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance e2017472-4da3-4676-b614-3e7039fedef3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:45:46.532100 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 9df306ad-76ad-4edb-9c21-6efab9d0a26e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:45:46.532100 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:45:46.532278 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:45:45 up 36 min,  2 users,  load average: 5.17, 5.86, 4.12\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '4', 'num_proj_28b3c0fa8f894ed2a7c3bcfac99ce74c': '1', 'io_workload': '1', 'num_proj_7041ddbe11174207bbc7363b3bf08af5': '1', 'num_proj_f892ab02546d4b6295c6abf1e79121ce': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_662c1a9b25e44aff8242f468232af7f3': '1'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:45:46.623121 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:45:46.661341 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00038752499995098333 future=<Future at 0x72183418d880 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:46.661728 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Emitting event <LifecycleEvent: 1779165931.6608343, 80436afa-9cd9-41cd-b589-629da01b6bfe => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:46.661866 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:46.662030 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] VM Stopped (Lifecycle Event)
May 19 04:45:46.663403 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=3.6318364809999366 future=<Future at 0x7218502a39e0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:46.663486 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=3.6317398699998193 future=<Future at 0x7218502a39e0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:46.792720 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:45:46.792952 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:45:46.819734 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:46.947821 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Updating instance_info_cache with network_info: [{"id": "10a1cfa6-e38d-42cf-903d-e78249ef211c", "address": "fa:16:3e:de:fe:78", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a1cfa6-e3", "ovs_interfaceid": "10a1cfa6-e38d-42cf-903d-e78249ef211c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:47.167781 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 80436afa-9cd9-41cd-b589-629da01b6bfe] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:47.295637 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:45:47.449855 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Releasing lock "refresh_cache-9df306ad-76ad-4edb-9c21-6efab9d0a26e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:45:47.450293 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Instance network_info: |[{"id": "10a1cfa6-e38d-42cf-903d-e78249ef211c", "address": "fa:16:3e:de:fe:78", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a1cfa6-e3", "ovs_interfaceid": "10a1cfa6-e38d-42cf-903d-e78249ef211c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:45:47.452726 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Start _get_guest_xml network_info=[{"id": "10a1cfa6-e38d-42cf-903d-e78249ef211c", "address": "fa:16:3e:de:fe:78", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a1cfa6-e3", "ovs_interfaceid": "10a1cfa6-e38d-42cf-903d-e78249ef211c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:45:47.455342 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:45:47.457026 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-594336579', uuid='9df306ad-76ad-4edb-9c21-6efab9d0a26e'), owner=OwnerMeta(userid='96f7f84eb55d44e89c2ed500098135e0', username='tempest-AttachVolumeTestJSON-1215369469-project-member', projectid='662c1a9b25e44aff8242f468232af7f3', projectname='tempest-AttachVolumeTestJSON-1215369469'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "10a1cfa6-e38d-42cf-903d-e78249ef211c", "address": "fa:16:3e:de:fe:78", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a1cfa6-e3", "ovs_interfaceid": "10a1cfa6-e38d-42cf-903d-e78249ef211c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165947.456591) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:45:47.458573 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:45:47.459195 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:45:47.460868 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:45:47.461187 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:45:47.462343 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:45:47.462796 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:45:47.463060 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:45:47.463279 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:45:47.463526 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:45:47.463730 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:45:47.463983 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:45:47.464281 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:45:47.464466 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:45:47.464616 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:45:47.464752 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:45:47.464903 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:45:47.480953 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-594336579',display_name='tempest-AttachVolumeTestJSON-server-594336579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumetestjson-server-594336579',id=57,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJjteTzq0NUwYjwlpQ+hmIeyZdzFSD8jLO3flUD31olByKHvMlaXIkHcoTbP5zr1sB+vIhKgjCAxFe9EWCttMdtJe51D9539Urgqg2yI5Wlw3obunt16eNiwvzDmaAL0Q==',key_name='tempest-keypair-1061891784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='662c1a9b25e44aff8242f468232af7f3',ramdisk_id='',reservation_id='r-016n60tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1215369469',owner_user_name='tempest-AttachVolumeTestJSON-1215369469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:45:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f7f84eb55d44e89c2ed500098135e0',uuid=9df306ad-76ad-4edb-9c21-6efab9d0a26e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10a1cfa6-e38d-42cf-903d-e78249ef211c", "address": "fa:16:3e:de:fe:78", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a1cfa6-e3", "ovs_interfaceid": "10a1cfa6-e38d-42cf-903d-e78249ef211c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:45:47.481364 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converting VIF {"id": "10a1cfa6-e38d-42cf-903d-e78249ef211c", "address": "fa:16:3e:de:fe:78", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a1cfa6-e3", "ovs_interfaceid": "10a1cfa6-e38d-42cf-903d-e78249ef211c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:45:47.482152 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:fe:78,bridge_name='br-int',has_traffic_filtering=True,id=10a1cfa6-e38d-42cf-903d-e78249ef211c,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10a1cfa6-e3') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:45:47.482967 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'pci_devices' on Instance uuid 9df306ad-76ad-4edb-9c21-6efab9d0a26e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:45:47.801804 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:45:47.802362 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.334s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:47.802362 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 39.81 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:45:47.986294 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] End _get_guest_xml xml=<domain type="qemu">
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:   <uuid>9df306ad-76ad-4edb-9c21-6efab9d0a26e</uuid>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:   <name>instance-00000039</name>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <nova:name>tempest-AttachVolumeTestJSON-server-594336579</nova:name>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:45:47</nova:creationTime>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:         <nova:user uuid="96f7f84eb55d44e89c2ed500098135e0">tempest-AttachVolumeTestJSON-1215369469-project-member</nova:user>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:         <nova:project uuid="662c1a9b25e44aff8242f468232af7f3">tempest-AttachVolumeTestJSON-1215369469</nova:project>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:         <nova:port uuid="10a1cfa6-e38d-42cf-903d-e78249ef211c">
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     <system>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <entry name="serial">9df306ad-76ad-4edb-9c21-6efab9d0a26e</entry>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <entry name="uuid">9df306ad-76ad-4edb-9c21-6efab9d0a26e</entry>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     </system>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:   <os>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:   </os>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:   <features>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:   </features>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:   <devices>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/9df306ad-76ad-4edb-9c21-6efab9d0a26e/disk"/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     </disk>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/9df306ad-76ad-4edb-9c21-6efab9d0a26e/disk.config"/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     </disk>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:de:fe:78"/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <target dev="tap10a1cfa6-e3"/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     </interface>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/9df306ad-76ad-4edb-9c21-6efab9d0a26e/console.log" append="off"/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     </serial>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     <video>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     </video>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     </rng>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:   </devices>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]: </domain>
May 19 04:45:47.986294 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:45:47.988076 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Preparing to wait for external event network-vif-plugged-10a1cfa6-e38d-42cf-903d-e78249ef211c {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:45:47.988076 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:47.988076 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:47.988076 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:47.989115 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-594336579',display_name='tempest-AttachVolumeTestJSON-server-594336579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumetestjson-server-594336579',id=57,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJjteTzq0NUwYjwlpQ+hmIeyZdzFSD8jLO3flUD31olByKHvMlaXIkHcoTbP5zr1sB+vIhKgjCAxFe9EWCttMdtJe51D9539Urgqg2yI5Wlw3obunt16eNiwvzDmaAL0Q==',key_name='tempest-keypair-1061891784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='662c1a9b25e44aff8242f468232af7f3',ramdisk_id='',reservation_id='r-016n60tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1215369469',owner_user_name='tempest-AttachVolumeTestJSON-1215369469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:45:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f7f84eb55d44e89c2ed500098135e0',uuid=9df306ad-76ad-4edb-9c21-6efab9d0a26e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10a1cfa6-e38d-42cf-903d-e78249ef211c", "address": "fa:16:3e:de:fe:78", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a1cfa6-e3", "ovs_interfaceid": "10a1cfa6-e38d-42cf-903d-e78249ef211c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:45:47.989362 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converting VIF {"id": "10a1cfa6-e38d-42cf-903d-e78249ef211c", "address": "fa:16:3e:de:fe:78", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a1cfa6-e3", "ovs_interfaceid": "10a1cfa6-e38d-42cf-903d-e78249ef211c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:45:47.989985 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:fe:78,bridge_name='br-int',has_traffic_filtering=True,id=10a1cfa6-e38d-42cf-903d-e78249ef211c,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10a1cfa6-e3') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:45:47.990330 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:fe:78,bridge_name='br-int',has_traffic_filtering=True,id=10a1cfa6-e38d-42cf-903d-e78249ef211c,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10a1cfa6-e3') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:45:47.990802 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:47.991254 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:47.991626 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:45:47.992561 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:47.992805 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35fa3939-16a1-5b78-a0c3-e063299909eb', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:48.005618 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:48.007211 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:48.009065 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:48.009367 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10a1cfa6-e3, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:48.009865 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10a1cfa6-e3, col_values=(('qos', UUID('a5c32de0-a5d2-4f1a-9227-6f49450a0f2f')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:48.010207 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10a1cfa6-e3, col_values=(('external_ids', {'iface-id': '10a1cfa6-e38d-42cf-903d-e78249ef211c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:fe:78', 'vm-uuid': '9df306ad-76ad-4edb-9c21-6efab9d0a26e'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:48.011192 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:48.012812 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:48.018631 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:48.019686 np0000001025 nova-compute[97981]: INFO os_vif [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:fe:78,bridge_name='br-int',has_traffic_filtering=True,id=10a1cfa6-e38d-42cf-903d-e78249ef211c,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10a1cfa6-e3')
May 19 04:45:48.407729 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:49.458602 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "fecd576c-4027-4b39-a92a-91d1e3248949" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:49.458602 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "fecd576c-4027-4b39-a92a-91d1e3248949" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:49.459205 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "fecd576c-4027-4b39-a92a-91d1e3248949-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:49.459205 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "fecd576c-4027-4b39-a92a-91d1e3248949-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:49.459205 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "fecd576c-4027-4b39-a92a-91d1e3248949-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:49.461485 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Terminating instance
May 19 04:45:49.538421 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:45:49.538549 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:45:49.538756 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No VIF found with MAC fa:16:3e:de:fe:78, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:45:49.539370 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Using config drive
May 19 04:45:49.964728 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:45:49.988525 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:49.995270 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:50.012978 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:50.045334 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:50.045579 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:50.143741 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4b6e9fe2-c068-40d1-8648-bb37878b9e03 req-9c57f52c-1769-4d6b-b527-dcd1afc926a3 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Received event network-vif-unplugged-f08ea0ed-d928-47ba-b313-41b12b79708a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:50.144768 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4b6e9fe2-c068-40d1-8648-bb37878b9e03 req-9c57f52c-1769-4d6b-b527-dcd1afc926a3 service nova] Acquiring lock "fecd576c-4027-4b39-a92a-91d1e3248949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:50.144959 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4b6e9fe2-c068-40d1-8648-bb37878b9e03 req-9c57f52c-1769-4d6b-b527-dcd1afc926a3 service nova] Lock "fecd576c-4027-4b39-a92a-91d1e3248949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:50.146484 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4b6e9fe2-c068-40d1-8648-bb37878b9e03 req-9c57f52c-1769-4d6b-b527-dcd1afc926a3 service nova] Lock "fecd576c-4027-4b39-a92a-91d1e3248949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:50.146484 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4b6e9fe2-c068-40d1-8648-bb37878b9e03 req-9c57f52c-1769-4d6b-b527-dcd1afc926a3 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] No waiting events found dispatching network-vif-unplugged-f08ea0ed-d928-47ba-b313-41b12b79708a {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:45:50.146484 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4b6e9fe2-c068-40d1-8648-bb37878b9e03 req-9c57f52c-1769-4d6b-b527-dcd1afc926a3 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Received event network-vif-unplugged-f08ea0ed-d928-47ba-b313-41b12b79708a for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:45:50.197964 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Creating config drive at /opt/stack/data/nova/instances/9df306ad-76ad-4edb-9c21-6efab9d0a26e/disk.config
May 19 04:45:50.201705 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9df306ad-76ad-4edb-9c21-6efab9d0a26e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptpc_0r4u {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:50.274423 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9df306ad-76ad-4edb-9c21-6efab9d0a26e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptpc_0r4u" returned: 0 in 0.072s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:45:50.296141 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0007758589999866672 future=<Future at 0x7218502a39e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:50.296320 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:50.299792 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Emitting event <LifecycleEvent: 1779165935.2951524, 32cc5240-7a56-4cee-9b41-54e17386b39f => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:50.300074 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] VM Stopped (Lifecycle Event)
May 19 04:45:50.511901 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999598619000153 future=<Future at 0x7218345e6cc0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:50.515091 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.996920469000088 future=<Future at 0x7218345e6cc0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:50.515091 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.996744410000247 future=<Future at 0x7218345e6cc0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:45:50.516960 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Instance destroyed successfully.
May 19 04:45:50.517705 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'resources' on Instance uuid fecd576c-4027-4b39-a92a-91d1e3248949 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:45:50.726504 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:50.757507 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:50.804170 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 32cc5240-7a56-4cee-9b41-54e17386b39f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:50.865183 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:50.876693 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:45:50.938312 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4c9d4725-54a8-420a-b584-62d9d8c7a009 req-5cc4a8e4-dc03-4c6d-9e10-0349f446c865 service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Received event network-vif-plugged-10a1cfa6-e38d-42cf-903d-e78249ef211c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:50.938876 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4c9d4725-54a8-420a-b584-62d9d8c7a009 req-5cc4a8e4-dc03-4c6d-9e10-0349f446c865 service nova] Acquiring lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:50.939433 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4c9d4725-54a8-420a-b584-62d9d8c7a009 req-5cc4a8e4-dc03-4c6d-9e10-0349f446c865 service nova] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:50.939433 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4c9d4725-54a8-420a-b584-62d9d8c7a009 req-5cc4a8e4-dc03-4c6d-9e10-0349f446c865 service nova] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:50.939433 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4c9d4725-54a8-420a-b584-62d9d8c7a009 req-5cc4a8e4-dc03-4c6d-9e10-0349f446c865 service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Processing event network-vif-plugged-10a1cfa6-e38d-42cf-903d-e78249ef211c {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:45:51.020174 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-631335083',display_name='tempest-TestVolumeBootPattern-server-631335083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-631335083',id=54,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN64hvrIGybIwAElinLKo/VbG9hSjSUs/ze49uyTKPWXsdeqEUWn/Lpvjt2B+Fess/qheYjdkiwQfjT63zoCE3gTtilbfESU8llxkXIh3KDQg4BSLPbR62uq8/NYye8VAw==',key_name='tempest-TestVolumeBootPattern-644793043',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:45:14Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-47pm5dmf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:45:15Z,user_data=None,user_id='5c46088fb3e74b819bb456461716a801',uuid=fecd576c-4027-4b39-a92a-91d1e3248949,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f08ea0ed-d928-47ba-b313-41b12b79708a", "address": "fa:16:3e:3d:b3:c8", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf08ea0ed-d9", "ovs_interfaceid": "f08ea0ed-d928-47ba-b313-41b12b79708a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:45:51.020367 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "f08ea0ed-d928-47ba-b313-41b12b79708a", "address": "fa:16:3e:3d:b3:c8", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf08ea0ed-d9", "ovs_interfaceid": "f08ea0ed-d928-47ba-b313-41b12b79708a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:45:51.020997 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:b3:c8,bridge_name='br-int',has_traffic_filtering=True,id=f08ea0ed-d928-47ba-b313-41b12b79708a,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf08ea0ed-d9') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:45:51.021263 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:b3:c8,bridge_name='br-int',has_traffic_filtering=True,id=f08ea0ed-d928-47ba-b313-41b12b79708a,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf08ea0ed-d9') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:45:51.023567 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:51.023567 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf08ea0ed-d9, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:51.024733 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:51.026185 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:51.027454 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:51.027646 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70cfabdd-a05e-4011-b917-6101c6245683) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:45:51.028329 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:51.028889 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:45:51.029043 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:51.031962 np0000001025 nova-compute[97981]: INFO os_vif [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:b3:c8,bridge_name='br-int',has_traffic_filtering=True,id=f08ea0ed-d928-47ba-b313-41b12b79708a,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf08ea0ed-d9')
May 19 04:45:51.036534 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:45:51.036534 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:45:51.036534 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:45:51.036534 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:45:51.036845 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:45:51.037206 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:45:51.072011 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:45:51.072011 np0000001025 nova-compute[97981]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:45:51.072011 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:45:51.072290 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:45:51.072290 np0000001025 nova-compute[97981]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:45:51.072290 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:45:51.072517 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '124')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:45:51.072713 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '123')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:45:51.073899 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '124')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:45:51.074866 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218343172e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531'): ({'sdc'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:45:51.075660 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Removing multipathed devices sdc, sdb {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:45:51.076404 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flush multipath device 33000000039c706b0 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:45:51.115304 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:51.116753 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:51.120491 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:51.139628 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:45:51.143149 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:51.196066 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:45:51.248514 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:45:51.248721 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:45:51.249450 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:45:51.263450 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:45:51.263702 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:45:51.276254 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:51.310418 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 123, target: iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531, portal: 192.168.40.100,3260]
May 19 04:45:51.310418 np0000001025 nova-compute[97981]: Logout of [sid: 123, target: iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531, portal: 192.168.40.100,3260] successful.
May 19 04:45:51.310418 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:51.321586 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:51.333068 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:51.367859 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 124, target: iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531, portal: 192.168.50.100,3260]
May 19 04:45:51.367859 np0000001025 nova-compute[97981]: Logout of [sid: 124, target: iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531, portal: 192.168.50.100,3260] successful.
May 19 04:45:51.367859 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:51.381853 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:51.382236 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:45:51.382419 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== disconnect_volume: return (346ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:45:51.382588 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:45:51.382943 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Deleting instance files /opt/stack/data/nova/instances/fecd576c-4027-4b39-a92a-91d1e3248949_del
May 19 04:45:51.385124 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Deletion of /opt/stack/data/nova/instances/fecd576c-4027-4b39-a92a-91d1e3248949_del complete
May 19 04:45:51.555219 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165951.554011, 9df306ad-76ad-4edb-9c21-6efab9d0a26e => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:51.555219 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] VM Started (Lifecycle Event)
May 19 04:45:51.556294 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:45:51.565715 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:45:51.575073 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Instance spawned successfully.
May 19 04:45:51.575073 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:45:51.892580 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Took 1.93 seconds to destroy the instance on the hypervisor.
May 19 04:45:51.893258 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:45:51.893488 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:45:51.893595 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:45:51.894000 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:52.024362 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:52.060285 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:52.062292 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:45:52.086721 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:52.086901 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:52.087275 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:52.087579 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:52.087836 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:52.088092 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:45:52.207144 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7818aa65-d9e6-4029-8969-f3f720668e18 req-17aebdcd-0211-46d9-a4f3-6af9868474e4 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Received event network-vif-unplugged-f08ea0ed-d928-47ba-b313-41b12b79708a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:52.208758 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7818aa65-d9e6-4029-8969-f3f720668e18 req-17aebdcd-0211-46d9-a4f3-6af9868474e4 service nova] Acquiring lock "fecd576c-4027-4b39-a92a-91d1e3248949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:52.208758 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7818aa65-d9e6-4029-8969-f3f720668e18 req-17aebdcd-0211-46d9-a4f3-6af9868474e4 service nova] Lock "fecd576c-4027-4b39-a92a-91d1e3248949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:52.208758 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7818aa65-d9e6-4029-8969-f3f720668e18 req-17aebdcd-0211-46d9-a4f3-6af9868474e4 service nova] Lock "fecd576c-4027-4b39-a92a-91d1e3248949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:52.208758 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7818aa65-d9e6-4029-8969-f3f720668e18 req-17aebdcd-0211-46d9-a4f3-6af9868474e4 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] No waiting events found dispatching network-vif-unplugged-f08ea0ed-d928-47ba-b313-41b12b79708a {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:45:52.208758 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7818aa65-d9e6-4029-8969-f3f720668e18 req-17aebdcd-0211-46d9-a4f3-6af9868474e4 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Received event network-vif-unplugged-f08ea0ed-d928-47ba-b313-41b12b79708a for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:45:52.569223 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:45:52.569223 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165952.5681365, 9df306ad-76ad-4edb-9c21-6efab9d0a26e => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:52.569223 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] VM Paused (Lifecycle Event)
May 19 04:45:52.593903 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Took 6.93 seconds to spawn the instance on the hypervisor.
May 19 04:45:52.594074 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:52.993280 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a1b1b35e-784a-485c-9d33-3e57f7f56f7a req-54653f4c-0ba8-4c26-a9a8-9aa78c6c5ce4 service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Received event network-vif-plugged-10a1cfa6-e38d-42cf-903d-e78249ef211c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:52.996843 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a1b1b35e-784a-485c-9d33-3e57f7f56f7a req-54653f4c-0ba8-4c26-a9a8-9aa78c6c5ce4 service nova] Acquiring lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:52.996843 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a1b1b35e-784a-485c-9d33-3e57f7f56f7a req-54653f4c-0ba8-4c26-a9a8-9aa78c6c5ce4 service nova] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:52.996843 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a1b1b35e-784a-485c-9d33-3e57f7f56f7a req-54653f4c-0ba8-4c26-a9a8-9aa78c6c5ce4 service nova] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:52.996843 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a1b1b35e-784a-485c-9d33-3e57f7f56f7a req-54653f4c-0ba8-4c26-a9a8-9aa78c6c5ce4 service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] No waiting events found dispatching network-vif-plugged-10a1cfa6-e38d-42cf-903d-e78249ef211c {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:45:52.996843 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-a1b1b35e-784a-485c-9d33-3e57f7f56f7a req-54653f4c-0ba8-4c26-a9a8-9aa78c6c5ce4 service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Received unexpected event network-vif-plugged-10a1cfa6-e38d-42cf-903d-e78249ef211c for instance with vm_state active and task_state None.
May 19 04:45:52.996843 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a1b1b35e-784a-485c-9d33-3e57f7f56f7a req-54653f4c-0ba8-4c26-a9a8-9aa78c6c5ce4 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Received event network-vif-deleted-f08ea0ed-d928-47ba-b313-41b12b79708a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:52.996843 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-a1b1b35e-784a-485c-9d33-3e57f7f56f7a req-54653f4c-0ba8-4c26-a9a8-9aa78c6c5ce4 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Neutron deleted interface f08ea0ed-d928-47ba-b313-41b12b79708a; detaching it from the instance and deleting it from the info cache
May 19 04:45:52.996843 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a1b1b35e-784a-485c-9d33-3e57f7f56f7a req-54653f4c-0ba8-4c26-a9a8-9aa78c6c5ce4 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:53.071647 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:53.073664 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165953.0734386, 9df306ad-76ad-4edb-9c21-6efab9d0a26e => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:45:53.073835 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] VM Resumed (Lifecycle Event)
May 19 04:45:53.102789 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Took 12.29 seconds to build instance.
May 19 04:45:53.363005 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:53.410099 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:53.503852 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a1b1b35e-784a-485c-9d33-3e57f7f56f7a req-54653f4c-0ba8-4c26-a9a8-9aa78c6c5ce4 service nova] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Detach interface failed, port_id=f08ea0ed-d928-47ba-b313-41b12b79708a, reason: Instance fecd576c-4027-4b39-a92a-91d1e3248949 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:45:53.576213 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:45:53.578275 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:45:53.604249 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-baeb74ad-6aac-4e46-a66e-6b04a46c21d8 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.799s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:53.866027 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Took 1.97 seconds to deallocate network for instance.
May 19 04:45:54.261892 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4e7341c5-6d33-4921-8058-47412b75757a req-4d526eec-b376-4bf3-9db5-fa8a42dad71e service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Received event network-changed-10a1cfa6-e38d-42cf-903d-e78249ef211c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:45:54.262289 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4e7341c5-6d33-4921-8058-47412b75757a req-4d526eec-b376-4bf3-9db5-fa8a42dad71e service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Refreshing instance network info cache due to event network-changed-10a1cfa6-e38d-42cf-903d-e78249ef211c. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:45:54.262508 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4e7341c5-6d33-4921-8058-47412b75757a req-4d526eec-b376-4bf3-9db5-fa8a42dad71e service nova] Acquiring lock "refresh_cache-9df306ad-76ad-4edb-9c21-6efab9d0a26e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:45:54.262561 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4e7341c5-6d33-4921-8058-47412b75757a req-4d526eec-b376-4bf3-9db5-fa8a42dad71e service nova] Acquired lock "refresh_cache-9df306ad-76ad-4edb-9c21-6efab9d0a26e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:45:54.262706 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4e7341c5-6d33-4921-8058-47412b75757a req-4d526eec-b376-4bf3-9db5-fa8a42dad71e service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Refreshing network info cache for port 10a1cfa6-e38d-42cf-903d-e78249ef211c {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:45:54.422023 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Took 0.56 seconds to detach 1 volumes for instance.
May 19 04:45:54.765946 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-4e7341c5-6d33-4921-8058-47412b75757a req-4d526eec-b376-4bf3-9db5-fa8a42dad71e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:54.771758 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "26edba3f-dd65-4651-8cc3-3939541dae32" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:54.771960 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "26edba3f-dd65-4651-8cc3-3939541dae32" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:54.927723 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:54.928181 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:55.088457 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-4e7341c5-6d33-4921-8058-47412b75757a req-4d526eec-b376-4bf3-9db5-fa8a42dad71e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:45:55.171401 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:45:55.171617 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:45:55.215207 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4e7341c5-6d33-4921-8058-47412b75757a req-4d526eec-b376-4bf3-9db5-fa8a42dad71e service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Updated VIF entry in instance network info cache for port 10a1cfa6-e38d-42cf-903d-e78249ef211c. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:45:55.215482 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4e7341c5-6d33-4921-8058-47412b75757a req-4d526eec-b376-4bf3-9db5-fa8a42dad71e service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Updating instance_info_cache with network_info: [{"id": "10a1cfa6-e38d-42cf-903d-e78249ef211c", "address": "fa:16:3e:de:fe:78", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a1cfa6-e3", "ovs_interfaceid": "10a1cfa6-e38d-42cf-903d-e78249ef211c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:45:55.275399 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lazy-loading 'flavor' on Instance uuid 26edba3f-dd65-4651-8cc3-3939541dae32 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:45:55.674302 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:45:55.717506 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4e7341c5-6d33-4921-8058-47412b75757a req-4d526eec-b376-4bf3-9db5-fa8a42dad71e service nova] Releasing lock "refresh_cache-9df306ad-76ad-4edb-9c21-6efab9d0a26e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:45:56.029136 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:56.181438 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.253s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:56.239931 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Deleted allocations for instance fecd576c-4027-4b39-a92a-91d1e3248949
May 19 04:45:56.281555 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "26edba3f-dd65-4651-8cc3-3939541dae32" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:57.252294 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4b5939e3-f11f-4e67-8c6a-08515d02c98d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "fecd576c-4027-4b39-a92a-91d1e3248949" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.794s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:45:57.471369 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "26edba3f-dd65-4651-8cc3-3939541dae32" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:57.471369 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "26edba3f-dd65-4651-8cc3-3939541dae32" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:57.471369 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Attaching volume f11e488f-0324-47c7-90d3-622d88da352c to /dev/vdb
May 19 04:45:57.518399 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:45:57.532573 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:45:57.554651 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:45:57.603246 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:45:57.603649 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:45:57.613884 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:45:57.615773 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fe8f:bbb0', 'fe80::808a:12ff:fe91:c161', 'fe80::fc16:3eff:fe33:f814', 'fe80::8008:f5ff:fe5e:1a35', 'fe80::fc16:3eff:fede:fe78', 'fe80::bc2a:1ff:fe94:f24f'] 
May 19 04:45:57.616307 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:45:57.616635 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:45:57.618302 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:45:57.618302 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Updating existing volume attachment record: ef57e880-82d7-4fa6-af38-4a1279d5197c {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:45:58.204338 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c', 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f11e488f-0324-47c7-90d3-622d88da352c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '26edba3f-dd65-4651-8cc3-3939541dae32', 'attached_at': '', 'detached_at': '', 'volume_id': 'f11e488f-0324-47c7-90d3-622d88da352c', 'serial': 'f11e488f-0324-47c7-90d3-622d88da352c'} {{(pid=97981) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 19 04:45:58.207654 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:45:58.208271 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c', 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f11e488f-0324-47c7-90d3-622d88da352c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:45:58.208559 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:45:58.209297 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:45:58.209694 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c', 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f11e488f-0324-47c7-90d3-622d88da352c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:45:58.221245 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:45:58.221882 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:45:58.222406 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:45:58.222623 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:45:58.223198 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:45:58.223432 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:45:58.235827 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:45:58.235827 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:58.241018 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:45:58.241018 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:58.249539 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c] added
May 19 04:45:58.249539 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:45:58.249539 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:45:58.249539 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:45:58.249539 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:45:58.249539 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:45:58.249539 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:58.249741 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:45:58.249863 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0272(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:45:58.250015 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:45:58.254258 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c] added
May 19 04:45:58.254258 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:45:58.254258 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:45:58.254258 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:45:58.254258 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:45:58.254258 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:45:58.254258 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:58.254694 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:45:58.254694 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0311(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:45:58.254694 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:45:58.411883 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:58.524340 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:45:58.655038 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "ab009682-2d6f-4f7a-b23d-95fd5f4d3f15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:58.656582 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "ab009682-2d6f-4f7a-b23d-95fd5f4d3f15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:59.161203 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:45:59.250490 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:45:59.255020 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:45:59.263759 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:45:59.263759 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:45:59.273272 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:45:59.273272 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:59.275472 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:59.287670 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 19 04:45:59.287670 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:45:59.287801 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 19 04:45:59.287801 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:45:59.287958 np0000001025 nova-compute[97981]: WARNING os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 19 04:45:59.287958 np0000001025 nova-compute[97981]: 
May 19 04:45:59.288633 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:59.319599 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c, portal: 192.168.40.100,3260]
May 19 04:45:59.319599 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c, portal: 192.168.40.100,3260] successful.
May 19 04:45:59.319599 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:59.320090 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:45:59.320090 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:45:59.320297 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsi session list stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:45:59.320297 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:45:59.330971 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:59.345893 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:45:59.345893 np0000001025 nova-compute[97981]: tcp: [126] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:45:59.345893 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:45:59.346102 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsi session list stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:45:59.346102 np0000001025 nova-compute[97981]: tcp: [126] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:45:59.346102 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:45:59.346413 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.124s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:45:59.346526 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:45:59.347184 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] HCTL ('7', '-', '-', 0) found on session 125 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:45:59.347298 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:45:59.356737 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c, portal: 192.168.50.100,3260]
May 19 04:45:59.356737 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c, portal: 192.168.50.100,3260] successful.
May 19 04:45:59.356737 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:59.364910 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Searching for a device in session 125 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:45:59.365088 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f11e488f-0324-47c7-90d3-622d88da352c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:45:59.374702 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:45:59.389407 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:45:59.389407 np0000001025 nova-compute[97981]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:45:59.389407 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:45:59.389407 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsi session list stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:45:59.389407 np0000001025 nova-compute[97981]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:45:59.389407 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:45:59.389732 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:45:59.389910 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:45:59.391573 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] HCTL ('8', '-', '-', 0) found on session 126 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:45:59.391573 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:45:59.410791 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Searching for a device in session 126 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:45:59.410791 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f11e488f-0324-47c7-90d3-622d88da352c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:45:59.709249 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:45:59.709418 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:45:59.712924 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:45:59.713144 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Claim successful on node np0000001025
May 19 04:46:00.225283 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:46:00.611531 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:00.935796 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:46:00.936052 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:46:01.030189 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:01.199238 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:01.240161 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Found WWN 330000000b9470baf for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:46:01.240161 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:46:01.241776 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000b9470baf', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000b9470baf'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:46:01.241776 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b9470baf', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000b9470baf'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:46:01.243061 np0000001025 nova-compute[97981]: WARNING stevedore.named [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 19 04:46:01.243406 np0000001025 nova-compute[97981]: WARNING castellan.key_manager [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:46:01.243646 np0000001025 nova-compute[97981]: WARNING nova.keymgr.conf_key_mgr [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:46:01.262053 np0000001025 nova-compute[97981]: WARNING os_brick.encryptors.luks [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 19 04:46:01.262053 np0000001025 nova-compute[97981]: WARNING stevedore.named [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 19 04:46:01.262053 np0000001025 nova-compute[97981]: WARNING castellan.key_manager [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:46:01.262053 np0000001025 nova-compute[97981]: WARNING nova.keymgr.conf_key_mgr [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:46:01.262053 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7218503dee10>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c', 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f11e488f-0324-47c7-90d3-622d88da352c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '26edba3f-dd65-4651-8cc3-3939541dae32', 'attached_at': '', 'detached_at': '', 'volume_id': 'f11e488f-0324-47c7-90d3-622d88da352c', 'serial': 'f11e488f-0324-47c7-90d3-622d88da352c'} {{(pid=97981) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 19 04:46:01.262053 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors.luks [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] formatting encrypted volume /dev/dm-0 {{(pid=97981) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 19 04:46:01.441288 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:46:01.948331 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.237s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:01.948331 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:46:02.453364 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:46:02.453636 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:46:02.454225 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:02.454580 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:02.541733 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c46088fb3e74b819bb456461716a801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b3c0fa8f894ed2a7c3bcfac99ce74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:46:02.959084 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:46:02.994834 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Successfully created port: a4300743-f053-4dd3-a562-c9458d9c1453 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:46:03.077804 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:03.077932 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:03.413760 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:03.424187 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Successfully updated port: a4300743-f053-4dd3-a562-c9458d9c1453 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:46:03.462771 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:46:03.471668 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b15e8485-fad3-4740-8e30-db845ed13369 req-7ef4c079-fc83-4a7f-abda-da612598586a service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Received event network-changed-a4300743-f053-4dd3-a562-c9458d9c1453 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:03.471801 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b15e8485-fad3-4740-8e30-db845ed13369 req-7ef4c079-fc83-4a7f-abda-da612598586a service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Refreshing instance network info cache due to event network-changed-a4300743-f053-4dd3-a562-c9458d9c1453. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:46:03.471940 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b15e8485-fad3-4740-8e30-db845ed13369 req-7ef4c079-fc83-4a7f-abda-da612598586a service nova] Acquiring lock "refresh_cache-ab009682-2d6f-4f7a-b23d-95fd5f4d3f15" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:46:03.472020 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b15e8485-fad3-4740-8e30-db845ed13369 req-7ef4c079-fc83-4a7f-abda-da612598586a service nova] Acquired lock "refresh_cache-ab009682-2d6f-4f7a-b23d-95fd5f4d3f15" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:46:03.472143 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-b15e8485-fad3-4740-8e30-db845ed13369 req-7ef4c079-fc83-4a7f-abda-da612598586a service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Refreshing network info cache for port a4300743-f053-4dd3-a562-c9458d9c1453 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:46:03.579617 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:46:03.926343 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "refresh_cache-ab009682-2d6f-4f7a-b23d-95fd5f4d3f15" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:46:03.967139 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Booting with volume 1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 at /dev/vda
May 19 04:46:03.974493 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-b15e8485-fad3-4740-8e30-db845ed13369 req-7ef4c079-fc83-4a7f-abda-da612598586a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:04.016257 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:46:04.026458 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:46:04.046852 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-b15e8485-fad3-4740-8e30-db845ed13369 req-7ef4c079-fc83-4a7f-abda-da612598586a service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:46:04.048996 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:04.096859 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:46:04.097993 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:46:04.110129 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:46:04.110129 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fe8f:bbb0', 'fe80::808a:12ff:fe91:c161', 'fe80::fc16:3eff:fe33:f814', 'fe80::8008:f5ff:fe5e:1a35', 'fe80::fc16:3eff:fede:fe78', 'fe80::bc2a:1ff:fe94:f24f'] 
May 19 04:46:04.110129 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:46:04.110129 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:46:04.110129 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:46:04.110129 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Updating existing volume attachment record: eeeffdd8-9f1f-4ffb-947d-6a1176b03318 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:46:04.164724 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:04.164989 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:04.171036 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:46:04.171313 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Claim successful on node np0000001025
May 19 04:46:04.199608 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-b15e8485-fad3-4740-8e30-db845ed13369 req-7ef4c079-fc83-4a7f-abda-da612598586a service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:46:04.701454 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b15e8485-fad3-4740-8e30-db845ed13369 req-7ef4c079-fc83-4a7f-abda-da612598586a service nova] Releasing lock "refresh_cache-ab009682-2d6f-4f7a-b23d-95fd5f4d3f15" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:46:04.701972 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquired lock "refresh_cache-ab009682-2d6f-4f7a-b23d-95fd5f4d3f15" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:46:04.702151 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:46:05.131747 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Secret XML: <secret ephemeral="no" private="no">
May 19 04:46:05.131747 np0000001025 nova-compute[97981]:   <usage type="volume">
May 19 04:46:05.131747 np0000001025 nova-compute[97981]:     <volume>f11e488f-0324-47c7-90d3-622d88da352c</volume>
May 19 04:46:05.131747 np0000001025 nova-compute[97981]:   </usage>
May 19 04:46:05.131747 np0000001025 nova-compute[97981]: </secret>
May 19 04:46:05.131747 np0000001025 nova-compute[97981]:  {{(pid=97981) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 19 04:46:05.137678 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lazy-loading 'flavor' on Instance uuid 26edba3f-dd65-4651-8cc3-3939541dae32 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:05.277513 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:46:05.447687 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:05.510954 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:46:05.511253 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:46:05.512611 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0009720949997245043 future=<Future at 0x7218345e6cc0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:46:05.512611 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:46:05.513064 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Emitting event <LifecycleEvent: 1779165950.5113256, fecd576c-4027-4b39-a92a-91d1e3248949 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:46:05.513433 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] VM Stopped (Lifecycle Event)
May 19 04:46:05.600467 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Updating instance_info_cache with network_info: [{"id": "a4300743-f053-4dd3-a562-c9458d9c1453", "address": "fa:16:3e:95:86:d9", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4300743-f0", "ovs_interfaceid": "a4300743-f053-4dd3-a562-c9458d9c1453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:46:05.640578 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Attempting to attach volume f11e488f-0324-47c7-90d3-622d88da352c with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:46:05.641743 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:46:05.641743 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:46:05.641743 np0000001025 nova-compute[97981]:   <alias name="ua-f11e488f-0324-47c7-90d3-622d88da352c"/>
May 19 04:46:05.641743 np0000001025 nova-compute[97981]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 19 04:46:05.641743 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:46:05.641743 np0000001025 nova-compute[97981]:   <serial>f11e488f-0324-47c7-90d3-622d88da352c</serial>
May 19 04:46:05.641743 np0000001025 nova-compute[97981]:   <encryption format="luks">
May 19 04:46:05.641743 np0000001025 nova-compute[97981]:     <secret type="passphrase" uuid="61527276-03d1-4d79-8410-dd72e74e01d4"/>
May 19 04:46:05.641743 np0000001025 nova-compute[97981]:   </encryption>
May 19 04:46:05.641743 np0000001025 nova-compute[97981]: </disk>
May 19 04:46:05.641743 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:46:05.934567 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e1c93eba-9db9-4ff0-8cd0-4e3926628387 req-d7443fa0-1a69-4833-88ae-43a5d0f84d16 service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Received event network-vif-unplugged-a4300743-f053-4dd3-a562-c9458d9c1453 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:05.935055 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e1c93eba-9db9-4ff0-8cd0-4e3926628387 req-d7443fa0-1a69-4833-88ae-43a5d0f84d16 service nova] Acquiring lock "ab009682-2d6f-4f7a-b23d-95fd5f4d3f15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:05.935544 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e1c93eba-9db9-4ff0-8cd0-4e3926628387 req-d7443fa0-1a69-4833-88ae-43a5d0f84d16 service nova] Lock "ab009682-2d6f-4f7a-b23d-95fd5f4d3f15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:05.936151 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e1c93eba-9db9-4ff0-8cd0-4e3926628387 req-d7443fa0-1a69-4833-88ae-43a5d0f84d16 service nova] Lock "ab009682-2d6f-4f7a-b23d-95fd5f4d3f15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:05.936151 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e1c93eba-9db9-4ff0-8cd0-4e3926628387 req-d7443fa0-1a69-4833-88ae-43a5d0f84d16 service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] No waiting events found dispatching network-vif-unplugged-a4300743-f053-4dd3-a562-c9458d9c1453 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:46:05.936151 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-e1c93eba-9db9-4ff0-8cd0-4e3926628387 req-d7443fa0-1a69-4833-88ae-43a5d0f84d16 service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Received unexpected event network-vif-unplugged-a4300743-f053-4dd3-a562-c9458d9c1453 for instance with vm_state building and task_state spawning.
May 19 04:46:06.015367 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:46:06.020714 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: fecd576c-4027-4b39-a92a-91d1e3248949] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:46:06.031237 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:06.102451 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Releasing lock "refresh_cache-ab009682-2d6f-4f7a-b23d-95fd5f4d3f15" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:46:06.102767 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Instance network_info: |[{"id": "a4300743-f053-4dd3-a562-c9458d9c1453", "address": "fa:16:3e:95:86:d9", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4300743-f0", "ovs_interfaceid": "a4300743-f053-4dd3-a562-c9458d9c1453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:46:06.214836 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:46:06.215707 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:46:06.215904 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Creating image(s)
May 19 04:46:06.216220 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:46:06.216359 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Ensure instance console log exists: /opt/stack/data/nova/instances/ab009682-2d6f-4f7a-b23d-95fd5f4d3f15/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:46:06.216550 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:06.216686 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:06.216794 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:06.217245 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Start _get_guest_xml network_info=[{"id": "a4300743-f053-4dd3-a562-c9458d9c1453", "address": "fa:16:3e:95:86:d9", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4300743-f0", "ovs_interfaceid": "a4300743-f053-4dd3-a562-c9458d9c1453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'eeeffdd8-9f1f-4ffb-947d-6a1176b03318', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ab009682-2d6f-4f7a-b23d-95fd5f4d3f15', 'attached_at': '', 'detached_at': '', 'volume_id': '1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'serial': '1bdfa1a6-fb6c-4690-8dd6-a14e0926d531'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:46:06.219729 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:46:06.220618 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1790855730', uuid='ab009682-2d6f-4f7a-b23d-95fd5f4d3f15'), owner=OwnerMeta(userid='5c46088fb3e74b819bb456461716a801', username='tempest-TestVolumeBootPattern-1071176852-project-member', projectid='28b3c0fa8f894ed2a7c3bcfac99ce74c', projectname='tempest-TestVolumeBootPattern-1071176852'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a4300743-f053-4dd3-a562-c9458d9c1453", "address": "fa:16:3e:95:86:d9", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4300743-f0", "ovs_interfaceid": "a4300743-f053-4dd3-a562-c9458d9c1453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165966.2203472) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:46:06.221902 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:46:06.222344 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:46:06.223261 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:46:06.223419 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:46:06.224464 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:46:06.224701 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:46:06.224825 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:46:06.224932 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:46:06.225066 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:46:06.225149 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:46:06.225285 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:46:06.225381 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:46:06.225495 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:46:06.225598 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:46:06.225752 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:46:06.226062 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:46:06.235927 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:46:06.236285 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:46:06.236442 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:46:06.236785 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:46:06.236950 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:46:06.248593 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:46:06.249293 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:46:06.249899 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:46:06.250089 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:46:06.250588 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:46:06.250792 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:46:06.260465 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:46:06.260465 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:06.265424 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:46:06.265424 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:06.273047 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531] added
May 19 04:46:06.273047 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:46:06.273047 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:46:06.273047 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:46:06.273047 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:46:06.273047 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:46:06.273047 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:06.273394 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:46:06.273394 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0233(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:46:06.273563 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:46:06.276929 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531] added
May 19 04:46:06.276929 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:46:06.276929 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:46:06.276929 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:46:06.276929 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:46:06.276929 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:46:06.276929 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:06.277123 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:46:06.277298 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:46:06.277465 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:46:06.522151 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.357s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:06.522622 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:46:07.028351 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:46:07.029272 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:46:07.029603 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:07.029895 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:07.106946 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '40f0313124fa425c916b6ad44fe2d7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a48491cc047108747a22e8c63c3ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:46:07.273948 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:46:07.277839 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:46:07.285447 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:46:07.285447 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:46:07.296034 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:46:07.296034 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:07.303518 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:07.310166 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:07.317067 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:46:07.317067 np0000001025 nova-compute[97981]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:46:07.317067 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:07.317240 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:46:07.317240 np0000001025 nova-compute[97981]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:46:07.317240 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:07.330446 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:46:07.330446 np0000001025 nova-compute[97981]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:46:07.330446 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:07.330610 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:46:07.330610 np0000001025 nova-compute[97981]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:46:07.330610 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:07.351384 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531, portal: 192.168.40.100,3260]
May 19 04:46:07.351384 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531, portal: 192.168.40.100,3260] successful.
May 19 04:46:07.351384 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:07.362812 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:07.368809 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531, portal: 192.168.50.100,3260]
May 19 04:46:07.368809 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531, portal: 192.168.50.100,3260] successful.
May 19 04:46:07.368809 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:07.375639 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:46:07.375639 np0000001025 nova-compute[97981]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:46:07.375639 np0000001025 nova-compute[97981]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:07.375639 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:07.375639 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:07.375817 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:46:07.375817 np0000001025 nova-compute[97981]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:46:07.375817 np0000001025 nova-compute[97981]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:07.375817 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:07.375817 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:07.376053 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.126s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:46:07.376156 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:46:07.376678 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] HCTL ('9', '-', '-', 0) found on session 127 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:46:07.376782 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:46:07.381839 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:07.391885 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching for a device in session 127 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:46:07.391885 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:46:07.394753 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:46:07.394753 np0000001025 nova-compute[97981]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:46:07.394753 np0000001025 nova-compute[97981]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:07.394753 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:07.394753 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:07.394953 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:46:07.394953 np0000001025 nova-compute[97981]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:46:07.394953 np0000001025 nova-compute[97981]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:07.394953 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:07.394953 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:07.395369 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:46:07.395546 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:46:07.396714 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] HCTL ('10', '-', '-', 0) found on session 128 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:46:07.396714 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:46:07.416089 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching for a device in session 128 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:46:07.416089 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:46:07.529530 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:46:07.632699 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Successfully created port: a00ed8d4-ff2d-4d0c-ad93-b01200ce4181 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:46:08.033375 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:46:08.129446 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Successfully updated port: a00ed8d4-ff2d-4d0c-ad93-b01200ce4181 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:46:08.181410 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4ba4aca9-3180-40d7-bf27-be9997a4a21a req-409e626f-804e-4413-9dcb-d445ec7e9062 service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Received event network-changed-a00ed8d4-ff2d-4d0c-ad93-b01200ce4181 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:08.181410 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4ba4aca9-3180-40d7-bf27-be9997a4a21a req-409e626f-804e-4413-9dcb-d445ec7e9062 service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Refreshing instance network info cache due to event network-changed-a00ed8d4-ff2d-4d0c-ad93-b01200ce4181. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:46:08.181410 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4ba4aca9-3180-40d7-bf27-be9997a4a21a req-409e626f-804e-4413-9dcb-d445ec7e9062 service nova] Acquiring lock "refresh_cache-5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:46:08.181410 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4ba4aca9-3180-40d7-bf27-be9997a4a21a req-409e626f-804e-4413-9dcb-d445ec7e9062 service nova] Acquired lock "refresh_cache-5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:46:08.181410 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4ba4aca9-3180-40d7-bf27-be9997a4a21a req-409e626f-804e-4413-9dcb-d445ec7e9062 service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Refreshing network info cache for port a00ed8d4-ff2d-4d0c-ad93-b01200ce4181 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:46:08.251677 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:46:08.263699 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:46:08.263853 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:46:08.263986 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:46:08.264170 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] No VIF found with MAC fa:16:3e:8f:bb:b0, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:46:08.415368 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:08.632671 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "refresh_cache-5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:46:08.686902 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-4ba4aca9-3180-40d7-bf27-be9997a4a21a req-409e626f-804e-4413-9dcb-d445ec7e9062 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:08.751278 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4ba4aca9-3180-40d7-bf27-be9997a4a21a req-409e626f-804e-4413-9dcb-d445ec7e9062 service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:46:08.871914 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4ba4aca9-3180-40d7-bf27-be9997a4a21a req-409e626f-804e-4413-9dcb-d445ec7e9062 service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:46:09.042130 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:46:09.043065 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:46:09.043354 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Creating image(s)
May 19 04:46:09.043762 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c7b7f14-f27a-4c7b-a39e-fd7c75d93117/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:09.043929 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "/opt/stack/data/nova/instances/5c7b7f14-f27a-4c7b-a39e-fd7c75d93117/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:09.044431 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "/opt/stack/data/nova/instances/5c7b7f14-f27a-4c7b-a39e-fd7c75d93117/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:09.045088 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:46:09.047611 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:46:09.048658 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:09.133291 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.084s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:09.133828 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:09.134418 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:09.135062 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:46:09.138874 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:46:09.139198 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:09.224081 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.085s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:09.224553 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/5c7b7f14-f27a-4c7b-a39e-fd7c75d93117/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:09.270762 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Found WWN 33000000039c706b0 for multipath device dm-1 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:46:09.271548 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:46:09.274554 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '33000000039c706b0', 'path': '/dev/dm-1', 'multipath_id': '33000000039c706b0'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:46:09.274882 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000039c706b0', 'path': '/dev/dm-1', 'multipath_id': '33000000039c706b0'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:46:09.279471 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/5c7b7f14-f27a-4c7b-a39e-fd7c75d93117/disk 1073741824" returned: 0 in 0.054s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:09.280189 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.146s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:09.280927 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:09.365450 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.085s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:09.365908 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c7b7f14-f27a-4c7b-a39e-fd7c75d93117/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:46:09.366208 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b7f14-f27a-4c7b-a39e-fd7c75d93117/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:09.379767 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4ba4aca9-3180-40d7-bf27-be9997a4a21a req-409e626f-804e-4413-9dcb-d445ec7e9062 service nova] Releasing lock "refresh_cache-5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:46:09.381952 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquired lock "refresh_cache-5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:46:09.382303 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:46:09.451099 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b7f14-f27a-4c7b-a39e-fd7c75d93117/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:09.451650 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Cannot resize image /opt/stack/data/nova/instances/5c7b7f14-f27a-4c7b-a39e-fd7c75d93117/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:46:09.452031 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:46:09.452303 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Ensure instance console log exists: /opt/stack/data/nova/instances/5c7b7f14-f27a-4c7b-a39e-fd7c75d93117/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:46:09.452658 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:09.452941 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:09.453157 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:09.809015 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:45:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1790855730',display_name='tempest-TestVolumeBootPattern-server-1790855730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-1790855730',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN64hvrIGybIwAElinLKo/VbG9hSjSUs/ze49uyTKPWXsdeqEUWn/Lpvjt2B+Fess/qheYjdkiwQfjT63zoCE3gTtilbfESU8llxkXIh3KDQg4BSLPbR62uq8/NYye8VAw==',key_name='tempest-TestVolumeBootPattern-644793043',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-yol0x0y7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:46:03Z,user_data=None,user_id='5c46088fb3e74b819bb456461716a801',uuid=ab009682-2d6f-4f7a-b23d-95fd5f4d3f15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4300743-f053-4dd3-a562-c9458d9c1453", "address": "fa:16:3e:95:86:d9", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4300743-f0", "ovs_interfaceid": "a4300743-f053-4dd3-a562-c9458d9c1453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:46:09.809364 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "a4300743-f053-4dd3-a562-c9458d9c1453", "address": "fa:16:3e:95:86:d9", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4300743-f0", "ovs_interfaceid": "a4300743-f053-4dd3-a562-c9458d9c1453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:46:09.810394 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:86:d9,bridge_name='br-int',has_traffic_filtering=True,id=a4300743-f053-4dd3-a562-c9458d9c1453,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4300743-f0') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:46:09.811917 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'pci_devices' on Instance uuid ab009682-2d6f-4f7a-b23d-95fd5f4d3f15 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:09.838981 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4c556279-d698-42e0-ad9e-d8deabbdea77 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "26edba3f-dd65-4651-8cc3-3939541dae32" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.370s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:09.944981 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:46:10.086068 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:10.193623 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Updating instance_info_cache with network_info: [{"id": "a00ed8d4-ff2d-4d0c-ad93-b01200ce4181", "address": "fa:16:3e:a9:81:c2", "network": {"id": "8a07682e-aaf0-4a4f-8bc0-70db155f01be", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2139331559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec4a48491cc047108747a22e8c63c3ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ed8d4-ff", "ovs_interfaceid": "a00ed8d4-ff2d-4d0c-ad93-b01200ce4181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:46:10.316500 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] End _get_guest_xml xml=<domain type="qemu">
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:   <uuid>ab009682-2d6f-4f7a-b23d-95fd5f4d3f15</uuid>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:   <name>instance-0000003a</name>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestVolumeBootPattern-server-1790855730</nova:name>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:46:06</nova:creationTime>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:         <nova:user uuid="5c46088fb3e74b819bb456461716a801">tempest-TestVolumeBootPattern-1071176852-project-member</nova:user>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:         <nova:project uuid="28b3c0fa8f894ed2a7c3bcfac99ce74c">tempest-TestVolumeBootPattern-1071176852</nova:project>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:         <nova:port uuid="a4300743-f053-4dd3-a562-c9458d9c1453">
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     <system>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <entry name="serial">ab009682-2d6f-4f7a-b23d-95fd5f4d3f15</entry>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <entry name="uuid">ab009682-2d6f-4f7a-b23d-95fd5f4d3f15</entry>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     </system>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:   <os>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:   </os>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:   <features>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:   </features>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:   <devices>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/ab009682-2d6f-4f7a-b23d-95fd5f4d3f15/disk.config"/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     </disk>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <alias name="ua-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531"/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-1"/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <serial>1bdfa1a6-fb6c-4690-8dd6-a14e0926d531</serial>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     </disk>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:95:86:d9"/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <target dev="tapa4300743-f0"/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     </interface>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/ab009682-2d6f-4f7a-b23d-95fd5f4d3f15/console.log" append="off"/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     </serial>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     <video>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     </video>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     </rng>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:   </devices>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]: </domain>
May 19 04:46:10.316500 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:46:10.318375 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Preparing to wait for external event network-vif-plugged-a4300743-f053-4dd3-a562-c9458d9c1453 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:46:10.318375 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "ab009682-2d6f-4f7a-b23d-95fd5f4d3f15-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:10.318375 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "ab009682-2d6f-4f7a-b23d-95fd5f4d3f15-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:10.318375 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "ab009682-2d6f-4f7a-b23d-95fd5f4d3f15-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:10.318375 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:45:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1790855730',display_name='tempest-TestVolumeBootPattern-server-1790855730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-1790855730',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN64hvrIGybIwAElinLKo/VbG9hSjSUs/ze49uyTKPWXsdeqEUWn/Lpvjt2B+Fess/qheYjdkiwQfjT63zoCE3gTtilbfESU8llxkXIh3KDQg4BSLPbR62uq8/NYye8VAw==',key_name='tempest-TestVolumeBootPattern-644793043',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-yol0x0y7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:46:03Z,user_data=None,user_id='5c46088fb3e74b819bb456461716a801',uuid=ab009682-2d6f-4f7a-b23d-95fd5f4d3f15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4300743-f053-4dd3-a562-c9458d9c1453", "address": "fa:16:3e:95:86:d9", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4300743-f0", "ovs_interfaceid": "a4300743-f053-4dd3-a562-c9458d9c1453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:46:10.318375 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "a4300743-f053-4dd3-a562-c9458d9c1453", "address": "fa:16:3e:95:86:d9", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4300743-f0", "ovs_interfaceid": "a4300743-f053-4dd3-a562-c9458d9c1453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:46:10.318615 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:86:d9,bridge_name='br-int',has_traffic_filtering=True,id=a4300743-f053-4dd3-a562-c9458d9c1453,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4300743-f0') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:46:10.318714 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:86:d9,bridge_name='br-int',has_traffic_filtering=True,id=a4300743-f053-4dd3-a562-c9458d9c1453,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4300743-f0') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:46:10.319090 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:10.319428 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:46:10.319683 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:46:10.320461 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:10.320604 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a6806019-7d22-54dc-914e-81e56ca42568', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:46:10.321366 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:10.322004 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:46:10.322687 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:10.324470 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:10.324594 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4300743-f0, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:46:10.324899 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4300743-f0, col_values=(('qos', UUID('2639dcea-b374-47b1-94fc-86d7053e7c6f')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:46:10.325061 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4300743-f0, col_values=(('external_ids', {'iface-id': 'a4300743-f053-4dd3-a562-c9458d9c1453', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:86:d9', 'vm-uuid': 'ab009682-2d6f-4f7a-b23d-95fd5f4d3f15'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:46:10.326001 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:10.327139 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:46:10.331601 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:10.332346 np0000001025 nova-compute[97981]: INFO os_vif [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:86:d9,bridge_name='br-int',has_traffic_filtering=True,id=a4300743-f053-4dd3-a562-c9458d9c1453,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4300743-f0')
May 19 04:46:10.404969 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "26edba3f-dd65-4651-8cc3-3939541dae32" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:10.405123 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "26edba3f-dd65-4651-8cc3-3939541dae32" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:10.695416 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Releasing lock "refresh_cache-5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:46:10.695745 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Instance network_info: |[{"id": "a00ed8d4-ff2d-4d0c-ad93-b01200ce4181", "address": "fa:16:3e:a9:81:c2", "network": {"id": "8a07682e-aaf0-4a4f-8bc0-70db155f01be", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2139331559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec4a48491cc047108747a22e8c63c3ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ed8d4-ff", "ovs_interfaceid": "a00ed8d4-ff2d-4d0c-ad93-b01200ce4181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:46:10.697059 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Start _get_guest_xml network_info=[{"id": "a00ed8d4-ff2d-4d0c-ad93-b01200ce4181", "address": "fa:16:3e:a9:81:c2", "network": {"id": "8a07682e-aaf0-4a4f-8bc0-70db155f01be", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2139331559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec4a48491cc047108747a22e8c63c3ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ed8d4-ff", "ovs_interfaceid": "a00ed8d4-ff2d-4d0c-ad93-b01200ce4181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:46:10.700124 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:46:10.701369 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-1333413469', uuid='5c7b7f14-f27a-4c7b-a39e-fd7c75d93117'), owner=OwnerMeta(userid='40f0313124fa425c916b6ad44fe2d7f3', username='tempest-VolumesBackupsTest-1527553839-project-member', projectid='ec4a48491cc047108747a22e8c63c3ac', projectname='tempest-VolumesBackupsTest-1527553839'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a00ed8d4-ff2d-4d0c-ad93-b01200ce4181", "address": "fa:16:3e:a9:81:c2", "network": {"id": "8a07682e-aaf0-4a4f-8bc0-70db155f01be", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2139331559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec4a48491cc047108747a22e8c63c3ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ed8d4-ff", "ovs_interfaceid": "a00ed8d4-ff2d-4d0c-ad93-b01200ce4181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165970.700936) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:46:10.702402 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:46:10.702759 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:46:10.703922 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:46:10.704134 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:46:10.705175 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:46:10.705489 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:46:10.705649 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:46:10.705733 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:46:10.705894 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:46:10.706003 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:46:10.706280 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:46:10.706448 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:46:10.706560 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:46:10.706703 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:46:10.706867 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:46:10.706998 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:46:10.718183 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1333413469',display_name='tempest-VolumesBackupsTest-instance-1333413469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesbackupstest-instance-1333413469',id=59,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrjL6rtPDpYDA7oIR30sic0p3S8tb4N47/h7yopbk+5rrKgAy6HQUBcJrVyFYLshCCakAzldqDL/JV/fvEv1MnWXM7gmhzlOFHTDFzr5dvTE9/CULLlU1UpInQvk7IDXQ==',key_name='tempest-keypair-401773272',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec4a48491cc047108747a22e8c63c3ac',ramdisk_id='',reservation_id='r-0gc53gu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1527553839',owner_user_name='tempest-VolumesBackupsTest-1527553839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:46:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40f0313124fa425c916b6ad44fe2d7f3',uuid=5c7b7f14-f27a-4c7b-a39e-fd7c75d93117,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a00ed8d4-ff2d-4d0c-ad93-b01200ce4181", "address": "fa:16:3e:a9:81:c2", "network": {"id": "8a07682e-aaf0-4a4f-8bc0-70db155f01be", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2139331559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec4a48491cc047108747a22e8c63c3ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ed8d4-ff", "ovs_interfaceid": "a00ed8d4-ff2d-4d0c-ad93-b01200ce4181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:46:10.718432 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Converting VIF {"id": "a00ed8d4-ff2d-4d0c-ad93-b01200ce4181", "address": "fa:16:3e:a9:81:c2", "network": {"id": "8a07682e-aaf0-4a4f-8bc0-70db155f01be", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2139331559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec4a48491cc047108747a22e8c63c3ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ed8d4-ff", "ovs_interfaceid": "a00ed8d4-ff2d-4d0c-ad93-b01200ce4181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:46:10.718754 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:81:c2,bridge_name='br-int',has_traffic_filtering=True,id=a00ed8d4-ff2d-4d0c-ad93-b01200ce4181,network=Network(8a07682e-aaf0-4a4f-8bc0-70db155f01be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00ed8d4-ff') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:46:10.719154 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:10.907278 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Detaching volume f11e488f-0324-47c7-90d3-622d88da352c
May 19 04:46:10.943567 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Attempting to driver detach volume f11e488f-0324-47c7-90d3-622d88da352c from mountpoint /dev/vdb
May 19 04:46:10.972950 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c', 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f11e488f-0324-47c7-90d3-622d88da352c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '26edba3f-dd65-4651-8cc3-3939541dae32', 'attached_at': '', 'detached_at': '', 'volume_id': 'f11e488f-0324-47c7-90d3-622d88da352c', 'serial': 'f11e488f-0324-47c7-90d3-622d88da352c'} {{(pid=97981) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 19 04:46:10.976088 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Found disk vdb by alias ua-f11e488f-0324-47c7-90d3-622d88da352c {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:46:10.977161 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Found disk vdb by alias ua-f11e488f-0324-47c7-90d3-622d88da352c {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:46:10.977286 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Attempting to detach device vdb from instance 26edba3f-dd65-4651-8cc3-3939541dae32 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:46:10.977519 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:46:10.977519 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:46:10.977519 np0000001025 nova-compute[97981]:   <alias name="ua-f11e488f-0324-47c7-90d3-622d88da352c"/>
May 19 04:46:10.977519 np0000001025 nova-compute[97981]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 19 04:46:10.977519 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:46:10.977519 np0000001025 nova-compute[97981]:   <serial>f11e488f-0324-47c7-90d3-622d88da352c</serial>
May 19 04:46:10.977519 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:46:10.977519 np0000001025 nova-compute[97981]:   <encryption format="luks">
May 19 04:46:10.977519 np0000001025 nova-compute[97981]:     <secret type="passphrase" uuid="61527276-03d1-4d79-8410-dd72e74e01d4"/>
May 19 04:46:10.977519 np0000001025 nova-compute[97981]:   </encryption>
May 19 04:46:10.977519 np0000001025 nova-compute[97981]: </disk>
May 19 04:46:10.977519 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:46:10.982390 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Successfully detached device vdb from instance 26edba3f-dd65-4651-8cc3-3939541dae32 from the persistent domain config.
May 19 04:46:10.982563 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] (1/8): Attempting to detach device vdb with device alias ua-f11e488f-0324-47c7-90d3-622d88da352c from instance 26edba3f-dd65-4651-8cc3-3939541dae32 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:46:10.982772 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:46:10.982772 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:46:10.982772 np0000001025 nova-compute[97981]:   <alias name="ua-f11e488f-0324-47c7-90d3-622d88da352c"/>
May 19 04:46:10.982772 np0000001025 nova-compute[97981]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 19 04:46:10.982772 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:46:10.982772 np0000001025 nova-compute[97981]:   <serial>f11e488f-0324-47c7-90d3-622d88da352c</serial>
May 19 04:46:10.982772 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:46:10.982772 np0000001025 nova-compute[97981]:   <encryption format="luks">
May 19 04:46:10.982772 np0000001025 nova-compute[97981]:     <secret type="passphrase" uuid="61527276-03d1-4d79-8410-dd72e74e01d4"/>
May 19 04:46:10.982772 np0000001025 nova-compute[97981]:   </encryption>
May 19 04:46:10.982772 np0000001025 nova-compute[97981]: </disk>
May 19 04:46:10.982772 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:46:11.222699 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] End _get_guest_xml xml=<domain type="qemu">
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:   <uuid>5c7b7f14-f27a-4c7b-a39e-fd7c75d93117</uuid>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:   <name>instance-0000003b</name>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <nova:name>tempest-VolumesBackupsTest-instance-1333413469</nova:name>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:46:10</nova:creationTime>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:         <nova:user uuid="40f0313124fa425c916b6ad44fe2d7f3">tempest-VolumesBackupsTest-1527553839-project-member</nova:user>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:         <nova:project uuid="ec4a48491cc047108747a22e8c63c3ac">tempest-VolumesBackupsTest-1527553839</nova:project>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:         <nova:port uuid="a00ed8d4-ff2d-4d0c-ad93-b01200ce4181">
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     <system>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <entry name="serial">5c7b7f14-f27a-4c7b-a39e-fd7c75d93117</entry>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <entry name="uuid">5c7b7f14-f27a-4c7b-a39e-fd7c75d93117</entry>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     </system>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:   <os>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:   </os>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:   <features>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:   </features>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:   <devices>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/5c7b7f14-f27a-4c7b-a39e-fd7c75d93117/disk"/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     </disk>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/5c7b7f14-f27a-4c7b-a39e-fd7c75d93117/disk.config"/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     </disk>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:a9:81:c2"/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <target dev="tapa00ed8d4-ff"/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     </interface>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/5c7b7f14-f27a-4c7b-a39e-fd7c75d93117/console.log" append="off"/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     </serial>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     <video>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     </video>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     </rng>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:   </devices>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]: </domain>
May 19 04:46:11.222699 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:46:11.225658 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Preparing to wait for external event network-vif-plugged-a00ed8d4-ff2d-4d0c-ad93-b01200ce4181 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:46:11.225658 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:11.225658 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:11.225658 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:11.225658 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1333413469',display_name='tempest-VolumesBackupsTest-instance-1333413469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesbackupstest-instance-1333413469',id=59,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrjL6rtPDpYDA7oIR30sic0p3S8tb4N47/h7yopbk+5rrKgAy6HQUBcJrVyFYLshCCakAzldqDL/JV/fvEv1MnWXM7gmhzlOFHTDFzr5dvTE9/CULLlU1UpInQvk7IDXQ==',key_name='tempest-keypair-401773272',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec4a48491cc047108747a22e8c63c3ac',ramdisk_id='',reservation_id='r-0gc53gu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1527553839',owner_user_name='tempest-VolumesBackupsTest-1527553839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:46:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40f0313124fa425c916b6ad44fe2d7f3',uuid=5c7b7f14-f27a-4c7b-a39e-fd7c75d93117,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a00ed8d4-ff2d-4d0c-ad93-b01200ce4181", "address": "fa:16:3e:a9:81:c2", "network": {"id": "8a07682e-aaf0-4a4f-8bc0-70db155f01be", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2139331559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec4a48491cc047108747a22e8c63c3ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ed8d4-ff", "ovs_interfaceid": "a00ed8d4-ff2d-4d0c-ad93-b01200ce4181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:46:11.225658 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Converting VIF {"id": "a00ed8d4-ff2d-4d0c-ad93-b01200ce4181", "address": "fa:16:3e:a9:81:c2", "network": {"id": "8a07682e-aaf0-4a4f-8bc0-70db155f01be", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2139331559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec4a48491cc047108747a22e8c63c3ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ed8d4-ff", "ovs_interfaceid": "a00ed8d4-ff2d-4d0c-ad93-b01200ce4181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:46:11.226336 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:81:c2,bridge_name='br-int',has_traffic_filtering=True,id=a00ed8d4-ff2d-4d0c-ad93-b01200ce4181,network=Network(8a07682e-aaf0-4a4f-8bc0-70db155f01be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00ed8d4-ff') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:46:11.226618 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:81:c2,bridge_name='br-int',has_traffic_filtering=True,id=a00ed8d4-ff2d-4d0c-ad93-b01200ce4181,network=Network(8a07682e-aaf0-4a4f-8bc0-70db155f01be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00ed8d4-ff') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:46:11.226858 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:11.227092 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:46:11.227339 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:46:11.227930 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:11.228117 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6027c990-4e75-54fb-ba9a-6770a2ae7826', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:46:11.228856 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:11.229590 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:46:11.234636 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:11.236626 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:11.236815 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa00ed8d4-ff, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:46:11.237160 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa00ed8d4-ff, col_values=(('qos', UUID('2306197c-6267-465c-99e7-674b87d9b584')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:46:11.237365 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa00ed8d4-ff, col_values=(('external_ids', {'iface-id': 'a00ed8d4-ff2d-4d0c-ad93-b01200ce4181', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:81:c2', 'vm-uuid': '5c7b7f14-f27a-4c7b-a39e-fd7c75d93117'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:46:11.238056 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:11.239407 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:46:11.248238 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:11.249352 np0000001025 nova-compute[97981]: INFO os_vif [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:81:c2,bridge_name='br-int',has_traffic_filtering=True,id=a00ed8d4-ff2d-4d0c-ad93-b01200ce4181,network=Network(8a07682e-aaf0-4a4f-8bc0-70db155f01be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00ed8d4-ff')
May 19 04:46:11.445260 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779165971.4448643, 26edba3f-dd65-4651-8cc3-3939541dae32 => ua-f11e488f-0324-47c7-90d3-622d88da352c> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:46:11.446298 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f11e488f-0324-47c7-90d3-622d88da352c for instance 26edba3f-dd65-4651-8cc3-3939541dae32 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:46:11.448316 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Successfully detached device vdb from instance 26edba3f-dd65-4651-8cc3-3939541dae32 from the live domain config.
May 19 04:46:11.450165 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:46:11.450411 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c', 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f11e488f-0324-47c7-90d3-622d88da352c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:46:11.450552 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:46:11.450878 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:46:11.451161 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c', 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f11e488f-0324-47c7-90d3-622d88da352c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:46:11.451312 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:46:11.473569 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:46:11.473569 np0000001025 nova-compute[97981]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:46:11.473569 np0000001025 nova-compute[97981]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:11.473569 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:11.473569 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:11.473760 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsi session list stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:46:11.473760 np0000001025 nova-compute[97981]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c (non-flash)
May 19 04:46:11.473760 np0000001025 nova-compute[97981]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:11.473760 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:11.473760 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:11.473867 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c', '125'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '127'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '128')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:46:11.473938 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c', '125')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:46:11.474797 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c', '126')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:46:11.475470 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721850275120>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c'): ({'sdc'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:46:11.475667 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Removing multipathed devices sdc, sdb {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:46:11.475883 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Flush multipath device 330000000b9470baf {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:46:11.509335 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:46:11.547591 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:46:11.591526 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:46:11.591695 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:46:11.592760 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:46:11.603139 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:46:11.603339 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:46:11.612973 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:11.649244 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 125, target: iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c, portal: 192.168.40.100,3260]
May 19 04:46:11.649244 np0000001025 nova-compute[97981]: Logout of [sid: 125, target: iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c, portal: 192.168.40.100,3260] successful.
May 19 04:46:11.649244 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:11.662736 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:11.673000 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:11.697958 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 126, target: iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c, portal: 192.168.50.100,3260]
May 19 04:46:11.697958 np0000001025 nova-compute[97981]: Logout of [sid: 126, target: iqn.2023-03.storpool.com:os--volume-f11e488f-0324-47c7-90d3-622d88da352c, portal: 192.168.50.100,3260] successful.
May 19 04:46:11.697958 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:11.710451 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:11.711644 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:46:11.711764 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] <== disconnect_volume: return (261ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:46:11.711906 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:46:11.848848 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:46:11.849002 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:46:11.849146 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No VIF found with MAC fa:16:3e:95:86:d9, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:46:11.849550 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Using config drive
May 19 04:46:12.250936 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lazy-loading 'flavor' on Instance uuid 26edba3f-dd65-4651-8cc3-3939541dae32 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:12.355227 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:12.459154 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Creating config drive at /opt/stack/data/nova/instances/ab009682-2d6f-4f7a-b23d-95fd5f4d3f15/disk.config
May 19 04:46:12.462286 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ab009682-2d6f-4f7a-b23d-95fd5f4d3f15/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvvca6vvx {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:12.513028 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ab009682-2d6f-4f7a-b23d-95fd5f4d3f15/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvvca6vvx" returned: 0 in 0.050s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:12.765701 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:46:12.765701 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:46:12.765701 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] No VIF found with MAC fa:16:3e:a9:81:c2, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:46:12.766970 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Using config drive
May 19 04:46:12.917030 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:12.947866 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:12.952141 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:13.028777 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:13.082568 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9b77fcaf-8211-4905-8340-9c1040e4267d req-ce9a719b-57b2-48e4-89ce-10d0916d0678 service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Received event network-vif-plugged-a4300743-f053-4dd3-a562-c9458d9c1453 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:13.082872 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9b77fcaf-8211-4905-8340-9c1040e4267d req-ce9a719b-57b2-48e4-89ce-10d0916d0678 service nova] Acquiring lock "ab009682-2d6f-4f7a-b23d-95fd5f4d3f15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:13.082994 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9b77fcaf-8211-4905-8340-9c1040e4267d req-ce9a719b-57b2-48e4-89ce-10d0916d0678 service nova] Lock "ab009682-2d6f-4f7a-b23d-95fd5f4d3f15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:13.083172 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9b77fcaf-8211-4905-8340-9c1040e4267d req-ce9a719b-57b2-48e4-89ce-10d0916d0678 service nova] Lock "ab009682-2d6f-4f7a-b23d-95fd5f4d3f15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:13.083409 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9b77fcaf-8211-4905-8340-9c1040e4267d req-ce9a719b-57b2-48e4-89ce-10d0916d0678 service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Processing event network-vif-plugged-a4300743-f053-4dd3-a562-c9458d9c1453 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:46:13.222513 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:13.229175 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:13.234779 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:13.255844 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:13.263183 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:13.264335 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-88efb210-ff08-41d7-85a9-e7c0c22bcb46 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "26edba3f-dd65-4651-8cc3-3939541dae32" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.859s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:13.273545 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:13.392813 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Creating config drive at /opt/stack/data/nova/instances/5c7b7f14-f27a-4c7b-a39e-fd7c75d93117/disk.config
May 19 04:46:13.396392 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5c7b7f14-f27a-4c7b-a39e-fd7c75d93117/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdhz9ov5d {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:13.418363 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:13.449598 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5c7b7f14-f27a-4c7b-a39e-fd7c75d93117/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdhz9ov5d" returned: 0 in 0.053s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:13.696545 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165973.6960297, ab009682-2d6f-4f7a-b23d-95fd5f4d3f15 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:46:13.697098 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:46:13.697928 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] VM Started (Lifecycle Event)
May 19 04:46:13.699485 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:46:13.702948 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Instance spawned successfully.
May 19 04:46:13.703269 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:46:13.711812 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "26edba3f-dd65-4651-8cc3-3939541dae32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:13.712080 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "26edba3f-dd65-4651-8cc3-3939541dae32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:13.712375 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "26edba3f-dd65-4651-8cc3-3939541dae32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:13.712555 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "26edba3f-dd65-4651-8cc3-3939541dae32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:13.712706 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "26edba3f-dd65-4651-8cc3-3939541dae32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:13.715589 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Terminating instance
May 19 04:46:13.853862 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:13.880471 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:13.883863 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:14.000231 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:14.089612 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0ee5fe02-ccdf-4dd0-9eab-d15b56650de8 req-54d5d673-c9cd-492b-a229-9ea982e48734 service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Received event network-vif-plugged-a00ed8d4-ff2d-4d0c-ad93-b01200ce4181 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:14.089612 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0ee5fe02-ccdf-4dd0-9eab-d15b56650de8 req-54d5d673-c9cd-492b-a229-9ea982e48734 service nova] Acquiring lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:14.090765 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0ee5fe02-ccdf-4dd0-9eab-d15b56650de8 req-54d5d673-c9cd-492b-a229-9ea982e48734 service nova] Lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:14.090995 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0ee5fe02-ccdf-4dd0-9eab-d15b56650de8 req-54d5d673-c9cd-492b-a229-9ea982e48734 service nova] Lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:14.091252 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0ee5fe02-ccdf-4dd0-9eab-d15b56650de8 req-54d5d673-c9cd-492b-a229-9ea982e48734 service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Processing event network-vif-plugged-a00ed8d4-ff2d-4d0c-ad93-b01200ce4181 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:46:14.201341 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:46:14.211978 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:46:14.218249 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:46:14.218249 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:46:14.218249 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:46:14.218249 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:46:14.218667 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:46:14.218738 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:46:14.225123 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:46:14.247657 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:14.250353 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:14.254206 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:14.273011 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:14.281923 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:14.284937 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:14.311686 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:14.320405 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:14.431118 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:14.457116 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:14.594833 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Instance destroyed successfully.
May 19 04:46:14.595820 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lazy-loading 'resources' on Instance uuid 26edba3f-dd65-4651-8cc3-3939541dae32 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:14.714866 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:46:14.715204 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165974.714964, ab009682-2d6f-4f7a-b23d-95fd5f4d3f15 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:46:14.715322 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] VM Paused (Lifecycle Event)
May 19 04:46:14.729607 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Took 8.51 seconds to spawn the instance on the hypervisor.
May 19 04:46:14.730146 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:46:14.858554 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:46:14.861155 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:46:14.863125 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Instance spawned successfully.
May 19 04:46:14.863449 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:46:15.099414 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:45:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-91523045',display_name='tempest-TestEncryptedCinderVolumes-server-91523045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testencryptedcindervolumes-server-91523045',id=55,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnhcvYkZhjIio0MyAW2vSDlqhQa3mxMW4rBWQXFhozErfngW3QNyz7O1lRBUF0Kicm1Bp75gm9pq/AQhAJbDmddp2sRAZylnVcnFeh1OniouvY7ntG/L/Rjqx8bSfxcRw==',key_name='tempest-keypair-623319440',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:45:16Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7041ddbe11174207bbc7363b3bf08af5',ramdisk_id='',reservation_id='r-uum1f5xn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-324201327',owner_user_name='tempest-TestEncryptedCinderVolumes-324201327-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:45:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada528b0c5c740799599a2b163709a87',uuid=26edba3f-dd65-4651-8cc3-3939541dae32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "660d654e-68e9-48a7-8ba0-1947fccd007a", "address": "fa:16:3e:8f:bb:b0", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap660d654e-68", "ovs_interfaceid": "660d654e-68e9-48a7-8ba0-1947fccd007a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:46:15.099718 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Converting VIF {"id": "660d654e-68e9-48a7-8ba0-1947fccd007a", "address": "fa:16:3e:8f:bb:b0", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap660d654e-68", "ovs_interfaceid": "660d654e-68e9-48a7-8ba0-1947fccd007a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:46:15.100677 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:bb:b0,bridge_name='br-int',has_traffic_filtering=True,id=660d654e-68e9-48a7-8ba0-1947fccd007a,network=Network(1eda8fb0-3870-4644-873a-b485fff9e767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660d654e-68') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:46:15.100993 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:bb:b0,bridge_name='br-int',has_traffic_filtering=True,id=660d654e-68e9-48a7-8ba0-1947fccd007a,network=Network(1eda8fb0-3870-4644-873a-b485fff9e767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660d654e-68') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:46:15.104151 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:15.104151 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap660d654e-68, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:46:15.105392 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:15.105392 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:46:15.105913 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:15.106839 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:15.106839 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec906e0a-1893-41a1-8103-a2f98e2d1756) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:46:15.107404 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:15.107634 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:46:15.107831 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:15.109898 np0000001025 nova-compute[97981]: INFO os_vif [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:bb:b0,bridge_name='br-int',has_traffic_filtering=True,id=660d654e-68e9-48a7-8ba0-1947fccd007a,network=Network(1eda8fb0-3870-4644-873a-b485fff9e767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660d654e-68')
May 19 04:46:15.110279 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Deleting instance files /opt/stack/data/nova/instances/26edba3f-dd65-4651-8cc3-3939541dae32_del
May 19 04:46:15.111233 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Deletion of /opt/stack/data/nova/instances/26edba3f-dd65-4651-8cc3-3939541dae32_del complete
May 19 04:46:15.139905 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7ae4237d-79a2-4f49-a9c1-389cc072db85 req-bc6da9c0-bb89-44f2-be87-d97ef2f527a7 service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Received event network-vif-plugged-a4300743-f053-4dd3-a562-c9458d9c1453 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:15.140330 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7ae4237d-79a2-4f49-a9c1-389cc072db85 req-bc6da9c0-bb89-44f2-be87-d97ef2f527a7 service nova] Acquiring lock "ab009682-2d6f-4f7a-b23d-95fd5f4d3f15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:15.140488 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7ae4237d-79a2-4f49-a9c1-389cc072db85 req-bc6da9c0-bb89-44f2-be87-d97ef2f527a7 service nova] Lock "ab009682-2d6f-4f7a-b23d-95fd5f4d3f15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:15.140595 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7ae4237d-79a2-4f49-a9c1-389cc072db85 req-bc6da9c0-bb89-44f2-be87-d97ef2f527a7 service nova] Lock "ab009682-2d6f-4f7a-b23d-95fd5f4d3f15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:15.140709 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7ae4237d-79a2-4f49-a9c1-389cc072db85 req-bc6da9c0-bb89-44f2-be87-d97ef2f527a7 service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] No waiting events found dispatching network-vif-plugged-a4300743-f053-4dd3-a562-c9458d9c1453 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:46:15.140823 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-7ae4237d-79a2-4f49-a9c1-389cc072db85 req-bc6da9c0-bb89-44f2-be87-d97ef2f527a7 service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Received unexpected event network-vif-plugged-a4300743-f053-4dd3-a562-c9458d9c1453 for instance with vm_state active and task_state None.
May 19 04:46:15.217844 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:46:15.219933 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165975.2197344, ab009682-2d6f-4f7a-b23d-95fd5f4d3f15 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:46:15.220060 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] VM Resumed (Lifecycle Event)
May 19 04:46:15.240586 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Took 15.58 seconds to build instance.
May 19 04:46:15.369491 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:46:15.369619 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:46:15.369790 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:46:15.370391 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:46:15.370391 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:46:15.370548 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:46:15.618558 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Took 1.39 seconds to destroy the instance on the hypervisor.
May 19 04:46:15.619327 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:46:15.619563 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:46:15.619666 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:46:15.619934 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:15.680738 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:15.686755 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3aaaa7d9-e7b4-4fdf-893d-ffd18ddd8f8f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:46:15.722644 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:46:15.725532 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:46:15.742230 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-af3ded13-27ec-4202-a072-782ddf9bbaf0 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "ab009682-2d6f-4f7a-b23d-95fd5f4d3f15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.086s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:15.875015 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Took 6.83 seconds to spawn the instance on the hypervisor.
May 19 04:46:15.875015 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:46:16.147873 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6ed4b933-0159-4835-a79d-47bd20135338 req-44a4946a-5f67-42ec-9e7e-c202a00ccc3a service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Received event network-vif-plugged-a00ed8d4-ff2d-4d0c-ad93-b01200ce4181 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:16.148061 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6ed4b933-0159-4835-a79d-47bd20135338 req-44a4946a-5f67-42ec-9e7e-c202a00ccc3a service nova] Acquiring lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:16.148285 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6ed4b933-0159-4835-a79d-47bd20135338 req-44a4946a-5f67-42ec-9e7e-c202a00ccc3a service nova] Lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:16.148406 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6ed4b933-0159-4835-a79d-47bd20135338 req-44a4946a-5f67-42ec-9e7e-c202a00ccc3a service nova] Lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:16.148613 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6ed4b933-0159-4835-a79d-47bd20135338 req-44a4946a-5f67-42ec-9e7e-c202a00ccc3a service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] No waiting events found dispatching network-vif-plugged-a00ed8d4-ff2d-4d0c-ad93-b01200ce4181 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:46:16.148795 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-6ed4b933-0159-4835-a79d-47bd20135338 req-44a4946a-5f67-42ec-9e7e-c202a00ccc3a service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Received unexpected event network-vif-plugged-a00ed8d4-ff2d-4d0c-ad93-b01200ce4181 for instance with vm_state active and task_state None.
May 19 04:46:16.148896 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6ed4b933-0159-4835-a79d-47bd20135338 req-44a4946a-5f67-42ec-9e7e-c202a00ccc3a service nova] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Received event network-vif-unplugged-660d654e-68e9-48a7-8ba0-1947fccd007a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:16.149005 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6ed4b933-0159-4835-a79d-47bd20135338 req-44a4946a-5f67-42ec-9e7e-c202a00ccc3a service nova] Acquiring lock "26edba3f-dd65-4651-8cc3-3939541dae32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:16.149157 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6ed4b933-0159-4835-a79d-47bd20135338 req-44a4946a-5f67-42ec-9e7e-c202a00ccc3a service nova] Lock "26edba3f-dd65-4651-8cc3-3939541dae32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:16.149381 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6ed4b933-0159-4835-a79d-47bd20135338 req-44a4946a-5f67-42ec-9e7e-c202a00ccc3a service nova] Lock "26edba3f-dd65-4651-8cc3-3939541dae32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:16.149508 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6ed4b933-0159-4835-a79d-47bd20135338 req-44a4946a-5f67-42ec-9e7e-c202a00ccc3a service nova] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] No waiting events found dispatching network-vif-unplugged-660d654e-68e9-48a7-8ba0-1947fccd007a {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:46:16.149648 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6ed4b933-0159-4835-a79d-47bd20135338 req-44a4946a-5f67-42ec-9e7e-c202a00ccc3a service nova] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Received event network-vif-unplugged-660d654e-68e9-48a7-8ba0-1947fccd007a for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:46:16.149766 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6ed4b933-0159-4835-a79d-47bd20135338 req-44a4946a-5f67-42ec-9e7e-c202a00ccc3a service nova] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Received event network-vif-unplugged-660d654e-68e9-48a7-8ba0-1947fccd007a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:16.149916 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6ed4b933-0159-4835-a79d-47bd20135338 req-44a4946a-5f67-42ec-9e7e-c202a00ccc3a service nova] Acquiring lock "26edba3f-dd65-4651-8cc3-3939541dae32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:16.150425 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6ed4b933-0159-4835-a79d-47bd20135338 req-44a4946a-5f67-42ec-9e7e-c202a00ccc3a service nova] Lock "26edba3f-dd65-4651-8cc3-3939541dae32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:16.150500 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6ed4b933-0159-4835-a79d-47bd20135338 req-44a4946a-5f67-42ec-9e7e-c202a00ccc3a service nova] Lock "26edba3f-dd65-4651-8cc3-3939541dae32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:16.150625 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6ed4b933-0159-4835-a79d-47bd20135338 req-44a4946a-5f67-42ec-9e7e-c202a00ccc3a service nova] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] No waiting events found dispatching network-vif-unplugged-660d654e-68e9-48a7-8ba0-1947fccd007a {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:46:16.150752 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6ed4b933-0159-4835-a79d-47bd20135338 req-44a4946a-5f67-42ec-9e7e-c202a00ccc3a service nova] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Received event network-vif-unplugged-660d654e-68e9-48a7-8ba0-1947fccd007a for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:46:16.196155 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-3aaaa7d9-e7b4-4fdf-893d-ffd18ddd8f8f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] instance snapshotting
May 19 04:46:16.228689 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999738421000075 future=<Future at 0x721834350f50 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:46:16.229053 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999371255999904 future=<Future at 0x721834350f50 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:46:16.229205 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999188655000125 future=<Future at 0x721834350f50 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:46:16.229618 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165976.229282, 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:46:16.229676 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] VM Started (Lifecycle Event)
May 19 04:46:16.280890 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3aaaa7d9-e7b4-4fdf-893d-ffd18ddd8f8f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Beginning live snapshot process
May 19 04:46:16.385473 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Took 12.29 seconds to build instance.
May 19 04:46:16.627174 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:46:16.732124 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:46:16.734827 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:46:16.886981 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.809s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:17.028349 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5b7e5fcc-2873-4d34-a70f-ccfa7f0e520d req-0658f78c-b67f-4987-a4e9-16ba28831774 service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Received event network-changed-a4300743-f053-4dd3-a562-c9458d9c1453 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:17.028463 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5b7e5fcc-2873-4d34-a70f-ccfa7f0e520d req-0658f78c-b67f-4987-a4e9-16ba28831774 service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Refreshing instance network info cache due to event network-changed-a4300743-f053-4dd3-a562-c9458d9c1453. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:46:17.028656 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5b7e5fcc-2873-4d34-a70f-ccfa7f0e520d req-0658f78c-b67f-4987-a4e9-16ba28831774 service nova] Acquiring lock "refresh_cache-ab009682-2d6f-4f7a-b23d-95fd5f4d3f15" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:46:17.028763 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5b7e5fcc-2873-4d34-a70f-ccfa7f0e520d req-0658f78c-b67f-4987-a4e9-16ba28831774 service nova] Acquired lock "refresh_cache-ab009682-2d6f-4f7a-b23d-95fd5f4d3f15" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:46:17.029090 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5b7e5fcc-2873-4d34-a70f-ccfa7f0e520d req-0658f78c-b67f-4987-a4e9-16ba28831774 service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Refreshing network info cache for port a4300743-f053-4dd3-a562-c9458d9c1453 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:46:17.129444 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Took 1.51 seconds to deallocate network for instance.
May 19 04:46:17.238014 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165977.2376735, 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:46:17.238419 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] VM Paused (Lifecycle Event)
May 19 04:46:17.532099 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-5b7e5fcc-2873-4d34-a70f-ccfa7f0e520d req-0658f78c-b67f-4987-a4e9-16ba28831774 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:17.638920 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:17.639137 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:17.744558 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:46:17.746596 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165977.7463677, 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:46:17.746730 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] VM Resumed (Lifecycle Event)
May 19 04:46:17.792933 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3aaaa7d9-e7b4-4fdf-893d-ffd18ddd8f8f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk --force-share --output=json -f qcow2 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:17.879780 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-5b7e5fcc-2873-4d34-a70f-ccfa7f0e520d req-0658f78c-b67f-4987-a4e9-16ba28831774 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:17.884614 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3aaaa7d9-e7b4-4fdf-893d-ffd18ddd8f8f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk --force-share --output=json -f qcow2" returned: 0 in 0.092s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:17.885223 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3aaaa7d9-e7b4-4fdf-893d-ffd18ddd8f8f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk --force-share --output=json -f qcow2 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:17.981034 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3aaaa7d9-e7b4-4fdf-893d-ffd18ddd8f8f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk --force-share --output=json -f qcow2" returned: 0 in 0.095s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:17.981954 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-3aaaa7d9-e7b4-4fdf-893d-ffd18ddd8f8f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:46:17.985471 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-3aaaa7d9-e7b4-4fdf-893d-ffd18ddd8f8f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:46:17.985834 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3aaaa7d9-e7b4-4fdf-893d-ffd18ddd8f8f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:18.031811 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:46:18.032136 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:46:18.073762 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5b7e5fcc-2873-4d34-a70f-ccfa7f0e520d req-0658f78c-b67f-4987-a4e9-16ba28831774 service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Updated VIF entry in instance network info cache for port a4300743-f053-4dd3-a562-c9458d9c1453. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:46:18.074543 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5b7e5fcc-2873-4d34-a70f-ccfa7f0e520d req-0658f78c-b67f-4987-a4e9-16ba28831774 service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Updating instance_info_cache with network_info: [{"id": "a4300743-f053-4dd3-a562-c9458d9c1453", "address": "fa:16:3e:95:86:d9", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4300743-f0", "ovs_interfaceid": "a4300743-f053-4dd3-a562-c9458d9c1453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:46:18.082842 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3aaaa7d9-e7b4-4fdf-893d-ffd18ddd8f8f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.097s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:18.083565 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3aaaa7d9-e7b4-4fdf-893d-ffd18ddd8f8f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpny8mrneb/3e18d2f4539a4f0f8d38b304d4ef3275.delta 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:18.154312 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3aaaa7d9-e7b4-4fdf-893d-ffd18ddd8f8f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpny8mrneb/3e18d2f4539a4f0f8d38b304d4ef3275.delta 1073741824" returned: 0 in 0.070s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:18.154312 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3aaaa7d9-e7b4-4fdf-893d-ffd18ddd8f8f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Quiescing instance not available: QEMU guest agent is not enabled.
May 19 04:46:18.224735 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6c696117-1094-46d2-93b4-8ee73bd20550 req-75e92182-8a1c-4028-9db2-2345dd7bbd82 service nova] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Received event network-vif-deleted-660d654e-68e9-48a7-8ba0-1947fccd007a {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:18.224891 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6c696117-1094-46d2-93b4-8ee73bd20550 req-75e92182-8a1c-4028-9db2-2345dd7bbd82 service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Received event network-changed-a00ed8d4-ff2d-4d0c-ad93-b01200ce4181 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:18.225028 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6c696117-1094-46d2-93b4-8ee73bd20550 req-75e92182-8a1c-4028-9db2-2345dd7bbd82 service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Refreshing instance network info cache due to event network-changed-a00ed8d4-ff2d-4d0c-ad93-b01200ce4181. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:46:18.225253 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6c696117-1094-46d2-93b4-8ee73bd20550 req-75e92182-8a1c-4028-9db2-2345dd7bbd82 service nova] Acquiring lock "refresh_cache-5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:46:18.225371 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6c696117-1094-46d2-93b4-8ee73bd20550 req-75e92182-8a1c-4028-9db2-2345dd7bbd82 service nova] Acquired lock "refresh_cache-5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:46:18.225528 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-6c696117-1094-46d2-93b4-8ee73bd20550 req-75e92182-8a1c-4028-9db2-2345dd7bbd82 service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Refreshing network info cache for port a00ed8d4-ff2d-4d0c-ad93-b01200ce4181 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:46:18.249022 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:46:18.251448 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:46:18.391295 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-3aaaa7d9-e7b4-4fdf-893d-ffd18ddd8f8f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] COPY block job progress, current cursor: 0 final cursor: 76677120 {{(pid=97981) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 19 04:46:18.419061 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:18.536611 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:46:18.579141 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5b7e5fcc-2873-4d34-a70f-ccfa7f0e520d req-0658f78c-b67f-4987-a4e9-16ba28831774 service nova] Releasing lock "refresh_cache-ab009682-2d6f-4f7a-b23d-95fd5f4d3f15" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:46:18.728200 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-6c696117-1094-46d2-93b4-8ee73bd20550 req-75e92182-8a1c-4028-9db2-2345dd7bbd82 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:18.895327 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-3aaaa7d9-e7b4-4fdf-893d-ffd18ddd8f8f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] COPY block job progress, current cursor: 76677120 final cursor: 76677120 {{(pid=97981) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 19 04:46:18.897009 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3aaaa7d9-e7b4-4fdf-893d-ffd18ddd8f8f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Skipping quiescing instance: QEMU guest agent is not enabled.
May 19 04:46:18.949791 np0000001025 nova-compute[97981]: DEBUG nova.privsep.utils [None req-3aaaa7d9-e7b4-4fdf-893d-ffd18ddd8f8f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97981) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 19 04:46:18.950539 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3aaaa7d9-e7b4-4fdf-893d-ffd18ddd8f8f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpny8mrneb/3e18d2f4539a4f0f8d38b304d4ef3275.delta /opt/stack/data/nova/instances/snapshots/tmpny8mrneb/3e18d2f4539a4f0f8d38b304d4ef3275 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:19.017802 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-6c696117-1094-46d2-93b4-8ee73bd20550 req-75e92182-8a1c-4028-9db2-2345dd7bbd82 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:19.043817 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.405s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:19.114166 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Deleted allocations for instance 26edba3f-dd65-4651-8cc3-3939541dae32
May 19 04:46:19.157821 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-6c696117-1094-46d2-93b4-8ee73bd20550 req-75e92182-8a1c-4028-9db2-2345dd7bbd82 service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Updated VIF entry in instance network info cache for port a00ed8d4-ff2d-4d0c-ad93-b01200ce4181. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:46:19.158274 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-6c696117-1094-46d2-93b4-8ee73bd20550 req-75e92182-8a1c-4028-9db2-2345dd7bbd82 service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Updating instance_info_cache with network_info: [{"id": "a00ed8d4-ff2d-4d0c-ad93-b01200ce4181", "address": "fa:16:3e:a9:81:c2", "network": {"id": "8a07682e-aaf0-4a4f-8bc0-70db155f01be", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2139331559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec4a48491cc047108747a22e8c63c3ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ed8d4-ff", "ovs_interfaceid": "a00ed8d4-ff2d-4d0c-ad93-b01200ce4181", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:46:19.207615 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3aaaa7d9-e7b4-4fdf-893d-ffd18ddd8f8f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpny8mrneb/3e18d2f4539a4f0f8d38b304d4ef3275.delta /opt/stack/data/nova/instances/snapshots/tmpny8mrneb/3e18d2f4539a4f0f8d38b304d4ef3275" returned: 0 in 0.257s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:19.211844 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3aaaa7d9-e7b4-4fdf-893d-ffd18ddd8f8f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Snapshot extracted, beginning image upload
May 19 04:46:19.660743 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6c696117-1094-46d2-93b4-8ee73bd20550 req-75e92182-8a1c-4028-9db2-2345dd7bbd82 service nova] Releasing lock "refresh_cache-5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:46:20.108256 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:20.130277 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f8372d8c-4833-4a96-ae2e-f926d514093b tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "26edba3f-dd65-4651-8cc3-3939541dae32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.418s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:21.918950 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3aaaa7d9-e7b4-4fdf-893d-ffd18ddd8f8f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Snapshot image upload complete
May 19 04:46:21.919394 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-3aaaa7d9-e7b4-4fdf-893d-ffd18ddd8f8f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Took 5.72 seconds to snapshot the instance on the hypervisor.
May 19 04:46:23.420691 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:23.472965 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "e2017472-4da3-4676-b614-3e7039fedef3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:23.473256 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "e2017472-4da3-4676-b614-3e7039fedef3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:23.976820 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lazy-loading 'flavor' on Instance uuid e2017472-4da3-4676-b614-3e7039fedef3 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:24.295381 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "032576d0-ced0-4686-8aad-26b4e06a4d67" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:24.295595 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "032576d0-ced0-4686-8aad-26b4e06a4d67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:24.797236 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:46:24.982322 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "e2017472-4da3-4676-b614-3e7039fedef3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:25.110425 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:25.349805 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:25.350024 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:25.355561 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:46:25.355723 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Claim successful on node np0000001025
May 19 04:46:26.036544 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "e2017472-4da3-4676-b614-3e7039fedef3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:26.037072 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "e2017472-4da3-4676-b614-3e7039fedef3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:26.037072 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Attaching volume 440133cc-e2e2-47e8-af85-891406649029 to /dev/vdb
May 19 04:46:26.070960 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:46:26.081959 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:46:26.101893 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:26.147858 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:46:26.148119 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:46:26.157663 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:46:26.158835 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fe33:f814', 'fe80::8008:f5ff:fe5e:1a35', 'fe80::fc16:3eff:fede:fe78', 'fe80::bc2a:1ff:fe94:f24f', 'fe80::fc16:3eff:fe95:86d9', 'fe80::bc20:d2ff:fef5:7278', 'fe80::fc16:3eff:fea9:81c2', 'fe80::b02a:c2ff:fe71:d502'] 
May 19 04:46:26.158932 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:46:26.159061 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:46:26.159355 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:46:26.159627 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Updating existing volume attachment record: 2145461f-df28-4a18-8211-6ec4d8d752c2 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:46:26.647396 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:46:26.647624 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:46:26.703821 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:46:26.704268 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '440133cc-e2e2-47e8-af85-891406649029', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:46:26.705561 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:46:26.705561 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:46:26.705561 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '440133cc-e2e2-47e8-af85-891406649029', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:46:26.717153 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:46:26.717892 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:46:26.718563 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:46:26.718753 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:46:26.719202 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:46:26.719545 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:46:26.732674 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:46:26.732674 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:26.737547 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:46:26.737547 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:26.746336 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029] added
May 19 04:46:26.746336 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:46:26.746336 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:46:26.746336 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:46:26.746336 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:46:26.746336 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:46:26.746336 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:26.746336 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:46:26.746336 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0273(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:46:26.746336 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:46:26.748058 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029] added
May 19 04:46:26.748058 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:46:26.748058 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:46:26.748058 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:46:26.748058 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:46:26.748058 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:46:26.748058 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:26.748295 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:46:26.748380 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0289(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:46:26.748460 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:46:27.150507 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:46:27.616192 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:46:27.616356 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Cleaning up deleted instances with incomplete migration  {{(pid=97981) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 19 04:46:27.657187 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.307s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:27.658074 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:46:27.746934 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:46:27.748910 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:46:27.759905 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:46:27.759905 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:46:27.766471 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:46:27.766471 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:27.775863 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:27.781923 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:27.789278 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:27.789278 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:27.789278 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:27.789278 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:27.789278 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:27.789278 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:27.794819 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:27.794819 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:27.794819 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:27.795017 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:27.795017 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:27.795017 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:27.819817 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029, portal: 192.168.40.100,3260]
May 19 04:46:27.819817 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029, portal: 192.168.40.100,3260] successful.
May 19 04:46:27.819817 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:27.831653 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029, portal: 192.168.50.100,3260]
May 19 04:46:27.831653 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029, portal: 192.168.50.100,3260] successful.
May 19 04:46:27.831653 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:27.832510 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:27.845380 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:27.850893 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:27.850893 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:27.850893 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:27.850893 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:27.850893 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:27.852841 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:27.852841 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:27.852841 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:27.852841 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:27.852841 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:27.852841 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.133s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:46:27.852841 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:46:27.852841 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] HCTL ('7', '-', '-', 0) found on session 129 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:46:27.852841 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:46:27.862481 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:27.862481 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:27.862481 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:27.862481 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:27.862481 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:27.862748 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:27.862748 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:27.862748 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:27.862748 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:27.862748 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:27.862883 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:46:27.863014 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:46:27.863615 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] HCTL ('8', '-', '-', 0) found on session 130 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:46:27.863739 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:46:27.871653 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Searching for a device in session 129 and hctl ['7', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:46:27.879408 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Searching for a device in session 130 and hctl ['8', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:46:28.118202 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:46:28.164751 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:46:28.164751 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:46:28.164751 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:28.165235 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:28.232745 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ada528b0c5c740799599a2b163709a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041ddbe11174207bbc7363b3bf08af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:46:28.423213 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:28.669693 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:46:28.697036 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Successfully created port: de633ad4-a9b9-4707-ab84-2205899d653e {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:46:28.871026 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Searching for a device in session 129 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:46:28.871212 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '440133cc-e2e2-47e8-af85-891406649029', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:46:28.879869 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Searching for a device in session 130 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:46:28.880054 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '440133cc-e2e2-47e8-af85-891406649029', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:46:29.138096 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Successfully updated port: de633ad4-a9b9-4707-ab84-2205899d653e {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:46:29.174188 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:46:29.201789 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fdd391d7-50e8-43f8-b85c-fa2857eab2ba req-8355df20-5fd1-4093-a314-a0b6ae074abb service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Received event network-changed-de633ad4-a9b9-4707-ab84-2205899d653e {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:29.201789 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fdd391d7-50e8-43f8-b85c-fa2857eab2ba req-8355df20-5fd1-4093-a314-a0b6ae074abb service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Refreshing instance network info cache due to event network-changed-de633ad4-a9b9-4707-ab84-2205899d653e. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:46:29.201789 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fdd391d7-50e8-43f8-b85c-fa2857eab2ba req-8355df20-5fd1-4093-a314-a0b6ae074abb service nova] Acquiring lock "refresh_cache-032576d0-ced0-4686-8aad-26b4e06a4d67" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:46:29.201789 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fdd391d7-50e8-43f8-b85c-fa2857eab2ba req-8355df20-5fd1-4093-a314-a0b6ae074abb service nova] Acquired lock "refresh_cache-032576d0-ced0-4686-8aad-26b4e06a4d67" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:46:29.201789 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-fdd391d7-50e8-43f8-b85c-fa2857eab2ba req-8355df20-5fd1-4093-a314-a0b6ae074abb service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Refreshing network info cache for port de633ad4-a9b9-4707-ab84-2205899d653e {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:46:29.640133 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "refresh_cache-032576d0-ced0-4686-8aad-26b4e06a4d67" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:46:29.704242 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-fdd391d7-50e8-43f8-b85c-fa2857eab2ba req-8355df20-5fd1-4093-a314-a0b6ae074abb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:29.719086 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:46:29.767219 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-fdd391d7-50e8-43f8-b85c-fa2857eab2ba req-8355df20-5fd1-4093-a314-a0b6ae074abb service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:46:29.894883 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-fdd391d7-50e8-43f8-b85c-fa2857eab2ba req-8355df20-5fd1-4093-a314-a0b6ae074abb service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:46:30.111558 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:30.182142 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:46:30.183080 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:46:30.183316 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Creating image(s)
May 19 04:46:30.183760 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "/opt/stack/data/nova/instances/032576d0-ced0-4686-8aad-26b4e06a4d67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:30.183925 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "/opt/stack/data/nova/instances/032576d0-ced0-4686-8aad-26b4e06a4d67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:30.184337 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "/opt/stack/data/nova/instances/032576d0-ced0-4686-8aad-26b4e06a4d67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:30.184832 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:46:30.187274 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:46:30.188258 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:30.282458 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:30.282934 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:30.283546 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:30.284101 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:46:30.286694 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:46:30.287012 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:30.373396 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.086s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:30.374023 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/032576d0-ced0-4686-8aad-26b4e06a4d67/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:30.402145 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fdd391d7-50e8-43f8-b85c-fa2857eab2ba req-8355df20-5fd1-4093-a314-a0b6ae074abb service nova] Releasing lock "refresh_cache-032576d0-ced0-4686-8aad-26b4e06a4d67" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:46:30.404614 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquired lock "refresh_cache-032576d0-ced0-4686-8aad-26b4e06a4d67" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:46:30.404751 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:46:30.437555 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/032576d0-ced0-4686-8aad-26b4e06a4d67/disk 1073741824" returned: 0 in 0.063s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:30.438155 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.155s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:30.438832 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:30.535728 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.096s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:30.536352 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Checking if we can resize image /opt/stack/data/nova/instances/032576d0-ced0-4686-8aad-26b4e06a4d67/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:46:30.536706 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032576d0-ced0-4686-8aad-26b4e06a4d67/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:30.626854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032576d0-ced0-4686-8aad-26b4e06a4d67/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:30.627303 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Cannot resize image /opt/stack/data/nova/instances/032576d0-ced0-4686-8aad-26b4e06a4d67/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:46:30.627811 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:46:30.628004 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Ensure instance console log exists: /opt/stack/data/nova/instances/032576d0-ced0-4686-8aad-26b4e06a4d67/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:46:30.628338 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:30.628731 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:30.628922 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:30.739954 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Found WWN 330000000f0eff326 for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:46:30.740519 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.036s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:46:30.740739 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] <== connect_volume: return (4036ms) {'type': 'block', 'scsi_wwn': '330000000f0eff326', 'path': '/dev/dm-0', 'multipath_id': '330000000f0eff326'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:46:30.740903 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f0eff326', 'path': '/dev/dm-0', 'multipath_id': '330000000f0eff326'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:46:30.745349 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lazy-loading 'flavor' on Instance uuid e2017472-4da3-4676-b614-3e7039fedef3 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:30.973757 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:46:31.117269 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:31.228956 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00045719700028712396 future=<Future at 0x721834350f50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:46:31.229547 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Emitting event <LifecycleEvent: 1779165976.2283266, 26edba3f-dd65-4651-8cc3-3939541dae32 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:46:31.229767 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:46:31.229871 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] VM Stopped (Lifecycle Event)
May 19 04:46:31.233983 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Updating instance_info_cache with network_info: [{"id": "de633ad4-a9b9-4707-ab84-2205899d653e", "address": "fa:16:3e:41:22:00", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde633ad4-a9", "ovs_interfaceid": "de633ad4-a9b9-4707-ab84-2205899d653e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:46:31.249798 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Attempting to attach volume 440133cc-e2e2-47e8-af85-891406649029 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:46:31.251165 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:46:31.251165 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:46:31.251165 np0000001025 nova-compute[97981]:   <alias name="ua-440133cc-e2e2-47e8-af85-891406649029"/>
May 19 04:46:31.251165 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:46:31.251165 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:46:31.251165 np0000001025 nova-compute[97981]:   <serial>440133cc-e2e2-47e8-af85-891406649029</serial>
May 19 04:46:31.251165 np0000001025 nova-compute[97981]: </disk>
May 19 04:46:31.251165 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:46:31.553977 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:31.554152 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:31.732788 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e5630c4b-8fc0-436e-8dc2-546f12f74a34 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: 26edba3f-dd65-4651-8cc3-3939541dae32] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:46:31.735390 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Releasing lock "refresh_cache-032576d0-ced0-4686-8aad-26b4e06a4d67" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:46:31.735930 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Instance network_info: |[{"id": "de633ad4-a9b9-4707-ab84-2205899d653e", "address": "fa:16:3e:41:22:00", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde633ad4-a9", "ovs_interfaceid": "de633ad4-a9b9-4707-ab84-2205899d653e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:46:31.737457 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Start _get_guest_xml network_info=[{"id": "de633ad4-a9b9-4707-ab84-2205899d653e", "address": "fa:16:3e:41:22:00", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde633ad4-a9", "ovs_interfaceid": "de633ad4-a9b9-4707-ab84-2205899d653e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:46:31.740411 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:46:31.742183 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1620368054', uuid='032576d0-ced0-4686-8aad-26b4e06a4d67'), owner=OwnerMeta(userid='ada528b0c5c740799599a2b163709a87', username='tempest-TestEncryptedCinderVolumes-324201327-project-member', projectid='7041ddbe11174207bbc7363b3bf08af5', projectname='tempest-TestEncryptedCinderVolumes-324201327'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "de633ad4-a9b9-4707-ab84-2205899d653e", "address": "fa:16:3e:41:22:00", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde633ad4-a9", "ovs_interfaceid": "de633ad4-a9b9-4707-ab84-2205899d653e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779165991.7416623) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:46:31.743743 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:46:31.744211 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:46:31.745303 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:46:31.745545 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:46:31.746781 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:46:31.747266 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:46:31.747673 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:46:31.747673 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:46:31.747832 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:46:31.747901 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:46:31.748028 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:46:31.748267 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:46:31.748444 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:46:31.748665 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:46:31.748843 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:46:31.748999 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:46:31.767687 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:46:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1620368054',display_name='tempest-TestEncryptedCinderVolumes-server-1620368054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testencryptedcindervolumes-server-1620368054',id=60,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKo53ovAvi14TqIRWZnvwRfNTlOR+i5s9AfjZ+3eUx31AmuLqFbDlL3lzVKNpoRTD4w7nDGwvwdz/UcCEXXNs5EWlHbL+yu6DqZLl93Hze/hZRkAw//UEOI3XvpaeRfqw==',key_name='tempest-keypair-630082317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7041ddbe11174207bbc7363b3bf08af5',ramdisk_id='',reservation_id='r-rhs1lwdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-324201327',owner_user_name='tempest-TestEncryptedCinderVolumes-324201327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:46:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada528b0c5c740799599a2b163709a87',uuid=032576d0-ced0-4686-8aad-26b4e06a4d67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de633ad4-a9b9-4707-ab84-2205899d653e", "address": "fa:16:3e:41:22:00", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde633ad4-a9", "ovs_interfaceid": "de633ad4-a9b9-4707-ab84-2205899d653e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:46:31.767687 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Converting VIF {"id": "de633ad4-a9b9-4707-ab84-2205899d653e", "address": "fa:16:3e:41:22:00", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde633ad4-a9", "ovs_interfaceid": "de633ad4-a9b9-4707-ab84-2205899d653e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:46:31.768010 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:22:00,bridge_name='br-int',has_traffic_filtering=True,id=de633ad4-a9b9-4707-ab84-2205899d653e,network=Network(1eda8fb0-3870-4644-873a-b485fff9e767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde633ad4-a9') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:46:31.768580 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lazy-loading 'pci_devices' on Instance uuid 032576d0-ced0-4686-8aad-26b4e06a4d67 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:32.057479 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'flavor' on Instance uuid 9df306ad-76ad-4edb-9c21-6efab9d0a26e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:32.271199 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] End _get_guest_xml xml=<domain type="qemu">
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:   <uuid>032576d0-ced0-4686-8aad-26b4e06a4d67</uuid>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:   <name>instance-0000003c</name>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1620368054</nova:name>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:46:31</nova:creationTime>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:         <nova:user uuid="ada528b0c5c740799599a2b163709a87">tempest-TestEncryptedCinderVolumes-324201327-project-member</nova:user>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:         <nova:project uuid="7041ddbe11174207bbc7363b3bf08af5">tempest-TestEncryptedCinderVolumes-324201327</nova:project>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:         <nova:port uuid="de633ad4-a9b9-4707-ab84-2205899d653e">
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     <system>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <entry name="serial">032576d0-ced0-4686-8aad-26b4e06a4d67</entry>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <entry name="uuid">032576d0-ced0-4686-8aad-26b4e06a4d67</entry>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     </system>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:   <os>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:   </os>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:   <features>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:   </features>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:   <devices>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/032576d0-ced0-4686-8aad-26b4e06a4d67/disk"/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     </disk>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/032576d0-ced0-4686-8aad-26b4e06a4d67/disk.config"/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     </disk>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:41:22:00"/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <target dev="tapde633ad4-a9"/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     </interface>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/032576d0-ced0-4686-8aad-26b4e06a4d67/console.log" append="off"/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     </serial>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     <video>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     </video>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     </rng>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:   </devices>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]: </domain>
May 19 04:46:32.271199 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:46:32.273511 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Preparing to wait for external event network-vif-plugged-de633ad4-a9b9-4707-ab84-2205899d653e {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:46:32.273511 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "032576d0-ced0-4686-8aad-26b4e06a4d67-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:32.273511 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "032576d0-ced0-4686-8aad-26b4e06a4d67-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:32.273511 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "032576d0-ced0-4686-8aad-26b4e06a4d67-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:32.273511 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:46:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1620368054',display_name='tempest-TestEncryptedCinderVolumes-server-1620368054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testencryptedcindervolumes-server-1620368054',id=60,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKo53ovAvi14TqIRWZnvwRfNTlOR+i5s9AfjZ+3eUx31AmuLqFbDlL3lzVKNpoRTD4w7nDGwvwdz/UcCEXXNs5EWlHbL+yu6DqZLl93Hze/hZRkAw//UEOI3XvpaeRfqw==',key_name='tempest-keypair-630082317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7041ddbe11174207bbc7363b3bf08af5',ramdisk_id='',reservation_id='r-rhs1lwdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-324201327',owner_user_name='tempest-TestEncryptedCinderVolumes-324201327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:46:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada528b0c5c740799599a2b163709a87',uuid=032576d0-ced0-4686-8aad-26b4e06a4d67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de633ad4-a9b9-4707-ab84-2205899d653e", "address": "fa:16:3e:41:22:00", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde633ad4-a9", "ovs_interfaceid": "de633ad4-a9b9-4707-ab84-2205899d653e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:46:32.273511 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Converting VIF {"id": "de633ad4-a9b9-4707-ab84-2205899d653e", "address": "fa:16:3e:41:22:00", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde633ad4-a9", "ovs_interfaceid": "de633ad4-a9b9-4707-ab84-2205899d653e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:46:32.273511 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:22:00,bridge_name='br-int',has_traffic_filtering=True,id=de633ad4-a9b9-4707-ab84-2205899d653e,network=Network(1eda8fb0-3870-4644-873a-b485fff9e767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde633ad4-a9') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:46:32.273511 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:22:00,bridge_name='br-int',has_traffic_filtering=True,id=de633ad4-a9b9-4707-ab84-2205899d653e,network=Network(1eda8fb0-3870-4644-873a-b485fff9e767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde633ad4-a9') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:46:32.273877 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:32.273877 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:46:32.274129 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:46:32.274755 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:32.274882 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06f3b729-9ace-592f-8369-33f305ec08dd', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:46:32.280935 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:32.281670 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:46:32.282008 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:32.284344 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:32.284496 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde633ad4-a9, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:46:32.284795 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde633ad4-a9, col_values=(('qos', UUID('4b81c422-7512-4e12-b934-ad6588ff1680')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:46:32.284971 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde633ad4-a9, col_values=(('external_ids', {'iface-id': 'de633ad4-a9b9-4707-ab84-2205899d653e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:22:00', 'vm-uuid': '032576d0-ced0-4686-8aad-26b4e06a4d67'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:46:32.285785 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:32.287159 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:46:32.291775 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:32.292469 np0000001025 nova-compute[97981]: INFO os_vif [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:22:00,bridge_name='br-int',has_traffic_filtering=True,id=de633ad4-a9b9-4707-ab84-2205899d653e,network=Network(1eda8fb0-3870-4644-873a-b485fff9e767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde633ad4-a9')
May 19 04:46:32.884926 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:46:32.885072 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:46:32.885202 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:46:32.885333 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] No VIF found with MAC fa:16:3e:33:f8:14, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:46:33.063672 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:33.424187 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:33.806270 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:46:33.806416 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:46:33.806462 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] No VIF found with MAC fa:16:3e:41:22:00, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:46:33.806838 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Using config drive
May 19 04:46:34.117997 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:46:34.118540 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.50 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:46:34.167913 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:34.168409 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:34.168571 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Attaching volume c78491f7-5078-428f-b0f7-542483ef376f to /dev/vdb
May 19 04:46:34.209025 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:46:34.219890 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:46:34.241168 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:34.293883 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:46:34.294239 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:46:34.303907 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:46:34.305568 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fe33:f814', 'fe80::8008:f5ff:fe5e:1a35', 'fe80::fc16:3eff:fede:fe78', 'fe80::bc2a:1ff:fe94:f24f', 'fe80::fc16:3eff:fe95:86d9', 'fe80::bc20:d2ff:fef5:7278', 'fe80::fc16:3eff:fea9:81c2', 'fe80::b02a:c2ff:fe71:d502'] 
May 19 04:46:34.306174 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:46:34.306174 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:46:34.306315 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:46:34.306670 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Updating existing volume attachment record: a21641d5-4f9b-4250-ab10-a462557ef88d {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:46:34.315489 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:34.431494 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-affc26ec-5e05-451d-81ed-fbc2b8be9837 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "e2017472-4da3-4676-b614-3e7039fedef3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.395s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:34.442048 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Creating config drive at /opt/stack/data/nova/instances/032576d0-ced0-4686-8aad-26b4e06a4d67/disk.config
May 19 04:46:34.448951 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/032576d0-ced0-4686-8aad-26b4e06a4d67/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd_as6aft {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:34.516887 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/032576d0-ced0-4686-8aad-26b4e06a4d67/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd_as6aft" returned: 0 in 0.068s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:34.867575 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:46:34.867880 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f', 'iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c78491f7-5078-428f-b0f7-542483ef376f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:46:34.868023 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:46:34.868448 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:46:34.868634 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f', 'iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c78491f7-5078-428f-b0f7-542483ef376f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:46:34.881389 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:46:34.882178 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:46:34.882755 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:46:34.882977 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:46:34.883483 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:46:34.883725 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:46:34.894202 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:46:34.894202 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:34.899086 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:46:34.899086 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:34.905258 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f] added
May 19 04:46:34.905258 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:46:34.905258 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:46:34.905258 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:46:34.905258 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:46:34.905258 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:46:34.905258 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:34.905555 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:46:34.905712 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0227(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:46:34.905867 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:46:34.910435 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:34.912407 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f] added
May 19 04:46:34.912407 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:46:34.912407 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:46:34.912407 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:46:34.912407 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:46:34.912407 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:46:34.912407 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:34.912669 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:46:34.912770 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.029(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:46:34.912896 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:46:34.935892 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:34.938195 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:35.017295 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:35.047014 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Rescuing
May 19 04:46:35.047270 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "refresh_cache-e2017472-4da3-4676-b614-3e7039fedef3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:46:35.047399 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquired lock "refresh_cache-e2017472-4da3-4676-b614-3e7039fedef3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:46:35.047531 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:46:35.072117 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2bce7d2e-7fc2-49d9-bb1f-794aec26ee2a req-b6a8a56b-efe6-43db-abb1-9e089babebee service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Received event network-vif-plugged-de633ad4-a9b9-4707-ab84-2205899d653e {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:35.072354 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2bce7d2e-7fc2-49d9-bb1f-794aec26ee2a req-b6a8a56b-efe6-43db-abb1-9e089babebee service nova] Acquiring lock "032576d0-ced0-4686-8aad-26b4e06a4d67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:35.072801 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2bce7d2e-7fc2-49d9-bb1f-794aec26ee2a req-b6a8a56b-efe6-43db-abb1-9e089babebee service nova] Lock "032576d0-ced0-4686-8aad-26b4e06a4d67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:35.072930 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2bce7d2e-7fc2-49d9-bb1f-794aec26ee2a req-b6a8a56b-efe6-43db-abb1-9e089babebee service nova] Lock "032576d0-ced0-4686-8aad-26b4e06a4d67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:35.073056 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2bce7d2e-7fc2-49d9-bb1f-794aec26ee2a req-b6a8a56b-efe6-43db-abb1-9e089babebee service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Processing event network-vif-plugged-de633ad4-a9b9-4707-ab84-2205899d653e {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:46:35.223880 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:35.225296 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:35.229977 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:35.232398 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:35.249939 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:35.549706 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:35.614990 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:46:35.615269 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:46:35.615443 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Cleaning up deleted instances {{(pid=97981) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 19 04:46:35.667958 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:46:35.668581 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165995.6682274, 032576d0-ced0-4686-8aad-26b4e06a4d67 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:46:35.668748 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] VM Started (Lifecycle Event)
May 19 04:46:35.670132 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:46:35.676086 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Instance spawned successfully.
May 19 04:46:35.676461 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:46:35.841400 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:35.906367 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:46:35.913277 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:46:35.920410 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:46:35.920410 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:46:35.929044 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:46:35.929044 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:35.938254 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:35.943237 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:35.954024 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:35.954024 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:35.954024 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:35.954024 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:35.954024 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:35.954317 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:35.954317 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:35.954317 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:35.954317 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:35.954317 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:35.960323 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:35.960323 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:35.960323 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:35.960323 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:35.960323 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:35.960606 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:35.960606 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:35.960606 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:35.960606 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:35.960606 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:35.977425 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Updating instance_info_cache with network_info: [{"id": "381aabe0-261a-4722-a473-90dd923ddd70", "address": "fa:16:3e:33:f8:14", "network": {"id": "502bb41d-fb0e-4491-9039-68b5fde2624f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-951372128-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f892ab02546d4b6295c6abf1e79121ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap381aabe0-26", "ovs_interfaceid": "381aabe0-261a-4722-a473-90dd923ddd70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:46:35.988651 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f, portal: 192.168.40.100,3260]
May 19 04:46:35.988651 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f, portal: 192.168.40.100,3260] successful.
May 19 04:46:35.988651 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:35.999721 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:36.005243 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f, portal: 192.168.50.100,3260]
May 19 04:46:36.005243 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f, portal: 192.168.50.100,3260] successful.
May 19 04:46:36.005243 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:36.014027 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:36.014027 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:36.014027 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:36.014027 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:36.014027 np0000001025 nova-compute[97981]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:36.014027 np0000001025 nova-compute[97981]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:36.014027 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:36.014327 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:36.014327 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:36.014327 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:36.014327 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:36.014327 np0000001025 nova-compute[97981]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:36.014327 np0000001025 nova-compute[97981]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:36.014327 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:36.014837 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.132s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:46:36.014837 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:46:36.015869 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] HCTL ('11', '-', '-', 0) found on session 131 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:46:36.015992 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:46:36.017841 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:36.033422 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Searching for a device in session 131 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:46:36.033605 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c78491f7-5078-428f-b0f7-542483ef376f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:46:36.041268 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:36.041268 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:36.041268 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:36.041268 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:36.041268 np0000001025 nova-compute[97981]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:36.041268 np0000001025 nova-compute[97981]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:36.041268 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:36.041495 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:36.041495 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:36.041495 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:36.041495 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:36.041495 np0000001025 nova-compute[97981]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:36.041495 np0000001025 nova-compute[97981]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:36.041495 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:36.041970 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:46:36.041970 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:46:36.043578 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] HCTL ('12', '-', '-', 0) found on session 132 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:46:36.043578 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:46:36.059408 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Searching for a device in session 132 and hctl ['12', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:46:36.117572 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] There are 0 instances to clean {{(pid=97981) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 19 04:46:36.119357 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:46:36.172811 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:46:36.177223 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:46:36.186347 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:46:36.186517 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:46:36.186911 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:46:36.187210 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:46:36.187584 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:46:36.187926 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:46:36.479337 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Releasing lock "refresh_cache-e2017472-4da3-4676-b614-3e7039fedef3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:46:36.680778 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:46:36.681271 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165996.6808326, 032576d0-ced0-4686-8aad-26b4e06a4d67 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:46:36.681271 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] VM Paused (Lifecycle Event)
May 19 04:46:36.693534 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Took 6.51 seconds to spawn the instance on the hypervisor.
May 19 04:46:36.693866 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:46:37.060132 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Searching for a device in session 132 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:46:37.060373 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c78491f7-5078-428f-b0f7-542483ef376f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:46:37.114744 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:46:37.115149 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:46:37.126029 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-99e908fe-211a-4af3-acaa-7593b96d2b37 req-62999ca3-40c3-43c7-a518-c347f069b8dc service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Received event network-vif-plugged-de633ad4-a9b9-4707-ab84-2205899d653e {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:37.126243 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-99e908fe-211a-4af3-acaa-7593b96d2b37 req-62999ca3-40c3-43c7-a518-c347f069b8dc service nova] Acquiring lock "032576d0-ced0-4686-8aad-26b4e06a4d67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:37.126431 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-99e908fe-211a-4af3-acaa-7593b96d2b37 req-62999ca3-40c3-43c7-a518-c347f069b8dc service nova] Lock "032576d0-ced0-4686-8aad-26b4e06a4d67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:37.126563 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-99e908fe-211a-4af3-acaa-7593b96d2b37 req-62999ca3-40c3-43c7-a518-c347f069b8dc service nova] Lock "032576d0-ced0-4686-8aad-26b4e06a4d67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:37.126923 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-99e908fe-211a-4af3-acaa-7593b96d2b37 req-62999ca3-40c3-43c7-a518-c347f069b8dc service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] No waiting events found dispatching network-vif-plugged-de633ad4-a9b9-4707-ab84-2205899d653e {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:46:37.127040 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-99e908fe-211a-4af3-acaa-7593b96d2b37 req-62999ca3-40c3-43c7-a518-c347f069b8dc service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Received unexpected event network-vif-plugged-de633ad4-a9b9-4707-ab84-2205899d653e for instance with vm_state active and task_state None.
May 19 04:46:37.183429 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:46:37.185737 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779165997.1854684, 032576d0-ced0-4686-8aad-26b4e06a4d67 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:46:37.185917 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] VM Resumed (Lifecycle Event)
May 19 04:46:37.203433 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Took 11.90 seconds to build instance.
May 19 04:46:37.288800 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:37.614880 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:46:37.615333 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:46:37.688382 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:46:37.690712 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:46:37.704980 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "032576d0-ced0-4686-8aad-26b4e06a4d67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.409s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:37.902444 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Found WWN 3300000006930b910 for multipath device dm-4 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:46:37.902764 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:46:37.903050 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '3300000006930b910', 'path': '/dev/dm-4', 'multipath_id': '3300000006930b910'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:46:37.903196 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006930b910', 'path': '/dev/dm-4', 'multipath_id': '3300000006930b910'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:46:37.905631 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'flavor' on Instance uuid 9df306ad-76ad-4edb-9c21-6efab9d0a26e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:38.093254 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:38.096925 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:38.114964 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:38.138760 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:38.408568 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Attempting to attach volume c78491f7-5078-428f-b0f7-542483ef376f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:46:38.409831 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999607518000175 future=<Future at 0x7218500f9be0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:46:38.410401 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999008890999903 future=<Future at 0x7218500f9be0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:46:38.411029 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:46:38.411029 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:46:38.411029 np0000001025 nova-compute[97981]:   <alias name="ua-c78491f7-5078-428f-b0f7-542483ef376f"/>
May 19 04:46:38.411029 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-4"/>
May 19 04:46:38.411029 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:46:38.411029 np0000001025 nova-compute[97981]:   <serial>c78491f7-5078-428f-b0f7-542483ef376f</serial>
May 19 04:46:38.411029 np0000001025 nova-compute[97981]: </disk>
May 19 04:46:38.411029 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:46:38.411301 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.998217034999925 future=<Future at 0x7218500f9be0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:46:38.411785 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Instance destroyed successfully.
May 19 04:46:38.411864 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lazy-loading 'numa_topology' on Instance uuid e2017472-4da3-4676-b614-3e7039fedef3 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:38.426742 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:38.461403 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d3dea3bc-7c82-46ea-9fd0-d4e882630c85 req-acca6f6f-764e-45f4-b231-85d21f20d9c9 service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Received event network-changed-de633ad4-a9b9-4707-ab84-2205899d653e {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:38.461743 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d3dea3bc-7c82-46ea-9fd0-d4e882630c85 req-acca6f6f-764e-45f4-b231-85d21f20d9c9 service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Refreshing instance network info cache due to event network-changed-de633ad4-a9b9-4707-ab84-2205899d653e. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:46:38.461917 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d3dea3bc-7c82-46ea-9fd0-d4e882630c85 req-acca6f6f-764e-45f4-b231-85d21f20d9c9 service nova] Acquiring lock "refresh_cache-032576d0-ced0-4686-8aad-26b4e06a4d67" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:46:38.462034 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d3dea3bc-7c82-46ea-9fd0-d4e882630c85 req-acca6f6f-764e-45f4-b231-85d21f20d9c9 service nova] Acquired lock "refresh_cache-032576d0-ced0-4686-8aad-26b4e06a4d67" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:46:38.462183 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d3dea3bc-7c82-46ea-9fd0-d4e882630c85 req-acca6f6f-764e-45f4-b231-85d21f20d9c9 service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Refreshing network info cache for port de633ad4-a9b9-4707-ab84-2205899d653e {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:46:38.916477 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Attempting a stable device rescue
May 19 04:46:38.964037 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-d3dea3bc-7c82-46ea-9fd0-d4e882630c85 req-acca6f6f-764e-45f4-b231-85d21f20d9c9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:39.003303 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=97981) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 19 04:46:39.007635 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Instance directory exists: not creating {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 19 04:46:39.007811 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Creating image(s)
May 19 04:46:39.008739 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:39.008892 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "/opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:39.009412 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "/opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:39.009609 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lazy-loading 'trusted_certs' on Instance uuid e2017472-4da3-4676-b614-3e7039fedef3 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:39.180603 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3c869eee-75d6-4370-8cf1-75edd54b3db5 req-464f6375-755d-4551-87c6-c979f365b97d service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received event network-vif-unplugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:39.180965 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3c869eee-75d6-4370-8cf1-75edd54b3db5 req-464f6375-755d-4551-87c6-c979f365b97d service nova] Acquiring lock "e2017472-4da3-4676-b614-3e7039fedef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:39.181156 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3c869eee-75d6-4370-8cf1-75edd54b3db5 req-464f6375-755d-4551-87c6-c979f365b97d service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:39.181259 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3c869eee-75d6-4370-8cf1-75edd54b3db5 req-464f6375-755d-4551-87c6-c979f365b97d service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:39.181375 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3c869eee-75d6-4370-8cf1-75edd54b3db5 req-464f6375-755d-4551-87c6-c979f365b97d service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] No waiting events found dispatching network-vif-unplugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:46:39.181494 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-3c869eee-75d6-4370-8cf1-75edd54b3db5 req-464f6375-755d-4551-87c6-c979f365b97d service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received unexpected event network-vif-unplugged-381aabe0-261a-4722-a473-90dd923ddd70 for instance with vm_state active and task_state rescuing.
May 19 04:46:39.181625 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3c869eee-75d6-4370-8cf1-75edd54b3db5 req-464f6375-755d-4551-87c6-c979f365b97d service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received event network-vif-unplugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:39.181772 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3c869eee-75d6-4370-8cf1-75edd54b3db5 req-464f6375-755d-4551-87c6-c979f365b97d service nova] Acquiring lock "e2017472-4da3-4676-b614-3e7039fedef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:39.181945 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3c869eee-75d6-4370-8cf1-75edd54b3db5 req-464f6375-755d-4551-87c6-c979f365b97d service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:39.182095 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3c869eee-75d6-4370-8cf1-75edd54b3db5 req-464f6375-755d-4551-87c6-c979f365b97d service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:39.182256 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3c869eee-75d6-4370-8cf1-75edd54b3db5 req-464f6375-755d-4551-87c6-c979f365b97d service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] No waiting events found dispatching network-vif-unplugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:46:39.182449 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-3c869eee-75d6-4370-8cf1-75edd54b3db5 req-464f6375-755d-4551-87c6-c979f365b97d service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received unexpected event network-vif-unplugged-381aabe0-261a-4722-a473-90dd923ddd70 for instance with vm_state active and task_state rescuing.
May 19 04:46:39.277755 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-d3dea3bc-7c82-46ea-9fd0-d4e882630c85 req-acca6f6f-764e-45f4-b231-85d21f20d9c9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:39.408079 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d3dea3bc-7c82-46ea-9fd0-d4e882630c85 req-acca6f6f-764e-45f4-b231-85d21f20d9c9 service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Updated VIF entry in instance network info cache for port de633ad4-a9b9-4707-ab84-2205899d653e. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:46:39.408545 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d3dea3bc-7c82-46ea-9fd0-d4e882630c85 req-acca6f6f-764e-45f4-b231-85d21f20d9c9 service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Updating instance_info_cache with network_info: [{"id": "de633ad4-a9b9-4707-ab84-2205899d653e", "address": "fa:16:3e:41:22:00", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde633ad4-a9", "ovs_interfaceid": "de633ad4-a9b9-4707-ab84-2205899d653e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:46:39.511651 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Object Instance<e2017472-4da3-4676-b614-3e7039fedef3> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:46:39.511966 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "b0ca7519b9015bba77155c63bf7466b89ff00117" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:39.512240 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "b0ca7519b9015bba77155c63bf7466b89ff00117" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:39.615348 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:46:39.615768 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:46:39.910660 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d3dea3bc-7c82-46ea-9fd0-d4e882630c85 req-acca6f6f-764e-45f4-b231-85d21f20d9c9 service nova] Releasing lock "refresh_cache-032576d0-ced0-4686-8aad-26b4e06a4d67" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:46:40.054086 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:46:40.054511 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:46:40.054511 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:46:40.054591 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No VIF found with MAC fa:16:3e:de:fe:78, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:46:40.181759 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:46:40.184627 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:46:40.184957 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0ca7519b9015bba77155c63bf7466b89ff00117.part --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:40.278035 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0ca7519b9015bba77155c63bf7466b89ff00117.part --force-share --output=json" returned: 0 in 0.093s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:40.278565 np0000001025 nova-compute[97981]: DEBUG nova.virt.images [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] 1fa710f5-7eec-4c41-9a37-8fa141fa073e was qcow2, converting to raw {{(pid=97981) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 19 04:46:40.279216 np0000001025 nova-compute[97981]: DEBUG nova.privsep.utils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97981) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 19 04:46:40.279486 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b0ca7519b9015bba77155c63bf7466b89ff00117.part /opt/stack/data/nova/instances/_base/b0ca7519b9015bba77155c63bf7466b89ff00117.converted {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:40.434439 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b0ca7519b9015bba77155c63bf7466b89ff00117.part /opt/stack/data/nova/instances/_base/b0ca7519b9015bba77155c63bf7466b89ff00117.converted" returned: 0 in 0.155s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:40.445546 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0ca7519b9015bba77155c63bf7466b89ff00117.converted --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:40.533905 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0ca7519b9015bba77155c63bf7466b89ff00117.converted --force-share --output=json" returned: 0 in 0.088s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:40.534662 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "b0ca7519b9015bba77155c63bf7466b89ff00117" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.022s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:40.535162 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:46:40.537816 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:46:40.538844 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "b0ca7519b9015bba77155c63bf7466b89ff00117" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:40.539221 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "b0ca7519b9015bba77155c63bf7466b89ff00117" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:40.539490 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:46:40.541557 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:46:40.541828 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0ca7519b9015bba77155c63bf7466b89ff00117 --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:40.615204 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:46:40.615697 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:46:40.630901 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0ca7519b9015bba77155c63bf7466b89ff00117 --force-share --output=json" returned: 0 in 0.089s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:40.631426 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b0ca7519b9015bba77155c63bf7466b89ff00117,backing_fmt=raw /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk.rescue {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:40.703690 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b0ca7519b9015bba77155c63bf7466b89ff00117,backing_fmt=raw /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk.rescue" returned: 0 in 0.072s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:40.704053 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "b0ca7519b9015bba77155c63bf7466b89ff00117" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.165s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:40.704392 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lazy-loading 'migration_context' on Instance uuid e2017472-4da3-4676-b614-3e7039fedef3 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:41.206821 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Object Instance<e2017472-4da3-4676-b614-3e7039fedef3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:46:41.207229 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:46:41.209386 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Start _get_guest_xml network_info=[{"id": "381aabe0-261a-4722-a473-90dd923ddd70", "address": "fa:16:3e:33:f8:14", "network": {"id": "502bb41d-fb0e-4491-9039-68b5fde2624f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-951372128-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-951372128-network", "vif_mac": "fa:16:3e:33:f8:14"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f892ab02546d4b6295c6abf1e79121ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap381aabe0-26", "ovs_interfaceid": "381aabe0-261a-4722-a473-90dd923ddd70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1fa710f5-7eec-4c41-9a37-8fa141fa073e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '2145461f-df28-4a18-8211-6ec4d8d752c2', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '440133cc-e2e2-47e8-af85-891406649029', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': 'e2017472-4da3-4676-b614-3e7039fedef3', 'attached_at': '', 'detached_at': '', 'volume_id': '440133cc-e2e2-47e8-af85-891406649029', 'serial': '440133cc-e2e2-47e8-af85-891406649029'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:46:41.209534 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lazy-loading 'resources' on Instance uuid e2017472-4da3-4676-b614-3e7039fedef3 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:41.610514 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-eb4cac6d-7f33-43ae-8b9f-9577618bfd15 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.442s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:41.614982 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:46:41.614982 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:46:41.615337 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:46:41.711351 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Object Instance<e2017472-4da3-4676-b614-3e7039fedef3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:46:41.719659 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:46:41.721086 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-1645383300', uuid='e2017472-4da3-4676-b614-3e7039fedef3'), owner=OwnerMeta(userid='71fd665949ed42008ee194558e5a8f1a', username='tempest-ServerStableDeviceRescueTest-1373788552-project-member', projectid='f892ab02546d4b6295c6abf1e79121ce', projectname='tempest-ServerStableDeviceRescueTest-1373788552'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "381aabe0-261a-4722-a473-90dd923ddd70", "address": "fa:16:3e:33:f8:14", "network": {"id": "502bb41d-fb0e-4491-9039-68b5fde2624f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-951372128-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-951372128-network", "vif_mac": "fa:16:3e:33:f8:14"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f892ab02546d4b6295c6abf1e79121ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap381aabe0-26", "ovs_interfaceid": "381aabe0-261a-4722-a473-90dd923ddd70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166001.720678) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:46:41.724564 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:46:41.724957 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:46:41.728345 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:46:41.732132 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:46:41.732132 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:46:41.732132 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:46:41.732132 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:46:41.732132 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:46:41.732132 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:46:41.732132 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:46:41.732132 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:46:41.732132 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:46:41.732132 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:46:41.732132 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:46:41.732132 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:46:41.732132 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:46:41.732132 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lazy-loading 'vcpu_model' on Instance uuid e2017472-4da3-4676-b614-3e7039fedef3 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:42.238140 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Object Instance<e2017472-4da3-4676-b614-3e7039fedef3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:46:42.246711 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk.config --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:42.291008 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:42.340940 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk.config --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:42.343984 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:42.343984 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "/opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:42.343984 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "/opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:42.343984 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:46:42.343984 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '440133cc-e2e2-47e8-af85-891406649029', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:46:42.343984 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:46:42.343984 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:46:42.343984 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '440133cc-e2e2-47e8-af85-891406649029', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:46:42.355490 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:46:42.355860 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:46:42.356071 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:46:42.356893 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:46:42.357658 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:46:42.357865 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.startup = automatic
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.scan = manual
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:46:42.367332 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:46:42.367332 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.startup = automatic
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.scan = manual
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:46:42.375280 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:46:42.375280 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:42.379230 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:42.385692 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:42.392710 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:42.392710 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:42.392710 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:42.392710 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:42.392710 np0000001025 nova-compute[97981]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:42.392710 np0000001025 nova-compute[97981]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:42.392710 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:42.392976 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:42.392976 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:42.392976 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:42.392976 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:42.392976 np0000001025 nova-compute[97981]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:42.392976 np0000001025 nova-compute[97981]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:42.392976 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:42.393091 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.037s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:46:42.394126 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:46:42.394126 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] HCTL ('7', '0', '0', 0) found on session 129 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:46:42.394126 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:46:42.400119 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:42.400119 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:42.400119 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:42.400119 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:42.400119 np0000001025 nova-compute[97981]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:42.400119 np0000001025 nova-compute[97981]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:42.400119 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:42.400301 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:42.400301 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:42.400301 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:42.400301 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:42.400301 np0000001025 nova-compute[97981]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:42.400301 np0000001025 nova-compute[97981]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:42.400301 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:42.400538 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.043s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:46:42.400627 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:46:42.401093 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] HCTL ('8', '0', '0', 0) found on session 130 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:46:42.401216 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:46:42.407056 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Searching for a device in session 129 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:46:42.407239 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '440133cc-e2e2-47e8-af85-891406649029', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:46:42.408641 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Searching for a device in session 130 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:46:42.408780 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '440133cc-e2e2-47e8-af85-891406649029', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:46:42.614940 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:46:42.736420 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:42.736782 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:43.121497 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:43.121707 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:43.121838 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:43.122056 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:46:43.240296 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'flavor' on Instance uuid 9df306ad-76ad-4edb-9c21-6efab9d0a26e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:43.358977 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:46:43.427976 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:44.149508 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032576d0-ced0-4686-8aad-26b4e06a4d67/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:44.243590 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032576d0-ced0-4686-8aad-26b4e06a4d67/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:44.244119 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032576d0-ced0-4686-8aad-26b4e06a4d67/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:44.262574 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.522s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:44.339969 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032576d0-ced0-4686-8aad-26b4e06a4d67/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:44.344541 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df306ad-76ad-4edb-9c21-6efab9d0a26e/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:44.375228 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Found WWN 330000000f0eff326 for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:46:44.376229 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.032s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:46:44.376556 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] <== connect_volume: return (2032ms) {'type': 'block', 'scsi_wwn': '330000000f0eff326', 'path': '/dev/dm-0', 'multipath_id': '330000000f0eff326'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:46:44.376709 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f0eff326', 'path': '/dev/dm-0', 'multipath_id': '330000000f0eff326'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:46:44.430725 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df306ad-76ad-4edb-9c21-6efab9d0a26e/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:44.431303 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df306ad-76ad-4edb-9c21-6efab9d0a26e/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:44.522424 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9df306ad-76ad-4edb-9c21-6efab9d0a26e/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:44.523048 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:46:44.528603 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:44.629716 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:44.630354 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:44.717020 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:44.717560 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:46:44.721596 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:46:44.722903 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b7f14-f27a-4c7b-a39e-fd7c75d93117/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:44.816938 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b7f14-f27a-4c7b-a39e-fd7c75d93117/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:44.817355 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b7f14-f27a-4c7b-a39e-fd7c75d93117/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:44.888431 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:45:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1645383300',display_name='tempest-ServerStableDeviceRescueTest-server-1645383300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverstabledevicerescuetest-server-1645383300',id=56,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmxK8WyxxhAZNJAGW9uj5RApz4FkMYnu+jzzwFf9ZoRxi4XmMIeQ6coYidX3UcBjBPKUfhayqmjiBIQ5+6lbotN9MsTrUqZ3reOtIllIXaAg6VTnfB25fPMIGjifc5wrA==',key_name='tempest-keypair-32905224',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:45:36Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f892ab02546d4b6295c6abf1e79121ce',ramdisk_id='',reservation_id='r-7myclumk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1373788552',owner_user_name='tempest-ServerStableDeviceRescueTest-1373788552-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:46:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71fd665949ed42008ee194558e5a8f1a',uuid=e2017472-4da3-4676-b614-3e7039fedef3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "381aabe0-261a-4722-a473-90dd923ddd70", "address": "fa:16:3e:33:f8:14", "network": {"id": "502bb41d-fb0e-4491-9039-68b5fde2624f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-951372128-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-951372128-network", "vif_mac": "fa:16:3e:33:f8:14"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f892ab02546d4b6295c6abf1e79121ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap381aabe0-26", "ovs_interfaceid": "381aabe0-261a-4722-a473-90dd923ddd70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:46:44.889154 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Converting VIF {"id": "381aabe0-261a-4722-a473-90dd923ddd70", "address": "fa:16:3e:33:f8:14", "network": {"id": "502bb41d-fb0e-4491-9039-68b5fde2624f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-951372128-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-951372128-network", "vif_mac": "fa:16:3e:33:f8:14"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f892ab02546d4b6295c6abf1e79121ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap381aabe0-26", "ovs_interfaceid": "381aabe0-261a-4722-a473-90dd923ddd70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:46:44.890307 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:f8:14,bridge_name='br-int',has_traffic_filtering=True,id=381aabe0-261a-4722-a473-90dd923ddd70,network=Network(502bb41d-fb0e-4491-9039-68b5fde2624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap381aabe0-26') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:46:44.891497 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lazy-loading 'pci_devices' on Instance uuid e2017472-4da3-4676-b614-3e7039fedef3 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:44.902499 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7b7f14-f27a-4c7b-a39e-fd7c75d93117/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:44.907935 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:46:44.908978 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:44.959026 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:44.959578 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=12961MB free_disk=72.85154342651367GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:46:44.959729 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:44.960029 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:45.314929 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:45.315318 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:45.315370 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Attaching volume edd497fb-e976-4ff9-ace8-23e7d6113daf to /dev/vdc
May 19 04:46:45.358397 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:46:45.369791 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:46:45.393366 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:45.407172 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Object Instance<e2017472-4da3-4676-b614-3e7039fedef3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:46:45.410628 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] End _get_guest_xml xml=<domain type="qemu">
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:   <uuid>e2017472-4da3-4676-b614-3e7039fedef3</uuid>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:   <name>instance-00000038</name>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1645383300</nova:name>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:46:41</nova:creationTime>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:           <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:           <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:         <nova:user uuid="71fd665949ed42008ee194558e5a8f1a">tempest-ServerStableDeviceRescueTest-1373788552-project-member</nova:user>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:         <nova:project uuid="f892ab02546d4b6295c6abf1e79121ce">tempest-ServerStableDeviceRescueTest-1373788552</nova:project>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:         <nova:port uuid="381aabe0-261a-4722-a473-90dd923ddd70">
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     <system>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <entry name="serial">e2017472-4da3-4676-b614-3e7039fedef3</entry>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <entry name="uuid">e2017472-4da3-4676-b614-3e7039fedef3</entry>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     </system>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:   <os>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:   </os>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:   <features>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:   </features>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:   <devices>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     </disk>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk.config"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     </disk>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <alias name="ua-440133cc-e2e2-47e8-af85-891406649029"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-0"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <target dev="vdb" bus="virtio"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <serial>440133cc-e2e2-47e8-af85-891406649029</serial>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     </disk>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk.rescue"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <target dev="vdc" bus="virtio"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <boot order="1"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     </disk>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:33:f8:14"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <target dev="tap381aabe0-26"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     </interface>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/console.log" append="off"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     </serial>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     <video>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     </video>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     </rng>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:   </devices>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]: </domain>
May 19 04:46:45.410628 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:46:45.420708 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Instance destroyed successfully.
May 19 04:46:45.437137 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:46:45.437720 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:46:45.449251 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:46:45.450753 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fede:fe78', 'fe80::bc2a:1ff:fe94:f24f', 'fe80::fc16:3eff:fe95:86d9', 'fe80::bc20:d2ff:fef5:7278', 'fe80::fc16:3eff:fea9:81c2', 'fe80::b02a:c2ff:fe71:d502', 'fe80::fc16:3eff:fe41:2200', 'fe80::808a:12ff:fe91:c161'] 
May 19 04:46:45.450929 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:46:45.451084 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:46:45.451432 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:46:45.451697 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Updating existing volume attachment record: 650b2a43-c6b8-4e6f-8dfc-789f5cd8ac11 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:46:46.020002 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:46:46.020530 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf', 'iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'edd497fb-e976-4ff9-ace8-23e7d6113daf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:46:46.020755 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:46:46.022088 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:46:46.022088 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf', 'iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'edd497fb-e976-4ff9-ace8-23e7d6113daf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:46:46.038427 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:46:46.039212 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:46:46.039802 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:46:46.040027 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:46:46.040519 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:46:46.040797 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:46:46.052587 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:46:46.052587 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:46.057139 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:46:46.057139 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:46.068924 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf] added
May 19 04:46:46.068924 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:46:46.068924 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:46:46.068924 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:46:46.068924 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:46:46.068924 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:46:46.068924 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:46.069166 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:46:46.069383 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0292(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:46:46.069503 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:46:46.069747 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf] added
May 19 04:46:46.069747 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:46:46.069747 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:46:46.069747 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:46:46.069747 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:46:46.069747 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:46:46.069747 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:46.069909 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:46:46.070054 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0293(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:46:46.070240 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:46:46.116783 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance e2017472-4da3-4676-b614-3e7039fedef3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:46:46.116974 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 9df306ad-76ad-4edb-9c21-6efab9d0a26e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:46:46.117081 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance ab009682-2d6f-4f7a-b23d-95fd5f4d3f15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:46:46.117188 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:46:46.117275 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 032576d0-ced0-4686-8aad-26b4e06a4d67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:46:46.117469 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:46:46.117604 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:46:44 up 37 min,  2 users,  load average: 4.23, 5.51, 4.11\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_rescuing': '1', 'num_os_type_None': '5', 'num_proj_f892ab02546d4b6295c6abf1e79121ce': '1', 'io_workload': '1', 'num_task_None': '4', 'num_proj_662c1a9b25e44aff8242f468232af7f3': '1', 'num_proj_28b3c0fa8f894ed2a7c3bcfac99ce74c': '1', 'num_proj_ec4a48491cc047108747a22e8c63c3ac': '1', 'num_proj_7041ddbe11174207bbc7363b3bf08af5': '1'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:46:46.386158 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:46:46.386599 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:46:46.889177 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:46:46.939425 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:46:46.939647 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:46:46.939805 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:46:46.939974 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:46:46.940180 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] No VIF found with MAC fa:16:3e:33:f8:14, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:46:46.940928 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Using config drive
May 19 04:46:47.070054 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:46:47.070629 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:46:47.083328 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:46:47.083328 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:46:47.088897 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:46:47.088897 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:47.095548 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:47.102865 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:47.111010 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:47.111010 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:47.111010 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:47.111010 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:47.111010 np0000001025 nova-compute[97981]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:47.111010 np0000001025 nova-compute[97981]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:47.111010 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:47.111267 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:47.111267 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:47.111267 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:47.111267 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:47.111267 np0000001025 nova-compute[97981]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:47.111267 np0000001025 nova-compute[97981]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:47.111267 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:47.120487 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:47.120487 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:47.120487 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:47.120487 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:47.120487 np0000001025 nova-compute[97981]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:47.120487 np0000001025 nova-compute[97981]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:47.120487 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:47.120677 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:47.120677 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:47.120677 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:47.120677 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:47.120677 np0000001025 nova-compute[97981]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:47.120677 np0000001025 nova-compute[97981]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:47.120677 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:47.150961 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf, portal: 192.168.50.100,3260]
May 19 04:46:47.150961 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf, portal: 192.168.50.100,3260] successful.
May 19 04:46:47.150961 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:47.162660 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf, portal: 192.168.40.100,3260]
May 19 04:46:47.162660 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf, portal: 192.168.40.100,3260] successful.
May 19 04:46:47.162660 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:47.167611 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:47.177329 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:47.185038 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:47.185038 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:47.185038 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:47.185038 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:47.185038 np0000001025 nova-compute[97981]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:47.185038 np0000001025 nova-compute[97981]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:47.185038 np0000001025 nova-compute[97981]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:47.185038 np0000001025 nova-compute[97981]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:47.185038 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:47.185465 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:47.185465 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:47.185465 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:47.185465 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:47.185465 np0000001025 nova-compute[97981]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:47.185465 np0000001025 nova-compute[97981]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:47.185465 np0000001025 nova-compute[97981]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:47.185465 np0000001025 nova-compute[97981]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:47.185465 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:47.185465 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:46:47.185809 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:46:47.186543 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] HCTL ('13', '-', '-', 0) found on session 133 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:46:47.186647 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:46:47.194527 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:47.194527 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:47.194527 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:47.194527 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:47.194527 np0000001025 nova-compute[97981]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:47.194527 np0000001025 nova-compute[97981]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:47.194527 np0000001025 nova-compute[97981]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:47.194527 np0000001025 nova-compute[97981]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:47.194527 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:47.194754 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:47.194754 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:47.194754 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:47.194754 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:47.194754 np0000001025 nova-compute[97981]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:47.194754 np0000001025 nova-compute[97981]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:47.194754 np0000001025 nova-compute[97981]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:47.194754 np0000001025 nova-compute[97981]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:47.194754 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:47.194969 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:46:47.195027 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:46:47.196012 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] HCTL ('14', '-', '-', 0) found on session 134 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:46:47.196118 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:46:47.203475 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Searching for a device in session 133 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:46:47.203698 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'edd497fb-e976-4ff9-ace8-23e7d6113daf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:46:47.210491 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Searching for a device in session 134 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:46:47.210772 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'edd497fb-e976-4ff9-ace8-23e7d6113daf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:46:47.293725 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:47.398897 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:46:47.399406 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.439s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:47.399495 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:46:47.444310 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lazy-loading 'ec2_ids' on Instance uuid e2017472-4da3-4676-b614-3e7039fedef3 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:47.901293 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:46:47.947556 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Object Instance<e2017472-4da3-4676-b614-3e7039fedef3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:46:47.947719 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lazy-loading 'keypairs' on Instance uuid e2017472-4da3-4676-b614-3e7039fedef3 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:48.040343 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:46:48.430988 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:48.450082 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Object Instance<e2017472-4da3-4676-b614-3e7039fedef3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:46:48.452683 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:48.572450 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Creating config drive at /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk.config.rescue
May 19 04:46:48.576328 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx0idr5m_ {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:48.631515 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx0idr5m_" returned: 0 in 0.055s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:46:49.055570 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Found WWN 330000000acbf7949 for multipath device dm-5 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:46:49.056061 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:46:49.056278 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000acbf7949', 'path': '/dev/dm-5', 'multipath_id': '330000000acbf7949'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:46:49.056502 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000acbf7949', 'path': '/dev/dm-5', 'multipath_id': '330000000acbf7949'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:46:49.064269 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'flavor' on Instance uuid 9df306ad-76ad-4edb-9c21-6efab9d0a26e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:49.077656 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:49.105345 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:49.111304 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:49.208126 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:49.283877 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-aaed838a-0957-4dc7-b387-d06ed48e11eb req-13d0114c-2ae7-4072-b8ce-0d33cfc1b2c7 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received event network-vif-plugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:49.283877 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-aaed838a-0957-4dc7-b387-d06ed48e11eb req-13d0114c-2ae7-4072-b8ce-0d33cfc1b2c7 service nova] Acquiring lock "e2017472-4da3-4676-b614-3e7039fedef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:49.283877 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-aaed838a-0957-4dc7-b387-d06ed48e11eb req-13d0114c-2ae7-4072-b8ce-0d33cfc1b2c7 service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:49.283877 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-aaed838a-0957-4dc7-b387-d06ed48e11eb req-13d0114c-2ae7-4072-b8ce-0d33cfc1b2c7 service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:49.283877 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-aaed838a-0957-4dc7-b387-d06ed48e11eb req-13d0114c-2ae7-4072-b8ce-0d33cfc1b2c7 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] No waiting events found dispatching network-vif-plugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:46:49.283877 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-aaed838a-0957-4dc7-b387-d06ed48e11eb req-13d0114c-2ae7-4072-b8ce-0d33cfc1b2c7 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received unexpected event network-vif-plugged-381aabe0-261a-4722-a473-90dd923ddd70 for instance with vm_state active and task_state rescuing.
May 19 04:46:49.413101 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:49.415886 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:49.418574 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:49.440977 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:49.568248 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Attempting to attach volume edd497fb-e976-4ff9-ace8-23e7d6113daf with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:46:49.569867 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:46:49.569867 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:46:49.569867 np0000001025 nova-compute[97981]:   <alias name="ua-edd497fb-e976-4ff9-ace8-23e7d6113daf"/>
May 19 04:46:49.569867 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-5"/>
May 19 04:46:49.569867 np0000001025 nova-compute[97981]:   <target dev="vdc" bus="virtio"/>
May 19 04:46:49.569867 np0000001025 nova-compute[97981]:   <serial>edd497fb-e976-4ff9-ace8-23e7d6113daf</serial>
May 19 04:46:49.569867 np0000001025 nova-compute[97981]: </disk>
May 19 04:46:49.569867 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:46:49.823032 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Removed pending STOPPED event for e2017472-4da3-4676-b614-3e7039fedef3 due to new event <LifecycleEvent: 1779166009.8226924, e2017472-4da3-4676-b614-3e7039fedef3 => Resumed> {{(pid=97981) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 19 04:46:49.826073 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166009.8226924, e2017472-4da3-4676-b614-3e7039fedef3 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:46:49.826073 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e2017472-4da3-4676-b614-3e7039fedef3] VM Resumed (Lifecycle Event)
May 19 04:46:49.827204 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-40b99f52-cc6e-438f-9585-2813be345356 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:46:50.329917 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:46:50.336131 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:46:50.838524 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166010.8368664, e2017472-4da3-4676-b614-3e7039fedef3 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:46:50.838524 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e2017472-4da3-4676-b614-3e7039fedef3] VM Started (Lifecycle Event)
May 19 04:46:50.882721 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-fe4161e6-7aac-44a1-8300-28a6edb4f897 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Unrescuing
May 19 04:46:50.882960 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe4161e6-7aac-44a1-8300-28a6edb4f897 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "refresh_cache-e2017472-4da3-4676-b614-3e7039fedef3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:46:50.883062 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe4161e6-7aac-44a1-8300-28a6edb4f897 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquired lock "refresh_cache-e2017472-4da3-4676-b614-3e7039fedef3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:46:50.883227 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-fe4161e6-7aac-44a1-8300-28a6edb4f897 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:46:51.204728 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3fe9a5e2-a07f-41ee-b6c1-ea703bd078d8 req-11bf9a65-f1f0-4ffb-b635-f863cb9e09a7 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received event network-changed-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:51.205332 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3fe9a5e2-a07f-41ee-b6c1-ea703bd078d8 req-11bf9a65-f1f0-4ffb-b635-f863cb9e09a7 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Refreshing instance network info cache due to event network-changed-381aabe0-261a-4722-a473-90dd923ddd70. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:46:51.205601 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3fe9a5e2-a07f-41ee-b6c1-ea703bd078d8 req-11bf9a65-f1f0-4ffb-b635-f863cb9e09a7 service nova] Acquiring lock "refresh_cache-e2017472-4da3-4676-b614-3e7039fedef3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:46:51.215022 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:46:51.215149 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:46:51.215320 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:46:51.215320 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:46:51.215441 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] No VIF found with MAC fa:16:3e:de:fe:78, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:46:51.340670 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:46:51.342762 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:46:51.348994 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0847e6fa-d4aa-4c4d-af15-40ba0297089f req-56ace0ea-08a2-4e09-9a3e-2c80952c96cd service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received event network-vif-plugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:51.349050 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0847e6fa-d4aa-4c4d-af15-40ba0297089f req-56ace0ea-08a2-4e09-9a3e-2c80952c96cd service nova] Acquiring lock "e2017472-4da3-4676-b614-3e7039fedef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:51.349222 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0847e6fa-d4aa-4c4d-af15-40ba0297089f req-56ace0ea-08a2-4e09-9a3e-2c80952c96cd service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:51.349343 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0847e6fa-d4aa-4c4d-af15-40ba0297089f req-56ace0ea-08a2-4e09-9a3e-2c80952c96cd service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:51.349492 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0847e6fa-d4aa-4c4d-af15-40ba0297089f req-56ace0ea-08a2-4e09-9a3e-2c80952c96cd service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] No waiting events found dispatching network-vif-plugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:46:51.349591 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-0847e6fa-d4aa-4c4d-af15-40ba0297089f req-56ace0ea-08a2-4e09-9a3e-2c80952c96cd service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received unexpected event network-vif-plugged-381aabe0-261a-4722-a473-90dd923ddd70 for instance with vm_state rescued and task_state unrescuing.
May 19 04:46:51.385446 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-fe4161e6-7aac-44a1-8300-28a6edb4f897 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:51.690720 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-fe4161e6-7aac-44a1-8300-28a6edb4f897 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:51.811190 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-fe4161e6-7aac-44a1-8300-28a6edb4f897 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Updating instance_info_cache with network_info: [{"id": "381aabe0-261a-4722-a473-90dd923ddd70", "address": "fa:16:3e:33:f8:14", "network": {"id": "502bb41d-fb0e-4491-9039-68b5fde2624f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-951372128-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f892ab02546d4b6295c6abf1e79121ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap381aabe0-26", "ovs_interfaceid": "381aabe0-261a-4722-a473-90dd923ddd70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:46:51.843884 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e2017472-4da3-4676-b614-3e7039fedef3] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 19 04:46:52.295713 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:52.312992 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fe4161e6-7aac-44a1-8300-28a6edb4f897 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Releasing lock "refresh_cache-e2017472-4da3-4676-b614-3e7039fedef3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:46:52.313478 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-fe4161e6-7aac-44a1-8300-28a6edb4f897 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lazy-loading 'flavor' on Instance uuid e2017472-4da3-4676-b614-3e7039fedef3 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:52.314428 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3fe9a5e2-a07f-41ee-b6c1-ea703bd078d8 req-11bf9a65-f1f0-4ffb-b635-f863cb9e09a7 service nova] Acquired lock "refresh_cache-e2017472-4da3-4676-b614-3e7039fedef3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:46:52.314705 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3fe9a5e2-a07f-41ee-b6c1-ea703bd078d8 req-11bf9a65-f1f0-4ffb-b635-f863cb9e09a7 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Refreshing network info cache for port 381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:46:52.757794 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-a8a348e0-53b4-4453-b7ef-9f63c46e2924 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.443s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:52.817806 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-3fe9a5e2-a07f-41ee-b6c1-ea703bd078d8 req-11bf9a65-f1f0-4ffb-b635-f863cb9e09a7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:52.838218 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:52.840799 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:52.859666 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:52.866502 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:52.890724 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:53.122255 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:53.129992 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:53.140549 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-3fe9a5e2-a07f-41ee-b6c1-ea703bd078d8 req-11bf9a65-f1f0-4ffb-b635-f863cb9e09a7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:53.168138 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999696935999964 future=<Future at 0x7218340fcb60 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:46:53.169317 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Instance destroyed successfully.
May 19 04:46:53.170941 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-fe4161e6-7aac-44a1-8300-28a6edb4f897 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lazy-loading 'numa_topology' on Instance uuid e2017472-4da3-4676-b614-3e7039fedef3 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:53.266586 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3fe9a5e2-a07f-41ee-b6c1-ea703bd078d8 req-11bf9a65-f1f0-4ffb-b635-f863cb9e09a7 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Updated VIF entry in instance network info cache for port 381aabe0-261a-4722-a473-90dd923ddd70. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:46:53.266897 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3fe9a5e2-a07f-41ee-b6c1-ea703bd078d8 req-11bf9a65-f1f0-4ffb-b635-f863cb9e09a7 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Updating instance_info_cache with network_info: [{"id": "381aabe0-261a-4722-a473-90dd923ddd70", "address": "fa:16:3e:33:f8:14", "network": {"id": "502bb41d-fb0e-4491-9039-68b5fde2624f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-951372128-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f892ab02546d4b6295c6abf1e79121ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap381aabe0-26", "ovs_interfaceid": "381aabe0-261a-4722-a473-90dd923ddd70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:46:53.270102 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6e877aa9-7c1b-408b-b841-993f348ec85b req-5eb66708-723a-400f-a407-985a38393f4b service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received event network-changed-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:53.270266 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6e877aa9-7c1b-408b-b841-993f348ec85b req-5eb66708-723a-400f-a407-985a38393f4b service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Refreshing instance network info cache due to event network-changed-381aabe0-261a-4722-a473-90dd923ddd70. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:46:53.270440 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6e877aa9-7c1b-408b-b841-993f348ec85b req-5eb66708-723a-400f-a407-985a38393f4b service nova] Acquiring lock "refresh_cache-e2017472-4da3-4676-b614-3e7039fedef3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:46:53.377494 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:53.377687 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:53.398262 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:53.398608 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:53.409775 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0003647419998742407 future=<Future at 0x7218500f9be0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:46:53.409877 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:46:53.409975 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.756901866000135 future=<Future at 0x7218340fcb60 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:46:53.410050 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.756821537000178 future=<Future at 0x7218340fcb60 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:46:53.413330 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6f56596a-4d14-465f-ada2-a7cdb47980ae req-a1386b32-93e5-4465-ba4d-cf5a4a0eecd1 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received event network-vif-unplugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:53.414012 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6f56596a-4d14-465f-ada2-a7cdb47980ae req-a1386b32-93e5-4465-ba4d-cf5a4a0eecd1 service nova] Acquiring lock "e2017472-4da3-4676-b614-3e7039fedef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:53.414263 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6f56596a-4d14-465f-ada2-a7cdb47980ae req-a1386b32-93e5-4465-ba4d-cf5a4a0eecd1 service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:53.414466 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6f56596a-4d14-465f-ada2-a7cdb47980ae req-a1386b32-93e5-4465-ba4d-cf5a4a0eecd1 service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:53.414624 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6f56596a-4d14-465f-ada2-a7cdb47980ae req-a1386b32-93e5-4465-ba4d-cf5a4a0eecd1 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] No waiting events found dispatching network-vif-unplugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:46:53.414976 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-6f56596a-4d14-465f-ada2-a7cdb47980ae req-a1386b32-93e5-4465-ba4d-cf5a4a0eecd1 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received unexpected event network-vif-unplugged-381aabe0-261a-4722-a473-90dd923ddd70 for instance with vm_state rescued and task_state unrescuing.
May 19 04:46:53.414976 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6f56596a-4d14-465f-ada2-a7cdb47980ae req-a1386b32-93e5-4465-ba4d-cf5a4a0eecd1 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received event network-vif-unplugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:53.415147 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6f56596a-4d14-465f-ada2-a7cdb47980ae req-a1386b32-93e5-4465-ba4d-cf5a4a0eecd1 service nova] Acquiring lock "e2017472-4da3-4676-b614-3e7039fedef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:53.415791 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6f56596a-4d14-465f-ada2-a7cdb47980ae req-a1386b32-93e5-4465-ba4d-cf5a4a0eecd1 service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:53.415791 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6f56596a-4d14-465f-ada2-a7cdb47980ae req-a1386b32-93e5-4465-ba4d-cf5a4a0eecd1 service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:53.415791 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6f56596a-4d14-465f-ada2-a7cdb47980ae req-a1386b32-93e5-4465-ba4d-cf5a4a0eecd1 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] No waiting events found dispatching network-vif-unplugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:46:53.415791 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-6f56596a-4d14-465f-ada2-a7cdb47980ae req-a1386b32-93e5-4465-ba4d-cf5a4a0eecd1 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received unexpected event network-vif-unplugged-381aabe0-261a-4722-a473-90dd923ddd70 for instance with vm_state rescued and task_state unrescuing.
May 19 04:46:53.433819 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:53.672310 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-fe4161e6-7aac-44a1-8300-28a6edb4f897 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Object Instance<e2017472-4da3-4676-b614-3e7039fedef3> lazy-loaded attributes: flavor,numa_topology {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:46:53.772051 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3fe9a5e2-a07f-41ee-b6c1-ea703bd078d8 req-11bf9a65-f1f0-4ffb-b635-f863cb9e09a7 service nova] Releasing lock "refresh_cache-e2017472-4da3-4676-b614-3e7039fedef3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:46:53.772586 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6e877aa9-7c1b-408b-b841-993f348ec85b req-5eb66708-723a-400f-a407-985a38393f4b service nova] Acquired lock "refresh_cache-e2017472-4da3-4676-b614-3e7039fedef3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:46:53.772675 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-6e877aa9-7c1b-408b-b841-993f348ec85b req-5eb66708-723a-400f-a407-985a38393f4b service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Refreshing network info cache for port 381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:46:53.881413 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lazy-loading 'flavor' on Instance uuid 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:53.901307 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Detaching volume c78491f7-5078-428f-b0f7-542483ef376f
May 19 04:46:53.936586 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Attempting to driver detach volume c78491f7-5078-428f-b0f7-542483ef376f from mountpoint /dev/vdb
May 19 04:46:53.941850 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Found disk vdb by alias ua-c78491f7-5078-428f-b0f7-542483ef376f {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:46:53.943650 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Found disk vdb by alias ua-c78491f7-5078-428f-b0f7-542483ef376f {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:46:53.943883 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Attempting to detach device vdb from instance 9df306ad-76ad-4edb-9c21-6efab9d0a26e from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:46:53.944001 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:46:53.944001 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:46:53.944001 np0000001025 nova-compute[97981]:   <alias name="ua-c78491f7-5078-428f-b0f7-542483ef376f"/>
May 19 04:46:53.944001 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-4"/>
May 19 04:46:53.944001 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:46:53.944001 np0000001025 nova-compute[97981]:   <serial>c78491f7-5078-428f-b0f7-542483ef376f</serial>
May 19 04:46:53.944001 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:46:53.944001 np0000001025 nova-compute[97981]: </disk>
May 19 04:46:53.944001 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:46:53.948795 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Successfully detached device vdb from instance 9df306ad-76ad-4edb-9c21-6efab9d0a26e from the persistent domain config.
May 19 04:46:53.948923 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] (1/8): Attempting to detach device vdb with device alias ua-c78491f7-5078-428f-b0f7-542483ef376f from instance 9df306ad-76ad-4edb-9c21-6efab9d0a26e from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:46:53.949146 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:46:53.949146 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:46:53.949146 np0000001025 nova-compute[97981]:   <alias name="ua-c78491f7-5078-428f-b0f7-542483ef376f"/>
May 19 04:46:53.949146 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-4"/>
May 19 04:46:53.949146 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:46:53.949146 np0000001025 nova-compute[97981]:   <serial>c78491f7-5078-428f-b0f7-542483ef376f</serial>
May 19 04:46:53.949146 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:46:53.949146 np0000001025 nova-compute[97981]: </disk>
May 19 04:46:53.949146 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:46:54.084807 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:54.107948 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:54.115238 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:54.203437 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:54.277341 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-6e877aa9-7c1b-408b-b841-993f348ec85b req-5eb66708-723a-400f-a407-985a38393f4b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:54.386077 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Ignoring supplied device name: /dev/vdb
May 19 04:46:54.401804 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:54.404555 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:54.412262 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:54.433129 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:54.460046 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779166014.4596694, 9df306ad-76ad-4edb-9c21-6efab9d0a26e => ua-c78491f7-5078-428f-b0f7-542483ef376f> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:46:54.461498 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c78491f7-5078-428f-b0f7-542483ef376f for instance 9df306ad-76ad-4edb-9c21-6efab9d0a26e {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:46:54.464291 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Successfully detached device vdb from instance 9df306ad-76ad-4edb-9c21-6efab9d0a26e from the live domain config.
May 19 04:46:54.466004 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:46:54.466372 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f', 'iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c78491f7-5078-428f-b0f7-542483ef376f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:46:54.466693 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:46:54.467019 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:46:54.467441 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f', 'iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c78491f7-5078-428f-b0f7-542483ef376f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:46:54.467630 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:46:54.497244 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:54.497244 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:54.497244 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:54.497244 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:54.497244 np0000001025 nova-compute[97981]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:54.497244 np0000001025 nova-compute[97981]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:54.497244 np0000001025 nova-compute[97981]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:54.497244 np0000001025 nova-compute[97981]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:54.497244 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:54.497736 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:54.497736 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:54.497736 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:54.497736 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:54.497736 np0000001025 nova-compute[97981]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:54.497736 np0000001025 nova-compute[97981]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f (non-flash)
May 19 04:46:54.497736 np0000001025 nova-compute[97981]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:54.497736 np0000001025 nova-compute[97981]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:54.497736 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:54.497736 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '127'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f', '131'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf', '133'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf', '134')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:46:54.498095 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f', '131')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:46:54.499125 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f', '132')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:46:54.499939 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218507402c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f'): ({'sdg'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:46:54.500193 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Removing multipathed devices sdf, sdg {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:46:54.500549 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Flush multipath device 3300000006930b910 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:46:54.536307 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:46:54.579735 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:46:54.593703 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-6e877aa9-7c1b-408b-b841-993f348ec85b req-5eb66708-723a-400f-a407-985a38393f4b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:46:54.626443 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:46:54.626610 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:46:54.627696 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:46:54.638592 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:46:54.638879 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:46:54.652374 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:54.688644 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 131, target: iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f, portal: 192.168.40.100,3260]
May 19 04:46:54.688644 np0000001025 nova-compute[97981]: Logout of [sid: 131, target: iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f, portal: 192.168.40.100,3260] successful.
May 19 04:46:54.688644 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:54.712380 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-6e877aa9-7c1b-408b-b841-993f348ec85b req-5eb66708-723a-400f-a407-985a38393f4b service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Updated VIF entry in instance network info cache for port 381aabe0-261a-4722-a473-90dd923ddd70. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:46:54.712655 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-6e877aa9-7c1b-408b-b841-993f348ec85b req-5eb66708-723a-400f-a407-985a38393f4b service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Updating instance_info_cache with network_info: [{"id": "381aabe0-261a-4722-a473-90dd923ddd70", "address": "fa:16:3e:33:f8:14", "network": {"id": "502bb41d-fb0e-4491-9039-68b5fde2624f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-951372128-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f892ab02546d4b6295c6abf1e79121ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap381aabe0-26", "ovs_interfaceid": "381aabe0-261a-4722-a473-90dd923ddd70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:46:54.713337 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:54.725162 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:54.751009 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 132, target: iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f, portal: 192.168.50.100,3260]
May 19 04:46:54.751009 np0000001025 nova-compute[97981]: Logout of [sid: 132, target: iqn.2023-03.storpool.com:os--volume-c78491f7-5078-428f-b0f7-542483ef376f, portal: 192.168.50.100,3260] successful.
May 19 04:46:54.751009 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:54.766246 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:54.766546 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:46:54.766696 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] <== disconnect_volume: return (300ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:46:54.766846 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:46:54.813167 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Removed pending STOPPED event for e2017472-4da3-4676-b614-3e7039fedef3 due to new event <LifecycleEvent: 1779166014.8128052, e2017472-4da3-4676-b614-3e7039fedef3 => Resumed> {{(pid=97981) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 19 04:46:54.813367 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166014.8128052, e2017472-4da3-4676-b614-3e7039fedef3 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:46:54.813554 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e2017472-4da3-4676-b614-3e7039fedef3] VM Resumed (Lifecycle Event)
May 19 04:46:54.816144 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-fe4161e6-7aac-44a1-8300-28a6edb4f897 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:46:54.887539 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:55.215152 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6e877aa9-7c1b-408b-b841-993f348ec85b req-5eb66708-723a-400f-a407-985a38393f4b service nova] Releasing lock "refresh_cache-e2017472-4da3-4676-b614-3e7039fedef3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:46:55.307863 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'flavor' on Instance uuid 9df306ad-76ad-4edb-9c21-6efab9d0a26e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:55.317135 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:46:55.323292 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:46:55.475921 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9662bd97-0096-4cc6-893e-ba6012355b81 req-85e4e673-de41-4b99-b586-d57faf717880 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received event network-vif-plugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:55.476770 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9662bd97-0096-4cc6-893e-ba6012355b81 req-85e4e673-de41-4b99-b586-d57faf717880 service nova] Acquiring lock "e2017472-4da3-4676-b614-3e7039fedef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:55.476960 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9662bd97-0096-4cc6-893e-ba6012355b81 req-85e4e673-de41-4b99-b586-d57faf717880 service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:55.477118 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9662bd97-0096-4cc6-893e-ba6012355b81 req-85e4e673-de41-4b99-b586-d57faf717880 service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:55.477301 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9662bd97-0096-4cc6-893e-ba6012355b81 req-85e4e673-de41-4b99-b586-d57faf717880 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] No waiting events found dispatching network-vif-plugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:46:55.477517 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-9662bd97-0096-4cc6-893e-ba6012355b81 req-85e4e673-de41-4b99-b586-d57faf717880 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received unexpected event network-vif-plugged-381aabe0-261a-4722-a473-90dd923ddd70 for instance with vm_state active and task_state None.
May 19 04:46:55.477603 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9662bd97-0096-4cc6-893e-ba6012355b81 req-85e4e673-de41-4b99-b586-d57faf717880 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received event network-vif-plugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:46:55.477757 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9662bd97-0096-4cc6-893e-ba6012355b81 req-85e4e673-de41-4b99-b586-d57faf717880 service nova] Acquiring lock "e2017472-4da3-4676-b614-3e7039fedef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:55.477918 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9662bd97-0096-4cc6-893e-ba6012355b81 req-85e4e673-de41-4b99-b586-d57faf717880 service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:55.478052 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9662bd97-0096-4cc6-893e-ba6012355b81 req-85e4e673-de41-4b99-b586-d57faf717880 service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:55.478195 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9662bd97-0096-4cc6-893e-ba6012355b81 req-85e4e673-de41-4b99-b586-d57faf717880 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] No waiting events found dispatching network-vif-plugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:46:55.478338 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-9662bd97-0096-4cc6-893e-ba6012355b81 req-85e4e673-de41-4b99-b586-d57faf717880 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received unexpected event network-vif-plugged-381aabe0-261a-4722-a473-90dd923ddd70 for instance with vm_state active and task_state None.
May 19 04:46:55.825252 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166015.8248863, e2017472-4da3-4676-b614-3e7039fedef3 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:46:55.825451 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e2017472-4da3-4676-b614-3e7039fedef3] VM Started (Lifecycle Event)
May 19 04:46:55.988719 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:55.989277 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:55.989277 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Attaching volume 03313691-1009-4c39-a92f-81fd1cb1d8a9 to /dev/vdb
May 19 04:46:56.026737 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:46:56.043577 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:46:56.065686 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:46:56.113632 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:46:56.114116 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:46:56.123344 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:46:56.124775 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::8008:f5ff:fe5e:1a35', 'fe80::fc16:3eff:fede:fe78', 'fe80::bc2a:1ff:fe94:f24f', 'fe80::fc16:3eff:fe95:86d9', 'fe80::bc20:d2ff:fef5:7278', 'fe80::fc16:3eff:fea9:81c2', 'fe80::b02a:c2ff:fe71:d502', 'fe80::fc16:3eff:fe41:2200', 'fe80::808a:12ff:fe91:c161', 'fe80::fc16:3eff:fe33:f814'] 
May 19 04:46:56.124883 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:46:56.124995 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:46:56.125231 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:46:56.125486 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Updating existing volume attachment record: 08b6ce8e-89c4-45a5-b860-a3348e8c4697 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:46:56.313181 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5ed24bea-d18c-46ee-bd05-1a302762b6bd tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.914s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:46:56.328190 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:46:56.332570 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:46:56.671397 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:46:56.671697 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9', 'iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03313691-1009-4c39-a92f-81fd1cb1d8a9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:46:56.671858 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:46:56.672335 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:46:56.672521 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9', 'iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03313691-1009-4c39-a92f-81fd1cb1d8a9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:46:56.683458 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:46:56.684004 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:46:56.684509 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:46:56.684719 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:46:56.685947 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:46:56.686268 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:46:56.697978 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:46:56.697978 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:56.698636 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:56.698834 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:56.706215 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:46:56.706215 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:56.717711 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9] added
May 19 04:46:56.717711 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:46:56.717711 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:46:56.717711 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:46:56.717711 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:46:56.717711 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:46:56.717711 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:56.717986 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:46:56.718096 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0333(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:46:56.718325 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:46:56.719389 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9] added
May 19 04:46:56.719389 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:46:56.719389 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:46:56.719389 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:46:56.719389 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:46:56.719389 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:46:56.719389 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:56.719572 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:46:56.719753 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0335(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:46:56.719906 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:46:57.201424 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Detaching volume edd497fb-e976-4ff9-ace8-23e7d6113daf
May 19 04:46:57.237570 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Attempting to driver detach volume edd497fb-e976-4ff9-ace8-23e7d6113daf from mountpoint /dev/vdc
May 19 04:46:57.241396 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Found disk vdc by alias ua-edd497fb-e976-4ff9-ace8-23e7d6113daf {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:46:57.242459 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Found disk vdc by alias ua-edd497fb-e976-4ff9-ace8-23e7d6113daf {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:46:57.242569 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Attempting to detach device vdc from instance 9df306ad-76ad-4edb-9c21-6efab9d0a26e from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:46:57.242821 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:46:57.242821 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:46:57.242821 np0000001025 nova-compute[97981]:   <alias name="ua-edd497fb-e976-4ff9-ace8-23e7d6113daf"/>
May 19 04:46:57.242821 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-5"/>
May 19 04:46:57.242821 np0000001025 nova-compute[97981]:   <target dev="vdc" bus="virtio"/>
May 19 04:46:57.242821 np0000001025 nova-compute[97981]:   <serial>edd497fb-e976-4ff9-ace8-23e7d6113daf</serial>
May 19 04:46:57.242821 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 19 04:46:57.242821 np0000001025 nova-compute[97981]: </disk>
May 19 04:46:57.242821 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:46:57.247372 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Successfully detached device vdc from instance 9df306ad-76ad-4edb-9c21-6efab9d0a26e from the persistent domain config.
May 19 04:46:57.247506 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] (1/8): Attempting to detach device vdc with device alias ua-edd497fb-e976-4ff9-ace8-23e7d6113daf from instance 9df306ad-76ad-4edb-9c21-6efab9d0a26e from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:46:57.247733 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:46:57.247733 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:46:57.247733 np0000001025 nova-compute[97981]:   <alias name="ua-edd497fb-e976-4ff9-ace8-23e7d6113daf"/>
May 19 04:46:57.247733 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-5"/>
May 19 04:46:57.247733 np0000001025 nova-compute[97981]:   <target dev="vdc" bus="virtio"/>
May 19 04:46:57.247733 np0000001025 nova-compute[97981]:   <serial>edd497fb-e976-4ff9-ace8-23e7d6113daf</serial>
May 19 04:46:57.247733 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 19 04:46:57.247733 np0000001025 nova-compute[97981]: </disk>
May 19 04:46:57.247733 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:46:57.307631 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:57.377175 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "f1eb2456-2f51-4465-b6ff-0f76439f3029" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:57.377409 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "f1eb2456-2f51-4465-b6ff-0f76439f3029" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:57.698391 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779166017.6980486, 9df306ad-76ad-4edb-9c21-6efab9d0a26e => ua-edd497fb-e976-4ff9-ace8-23e7d6113daf> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:46:57.699033 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-edd497fb-e976-4ff9-ace8-23e7d6113daf for instance 9df306ad-76ad-4edb-9c21-6efab9d0a26e {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:46:57.701245 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Successfully detached device vdc from instance 9df306ad-76ad-4edb-9c21-6efab9d0a26e from the live domain config.
May 19 04:46:57.702287 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:46:57.702593 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf', 'iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'edd497fb-e976-4ff9-ace8-23e7d6113daf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:46:57.702713 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:46:57.718848 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:46:57.720395 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:46:57.731129 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:46:57.731129 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:46:57.736329 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:46:57.736329 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:57.744733 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:57.749264 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:57.764057 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:57.764057 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:57.764057 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:57.764057 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:57.764057 np0000001025 nova-compute[97981]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:57.764057 np0000001025 nova-compute[97981]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:57.764057 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:57.764337 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:57.764337 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:57.764337 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:57.764337 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:57.764337 np0000001025 nova-compute[97981]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:57.764337 np0000001025 nova-compute[97981]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:57.764337 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:57.769602 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:57.769602 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:57.769602 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:57.769602 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:57.769602 np0000001025 nova-compute[97981]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:57.769602 np0000001025 nova-compute[97981]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:57.769602 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:57.769807 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:57.769807 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:57.769807 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:57.769807 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:57.769807 np0000001025 nova-compute[97981]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:57.769807 np0000001025 nova-compute[97981]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:57.769807 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:57.811229 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9, portal: 192.168.50.100,3260]
May 19 04:46:57.811229 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9, portal: 192.168.50.100,3260] successful.
May 19 04:46:57.811229 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:57.819989 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9, portal: 192.168.40.100,3260]
May 19 04:46:57.819989 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9, portal: 192.168.40.100,3260] successful.
May 19 04:46:57.819989 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:57.826959 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:57.835056 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:57.844227 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:57.844227 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:57.844227 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:57.844227 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:57.844227 np0000001025 nova-compute[97981]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:57.844227 np0000001025 nova-compute[97981]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:57.844227 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:46:57.844227 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:46:57.844227 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:57.844511 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:57.844511 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:57.844511 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:57.844511 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:57.844511 np0000001025 nova-compute[97981]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:57.844511 np0000001025 nova-compute[97981]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:57.844511 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:46:57.844511 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:46:57.844511 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:57.844721 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:46:57.844864 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:46:57.845815 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] HCTL ('11', '-', '-', 0) found on session 135 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:46:57.845946 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:46:57.853586 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:57.853586 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:57.853586 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:57.853586 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:57.853586 np0000001025 nova-compute[97981]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:57.853586 np0000001025 nova-compute[97981]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:57.853586 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:46:57.853586 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:46:57.853586 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:57.853893 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:57.853893 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:57.853893 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:57.853893 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:57.853893 np0000001025 nova-compute[97981]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:57.853893 np0000001025 nova-compute[97981]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:57.853893 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:46:57.853893 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:46:57.853893 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:57.853893 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:46:57.854133 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:46:57.854872 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] HCTL ('12', '-', '-', 0) found on session 136 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:46:57.855000 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:46:57.864468 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Searching for a device in session 135 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:46:57.864829 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '03313691-1009-4c39-a92f-81fd1cb1d8a9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:46:57.871526 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Searching for a device in session 136 and hctl ['12', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:46:57.880564 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:46:58.434662 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:46:58.435008 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:46:58.435329 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:46:58.439289 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:46:58.439444 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Claim successful on node np0000001025
May 19 04:46:58.869814 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Searching for a device in session 136 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:46:58.869978 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03313691-1009-4c39-a92f-81fd1cb1d8a9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:46:59.504375 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Refreshing inventories for resource provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 19 04:46:59.545418 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Updating ProviderTree inventory for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 19 04:46:59.545709 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Updating inventory in ProviderTree for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 19 04:46:59.584757 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Refreshing aggregate associations for resource provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6, aggregates: None {{(pid=97981) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 19 04:46:59.631813 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Refreshing trait associations for resource provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6, traits: COMPUTE_SOUND_MODEL_AC97,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ARCH_S390X,COMPUTE_SOUND_MODEL_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SOUND_MODEL_ICH9,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ARCH_MIPSEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_SOUND_MODEL_ICH6,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIF_MODEL_IGB,HW_ARCH_X86_64,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ARCH_X86_64,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ARCH_RISCV64,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_ARCH_AARCH64,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_STORAGE_VIRTIO_FS {{(pid=97981) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 19 04:46:59.700233 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Found WWN 33000000005737a8d for multipath device dm-4 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:46:59.700475 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:46:59.700633 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] <== connect_volume: return (3028ms) {'type': 'block', 'scsi_wwn': '33000000005737a8d', 'path': '/dev/dm-4', 'multipath_id': '33000000005737a8d'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:46:59.700755 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000005737a8d', 'path': '/dev/dm-4', 'multipath_id': '33000000005737a8d'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:46:59.702209 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.999s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:46:59.702991 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf', 'iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'edd497fb-e976-4ff9-ace8-23e7d6113daf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:46:59.702991 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:46:59.705078 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lazy-loading 'flavor' on Instance uuid 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:46:59.735630 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:59.735630 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:59.735630 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:59.735630 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:59.735630 np0000001025 nova-compute[97981]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:59.735630 np0000001025 nova-compute[97981]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:59.735630 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:46:59.735630 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:46:59.735630 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:46:59.737027 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:59.737027 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:46:59.737027 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:59.737027 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:46:59.737027 np0000001025 nova-compute[97981]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:59.737027 np0000001025 nova-compute[97981]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf (non-flash)
May 19 04:46:59.737027 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:46:59.737027 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:46:59.737027 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:46:59.737027 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '127'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', '130'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf', '133'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9', '136')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:46:59.737027 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf', '134')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:46:59.739360 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf', '133')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:46:59.739360 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721834445da0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf'): ({'sdh'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:46:59.739360 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Removing multipathed devices sdh, sdi {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:46:59.739360 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Flush multipath device 330000000acbf7949 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:46:59.775903 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:46:59.833663 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:46:59.875325 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:46:59.875325 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:46:59.875325 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:46:59.887563 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:46:59.887968 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:46:59.898847 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:59.928830 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 134, target: iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf, portal: 192.168.40.100,3260]
May 19 04:46:59.928830 np0000001025 nova-compute[97981]: Logout of [sid: 134, target: iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf, portal: 192.168.40.100,3260] successful.
May 19 04:46:59.928830 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:59.945370 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:59.957598 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:46:59.960456 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:46:59.960714 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:46:59.992208 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 133, target: iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf, portal: 192.168.50.100,3260]
May 19 04:46:59.992208 np0000001025 nova-compute[97981]: Logout of [sid: 133, target: iqn.2023-03.storpool.com:os--volume-edd497fb-e976-4ff9-ace8-23e7d6113daf, portal: 192.168.50.100,3260] successful.
May 19 04:46:59.992208 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:00.010971 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:00.010971 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:47:00.010971 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] <== disconnect_volume: return (2305ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:47:00.010971 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:47:00.209844 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Attempting to attach volume 03313691-1009-4c39-a92f-81fd1cb1d8a9 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:47:00.211242 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:47:00.211242 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:47:00.211242 np0000001025 nova-compute[97981]:   <alias name="ua-03313691-1009-4c39-a92f-81fd1cb1d8a9"/>
May 19 04:47:00.211242 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-4"/>
May 19 04:47:00.211242 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:47:00.211242 np0000001025 nova-compute[97981]:   <serial>03313691-1009-4c39-a92f-81fd1cb1d8a9</serial>
May 19 04:47:00.211242 np0000001025 nova-compute[97981]: </disk>
May 19 04:47:00.211242 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:47:00.463563 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:47:00.553500 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'flavor' on Instance uuid 9df306ad-76ad-4edb-9c21-6efab9d0a26e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:47:00.969929 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.535s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:00.970105 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:47:01.473921 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:47:01.474118 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:47:01.474402 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:01.474644 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:01.544630 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c46088fb3e74b819bb456461716a801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b3c0fa8f894ed2a7c3bcfac99ce74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:47:01.560078 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-adeb97d3-bf53-49bf-9f71-f404e675fef4 tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.861s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:01.867247 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:47:01.867372 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:47:01.867480 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:47:01.876229 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] No VIF found with MAC fa:16:3e:a9:81:c2, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:47:01.884895 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:01.980392 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:47:02.057353 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Successfully created port: 0f376d17-e9e6-4eba-9d70-70960eadb9a4 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:47:02.157639 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:02.157639 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:02.157639 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:02.157639 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:02.157639 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:02.158834 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Terminating instance
May 19 04:47:02.308773 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:02.483338 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:47:02.539230 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Successfully updated port: 0f376d17-e9e6-4eba-9d70-70960eadb9a4 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:47:02.591701 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-dcca2862-7f59-4737-bc12-65a116640fad req-ae81316b-8d15-46bb-8d22-01fc5bf08fe7 service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Received event network-changed-0f376d17-e9e6-4eba-9d70-70960eadb9a4 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:02.591701 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-dcca2862-7f59-4737-bc12-65a116640fad req-ae81316b-8d15-46bb-8d22-01fc5bf08fe7 service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Refreshing instance network info cache due to event network-changed-0f376d17-e9e6-4eba-9d70-70960eadb9a4. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:47:02.591701 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-dcca2862-7f59-4737-bc12-65a116640fad req-ae81316b-8d15-46bb-8d22-01fc5bf08fe7 service nova] Acquiring lock "refresh_cache-f1eb2456-2f51-4465-b6ff-0f76439f3029" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:47:02.591701 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-dcca2862-7f59-4737-bc12-65a116640fad req-ae81316b-8d15-46bb-8d22-01fc5bf08fe7 service nova] Acquired lock "refresh_cache-f1eb2456-2f51-4465-b6ff-0f76439f3029" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:47:02.591701 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-dcca2862-7f59-4737-bc12-65a116640fad req-ae81316b-8d15-46bb-8d22-01fc5bf08fe7 service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Refreshing network info cache for port 0f376d17-e9e6-4eba-9d70-70960eadb9a4 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:47:02.662519 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:47:02.680944 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:02.686399 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:02.700455 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:02.720702 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:02.987229 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Booting with volume 06a16928-529f-4113-9ad7-db1ca59c0485 at /dev/vda
May 19 04:47:02.991874 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999702505000187 future=<Future at 0x721834380d40 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:02.995843 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Instance destroyed successfully.
May 19 04:47:02.998520 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lazy-loading 'resources' on Instance uuid 9df306ad-76ad-4edb-9c21-6efab9d0a26e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:47:03.023088 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:47:03.033990 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:47:03.043542 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "refresh_cache-f1eb2456-2f51-4465-b6ff-0f76439f3029" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:47:03.054282 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:47:03.095158 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-dcca2862-7f59-4737-bc12-65a116640fad req-ae81316b-8d15-46bb-8d22-01fc5bf08fe7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:03.097968 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:47:03.098292 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:47:03.107150 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:47:03.108140 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::8008:f5ff:fe5e:1a35', 'fe80::fc16:3eff:fe95:86d9', 'fe80::bc20:d2ff:fef5:7278', 'fe80::fc16:3eff:fea9:81c2', 'fe80::b02a:c2ff:fe71:d502', 'fe80::fc16:3eff:fe41:2200', 'fe80::808a:12ff:fe91:c161', 'fe80::fc16:3eff:fe33:f814'] 
May 19 04:47:03.108267 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:47:03.108371 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:47:03.108600 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:47:03.108782 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Updating existing volume attachment record: 5caf794e-7f13-4f34-83bd-4893854873bd {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:47:03.161984 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-dcca2862-7f59-4737-bc12-65a116640fad req-ae81316b-8d15-46bb-8d22-01fc5bf08fe7 service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:47:03.301525 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-dcca2862-7f59-4737-bc12-65a116640fad req-ae81316b-8d15-46bb-8d22-01fc5bf08fe7 service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:47:03.426902 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ea3f41b8-d583-462e-bdfb-74452f4ac150 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.438s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:03.436978 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:03.501161 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-594336579',display_name='tempest-AttachVolumeTestJSON-server-594336579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumetestjson-server-594336579',id=57,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJjteTzq0NUwYjwlpQ+hmIeyZdzFSD8jLO3flUD31olByKHvMlaXIkHcoTbP5zr1sB+vIhKgjCAxFe9EWCttMdtJe51D9539Urgqg2yI5Wlw3obunt16eNiwvzDmaAL0Q==',key_name='tempest-keypair-1061891784',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:45:52Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='662c1a9b25e44aff8242f468232af7f3',ramdisk_id='',reservation_id='r-016n60tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1215369469',owner_user_name='tempest-AttachVolumeTestJSON-1215369469-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:45:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f7f84eb55d44e89c2ed500098135e0',uuid=9df306ad-76ad-4edb-9c21-6efab9d0a26e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10a1cfa6-e38d-42cf-903d-e78249ef211c", "address": "fa:16:3e:de:fe:78", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a1cfa6-e3", "ovs_interfaceid": "10a1cfa6-e38d-42cf-903d-e78249ef211c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:47:03.501501 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converting VIF {"id": "10a1cfa6-e38d-42cf-903d-e78249ef211c", "address": "fa:16:3e:de:fe:78", "network": {"id": "a9705331-421e-4c59-bfe5-c3519cec1670", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-782092937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662c1a9b25e44aff8242f468232af7f3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a1cfa6-e3", "ovs_interfaceid": "10a1cfa6-e38d-42cf-903d-e78249ef211c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:47:03.502076 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:fe:78,bridge_name='br-int',has_traffic_filtering=True,id=10a1cfa6-e38d-42cf-903d-e78249ef211c,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10a1cfa6-e3') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:47:03.502318 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:fe:78,bridge_name='br-int',has_traffic_filtering=True,id=10a1cfa6-e38d-42cf-903d-e78249ef211c,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10a1cfa6-e3') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:47:03.504240 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:03.504689 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10a1cfa6-e3, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:47:03.505765 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:03.506628 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:47:03.507721 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:03.508548 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:03.508763 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a5c32de0-a5d2-4f1a-9227-6f49450a0f2f) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:47:03.509228 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:03.509832 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:47:03.510405 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:03.512030 np0000001025 nova-compute[97981]: INFO os_vif [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:fe:78,bridge_name='br-int',has_traffic_filtering=True,id=10a1cfa6-e38d-42cf-903d-e78249ef211c,network=Network(a9705331-421e-4c59-bfe5-c3519cec1670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10a1cfa6-e3')
May 19 04:47:03.512342 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Deleting instance files /opt/stack/data/nova/instances/9df306ad-76ad-4edb-9c21-6efab9d0a26e_del
May 19 04:47:03.513063 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Deletion of /opt/stack/data/nova/instances/9df306ad-76ad-4edb-9c21-6efab9d0a26e_del complete
May 19 04:47:03.804341 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-dcca2862-7f59-4737-bc12-65a116640fad req-ae81316b-8d15-46bb-8d22-01fc5bf08fe7 service nova] Releasing lock "refresh_cache-f1eb2456-2f51-4465-b6ff-0f76439f3029" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:47:03.804891 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquired lock "refresh_cache-f1eb2456-2f51-4465-b6ff-0f76439f3029" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:47:03.804891 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:47:04.020875 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Took 1.36 seconds to destroy the instance on the hypervisor.
May 19 04:47:04.021673 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:47:04.022007 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:47:04.022141 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:47:04.022351 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:04.115964 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:04.387704 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:47:04.551543 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:04.647217 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3daa8880-0013-43f0-b745-7bc17eccf22a req-e876656b-3b11-4984-8e9e-bb2ab0062cfd service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Received event network-vif-unplugged-10a1cfa6-e38d-42cf-903d-e78249ef211c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:04.647623 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3daa8880-0013-43f0-b745-7bc17eccf22a req-e876656b-3b11-4984-8e9e-bb2ab0062cfd service nova] Acquiring lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:04.647788 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3daa8880-0013-43f0-b745-7bc17eccf22a req-e876656b-3b11-4984-8e9e-bb2ab0062cfd service nova] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:04.647923 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3daa8880-0013-43f0-b745-7bc17eccf22a req-e876656b-3b11-4984-8e9e-bb2ab0062cfd service nova] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:04.648017 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3daa8880-0013-43f0-b745-7bc17eccf22a req-e876656b-3b11-4984-8e9e-bb2ab0062cfd service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] No waiting events found dispatching network-vif-unplugged-10a1cfa6-e38d-42cf-903d-e78249ef211c {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:47:04.648147 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3daa8880-0013-43f0-b745-7bc17eccf22a req-e876656b-3b11-4984-8e9e-bb2ab0062cfd service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Received event network-vif-unplugged-10a1cfa6-e38d-42cf-903d-e78249ef211c for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:47:04.648250 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3daa8880-0013-43f0-b745-7bc17eccf22a req-e876656b-3b11-4984-8e9e-bb2ab0062cfd service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Received event network-vif-unplugged-10a1cfa6-e38d-42cf-903d-e78249ef211c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:04.648357 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3daa8880-0013-43f0-b745-7bc17eccf22a req-e876656b-3b11-4984-8e9e-bb2ab0062cfd service nova] Acquiring lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:04.648487 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3daa8880-0013-43f0-b745-7bc17eccf22a req-e876656b-3b11-4984-8e9e-bb2ab0062cfd service nova] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:04.648590 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3daa8880-0013-43f0-b745-7bc17eccf22a req-e876656b-3b11-4984-8e9e-bb2ab0062cfd service nova] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:04.648687 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3daa8880-0013-43f0-b745-7bc17eccf22a req-e876656b-3b11-4984-8e9e-bb2ab0062cfd service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] No waiting events found dispatching network-vif-unplugged-10a1cfa6-e38d-42cf-903d-e78249ef211c {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:47:04.648779 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3daa8880-0013-43f0-b745-7bc17eccf22a req-e876656b-3b11-4984-8e9e-bb2ab0062cfd service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Received event network-vif-unplugged-10a1cfa6-e38d-42cf-903d-e78249ef211c for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:47:04.648868 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3daa8880-0013-43f0-b745-7bc17eccf22a req-e876656b-3b11-4984-8e9e-bb2ab0062cfd service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Received event network-vif-deleted-10a1cfa6-e38d-42cf-903d-e78249ef211c {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:04.648967 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-3daa8880-0013-43f0-b745-7bc17eccf22a req-e876656b-3b11-4984-8e9e-bb2ab0062cfd service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Neutron deleted interface 10a1cfa6-e38d-42cf-903d-e78249ef211c; detaching it from the instance and deleting it from the info cache
May 19 04:47:04.649064 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3daa8880-0013-43f0-b745-7bc17eccf22a req-e876656b-3b11-4984-8e9e-bb2ab0062cfd service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:47:04.669522 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Updating instance_info_cache with network_info: [{"id": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "address": "fa:16:3e:3c:09:8a", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f376d17-e9", "ovs_interfaceid": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:47:04.947491 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:47:05.152175 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3daa8880-0013-43f0-b745-7bc17eccf22a req-e876656b-3b11-4984-8e9e-bb2ab0062cfd service nova] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Detach interface failed, port_id=10a1cfa6-e38d-42cf-903d-e78249ef211c, reason: Instance 9df306ad-76ad-4edb-9c21-6efab9d0a26e could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:47:05.171392 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Releasing lock "refresh_cache-f1eb2456-2f51-4465-b6ff-0f76439f3029" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:47:05.172158 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Instance network_info: |[{"id": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "address": "fa:16:3e:3c:09:8a", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f376d17-e9", "ovs_interfaceid": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:47:05.216454 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:47:05.217713 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:47:05.217952 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Creating image(s)
May 19 04:47:05.218281 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:47:05.218418 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Ensure instance console log exists: /opt/stack/data/nova/instances/f1eb2456-2f51-4465-b6ff-0f76439f3029/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:47:05.218660 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:05.218826 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:05.218952 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:05.219451 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Start _get_guest_xml network_info=[{"id": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "address": "fa:16:3e:3c:09:8a", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f376d17-e9", "ovs_interfaceid": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '5caf794e-7f13-4f34-83bd-4893854873bd', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06a16928-529f-4113-9ad7-db1ca59c0485', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f1eb2456-2f51-4465-b6ff-0f76439f3029', 'attached_at': '', 'detached_at': '', 'volume_id': '06a16928-529f-4113-9ad7-db1ca59c0485', 'serial': '06a16928-529f-4113-9ad7-db1ca59c0485'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:47:05.221744 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:47:05.222869 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-557872007', uuid='f1eb2456-2f51-4465-b6ff-0f76439f3029'), owner=OwnerMeta(userid='5c46088fb3e74b819bb456461716a801', username='tempest-TestVolumeBootPattern-1071176852-project-member', projectid='28b3c0fa8f894ed2a7c3bcfac99ce74c', projectname='tempest-TestVolumeBootPattern-1071176852'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "address": "fa:16:3e:3c:09:8a", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f376d17-e9", "ovs_interfaceid": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166025.22255) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:47:05.224297 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:47:05.224638 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:47:05.225613 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:47:05.225779 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:47:05.226704 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:47:05.227004 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:47:05.227144 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:47:05.227270 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:47:05.227405 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:47:05.227509 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:47:05.227611 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:47:05.227784 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:47:05.227891 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:47:05.228011 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:47:05.228139 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:47:05.228268 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:47:05.241413 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:47:05.241798 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06a16928-529f-4113-9ad7-db1ca59c0485', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:47:05.241952 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:47:05.447483 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Took 1.43 seconds to deallocate network for instance.
May 19 04:47:05.955690 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:05.955690 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:06.094684 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.852s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:47:06.094994 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06a16928-529f-4113-9ad7-db1ca59c0485', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:47:06.111531 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:47:06.111950 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:47:06.112426 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:47:06.112700 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:47:06.113067 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:47:06.113330 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:47:06.126441 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:47:06.126441 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:06.134232 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:47:06.134232 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:06.141092 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485] added
May 19 04:47:06.141092 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:47:06.141092 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:47:06.141092 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:47:06.141092 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:47:06.141092 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:47:06.141092 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:06.141460 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:47:06.141519 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0288(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:47:06.143723 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:47:06.145010 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485] added
May 19 04:47:06.145010 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:47:06.145010 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:47:06.145010 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:47:06.145010 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:47:06.145010 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:47:06.145010 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:06.145010 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:47:06.145010 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0316(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:47:06.145010 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:47:06.291476 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:47:06.291755 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:47:06.794735 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:47:07.144378 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:47:07.145606 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:47:07.160985 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:47:07.160985 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:47:07.166496 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:47:07.166496 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:07.173430 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:07.179705 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:07.189906 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:07.189906 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:07.189906 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:07.189906 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:07.189906 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:07.189906 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:07.189906 np0000001025 nova-compute[97981]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa33a95a-28f3-4999-8d3b-0fdaf61b0b03 (non-flash)
May 19 04:47:07.189906 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:47:07.190166 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:07.190166 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:07.190166 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:07.190166 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:07.190166 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:07.190166 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:07.190166 np0000001025 nova-compute[97981]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa33a95a-28f3-4999-8d3b-0fdaf61b0b03 (non-flash)
May 19 04:47:07.190166 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:47:07.199834 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:07.199834 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:07.199834 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:07.199834 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:07.199834 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:07.199834 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:07.199834 np0000001025 nova-compute[97981]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa33a95a-28f3-4999-8d3b-0fdaf61b0b03 (non-flash)
May 19 04:47:07.199834 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:47:07.199834 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:07.199834 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:07.199834 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:07.199834 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:07.199834 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:07.199834 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:07.199834 np0000001025 nova-compute[97981]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa33a95a-28f3-4999-8d3b-0fdaf61b0b03 (non-flash)
May 19 04:47:07.199834 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:47:07.227081 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485, portal: 192.168.40.100,3260]
May 19 04:47:07.227081 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485, portal: 192.168.40.100,3260] successful.
May 19 04:47:07.227081 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:07.240798 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:07.249045 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485, portal: 192.168.50.100,3260]
May 19 04:47:07.249045 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485, portal: 192.168.50.100,3260] successful.
May 19 04:47:07.249045 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:07.259296 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:07.259296 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:07.259296 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:07.259296 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:07.259296 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:07.259296 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:07.259296 np0000001025 nova-compute[97981]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa33a95a-28f3-4999-8d3b-0fdaf61b0b03 (non-flash)
May 19 04:47:07.259296 np0000001025 nova-compute[97981]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:07.259296 np0000001025 nova-compute[97981]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:07.259296 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:47:07.259562 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:07.259562 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:07.259562 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:07.259562 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:07.259562 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:07.259562 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:07.259562 np0000001025 nova-compute[97981]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa33a95a-28f3-4999-8d3b-0fdaf61b0b03 (non-flash)
May 19 04:47:07.259562 np0000001025 nova-compute[97981]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:07.259562 np0000001025 nova-compute[97981]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:07.259562 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:47:07.259731 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:47:07.259929 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:47:07.260758 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] HCTL ('14', '-', '-', 0) found on session 138 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:47:07.260861 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:47:07.261386 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:07.287493 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching for a device in session 138 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:47:07.287757 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06a16928-529f-4113-9ad7-db1ca59c0485', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:47:07.293000 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:07.293000 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:07.293000 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:07.293000 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:07.293000 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:07.293000 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:07.293000 np0000001025 nova-compute[97981]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa33a95a-28f3-4999-8d3b-0fdaf61b0b03 (non-flash)
May 19 04:47:07.293000 np0000001025 nova-compute[97981]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:07.293000 np0000001025 nova-compute[97981]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:07.293000 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:47:07.293000 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:07.293000 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:07.293000 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:07.293000 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:07.293000 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:07.293000 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:07.293000 np0000001025 nova-compute[97981]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa33a95a-28f3-4999-8d3b-0fdaf61b0b03 (non-flash)
May 19 04:47:07.293000 np0000001025 nova-compute[97981]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:07.293000 np0000001025 nova-compute[97981]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:07.293000 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:47:07.293000 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:47:07.293000 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:47:07.294054 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] HCTL ('15', '-', '-', 0) found on session 139 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:47:07.294280 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:47:07.301602 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.347s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:07.317667 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Searching for a device in session 139 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:47:07.317667 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '06a16928-529f-4113-9ad7-db1ca59c0485', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:47:07.369023 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Deleted allocations for instance 9df306ad-76ad-4edb-9c21-6efab9d0a26e
May 19 04:47:08.115129 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:47:08.167666 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00040314900024895906 future=<Future at 0x7218340fcb60 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:08.167666 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:08.167666 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=9.823935378999977 future=<Future at 0x721834380d40 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:08.167666 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=9.823842254999818 future=<Future at 0x721834380d40 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:08.390059 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-74973b84-03e1-42b6-a3f3-abbd878f30aa tempest-AttachVolumeTestJSON-1215369469 tempest-AttachVolumeTestJSON-1215369469-project-member] Lock "9df306ad-76ad-4edb-9c21-6efab9d0a26e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.234s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:08.448094 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:08.509442 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:09.130742 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Found WWN 33000000009a7684d for multipath device dm-5 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:47:09.130979 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:47:09.131137 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== connect_volume: return (3889ms) {'type': 'block', 'scsi_wwn': '33000000009a7684d', 'path': '/dev/dm-5', 'multipath_id': '33000000009a7684d'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:47:09.131257 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000009a7684d', 'path': '/dev/dm-5', 'multipath_id': '33000000009a7684d'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:47:09.635828 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-557872007',display_name='tempest-TestVolumeBootPattern-server-557872007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-557872007',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN64hvrIGybIwAElinLKo/VbG9hSjSUs/ze49uyTKPWXsdeqEUWn/Lpvjt2B+Fess/qheYjdkiwQfjT63zoCE3gTtilbfESU8llxkXIh3KDQg4BSLPbR62uq8/NYye8VAw==',key_name='tempest-TestVolumeBootPattern-644793043',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-u1ua99mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:47:03Z,user_data=None,user_id='5c46088fb3e74b819bb456461716a801',uuid=f1eb2456-2f51-4465-b6ff-0f76439f3029,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "address": "fa:16:3e:3c:09:8a", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f376d17-e9", "ovs_interfaceid": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:47:09.636269 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "address": "fa:16:3e:3c:09:8a", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f376d17-e9", "ovs_interfaceid": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:47:09.638321 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:09:8a,bridge_name='br-int',has_traffic_filtering=True,id=0f376d17-e9e6-4eba-9d70-70960eadb9a4,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f376d17-e9') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:47:09.638321 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'pci_devices' on Instance uuid f1eb2456-2f51-4465-b6ff-0f76439f3029 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:47:10.140259 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] End _get_guest_xml xml=<domain type="qemu">
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:   <uuid>f1eb2456-2f51-4465-b6ff-0f76439f3029</uuid>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:   <name>instance-0000003d</name>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestVolumeBootPattern-server-557872007</nova:name>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:47:05</nova:creationTime>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:         <nova:user uuid="5c46088fb3e74b819bb456461716a801">tempest-TestVolumeBootPattern-1071176852-project-member</nova:user>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:         <nova:project uuid="28b3c0fa8f894ed2a7c3bcfac99ce74c">tempest-TestVolumeBootPattern-1071176852</nova:project>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:         <nova:port uuid="0f376d17-e9e6-4eba-9d70-70960eadb9a4">
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     <system>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <entry name="serial">f1eb2456-2f51-4465-b6ff-0f76439f3029</entry>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <entry name="uuid">f1eb2456-2f51-4465-b6ff-0f76439f3029</entry>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     </system>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:   <os>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:   </os>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:   <features>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:   </features>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:   <devices>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/f1eb2456-2f51-4465-b6ff-0f76439f3029/disk.config"/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     </disk>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <alias name="ua-06a16928-529f-4113-9ad7-db1ca59c0485"/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-5"/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <serial>06a16928-529f-4113-9ad7-db1ca59c0485</serial>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     </disk>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:3c:09:8a"/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <target dev="tap0f376d17-e9"/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     </interface>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/f1eb2456-2f51-4465-b6ff-0f76439f3029/console.log" append="off"/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     </serial>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     <video>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     </video>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     </rng>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:   </devices>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]: </domain>
May 19 04:47:10.140259 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:47:10.152347 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Preparing to wait for external event network-vif-plugged-0f376d17-e9e6-4eba-9d70-70960eadb9a4 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:47:10.152347 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "f1eb2456-2f51-4465-b6ff-0f76439f3029-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:10.152347 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "f1eb2456-2f51-4465-b6ff-0f76439f3029-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:10.152347 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "f1eb2456-2f51-4465-b6ff-0f76439f3029-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:10.152347 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-557872007',display_name='tempest-TestVolumeBootPattern-server-557872007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-557872007',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN64hvrIGybIwAElinLKo/VbG9hSjSUs/ze49uyTKPWXsdeqEUWn/Lpvjt2B+Fess/qheYjdkiwQfjT63zoCE3gTtilbfESU8llxkXIh3KDQg4BSLPbR62uq8/NYye8VAw==',key_name='tempest-TestVolumeBootPattern-644793043',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-u1ua99mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:47:03Z,user_data=None,user_id='5c46088fb3e74b819bb456461716a801',uuid=f1eb2456-2f51-4465-b6ff-0f76439f3029,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "address": "fa:16:3e:3c:09:8a", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f376d17-e9", "ovs_interfaceid": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:47:10.152347 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "address": "fa:16:3e:3c:09:8a", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f376d17-e9", "ovs_interfaceid": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:47:10.152347 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:09:8a,bridge_name='br-int',has_traffic_filtering=True,id=0f376d17-e9e6-4eba-9d70-70960eadb9a4,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f376d17-e9') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:47:10.152347 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:09:8a,bridge_name='br-int',has_traffic_filtering=True,id=0f376d17-e9e6-4eba-9d70-70960eadb9a4,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f376d17-e9') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:47:10.152347 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:10.152347 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:47:10.152347 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:47:10.152347 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:10.152347 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca7518e8-4703-5ea4-9fa1-8e0f8029efdf', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:47:10.152347 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:10.152347 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:47:10.152347 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:10.152347 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f376d17-e9, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:47:10.152347 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f376d17-e9, col_values=(('qos', UUID('40ee99c7-3330-4efe-bdb0-e6f405d4ec61')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:47:10.152347 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f376d17-e9, col_values=(('external_ids', {'iface-id': '0f376d17-e9e6-4eba-9d70-70960eadb9a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:09:8a', 'vm-uuid': 'f1eb2456-2f51-4465-b6ff-0f76439f3029'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:47:10.155126 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:47:10.158225 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:10.160178 np0000001025 nova-compute[97981]: INFO os_vif [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:09:8a,bridge_name='br-int',has_traffic_filtering=True,id=0f376d17-e9e6-4eba-9d70-70960eadb9a4,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f376d17-e9')
May 19 04:47:11.675814 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:47:11.675814 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:47:11.675814 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] No VIF found with MAC fa:16:3e:3c:09:8a, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:47:11.675814 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Using config drive
May 19 04:47:12.179861 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:12.289018 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Creating config drive at /opt/stack/data/nova/instances/f1eb2456-2f51-4465-b6ff-0f76439f3029/disk.config
May 19 04:47:12.291881 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f1eb2456-2f51-4465-b6ff-0f76439f3029/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd6zj4rx9 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:47:12.344036 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f1eb2456-2f51-4465-b6ff-0f76439f3029/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd6zj4rx9" returned: 0 in 0.052s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:47:12.754528 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:12.780675 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:12.783378 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:12.872785 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:12.893345 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:12.894033 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:13.458324 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:13.533466 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9b308370-6ea0-45d5-95c7-545f617a6145 req-256bbbad-2a18-40f4-abf0-f4ca6364dc29 service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Received event network-vif-plugged-0f376d17-e9e6-4eba-9d70-70960eadb9a4 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:13.533843 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9b308370-6ea0-45d5-95c7-545f617a6145 req-256bbbad-2a18-40f4-abf0-f4ca6364dc29 service nova] Acquiring lock "f1eb2456-2f51-4465-b6ff-0f76439f3029-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:13.534853 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9b308370-6ea0-45d5-95c7-545f617a6145 req-256bbbad-2a18-40f4-abf0-f4ca6364dc29 service nova] Lock "f1eb2456-2f51-4465-b6ff-0f76439f3029-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:13.534853 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9b308370-6ea0-45d5-95c7-545f617a6145 req-256bbbad-2a18-40f4-abf0-f4ca6364dc29 service nova] Lock "f1eb2456-2f51-4465-b6ff-0f76439f3029-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:13.534853 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9b308370-6ea0-45d5-95c7-545f617a6145 req-256bbbad-2a18-40f4-abf0-f4ca6364dc29 service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Processing event network-vif-plugged-0f376d17-e9e6-4eba-9d70-70960eadb9a4 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:47:13.580042 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166033.579571, f1eb2456-2f51-4465-b6ff-0f76439f3029 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:47:13.580241 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] VM Started (Lifecycle Event)
May 19 04:47:13.582776 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:47:13.586274 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:47:13.594647 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Instance spawned successfully.
May 19 04:47:13.594918 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:47:14.084385 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:47:14.086409 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:47:14.103400 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:47:14.103533 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:47:14.104370 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:47:14.104635 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:47:14.104930 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:47:14.105206 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:47:14.334994 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:14.589240 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:47:14.589529 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166034.589338, f1eb2456-2f51-4465-b6ff-0f76439f3029 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:47:14.589689 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] VM Paused (Lifecycle Event)
May 19 04:47:14.611276 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Took 9.39 seconds to spawn the instance on the hypervisor.
May 19 04:47:14.611780 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:47:15.070048 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "032576d0-ced0-4686-8aad-26b4e06a4d67" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:15.070246 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "032576d0-ced0-4686-8aad-26b4e06a4d67" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:15.095560 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:47:15.100253 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166035.0999875, f1eb2456-2f51-4465-b6ff-0f76439f3029 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:47:15.100385 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] VM Resumed (Lifecycle Event)
May 19 04:47:15.127765 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Took 16.74 seconds to build instance.
May 19 04:47:15.153664 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:15.573198 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lazy-loading 'flavor' on Instance uuid 032576d0-ced0-4686-8aad-26b4e06a4d67 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:47:15.602680 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-be100dac-958e-4147-9985-b2510d97f57d req-a10bb5f9-cd23-40b2-ad80-722fd95035e6 service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Received event network-vif-plugged-0f376d17-e9e6-4eba-9d70-70960eadb9a4 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:15.602880 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-be100dac-958e-4147-9985-b2510d97f57d req-a10bb5f9-cd23-40b2-ad80-722fd95035e6 service nova] Acquiring lock "f1eb2456-2f51-4465-b6ff-0f76439f3029-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:15.603044 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-be100dac-958e-4147-9985-b2510d97f57d req-a10bb5f9-cd23-40b2-ad80-722fd95035e6 service nova] Lock "f1eb2456-2f51-4465-b6ff-0f76439f3029-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:15.603194 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-be100dac-958e-4147-9985-b2510d97f57d req-a10bb5f9-cd23-40b2-ad80-722fd95035e6 service nova] Lock "f1eb2456-2f51-4465-b6ff-0f76439f3029-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:15.603327 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-be100dac-958e-4147-9985-b2510d97f57d req-a10bb5f9-cd23-40b2-ad80-722fd95035e6 service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] No waiting events found dispatching network-vif-plugged-0f376d17-e9e6-4eba-9d70-70960eadb9a4 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:47:15.603495 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-be100dac-958e-4147-9985-b2510d97f57d req-a10bb5f9-cd23-40b2-ad80-722fd95035e6 service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Received unexpected event network-vif-plugged-0f376d17-e9e6-4eba-9d70-70960eadb9a4 for instance with vm_state active and task_state None.
May 19 04:47:15.604465 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:47:15.608862 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:47:15.629300 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "f1eb2456-2f51-4465-b6ff-0f76439f3029" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.252s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:16.577921 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "032576d0-ced0-4686-8aad-26b4e06a4d67" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:16.954250 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2039b5c7-9c79-4123-b6c5-d13ff915d3dc req-a08a07db-1483-4b62-9026-6f371624bf1a service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Received event network-changed-0f376d17-e9e6-4eba-9d70-70960eadb9a4 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:16.954865 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2039b5c7-9c79-4123-b6c5-d13ff915d3dc req-a08a07db-1483-4b62-9026-6f371624bf1a service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Refreshing instance network info cache due to event network-changed-0f376d17-e9e6-4eba-9d70-70960eadb9a4. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:47:16.955090 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2039b5c7-9c79-4123-b6c5-d13ff915d3dc req-a08a07db-1483-4b62-9026-6f371624bf1a service nova] Acquiring lock "refresh_cache-f1eb2456-2f51-4465-b6ff-0f76439f3029" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:47:16.955240 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2039b5c7-9c79-4123-b6c5-d13ff915d3dc req-a08a07db-1483-4b62-9026-6f371624bf1a service nova] Acquired lock "refresh_cache-f1eb2456-2f51-4465-b6ff-0f76439f3029" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:47:16.955418 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2039b5c7-9c79-4123-b6c5-d13ff915d3dc req-a08a07db-1483-4b62-9026-6f371624bf1a service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Refreshing network info cache for port 0f376d17-e9e6-4eba-9d70-70960eadb9a4 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:47:17.458425 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-2039b5c7-9c79-4123-b6c5-d13ff915d3dc req-a08a07db-1483-4b62-9026-6f371624bf1a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:17.660854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "032576d0-ced0-4686-8aad-26b4e06a4d67" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:17.661239 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "032576d0-ced0-4686-8aad-26b4e06a4d67" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:17.661427 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Attaching volume 538c207c-49c1-40a3-8d4c-d98f2c52f683 to /dev/vdb
May 19 04:47:17.708763 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:47:17.723672 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:47:17.751984 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:47:17.803612 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:47:17.803919 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:47:17.815449 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:47:17.816761 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::8008:f5ff:fe5e:1a35', 'fe80::fc16:3eff:fe3c:98a', 'fe80::fc16:3eff:fe95:86d9', 'fe80::bc20:d2ff:fef5:7278', 'fe80::fc16:3eff:fea9:81c2', 'fe80::b02a:c2ff:fe71:d502', 'fe80::fc16:3eff:fe41:2200', 'fe80::808a:12ff:fe91:c161', 'fe80::fc16:3eff:fe33:f814'] 
May 19 04:47:17.816998 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:47:17.817534 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:47:17.817534 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:47:17.820328 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-2039b5c7-9c79-4123-b6c5-d13ff915d3dc req-a08a07db-1483-4b62-9026-6f371624bf1a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:17.822021 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Updating existing volume attachment record: 2f84444b-cf93-4add-bdfd-aed9e9039af3 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:47:17.963105 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2039b5c7-9c79-4123-b6c5-d13ff915d3dc req-a08a07db-1483-4b62-9026-6f371624bf1a service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Updated VIF entry in instance network info cache for port 0f376d17-e9e6-4eba-9d70-70960eadb9a4. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:47:17.963877 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2039b5c7-9c79-4123-b6c5-d13ff915d3dc req-a08a07db-1483-4b62-9026-6f371624bf1a service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Updating instance_info_cache with network_info: [{"id": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "address": "fa:16:3e:3c:09:8a", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f376d17-e9", "ovs_interfaceid": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:47:17.992238 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0006037550001565251 future=<Future at 0x721834380d40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:17.992389 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:17.993497 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Emitting event <LifecycleEvent: 1779166022.9914737, 9df306ad-76ad-4edb-9c21-6efab9d0a26e => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:47:17.993731 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] VM Stopped (Lifecycle Event)
May 19 04:47:18.180361 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:18.405517 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '538c207c-49c1-40a3-8d4c-d98f2c52f683', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '032576d0-ced0-4686-8aad-26b4e06a4d67', 'attached_at': '', 'detached_at': '', 'volume_id': '538c207c-49c1-40a3-8d4c-d98f2c52f683', 'serial': '538c207c-49c1-40a3-8d4c-d98f2c52f683'} {{(pid=97981) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 19 04:47:18.408261 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:47:18.408634 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '538c207c-49c1-40a3-8d4c-d98f2c52f683', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:47:18.408772 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:47:18.459461 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:18.466455 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2039b5c7-9c79-4123-b6c5-d13ff915d3dc req-a08a07db-1483-4b62-9026-6f371624bf1a service nova] Releasing lock "refresh_cache-f1eb2456-2f51-4465-b6ff-0f76439f3029" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:47:18.501126 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: 9df306ad-76ad-4edb-9c21-6efab9d0a26e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:47:18.510476 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.102s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:47:18.511015 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '538c207c-49c1-40a3-8d4c-d98f2c52f683', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:47:18.525405 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:47:18.526141 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:47:18.526411 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:47:18.526655 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:47:18.527159 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:47:18.529410 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:47:18.541828 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:47:18.541828 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:18.545038 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:47:18.545038 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:18.556287 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683] added
May 19 04:47:18.556287 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:47:18.556287 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:47:18.556287 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:47:18.556287 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:47:18.556287 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:47:18.556287 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:18.557971 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:47:18.557971 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.03(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:47:18.557971 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:47:18.558382 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683] added
May 19 04:47:18.558382 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:47:18.558382 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:47:18.558382 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:47:18.558382 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:47:18.558382 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:47:18.558382 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:18.558562 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:47:18.558673 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0313(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:47:18.558768 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:47:19.557370 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:47:19.559097 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:47:19.569165 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:47:19.569165 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:47:19.575351 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:47:19.575351 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:19.582341 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:19.597502 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:19.606504 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:19.606504 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:19.606504 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:19.606504 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:19.606504 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:19.606504 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:19.606504 np0000001025 nova-compute[97981]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:19.606504 np0000001025 nova-compute[97981]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:19.606504 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:47:19.606755 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:19.606755 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:19.606755 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:19.606755 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:19.606755 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:19.606755 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:19.606755 np0000001025 nova-compute[97981]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:19.606755 np0000001025 nova-compute[97981]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:19.606755 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:47:19.618362 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:19.618362 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:19.618362 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:19.618362 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:19.618362 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:19.618362 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:19.618362 np0000001025 nova-compute[97981]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:19.618362 np0000001025 nova-compute[97981]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:19.618362 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:47:19.618672 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:19.618672 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:19.618672 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:19.618672 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:19.618672 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:19.618672 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:19.618672 np0000001025 nova-compute[97981]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:19.618672 np0000001025 nova-compute[97981]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:19.618672 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:47:19.651422 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683, portal: 192.168.40.100,3260]
May 19 04:47:19.651422 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683, portal: 192.168.40.100,3260] successful.
May 19 04:47:19.651422 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:19.664550 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:19.678833 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683, portal: 192.168.50.100,3260]
May 19 04:47:19.678833 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683, portal: 192.168.50.100,3260] successful.
May 19 04:47:19.678833 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:19.685061 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:19.685061 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:19.685061 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:19.685061 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:19.685061 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:19.685061 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:19.685061 np0000001025 nova-compute[97981]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:19.685061 np0000001025 nova-compute[97981]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:19.685061 np0000001025 nova-compute[97981]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683 (non-flash)
May 19 04:47:19.685061 np0000001025 nova-compute[97981]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683 (non-flash)
May 19 04:47:19.685061 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:47:19.685420 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:19.685420 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:19.685420 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:19.685420 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:19.685420 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:19.685420 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:19.685420 np0000001025 nova-compute[97981]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:19.685420 np0000001025 nova-compute[97981]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:19.685420 np0000001025 nova-compute[97981]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683 (non-flash)
May 19 04:47:19.685420 np0000001025 nova-compute[97981]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683 (non-flash)
May 19 04:47:19.685420 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:47:19.685663 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:47:19.685663 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:47:19.686588 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] HCTL ('13', '-', '-', 0) found on session 140 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:47:19.686695 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:47:19.692318 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:19.719440 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Searching for a device in session 140 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:47:19.719440 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '538c207c-49c1-40a3-8d4c-d98f2c52f683', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:47:19.734198 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:19.734198 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:19.734198 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:19.734198 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:19.734198 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:19.734198 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:19.734198 np0000001025 nova-compute[97981]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:19.734198 np0000001025 nova-compute[97981]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:19.734198 np0000001025 nova-compute[97981]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683 (non-flash)
May 19 04:47:19.734198 np0000001025 nova-compute[97981]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683 (non-flash)
May 19 04:47:19.734198 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:47:19.734425 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:19.734425 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:19.734425 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:19.734425 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:19.734425 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:19.734425 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:19.734425 np0000001025 nova-compute[97981]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:19.734425 np0000001025 nova-compute[97981]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:19.734425 np0000001025 nova-compute[97981]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683 (non-flash)
May 19 04:47:19.734425 np0000001025 nova-compute[97981]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683 (non-flash)
May 19 04:47:19.734425 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:47:19.734612 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.208s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:47:19.734680 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:47:19.736184 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] HCTL ('16', '-', '-', 0) found on session 141 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:47:19.736184 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:47:19.750539 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Searching for a device in session 141 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:47:19.750539 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '538c207c-49c1-40a3-8d4c-d98f2c52f683', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:47:19.892935 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:20.155215 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:20.527103 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:47:21.432557 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:21.432862 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:21.544887 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Found WWN 33000000018307703 for multipath device dm-9 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:47:21.545235 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:47:21.546953 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] <== connect_volume: return (3138ms) {'type': 'block', 'scsi_wwn': '33000000018307703', 'path': '/dev/disk/by-id/os-brick+dev+dm-9', 'multipath_id': '33000000018307703'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:47:21.547117 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000018307703', 'path': '/dev/disk/by-id/os-brick+dev+dm-9', 'multipath_id': '33000000018307703'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:47:21.552494 np0000001025 nova-compute[97981]: WARNING stevedore.named [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 19 04:47:21.552732 np0000001025 nova-compute[97981]: WARNING castellan.key_manager [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:47:21.552916 np0000001025 nova-compute[97981]: WARNING nova.keymgr.conf_key_mgr [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:47:21.556122 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x721834336960>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '538c207c-49c1-40a3-8d4c-d98f2c52f683', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, 'status': 'reserved', 'instance': '032576d0-ced0-4686-8aad-26b4e06a4d67', 'attached_at': '', 'detached_at': '', 'volume_id': '538c207c-49c1-40a3-8d4c-d98f2c52f683', 'serial': '538c207c-49c1-40a3-8d4c-d98f2c52f683'} {{(pid=97981) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 19 04:47:21.556318 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=97981) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 19 04:47:21.556475 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors.luks [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] opening encrypted volume /dev/dm-9 {{(pid=97981) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 19 04:47:21.591536 np0000001025 nova-compute[97981]: WARNING os_brick.encryptors.luks [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 19 04:47:21.591692 np0000001025 nova-compute[97981]: INFO os_brick.encryptors.luks [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] /dev/dm-9 is not a valid LUKS device; formatting device for first use
May 19 04:47:21.591838 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors.luks [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] formatting encrypted volume /dev/dm-9 {{(pid=97981) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 19 04:47:21.939064 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Detaching volume 03313691-1009-4c39-a92f-81fd1cb1d8a9
May 19 04:47:21.989887 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Attempting to driver detach volume 03313691-1009-4c39-a92f-81fd1cb1d8a9 from mountpoint /dev/vdb
May 19 04:47:22.000190 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Found disk vdb by alias ua-03313691-1009-4c39-a92f-81fd1cb1d8a9 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:47:22.001774 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Found disk vdb by alias ua-03313691-1009-4c39-a92f-81fd1cb1d8a9 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:47:22.004131 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Attempting to detach device vdb from instance 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:47:22.004131 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:47:22.004131 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:47:22.004131 np0000001025 nova-compute[97981]:   <alias name="ua-03313691-1009-4c39-a92f-81fd1cb1d8a9"/>
May 19 04:47:22.004131 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-4"/>
May 19 04:47:22.004131 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:47:22.004131 np0000001025 nova-compute[97981]:   <serial>03313691-1009-4c39-a92f-81fd1cb1d8a9</serial>
May 19 04:47:22.004131 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:47:22.004131 np0000001025 nova-compute[97981]: </disk>
May 19 04:47:22.004131 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:47:22.014148 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Successfully detached device vdb from instance 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117 from the persistent domain config.
May 19 04:47:22.014474 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] (1/8): Attempting to detach device vdb with device alias ua-03313691-1009-4c39-a92f-81fd1cb1d8a9 from instance 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:47:22.014825 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:47:22.014825 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:47:22.014825 np0000001025 nova-compute[97981]:   <alias name="ua-03313691-1009-4c39-a92f-81fd1cb1d8a9"/>
May 19 04:47:22.014825 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-4"/>
May 19 04:47:22.014825 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:47:22.014825 np0000001025 nova-compute[97981]:   <serial>03313691-1009-4c39-a92f-81fd1cb1d8a9</serial>
May 19 04:47:22.014825 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:47:22.014825 np0000001025 nova-compute[97981]: </disk>
May 19 04:47:22.014825 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:47:22.518239 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779166042.5178418, 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117 => ua-03313691-1009-4c39-a92f-81fd1cb1d8a9> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:47:22.520319 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-03313691-1009-4c39-a92f-81fd1cb1d8a9 for instance 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:47:22.523742 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Successfully detached device vdb from instance 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117 from the live domain config.
May 19 04:47:22.524889 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:47:22.525895 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9', 'iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03313691-1009-4c39-a92f-81fd1cb1d8a9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:47:22.525895 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:47:22.525895 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:47:22.526221 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9', 'iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03313691-1009-4c39-a92f-81fd1cb1d8a9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:47:22.526221 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:47:22.555561 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:22.555561 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:22.555561 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:22.555561 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:22.555561 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:22.555561 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:22.555561 np0000001025 nova-compute[97981]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:22.555561 np0000001025 nova-compute[97981]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:22.555561 np0000001025 nova-compute[97981]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683 (non-flash)
May 19 04:47:22.555561 np0000001025 nova-compute[97981]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683 (non-flash)
May 19 04:47:22.555561 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:47:22.556058 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:22.556058 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:22.556058 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:22.556058 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:22.556058 np0000001025 nova-compute[97981]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:22.556058 np0000001025 nova-compute[97981]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9 (non-flash)
May 19 04:47:22.556058 np0000001025 nova-compute[97981]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:22.556058 np0000001025 nova-compute[97981]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:22.556058 np0000001025 nova-compute[97981]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683 (non-flash)
May 19 04:47:22.556058 np0000001025 nova-compute[97981]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683 (non-flash)
May 19 04:47:22.556058 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:47:22.556058 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '127'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', '130'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9', '136'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', '138'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', '140'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', '141')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:47:22.556469 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9', '136')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:47:22.557921 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9', '135')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:47:22.558771 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185012f420>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9'): ({'sdf'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:47:22.559040 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Removing multipathed devices sdg, sdf {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:47:22.559660 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Flush multipath device 33000000005737a8d {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:47:22.592574 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:22.592838 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:22.594794 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:47:22.646663 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:47:22.697590 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:47:22.697819 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:47:22.699014 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:47:22.708993 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:47:22.709291 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:47:22.721429 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:22.756410 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 136, target: iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9, portal: 192.168.40.100,3260]
May 19 04:47:22.756410 np0000001025 nova-compute[97981]: Logout of [sid: 136, target: iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9, portal: 192.168.40.100,3260] successful.
May 19 04:47:22.756410 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:22.773155 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:22.783684 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:22.819741 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 135, target: iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9, portal: 192.168.50.100,3260]
May 19 04:47:22.819741 np0000001025 nova-compute[97981]: Logout of [sid: 135, target: iqn.2023-03.storpool.com:os--volume-03313691-1009-4c39-a92f-81fd1cb1d8a9, portal: 192.168.50.100,3260] successful.
May 19 04:47:22.819741 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:22.840197 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:22.840714 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:47:22.840922 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] <== disconnect_volume: return (315ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:47:22.841126 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:47:23.095100 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:47:23.398187 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lazy-loading 'flavor' on Instance uuid 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:47:23.461103 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:23.662153 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:23.662153 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:23.662153 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:47:23.662153 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Claim successful on node np0000001025
May 19 04:47:24.410160 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8d2bb83e-e77b-40dd-9957-027884e91462 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.976s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:24.677247 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:24.686741 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.009s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:24.688535 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:24.688941 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:24.689651 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:24.695310 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Terminating instance
May 19 04:47:25.076864 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:47:25.077115 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:47:25.171694 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:25.232056 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:47:25.255935 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:25.266762 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:25.289622 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:25.304691 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:25.329568 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:25.432010 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a7df5c0b-9207-4aff-b144-4bcdfb7e5fb9 req-053968de-6b31-407a-b592-92a7c87c3a5b service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Received event network-vif-unplugged-a00ed8d4-ff2d-4d0c-ad93-b01200ce4181 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:25.432218 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a7df5c0b-9207-4aff-b144-4bcdfb7e5fb9 req-053968de-6b31-407a-b592-92a7c87c3a5b service nova] Acquiring lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:25.432505 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a7df5c0b-9207-4aff-b144-4bcdfb7e5fb9 req-053968de-6b31-407a-b592-92a7c87c3a5b service nova] Lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:25.432505 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a7df5c0b-9207-4aff-b144-4bcdfb7e5fb9 req-053968de-6b31-407a-b592-92a7c87c3a5b service nova] Lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:25.432648 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a7df5c0b-9207-4aff-b144-4bcdfb7e5fb9 req-053968de-6b31-407a-b592-92a7c87c3a5b service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] No waiting events found dispatching network-vif-unplugged-a00ed8d4-ff2d-4d0c-ad93-b01200ce4181 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:47:25.432745 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a7df5c0b-9207-4aff-b144-4bcdfb7e5fb9 req-053968de-6b31-407a-b592-92a7c87c3a5b service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Received event network-vif-unplugged-a00ed8d4-ff2d-4d0c-ad93-b01200ce4181 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:47:25.575559 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999718014999871 future=<Future at 0x7218343665d0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:25.576161 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999308342999939 future=<Future at 0x7218343665d0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:25.576161 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999126053000055 future=<Future at 0x7218343665d0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:25.576685 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Instance destroyed successfully.
May 19 04:47:25.581822 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:47:25.587136 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lazy-loading 'resources' on Instance uuid 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:47:26.089689 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.435s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:26.091333 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1333413469',display_name='tempest-VolumesBackupsTest-instance-1333413469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesbackupstest-instance-1333413469',id=59,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrjL6rtPDpYDA7oIR30sic0p3S8tb4N47/h7yopbk+5rrKgAy6HQUBcJrVyFYLshCCakAzldqDL/JV/fvEv1MnWXM7gmhzlOFHTDFzr5dvTE9/CULLlU1UpInQvk7IDXQ==',key_name='tempest-keypair-401773272',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:46:15Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec4a48491cc047108747a22e8c63c3ac',ramdisk_id='',reservation_id='r-0gc53gu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-1527553839',owner_user_name='tempest-VolumesBackupsTest-1527553839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40f0313124fa425c916b6ad44fe2d7f3',uuid=5c7b7f14-f27a-4c7b-a39e-fd7c75d93117,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a00ed8d4-ff2d-4d0c-ad93-b01200ce4181", "address": "fa:16:3e:a9:81:c2", "network": {"id": "8a07682e-aaf0-4a4f-8bc0-70db155f01be", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2139331559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec4a48491cc047108747a22e8c63c3ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ed8d4-ff", "ovs_interfaceid": "a00ed8d4-ff2d-4d0c-ad93-b01200ce4181", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:47:26.091604 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:47:26.093599 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Converting VIF {"id": "a00ed8d4-ff2d-4d0c-ad93-b01200ce4181", "address": "fa:16:3e:a9:81:c2", "network": {"id": "8a07682e-aaf0-4a4f-8bc0-70db155f01be", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2139331559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec4a48491cc047108747a22e8c63c3ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00ed8d4-ff", "ovs_interfaceid": "a00ed8d4-ff2d-4d0c-ad93-b01200ce4181", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:47:26.094235 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:81:c2,bridge_name='br-int',has_traffic_filtering=True,id=a00ed8d4-ff2d-4d0c-ad93-b01200ce4181,network=Network(8a07682e-aaf0-4a4f-8bc0-70db155f01be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00ed8d4-ff') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:47:26.094682 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:81:c2,bridge_name='br-int',has_traffic_filtering=True,id=a00ed8d4-ff2d-4d0c-ad93-b01200ce4181,network=Network(8a07682e-aaf0-4a4f-8bc0-70db155f01be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00ed8d4-ff') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:47:26.103283 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:26.103491 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa00ed8d4-ff, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:47:26.105866 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:26.106811 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:47:26.107308 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:26.107431 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2306197c-6267-465c-99e7-674b87d9b584) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:47:26.107928 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:26.109152 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:26.109543 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:47:26.111088 np0000001025 nova-compute[97981]: INFO os_vif [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:81:c2,bridge_name='br-int',has_traffic_filtering=True,id=a00ed8d4-ff2d-4d0c-ad93-b01200ce4181,network=Network(8a07682e-aaf0-4a4f-8bc0-70db155f01be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00ed8d4-ff')
May 19 04:47:26.111491 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Deleting instance files /opt/stack/data/nova/instances/5c7b7f14-f27a-4c7b-a39e-fd7c75d93117_del
May 19 04:47:26.112175 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Deletion of /opt/stack/data/nova/instances/5c7b7f14-f27a-4c7b-a39e-fd7c75d93117_del complete
May 19 04:47:26.608905 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:47:26.609160 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:47:26.609751 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:26.610031 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:26.620519 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Took 1.39 seconds to destroy the instance on the hypervisor.
May 19 04:47:26.621266 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:47:26.621544 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:47:26.621667 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:47:26.621920 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:26.704402 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:26.726785 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fd3d5c8cf5c41589ceb1e2a5a9813c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e16e702e1284e7fbba4184913a43de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:47:27.113257 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:47:27.306596 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e36a77e6-7f74-41df-8a57-6bb17815a532 req-aa176014-f518-4c45-bff5-85173d040e10 service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Received event network-vif-deleted-a00ed8d4-ff2d-4d0c-ad93-b01200ce4181 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:27.306596 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-e36a77e6-7f74-41df-8a57-6bb17815a532 req-aa176014-f518-4c45-bff5-85173d040e10 service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Neutron deleted interface a00ed8d4-ff2d-4d0c-ad93-b01200ce4181; detaching it from the instance and deleting it from the info cache
May 19 04:47:27.306596 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e36a77e6-7f74-41df-8a57-6bb17815a532 req-aa176014-f518-4c45-bff5-85173d040e10 service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:47:27.354199 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Successfully created port: 4a0502dc-0324-428b-b82c-e3ef9fc303e8 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:47:27.497875 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-caf43c49-f900-4deb-b597-0320d606e992 req-9d291168-de4b-4ecc-bd00-0c34eb5c4717 service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Received event network-vif-unplugged-a00ed8d4-ff2d-4d0c-ad93-b01200ce4181 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:27.498927 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-caf43c49-f900-4deb-b597-0320d606e992 req-9d291168-de4b-4ecc-bd00-0c34eb5c4717 service nova] Acquiring lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:27.499177 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-caf43c49-f900-4deb-b597-0320d606e992 req-9d291168-de4b-4ecc-bd00-0c34eb5c4717 service nova] Lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:27.499347 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-caf43c49-f900-4deb-b597-0320d606e992 req-9d291168-de4b-4ecc-bd00-0c34eb5c4717 service nova] Lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:27.500243 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-caf43c49-f900-4deb-b597-0320d606e992 req-9d291168-de4b-4ecc-bd00-0c34eb5c4717 service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] No waiting events found dispatching network-vif-unplugged-a00ed8d4-ff2d-4d0c-ad93-b01200ce4181 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:47:27.500243 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-caf43c49-f900-4deb-b597-0320d606e992 req-9d291168-de4b-4ecc-bd00-0c34eb5c4717 service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Received event network-vif-unplugged-a00ed8d4-ff2d-4d0c-ad93-b01200ce4181 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:47:27.616057 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:47:27.735878 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:47:27.811183 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e36a77e6-7f74-41df-8a57-6bb17815a532 req-aa176014-f518-4c45-bff5-85173d040e10 service nova] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Detach interface failed, port_id=a00ed8d4-ff2d-4d0c-ad93-b01200ce4181, reason: Instance 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:47:27.816633 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "e2017472-4da3-4676-b614-3e7039fedef3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:27.816903 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "e2017472-4da3-4676-b614-3e7039fedef3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:27.918623 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Successfully updated port: 4a0502dc-0324-428b-b82c-e3ef9fc303e8 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:47:28.209708 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors.luks [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] opening encrypted volume /dev/dm-9 {{(pid=97981) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 19 04:47:28.238202 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Took 1.62 seconds to deallocate network for instance.
May 19 04:47:28.319203 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Detaching volume 440133cc-e2e2-47e8-af85-891406649029
May 19 04:47:28.365219 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Attempting to driver detach volume 440133cc-e2e2-47e8-af85-891406649029 from mountpoint /dev/vdb
May 19 04:47:28.371957 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Found disk vdb by alias ua-440133cc-e2e2-47e8-af85-891406649029 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:47:28.373608 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Found disk vdb by alias ua-440133cc-e2e2-47e8-af85-891406649029 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:47:28.373738 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Attempting to detach device vdb from instance e2017472-4da3-4676-b614-3e7039fedef3 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:47:28.373981 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:47:28.373981 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:47:28.373981 np0000001025 nova-compute[97981]:   <alias name="ua-440133cc-e2e2-47e8-af85-891406649029"/>
May 19 04:47:28.373981 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:47:28.373981 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:47:28.373981 np0000001025 nova-compute[97981]:   <serial>440133cc-e2e2-47e8-af85-891406649029</serial>
May 19 04:47:28.373981 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:47:28.373981 np0000001025 nova-compute[97981]: </disk>
May 19 04:47:28.373981 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:47:28.379977 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Successfully detached device vdb from instance e2017472-4da3-4676-b614-3e7039fedef3 from the persistent domain config.
May 19 04:47:28.380132 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] (1/8): Attempting to detach device vdb with device alias ua-440133cc-e2e2-47e8-af85-891406649029 from instance e2017472-4da3-4676-b614-3e7039fedef3 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:47:28.380365 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:47:28.380365 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:47:28.380365 np0000001025 nova-compute[97981]:   <alias name="ua-440133cc-e2e2-47e8-af85-891406649029"/>
May 19 04:47:28.380365 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:47:28.380365 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:47:28.380365 np0000001025 nova-compute[97981]:   <serial>440133cc-e2e2-47e8-af85-891406649029</serial>
May 19 04:47:28.380365 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:47:28.380365 np0000001025 nova-compute[97981]: </disk>
May 19 04:47:28.380365 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:47:28.421033 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "refresh_cache-3bd17542-9a9b-4bda-80a6-413cb4c2091d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:47:28.421230 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquired lock "refresh_cache-3bd17542-9a9b-4bda-80a6-413cb4c2091d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:47:28.421438 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:47:28.463625 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:28.623926 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:47:28.624896 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:47:28.625141 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Creating image(s)
May 19 04:47:28.625755 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "/opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:28.625935 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "/opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:28.626392 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "/opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:28.627047 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:47:28.629430 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:47:28.631941 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:47:28.733254 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.101s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:47:28.733886 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:28.734616 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:28.735153 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:47:28.737652 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:47:28.738018 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:47:28.758250 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:28.758684 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:28.839177 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.100s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:47:28.839177 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:47:28.898659 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/disk 1073741824" returned: 0 in 0.060s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:47:28.899741 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.165s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:28.899741 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:47:28.967611 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779166048.9669611, e2017472-4da3-4676-b614-3e7039fedef3 => ua-440133cc-e2e2-47e8-af85-891406649029> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:47:28.969456 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-440133cc-e2e2-47e8-af85-891406649029 for instance e2017472-4da3-4676-b614-3e7039fedef3 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:47:28.973132 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Successfully detached device vdb from instance e2017472-4da3-4676-b614-3e7039fedef3 from the live domain config.
May 19 04:47:28.974471 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:47:28.974883 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '440133cc-e2e2-47e8-af85-891406649029', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:47:28.975038 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:47:28.975575 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:47:28.975900 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '440133cc-e2e2-47e8-af85-891406649029', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:47:28.976057 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:47:28.994959 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.095s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:47:28.998126 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:47:28.998126 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:47:29.012420 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:29.012420 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:29.012420 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:29.012420 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:29.012420 np0000001025 nova-compute[97981]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:29.012420 np0000001025 nova-compute[97981]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:29.012420 np0000001025 nova-compute[97981]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683 (non-flash)
May 19 04:47:29.012420 np0000001025 nova-compute[97981]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683 (non-flash)
May 19 04:47:29.012420 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:47:29.012770 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:29.012770 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:29.012770 np0000001025 nova-compute[97981]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:29.012770 np0000001025 nova-compute[97981]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029 (non-flash)
May 19 04:47:29.012770 np0000001025 nova-compute[97981]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:29.012770 np0000001025 nova-compute[97981]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:29.012770 np0000001025 nova-compute[97981]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683 (non-flash)
May 19 04:47:29.012770 np0000001025 nova-compute[97981]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683 (non-flash)
May 19 04:47:29.012770 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:47:29.013320 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '127'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', '138'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', '140'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', '141')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:47:29.013757 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', '129')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:47:29.032134 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:47:29.036811 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029', '130')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:47:29.038144 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721834447740>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029'): ({'sdc'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:47:29.038404 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Removing multipathed devices sdc, sdb {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:47:29.038695 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Flush multipath device 330000000f0eff326 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:47:29.073622 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:47:29.088970 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:47:29.089404 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Cannot resize image /opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:47:29.090171 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:47:29.090301 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Ensure instance console log exists: /opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:47:29.093131 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:29.093131 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:29.093131 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:29.131922 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:47:29.195532 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:47:29.195848 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:47:29.199129 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:47:29.214576 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:47:29.215014 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:47:29.228558 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:29.250600 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:29.265939 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 129, target: iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029, portal: 192.168.40.100,3260]
May 19 04:47:29.265939 np0000001025 nova-compute[97981]: Logout of [sid: 129, target: iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029, portal: 192.168.40.100,3260] successful.
May 19 04:47:29.265939 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:29.277190 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:47:29.277529 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:47:29.291039 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:29.307531 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:29.344041 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 130, target: iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029, portal: 192.168.50.100,3260]
May 19 04:47:29.344041 np0000001025 nova-compute[97981]: Logout of [sid: 130, target: iqn.2023-03.storpool.com:os--volume-440133cc-e2e2-47e8-af85-891406649029, portal: 192.168.50.100,3260] successful.
May 19 04:47:29.344041 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:29.365363 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:29.365780 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:47:29.365974 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] <== disconnect_volume: return (391ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:47:29.366177 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:47:29.396374 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Updating instance_info_cache with network_info: [{"id": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "address": "fa:16:3e:9b:91:0a", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0502dc-03", "ovs_interfaceid": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:47:29.566360 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1e5fd0b9-4c43-42c0-9181-130f7e52f923 req-f12fe08d-edae-4f85-ac57-d861555e81c6 service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Received event network-changed-4a0502dc-0324-428b-b82c-e3ef9fc303e8 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:29.566763 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1e5fd0b9-4c43-42c0-9181-130f7e52f923 req-f12fe08d-edae-4f85-ac57-d861555e81c6 service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Refreshing instance network info cache due to event network-changed-4a0502dc-0324-428b-b82c-e3ef9fc303e8. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:47:29.566902 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1e5fd0b9-4c43-42c0-9181-130f7e52f923 req-f12fe08d-edae-4f85-ac57-d861555e81c6 service nova] Acquiring lock "refresh_cache-3bd17542-9a9b-4bda-80a6-413cb4c2091d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:47:29.785174 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:47:29.901203 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Releasing lock "refresh_cache-3bd17542-9a9b-4bda-80a6-413cb4c2091d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:47:29.901203 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Instance network_info: |[{"id": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "address": "fa:16:3e:9b:91:0a", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0502dc-03", "ovs_interfaceid": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:47:29.901203 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Start _get_guest_xml network_info=[{"id": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "address": "fa:16:3e:9b:91:0a", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0502dc-03", "ovs_interfaceid": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:47:29.901203 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1e5fd0b9-4c43-42c0-9181-130f7e52f923 req-f12fe08d-edae-4f85-ac57-d861555e81c6 service nova] Acquired lock "refresh_cache-3bd17542-9a9b-4bda-80a6-413cb4c2091d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:47:29.901598 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1e5fd0b9-4c43-42c0-9181-130f7e52f923 req-f12fe08d-edae-4f85-ac57-d861555e81c6 service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Refreshing network info cache for port 4a0502dc-0324-428b-b82c-e3ef9fc303e8 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:47:29.905554 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:47:29.906835 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1519602058', uuid='3bd17542-9a9b-4bda-80a6-413cb4c2091d'), owner=OwnerMeta(userid='3fd3d5c8cf5c41589ceb1e2a5a9813c9', username='tempest-AttachVolumeNegativeTest-198121636-project-member', projectid='2e16e702e1284e7fbba4184913a43de7', projectname='tempest-AttachVolumeNegativeTest-198121636'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "address": "fa:16:3e:9b:91:0a", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0502dc-03", "ovs_interfaceid": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166049.90634) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:47:29.908803 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:47:29.909039 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:47:29.910837 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:47:29.911176 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:47:29.912253 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:47:29.912952 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:47:29.912952 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:47:29.913284 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:47:29.913284 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:47:29.913284 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:47:29.913496 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:47:29.913847 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:47:29.913847 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:47:29.913847 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:47:29.914045 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:47:29.914124 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:47:29.924688 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lazy-loading 'flavor' on Instance uuid e2017472-4da3-4676-b614-3e7039fedef3 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:47:29.929122 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:47:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1519602058',display_name='tempest-AttachVolumeNegativeTest-server-1519602058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumenegativetest-server-1519602058',id=62,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiwvfOeciIOcJOeucaJt13r8OQ9LXJLgM+W8vXWJc5gkCuVE9A7LrgCN4JdEQ2Wp3m8aXka335aN8TxivFJ0U50jwtVNuMtnsiYK7tEwyqWqo0d1GurulEHCTPxl3EcOg==',key_name='tempest-keypair-437911657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e16e702e1284e7fbba4184913a43de7',ramdisk_id='',reservation_id='r-zv6wm6fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-198121636',owner_user_name='tempest-AttachVolumeNegativeTest-198121636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:47:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fd3d5c8cf5c41589ceb1e2a5a9813c9',uuid=3bd17542-9a9b-4bda-80a6-413cb4c2091d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "address": "fa:16:3e:9b:91:0a", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0502dc-03", "ovs_interfaceid": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:47:29.929122 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converting VIF {"id": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "address": "fa:16:3e:9b:91:0a", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0502dc-03", "ovs_interfaceid": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:47:29.929122 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:91:0a,bridge_name='br-int',has_traffic_filtering=True,id=4a0502dc-0324-428b-b82c-e3ef9fc303e8,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a0502dc-03') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:47:29.929122 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lazy-loading 'pci_devices' on Instance uuid 3bd17542-9a9b-4bda-80a6-413cb4c2091d {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:47:30.179371 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lazy-loading 'flavor' on Instance uuid 032576d0-ced0-4686-8aad-26b4e06a4d67 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:47:30.300960 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.542s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:30.348699 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Deleted allocations for instance 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117
May 19 04:47:30.403843 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-1e5fd0b9-4c43-42c0-9181-130f7e52f923 req-f12fe08d-edae-4f85-ac57-d861555e81c6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:30.431835 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] End _get_guest_xml xml=<domain type="qemu">
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:   <uuid>3bd17542-9a9b-4bda-80a6-413cb4c2091d</uuid>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:   <name>instance-0000003e</name>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1519602058</nova:name>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:47:29</nova:creationTime>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:         <nova:user uuid="3fd3d5c8cf5c41589ceb1e2a5a9813c9">tempest-AttachVolumeNegativeTest-198121636-project-member</nova:user>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:         <nova:project uuid="2e16e702e1284e7fbba4184913a43de7">tempest-AttachVolumeNegativeTest-198121636</nova:project>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:         <nova:port uuid="4a0502dc-0324-428b-b82c-e3ef9fc303e8">
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     <system>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <entry name="serial">3bd17542-9a9b-4bda-80a6-413cb4c2091d</entry>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <entry name="uuid">3bd17542-9a9b-4bda-80a6-413cb4c2091d</entry>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     </system>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:   <os>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:   </os>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:   <features>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:   </features>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:   <devices>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/disk"/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     </disk>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/disk.config"/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     </disk>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:9b:91:0a"/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <target dev="tap4a0502dc-03"/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     </interface>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/console.log" append="off"/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     </serial>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     <video>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     </video>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     </rng>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:   </devices>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]: </domain>
May 19 04:47:30.431835 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:47:30.434801 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Preparing to wait for external event network-vif-plugged-4a0502dc-0324-428b-b82c-e3ef9fc303e8 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:47:30.434801 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:30.434801 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:30.434801 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:30.434801 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:47:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1519602058',display_name='tempest-AttachVolumeNegativeTest-server-1519602058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumenegativetest-server-1519602058',id=62,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiwvfOeciIOcJOeucaJt13r8OQ9LXJLgM+W8vXWJc5gkCuVE9A7LrgCN4JdEQ2Wp3m8aXka335aN8TxivFJ0U50jwtVNuMtnsiYK7tEwyqWqo0d1GurulEHCTPxl3EcOg==',key_name='tempest-keypair-437911657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e16e702e1284e7fbba4184913a43de7',ramdisk_id='',reservation_id='r-zv6wm6fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-198121636',owner_user_name='tempest-AttachVolumeNegativeTest-198121636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:47:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fd3d5c8cf5c41589ceb1e2a5a9813c9',uuid=3bd17542-9a9b-4bda-80a6-413cb4c2091d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "address": "fa:16:3e:9b:91:0a", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0502dc-03", "ovs_interfaceid": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:47:30.434801 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converting VIF {"id": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "address": "fa:16:3e:9b:91:0a", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0502dc-03", "ovs_interfaceid": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:47:30.434801 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:91:0a,bridge_name='br-int',has_traffic_filtering=True,id=4a0502dc-0324-428b-b82c-e3ef9fc303e8,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a0502dc-03') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:47:30.434801 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:91:0a,bridge_name='br-int',has_traffic_filtering=True,id=4a0502dc-0324-428b-b82c-e3ef9fc303e8,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a0502dc-03') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:47:30.435293 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:30.435293 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:47:30.435563 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:47:30.436525 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:30.436726 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bba18851-2894-58f1-91ab-f44dfa43a52e', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:47:30.437407 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:30.438658 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:47:30.440428 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:30.440569 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a0502dc-03, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:47:30.440866 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a0502dc-03, col_values=(('qos', UUID('e85f56ca-89b8-4a07-8592-fc7bbd3c76e4')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:47:30.441055 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a0502dc-03, col_values=(('external_ids', {'iface-id': '4a0502dc-0324-428b-b82c-e3ef9fc303e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:91:0a', 'vm-uuid': '3bd17542-9a9b-4bda-80a6-413cb4c2091d'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:47:30.442136 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:30.444136 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:47:30.448530 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:30.449773 np0000001025 nova-compute[97981]: INFO os_vif [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:91:0a,bridge_name='br-int',has_traffic_filtering=True,id=4a0502dc-0324-428b-b82c-e3ef9fc303e8,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a0502dc-03')
May 19 04:47:30.661151 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-1e5fd0b9-4c43-42c0-9181-130f7e52f923 req-f12fe08d-edae-4f85-ac57-d861555e81c6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:30.681989 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Attempting to attach volume 538c207c-49c1-40a3-8d4c-d98f2c52f683 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:47:30.683174 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:47:30.683174 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:47:30.683174 np0000001025 nova-compute[97981]:   <alias name="ua-538c207c-49c1-40a3-8d4c-d98f2c52f683"/>
May 19 04:47:30.683174 np0000001025 nova-compute[97981]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-9"/>
May 19 04:47:30.683174 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:47:30.683174 np0000001025 nova-compute[97981]:   <serial>538c207c-49c1-40a3-8d4c-d98f2c52f683</serial>
May 19 04:47:30.683174 np0000001025 nova-compute[97981]: </disk>
May 19 04:47:30.683174 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:47:30.783154 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1e5fd0b9-4c43-42c0-9181-130f7e52f923 req-f12fe08d-edae-4f85-ac57-d861555e81c6 service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Updated VIF entry in instance network info cache for port 4a0502dc-0324-428b-b82c-e3ef9fc303e8. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:47:30.783450 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1e5fd0b9-4c43-42c0-9181-130f7e52f923 req-f12fe08d-edae-4f85-ac57-d861555e81c6 service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Updating instance_info_cache with network_info: [{"id": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "address": "fa:16:3e:9b:91:0a", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0502dc-03", "ovs_interfaceid": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:47:30.934773 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-edf2c8eb-dca0-4381-8c94-c071ca69707f tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "e2017472-4da3-4676-b614-3e7039fedef3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.118s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:31.285455 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1e5fd0b9-4c43-42c0-9181-130f7e52f923 req-f12fe08d-edae-4f85-ac57-d861555e81c6 service nova] Releasing lock "refresh_cache-3bd17542-9a9b-4bda-80a6-413cb4c2091d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:47:31.356487 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-94626057-9e68-4e04-a756-6a6b91c37c06 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "5c7b7f14-f27a-4c7b-a39e-fd7c75d93117" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.670s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:31.396498 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "e2017472-4da3-4676-b614-3e7039fedef3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:31.396748 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "e2017472-4da3-4676-b614-3e7039fedef3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:31.397027 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "e2017472-4da3-4676-b614-3e7039fedef3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:31.397231 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:31.397417 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:31.399606 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Terminating instance
May 19 04:47:31.902530 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:47:31.923419 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:31.925596 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:31.940201 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:31.943270 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:31.968064 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:31.975858 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:47:31.976020 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:47:31.976122 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No VIF found with MAC fa:16:3e:9b:91:0a, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:47:31.977139 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Using config drive
May 19 04:47:32.054398 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f0f2984f-1974-46ce-a265-e965ba5ebf58 req-5b32ccee-5f5b-43d4-be93-8993e46b3a1f service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received event network-vif-unplugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:32.054674 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f0f2984f-1974-46ce-a265-e965ba5ebf58 req-5b32ccee-5f5b-43d4-be93-8993e46b3a1f service nova] Acquiring lock "e2017472-4da3-4676-b614-3e7039fedef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:32.054907 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f0f2984f-1974-46ce-a265-e965ba5ebf58 req-5b32ccee-5f5b-43d4-be93-8993e46b3a1f service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:32.055595 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f0f2984f-1974-46ce-a265-e965ba5ebf58 req-5b32ccee-5f5b-43d4-be93-8993e46b3a1f service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:32.055595 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f0f2984f-1974-46ce-a265-e965ba5ebf58 req-5b32ccee-5f5b-43d4-be93-8993e46b3a1f service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] No waiting events found dispatching network-vif-unplugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:47:32.055595 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f0f2984f-1974-46ce-a265-e965ba5ebf58 req-5b32ccee-5f5b-43d4-be93-8993e46b3a1f service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received event network-vif-unplugged-381aabe0-261a-4722-a473-90dd923ddd70 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:47:32.193251 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:32.205539 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:32.217457 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999648155000159 future=<Future at 0x721834366db0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:32.220578 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Instance destroyed successfully.
May 19 04:47:32.221221 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lazy-loading 'resources' on Instance uuid e2017472-4da3-4676-b614-3e7039fedef3 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:47:32.326498 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:47:32.326648 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:47:32.326701 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:47:32.326798 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] No VIF found with MAC fa:16:3e:41:22:00, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:47:32.482896 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:32.600728 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Creating config drive at /opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/disk.config
May 19 04:47:32.604794 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc1pfw5_w {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:47:32.658550 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc1pfw5_w" returned: 0 in 0.053s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:47:32.724524 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:45:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1645383300',display_name='tempest-ServerStableDeviceRescueTest-server-1645383300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-serverstabledevicerescuetest-server-1645383300',id=56,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmxK8WyxxhAZNJAGW9uj5RApz4FkMYnu+jzzwFf9ZoRxi4XmMIeQ6coYidX3UcBjBPKUfhayqmjiBIQ5+6lbotN9MsTrUqZ3reOtIllIXaAg6VTnfB25fPMIGjifc5wrA==',key_name='tempest-keypair-32905224',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:46:49Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f892ab02546d4b6295c6abf1e79121ce',ramdisk_id='',reservation_id='r-7myclumk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1373788552',owner_user_name='tempest-ServerStableDeviceRescueTest-1373788552-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71fd665949ed42008ee194558e5a8f1a',uuid=e2017472-4da3-4676-b614-3e7039fedef3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "381aabe0-261a-4722-a473-90dd923ddd70", "address": "fa:16:3e:33:f8:14", "network": {"id": "502bb41d-fb0e-4491-9039-68b5fde2624f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-951372128-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f892ab02546d4b6295c6abf1e79121ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap381aabe0-26", "ovs_interfaceid": "381aabe0-261a-4722-a473-90dd923ddd70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:47:32.724838 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Converting VIF {"id": "381aabe0-261a-4722-a473-90dd923ddd70", "address": "fa:16:3e:33:f8:14", "network": {"id": "502bb41d-fb0e-4491-9039-68b5fde2624f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-951372128-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f892ab02546d4b6295c6abf1e79121ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap381aabe0-26", "ovs_interfaceid": "381aabe0-261a-4722-a473-90dd923ddd70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:47:32.725834 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:f8:14,bridge_name='br-int',has_traffic_filtering=True,id=381aabe0-261a-4722-a473-90dd923ddd70,network=Network(502bb41d-fb0e-4491-9039-68b5fde2624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap381aabe0-26') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:47:32.726244 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:f8:14,bridge_name='br-int',has_traffic_filtering=True,id=381aabe0-261a-4722-a473-90dd923ddd70,network=Network(502bb41d-fb0e-4491-9039-68b5fde2624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap381aabe0-26') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:47:32.728240 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:32.728673 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap381aabe0-26, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:47:32.729929 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:32.730877 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:47:32.735734 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:32.736671 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:32.736847 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a8a77d6-aa3b-4aa7-8ab9-a8641e543594) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:47:32.737488 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:32.737962 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:47:32.741896 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:32.743842 np0000001025 nova-compute[97981]: INFO os_vif [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:f8:14,bridge_name='br-int',has_traffic_filtering=True,id=381aabe0-261a-4722-a473-90dd923ddd70,network=Network(502bb41d-fb0e-4491-9039-68b5fde2624f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap381aabe0-26')
May 19 04:47:32.744224 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Deleting instance files /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3_del
May 19 04:47:32.745301 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Deletion of /opt/stack/data/nova/instances/e2017472-4da3-4676-b614-3e7039fedef3_del complete
May 19 04:47:33.019862 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:33.040648 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:33.043963 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:33.122406 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:33.253424 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Took 1.35 seconds to destroy the instance on the hypervisor.
May 19 04:47:33.254349 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:47:33.254917 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:47:33.254917 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: e2017472-4da3-4676-b614-3e7039fedef3] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:47:33.255269 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:33.303639 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:33.305492 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:33.306595 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:33.314931 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:33.326540 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:33.464954 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:33.679739 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1babc510-f7b1-4491-9bfd-9c3d2fed570e req-974e480a-156b-4a32-9b2f-55fa398005e8 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received event network-vif-deleted-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:33.680243 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-1babc510-f7b1-4491-9bfd-9c3d2fed570e req-974e480a-156b-4a32-9b2f-55fa398005e8 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Neutron deleted interface 381aabe0-261a-4722-a473-90dd923ddd70; detaching it from the instance and deleting it from the info cache
May 19 04:47:33.680491 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1babc510-f7b1-4491-9bfd-9c3d2fed570e req-974e480a-156b-4a32-9b2f-55fa398005e8 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:47:33.764875 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166053.7644844, 3bd17542-9a9b-4bda-80a6-413cb4c2091d => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:47:33.765303 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] VM Started (Lifecycle Event)
May 19 04:47:33.881330 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ad209590-ec60-4133-a132-b4340ca9fef8 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "032576d0-ced0-4686-8aad-26b4e06a4d67" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.220s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:34.114404 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-476e39a4-118a-456f-8fc8-a2e34d317015 req-81c5d394-a227-40bb-b42c-e55b1202f322 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received event network-vif-unplugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:34.115314 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-476e39a4-118a-456f-8fc8-a2e34d317015 req-81c5d394-a227-40bb-b42c-e55b1202f322 service nova] Acquiring lock "e2017472-4da3-4676-b614-3e7039fedef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:34.115539 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-476e39a4-118a-456f-8fc8-a2e34d317015 req-81c5d394-a227-40bb-b42c-e55b1202f322 service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:34.115658 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-476e39a4-118a-456f-8fc8-a2e34d317015 req-81c5d394-a227-40bb-b42c-e55b1202f322 service nova] Lock "e2017472-4da3-4676-b614-3e7039fedef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:34.115773 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-476e39a4-118a-456f-8fc8-a2e34d317015 req-81c5d394-a227-40bb-b42c-e55b1202f322 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] No waiting events found dispatching network-vif-unplugged-381aabe0-261a-4722-a473-90dd923ddd70 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:47:34.115930 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-476e39a4-118a-456f-8fc8-a2e34d317015 req-81c5d394-a227-40bb-b42c-e55b1202f322 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Received event network-vif-unplugged-381aabe0-261a-4722-a473-90dd923ddd70 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:47:34.115970 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-476e39a4-118a-456f-8fc8-a2e34d317015 req-81c5d394-a227-40bb-b42c-e55b1202f322 service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Received event network-vif-plugged-4a0502dc-0324-428b-b82c-e3ef9fc303e8 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:34.116088 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-476e39a4-118a-456f-8fc8-a2e34d317015 req-81c5d394-a227-40bb-b42c-e55b1202f322 service nova] Acquiring lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:34.116217 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-476e39a4-118a-456f-8fc8-a2e34d317015 req-81c5d394-a227-40bb-b42c-e55b1202f322 service nova] Lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:34.116317 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-476e39a4-118a-456f-8fc8-a2e34d317015 req-81c5d394-a227-40bb-b42c-e55b1202f322 service nova] Lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:34.116411 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-476e39a4-118a-456f-8fc8-a2e34d317015 req-81c5d394-a227-40bb-b42c-e55b1202f322 service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Processing event network-vif-plugged-4a0502dc-0324-428b-b82c-e3ef9fc303e8 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:47:34.116643 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-476e39a4-118a-456f-8fc8-a2e34d317015 req-81c5d394-a227-40bb-b42c-e55b1202f322 service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Received event network-vif-plugged-4a0502dc-0324-428b-b82c-e3ef9fc303e8 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:34.116872 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:47:34.117582 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-476e39a4-118a-456f-8fc8-a2e34d317015 req-81c5d394-a227-40bb-b42c-e55b1202f322 service nova] Acquiring lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:34.117582 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-476e39a4-118a-456f-8fc8-a2e34d317015 req-81c5d394-a227-40bb-b42c-e55b1202f322 service nova] Lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:34.117582 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-476e39a4-118a-456f-8fc8-a2e34d317015 req-81c5d394-a227-40bb-b42c-e55b1202f322 service nova] Lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:34.117582 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-476e39a4-118a-456f-8fc8-a2e34d317015 req-81c5d394-a227-40bb-b42c-e55b1202f322 service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] No waiting events found dispatching network-vif-plugged-4a0502dc-0324-428b-b82c-e3ef9fc303e8 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:47:34.117995 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-476e39a4-118a-456f-8fc8-a2e34d317015 req-81c5d394-a227-40bb-b42c-e55b1202f322 service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Received unexpected event network-vif-plugged-4a0502dc-0324-428b-b82c-e3ef9fc303e8 for instance with vm_state building and task_state spawning.
May 19 04:47:34.120286 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:47:34.122860 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Instance spawned successfully.
May 19 04:47:34.123305 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:47:34.135475 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:47:34.184280 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1babc510-f7b1-4491-9bfd-9c3d2fed570e req-974e480a-156b-4a32-9b2f-55fa398005e8 service nova] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Detach interface failed, port_id=381aabe0-261a-4722-a473-90dd923ddd70, reason: Instance e2017472-4da3-4676-b614-3e7039fedef3 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:47:34.269340 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:47:34.271256 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:47:34.629361 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:47:34.629493 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:47:34.629755 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:47:34.629982 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:47:34.630241 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:47:34.630483 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:47:34.637216 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Took 1.38 seconds to deallocate network for instance.
May 19 04:47:34.773702 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:47:34.774056 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166054.7737887, 3bd17542-9a9b-4bda-80a6-413cb4c2091d => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:47:34.774056 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] VM Paused (Lifecycle Event)
May 19 04:47:34.939211 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "032576d0-ced0-4686-8aad-26b4e06a4d67" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:34.939409 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "032576d0-ced0-4686-8aad-26b4e06a4d67" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:35.138328 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Took 6.51 seconds to spawn the instance on the hypervisor.
May 19 04:47:35.138548 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:47:35.146209 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:35.146371 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:35.276931 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:47:35.282367 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166055.2807105, 3bd17542-9a9b-4bda-80a6-413cb4c2091d => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:47:35.282367 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] VM Resumed (Lifecycle Event)
May 19 04:47:35.416571 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:47:35.416768 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:47:35.441630 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Detaching volume 538c207c-49c1-40a3-8d4c-d98f2c52f683
May 19 04:47:35.474431 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Attempting to driver detach volume 538c207c-49c1-40a3-8d4c-d98f2c52f683 from mountpoint /dev/vdb
May 19 04:47:35.511797 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '538c207c-49c1-40a3-8d4c-d98f2c52f683', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, 'status': 'reserved', 'instance': '032576d0-ced0-4686-8aad-26b4e06a4d67', 'attached_at': '', 'detached_at': '', 'volume_id': '538c207c-49c1-40a3-8d4c-d98f2c52f683', 'serial': '538c207c-49c1-40a3-8d4c-d98f2c52f683'} {{(pid=97981) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 19 04:47:35.514809 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Found disk vdb by alias ua-538c207c-49c1-40a3-8d4c-d98f2c52f683 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:47:35.515756 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Found disk vdb by alias ua-538c207c-49c1-40a3-8d4c-d98f2c52f683 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:47:35.515906 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Attempting to detach device vdb from instance 032576d0-ced0-4686-8aad-26b4e06a4d67 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:47:35.516157 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:47:35.516157 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:47:35.516157 np0000001025 nova-compute[97981]:   <alias name="ua-538c207c-49c1-40a3-8d4c-d98f2c52f683"/>
May 19 04:47:35.516157 np0000001025 nova-compute[97981]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-9"/>
May 19 04:47:35.516157 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:47:35.516157 np0000001025 nova-compute[97981]:   <serial>538c207c-49c1-40a3-8d4c-d98f2c52f683</serial>
May 19 04:47:35.516157 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:47:35.516157 np0000001025 nova-compute[97981]: </disk>
May 19 04:47:35.516157 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:47:35.520963 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Successfully detached device vdb from instance 032576d0-ced0-4686-8aad-26b4e06a4d67 from the persistent domain config.
May 19 04:47:35.521091 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] (1/8): Attempting to detach device vdb with device alias ua-538c207c-49c1-40a3-8d4c-d98f2c52f683 from instance 032576d0-ced0-4686-8aad-26b4e06a4d67 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:47:35.521338 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:47:35.521338 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:47:35.521338 np0000001025 nova-compute[97981]:   <alias name="ua-538c207c-49c1-40a3-8d4c-d98f2c52f683"/>
May 19 04:47:35.521338 np0000001025 nova-compute[97981]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-9"/>
May 19 04:47:35.521338 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:47:35.521338 np0000001025 nova-compute[97981]:   <serial>538c207c-49c1-40a3-8d4c-d98f2c52f683</serial>
May 19 04:47:35.521338 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:47:35.521338 np0000001025 nova-compute[97981]: </disk>
May 19 04:47:35.521338 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:47:35.650841 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Took 12.05 seconds to build instance.
May 19 04:47:35.783755 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:47:35.786588 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:47:35.920051 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:47:36.017067 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-538c207c-49c1-40a3-8d4c-d98f2c52f683 for instance 032576d0-ced0-4686-8aad-26b4e06a4d67 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:47:36.152804 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-808236ce-7d2a-4b46-b3cd-10e940283428 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.560s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:36.289514 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779166056.289127, 032576d0-ced0-4686-8aad-26b4e06a4d67 => ua-538c207c-49c1-40a3-8d4c-d98f2c52f683> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:47:36.292126 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Successfully detached device vdb from instance 032576d0-ced0-4686-8aad-26b4e06a4d67 from the live domain config.
May 19 04:47:36.295179 np0000001025 nova-compute[97981]: WARNING stevedore.named [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 19 04:47:36.295179 np0000001025 nova-compute[97981]: WARNING castellan.key_manager [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:47:36.295179 np0000001025 nova-compute[97981]: WARNING nova.keymgr.conf_key_mgr [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:47:36.295179 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x721834386ff0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '538c207c-49c1-40a3-8d4c-d98f2c52f683', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, 'status': 'reserved', 'instance': '032576d0-ced0-4686-8aad-26b4e06a4d67', 'attached_at': '', 'detached_at': '', 'volume_id': '538c207c-49c1-40a3-8d4c-d98f2c52f683', 'serial': '538c207c-49c1-40a3-8d4c-d98f2c52f683'} {{(pid=97981) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 19 04:47:36.295179 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors.luks [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] closing encrypted volume /dev/dm-0 {{(pid=97981) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 19 04:47:36.322839 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:47:36.323128 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '538c207c-49c1-40a3-8d4c-d98f2c52f683', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:47:36.323320 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:47:36.430981 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.284s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:36.486086 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Deleted allocations for instance e2017472-4da3-4676-b614-3e7039fedef3
May 19 04:47:37.004573 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-45a6f781-af01-4fea-8c2b-86d0afcc1acb req-e2c692e6-d706-4918-b6c6-b527cc6c7e8d service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Received event network-changed-4a0502dc-0324-428b-b82c-e3ef9fc303e8 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:37.004573 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-45a6f781-af01-4fea-8c2b-86d0afcc1acb req-e2c692e6-d706-4918-b6c6-b527cc6c7e8d service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Refreshing instance network info cache due to event network-changed-4a0502dc-0324-428b-b82c-e3ef9fc303e8. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:47:37.005048 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-45a6f781-af01-4fea-8c2b-86d0afcc1acb req-e2c692e6-d706-4918-b6c6-b527cc6c7e8d service nova] Acquiring lock "refresh_cache-3bd17542-9a9b-4bda-80a6-413cb4c2091d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:47:37.005048 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-45a6f781-af01-4fea-8c2b-86d0afcc1acb req-e2c692e6-d706-4918-b6c6-b527cc6c7e8d service nova] Acquired lock "refresh_cache-3bd17542-9a9b-4bda-80a6-413cb4c2091d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:47:37.005048 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-45a6f781-af01-4fea-8c2b-86d0afcc1acb req-e2c692e6-d706-4918-b6c6-b527cc6c7e8d service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Refreshing network info cache for port 4a0502dc-0324-428b-b82c-e3ef9fc303e8 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:47:37.498145 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5f3671b9-afd4-49bb-8477-069230b5f5b1 tempest-ServerStableDeviceRescueTest-1373788552 tempest-ServerStableDeviceRescueTest-1373788552-project-member] Lock "e2017472-4da3-4676-b614-3e7039fedef3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.101s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:37.507582 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-45a6f781-af01-4fea-8c2b-86d0afcc1acb req-e2c692e6-d706-4918-b6c6-b527cc6c7e8d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:37.576395 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.253s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:47:37.576804 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '538c207c-49c1-40a3-8d4c-d98f2c52f683', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:47:37.576955 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:47:37.601135 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:37.601135 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:37.601135 np0000001025 nova-compute[97981]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:37.601135 np0000001025 nova-compute[97981]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:37.601135 np0000001025 nova-compute[97981]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683 (non-flash)
May 19 04:47:37.601135 np0000001025 nova-compute[97981]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683 (non-flash)
May 19 04:47:37.601135 np0000001025 nova-compute[97981]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48586817-6f42-4315-8785-f6dc11d3a497 (non-flash)
May 19 04:47:37.601135 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:47:37.601135 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:37.601135 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:37.601135 np0000001025 nova-compute[97981]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:37.601135 np0000001025 nova-compute[97981]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:37.601135 np0000001025 nova-compute[97981]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683 (non-flash)
May 19 04:47:37.601135 np0000001025 nova-compute[97981]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683 (non-flash)
May 19 04:47:37.601135 np0000001025 nova-compute[97981]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48586817-6f42-4315-8785-f6dc11d3a497 (non-flash)
May 19 04:47:37.601135 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:47:37.601584 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '127'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', '138'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', '140'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48586817-6f42-4315-8785-f6dc11d3a497', '142')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:47:37.601584 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', '140')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:47:37.603147 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683', '141')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:47:37.603443 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218507419e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683'): ({'sdk'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:47:37.604177 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Removing multipathed devices sdh, sdk {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:47:37.604177 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Flush multipath device 33000000018307703 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:47:37.639388 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:47:37.698728 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:47:37.740053 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:37.747572 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Checking to see if SCSI volumes sdh, sdk have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:47:37.747753 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] SCSI volumes sdh, sdk have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:47:37.749339 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Checking to see if device paths {'sdh', 'sdk'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:47:37.761762 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Device paths {'sdh', 'sdk'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:47:37.761952 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:47:37.774691 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:37.805537 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-45a6f781-af01-4fea-8c2b-86d0afcc1acb req-e2c692e6-d706-4918-b6c6-b527cc6c7e8d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:37.806782 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 140, target: iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683, portal: 192.168.40.100,3260]
May 19 04:47:37.806782 np0000001025 nova-compute[97981]: Logout of [sid: 140, target: iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683, portal: 192.168.40.100,3260] successful.
May 19 04:47:37.806782 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:37.824415 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:37.835927 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:37.867824 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 141, target: iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683, portal: 192.168.50.100,3260]
May 19 04:47:37.867824 np0000001025 nova-compute[97981]: Logout of [sid: 141, target: iqn.2023-03.storpool.com:os--volume-538c207c-49c1-40a3-8d4c-d98f2c52f683, portal: 192.168.50.100,3260] successful.
May 19 04:47:37.867824 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:37.883192 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:37.884269 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:47:37.884550 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] <== disconnect_volume: return (1560ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:47:37.884618 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:47:37.922397 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-45a6f781-af01-4fea-8c2b-86d0afcc1acb req-e2c692e6-d706-4918-b6c6-b527cc6c7e8d service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Updated VIF entry in instance network info cache for port 4a0502dc-0324-428b-b82c-e3ef9fc303e8. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:47:37.922691 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-45a6f781-af01-4fea-8c2b-86d0afcc1acb req-e2c692e6-d706-4918-b6c6-b527cc6c7e8d service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Updating instance_info_cache with network_info: [{"id": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "address": "fa:16:3e:9b:91:0a", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0502dc-03", "ovs_interfaceid": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:47:38.424496 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-45a6f781-af01-4fea-8c2b-86d0afcc1acb req-e2c692e6-d706-4918-b6c6-b527cc6c7e8d service nova] Releasing lock "refresh_cache-3bd17542-9a9b-4bda-80a6-413cb4c2091d" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:47:38.434280 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lazy-loading 'flavor' on Instance uuid 032576d0-ced0-4686-8aad-26b4e06a4d67 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:47:38.466763 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:39.444290 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d2280924-7ded-4174-8d44-f83ec32f1038 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "032576d0-ced0-4686-8aad-26b4e06a4d67" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.504s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:39.902494 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:47:39.902494 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:47:39.902494 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:47:39.902795 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:47:39.903069 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.71 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:47:40.355443 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "032576d0-ced0-4686-8aad-26b4e06a4d67" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:40.355677 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "032576d0-ced0-4686-8aad-26b4e06a4d67" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:40.355866 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "032576d0-ced0-4686-8aad-26b4e06a4d67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:40.356029 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "032576d0-ced0-4686-8aad-26b4e06a4d67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:40.356188 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "032576d0-ced0-4686-8aad-26b4e06a4d67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:40.359819 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Terminating instance
May 19 04:47:40.578895 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0007977459999892744 future=<Future at 0x7218343665d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:40.578895 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:40.578895 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=6.640606336000019 future=<Future at 0x721834366db0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:40.578895 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=6.640510535999965 future=<Future at 0x721834366db0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:40.578895 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Emitting event <LifecycleEvent: 1779166045.5751865, 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:47:40.578895 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] VM Stopped (Lifecycle Event)
May 19 04:47:40.611153 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:47:40.611420 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:47:40.614573 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:47:40.615096 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:47:40.684067 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:40.864150 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:47:40.882768 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:40.884837 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:40.903304 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:40.910436 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:40.943401 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:41.059166 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e6f1420f-407f-4ca7-a9de-b3689ae2c6d1 req-ac14a0d7-c72f-4adf-90eb-6ea50ba0e149 service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Received event network-vif-unplugged-de633ad4-a9b9-4707-ab84-2205899d653e {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:41.059780 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e6f1420f-407f-4ca7-a9de-b3689ae2c6d1 req-ac14a0d7-c72f-4adf-90eb-6ea50ba0e149 service nova] Acquiring lock "032576d0-ced0-4686-8aad-26b4e06a4d67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:41.060003 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e6f1420f-407f-4ca7-a9de-b3689ae2c6d1 req-ac14a0d7-c72f-4adf-90eb-6ea50ba0e149 service nova] Lock "032576d0-ced0-4686-8aad-26b4e06a4d67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:41.060131 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e6f1420f-407f-4ca7-a9de-b3689ae2c6d1 req-ac14a0d7-c72f-4adf-90eb-6ea50ba0e149 service nova] Lock "032576d0-ced0-4686-8aad-26b4e06a4d67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:41.060240 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e6f1420f-407f-4ca7-a9de-b3689ae2c6d1 req-ac14a0d7-c72f-4adf-90eb-6ea50ba0e149 service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] No waiting events found dispatching network-vif-unplugged-de633ad4-a9b9-4707-ab84-2205899d653e {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:47:41.060344 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e6f1420f-407f-4ca7-a9de-b3689ae2c6d1 req-ac14a0d7-c72f-4adf-90eb-6ea50ba0e149 service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Received event network-vif-unplugged-de633ad4-a9b9-4707-ab84-2205899d653e for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:47:41.082249 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-61746f67-5fb5-47d8-a6ac-bcfe0705716d tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 5c7b7f14-f27a-4c7b-a39e-fd7c75d93117] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:47:41.208710 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.99975935800012 future=<Future at 0x721834353590 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:41.210321 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Instance destroyed successfully.
May 19 04:47:41.211351 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lazy-loading 'resources' on Instance uuid 032576d0-ced0-4686-8aad-26b4e06a4d67 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:47:41.712842 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:46:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1620368054',display_name='tempest-TestEncryptedCinderVolumes-server-1620368054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testencryptedcindervolumes-server-1620368054',id=60,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKo53ovAvi14TqIRWZnvwRfNTlOR+i5s9AfjZ+3eUx31AmuLqFbDlL3lzVKNpoRTD4w7nDGwvwdz/UcCEXXNs5EWlHbL+yu6DqZLl93Hze/hZRkAw//UEOI3XvpaeRfqw==',key_name='tempest-keypair-630082317',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:46:36Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7041ddbe11174207bbc7363b3bf08af5',ramdisk_id='',reservation_id='r-rhs1lwdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-324201327',owner_user_name='tempest-TestEncryptedCinderVolumes-324201327-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada528b0c5c740799599a2b163709a87',uuid=032576d0-ced0-4686-8aad-26b4e06a4d67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de633ad4-a9b9-4707-ab84-2205899d653e", "address": "fa:16:3e:41:22:00", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde633ad4-a9", "ovs_interfaceid": "de633ad4-a9b9-4707-ab84-2205899d653e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:47:41.716282 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Converting VIF {"id": "de633ad4-a9b9-4707-ab84-2205899d653e", "address": "fa:16:3e:41:22:00", "network": {"id": "1eda8fb0-3870-4644-873a-b485fff9e767", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1311378405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7041ddbe11174207bbc7363b3bf08af5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapde633ad4-a9", "ovs_interfaceid": "de633ad4-a9b9-4707-ab84-2205899d653e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:47:41.716282 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:22:00,bridge_name='br-int',has_traffic_filtering=True,id=de633ad4-a9b9-4707-ab84-2205899d653e,network=Network(1eda8fb0-3870-4644-873a-b485fff9e767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde633ad4-a9') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:47:41.716282 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:22:00,bridge_name='br-int',has_traffic_filtering=True,id=de633ad4-a9b9-4707-ab84-2205899d653e,network=Network(1eda8fb0-3870-4644-873a-b485fff9e767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde633ad4-a9') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:47:41.717229 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:41.717438 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde633ad4-a9, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:47:41.718419 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:41.719696 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:47:41.719879 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:41.721986 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:41.722265 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b81c422-7512-4e12-b934-ad6588ff1680) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:47:41.723129 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:41.723353 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:47:41.723857 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:41.726369 np0000001025 nova-compute[97981]: INFO os_vif [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:22:00,bridge_name='br-int',has_traffic_filtering=True,id=de633ad4-a9b9-4707-ab84-2205899d653e,network=Network(1eda8fb0-3870-4644-873a-b485fff9e767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde633ad4-a9')
May 19 04:47:41.726723 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Deleting instance files /opt/stack/data/nova/instances/032576d0-ced0-4686-8aad-26b4e06a4d67_del
May 19 04:47:41.728702 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Deletion of /opt/stack/data/nova/instances/032576d0-ced0-4686-8aad-26b4e06a4d67_del complete
May 19 04:47:42.239081 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Took 1.37 seconds to destroy the instance on the hypervisor.
May 19 04:47:42.240596 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:47:42.241006 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:47:42.241006 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:47:42.241244 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:42.335606 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:42.614843 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:47:42.615156 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:47:42.615309 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:47:42.615582 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:47:42.831076 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8ce67814-1d0d-44fc-bd76-b8ce668c2276 req-c28e5cf4-a380-48a7-ac05-d3c013b8e3a7 service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Received event network-vif-deleted-de633ad4-a9b9-4707-ab84-2205899d653e {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:42.831575 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-8ce67814-1d0d-44fc-bd76-b8ce668c2276 req-c28e5cf4-a380-48a7-ac05-d3c013b8e3a7 service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Neutron deleted interface de633ad4-a9b9-4707-ab84-2205899d653e; detaching it from the instance and deleting it from the info cache
May 19 04:47:42.831688 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-8ce67814-1d0d-44fc-bd76-b8ce668c2276 req-c28e5cf4-a380-48a7-ac05-d3c013b8e3a7 service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:47:43.127912 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-19dc2e82-d0f7-4c61-9094-09a5e7616b84 req-9c8e5ba0-5487-4e62-a0f0-773fff5644d6 service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Received event network-vif-unplugged-de633ad4-a9b9-4707-ab84-2205899d653e {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:43.128217 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-19dc2e82-d0f7-4c61-9094-09a5e7616b84 req-9c8e5ba0-5487-4e62-a0f0-773fff5644d6 service nova] Acquiring lock "032576d0-ced0-4686-8aad-26b4e06a4d67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:43.128748 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-19dc2e82-d0f7-4c61-9094-09a5e7616b84 req-9c8e5ba0-5487-4e62-a0f0-773fff5644d6 service nova] Lock "032576d0-ced0-4686-8aad-26b4e06a4d67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:43.128865 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-19dc2e82-d0f7-4c61-9094-09a5e7616b84 req-9c8e5ba0-5487-4e62-a0f0-773fff5644d6 service nova] Lock "032576d0-ced0-4686-8aad-26b4e06a4d67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:43.128993 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-19dc2e82-d0f7-4c61-9094-09a5e7616b84 req-9c8e5ba0-5487-4e62-a0f0-773fff5644d6 service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] No waiting events found dispatching network-vif-unplugged-de633ad4-a9b9-4707-ab84-2205899d653e {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:47:43.129098 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-19dc2e82-d0f7-4c61-9094-09a5e7616b84 req-9c8e5ba0-5487-4e62-a0f0-773fff5644d6 service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Received event network-vif-unplugged-de633ad4-a9b9-4707-ab84-2205899d653e for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:47:43.285307 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:47:43.334420 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8ce67814-1d0d-44fc-bd76-b8ce668c2276 req-c28e5cf4-a380-48a7-ac05-d3c013b8e3a7 service nova] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Detach interface failed, port_id=de633ad4-a9b9-4707-ab84-2205899d653e, reason: Instance 032576d0-ced0-4686-8aad-26b4e06a4d67 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:47:43.477506 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:43.615574 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:47:43.787273 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Took 1.55 seconds to deallocate network for instance.
May 19 04:47:44.122588 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:44.123023 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:44.123023 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:44.123023 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:47:44.293760 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:44.294660 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:44.525492 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:47:44.525492 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:47:45.027267 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:47:45.151992 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:47:45.153537 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:47:45.248689 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:47:45.250047 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:47:45.341300 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:47:45.347169 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:47:45.348898 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:47:45.350050 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:47:45.393917 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:47:45.394703 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=13192MB free_disk=72.95963668823242GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:47:45.394924 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:45.537098 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.243s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:45.538852 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.142s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:45.600568 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Deleted allocations for instance 032576d0-ced0-4686-8aad-26b4e06a4d67
May 19 04:47:46.612305 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cd3bf77a-b953-4ef3-98b9-a69bd1a61280 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Lock "032576d0-ced0-4686-8aad-26b4e06a4d67" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.257s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:46.624574 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance ab009682-2d6f-4f7a-b23d-95fd5f4d3f15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:47:46.624817 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance f1eb2456-2f51-4465-b6ff-0f76439f3029 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:47:46.624952 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 3bd17542-9a9b-4bda-80a6-413cb4c2091d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:47:46.625166 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:47:46.625324 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:47:45 up 38 min,  2 users,  load average: 4.73, 5.40, 4.16\n', 'num_instances': '3', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '3', 'num_proj_28b3c0fa8f894ed2a7c3bcfac99ce74c': '2', 'io_workload': '0', 'num_proj_2e16e702e1284e7fbba4184913a43de7': '1'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:47:46.723764 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:46.824189 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:47:46.824514 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:47:47.217807 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0007579919997624529 future=<Future at 0x721834366db0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:47.217952 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:47.218063 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=8.990325474999736 future=<Future at 0x721834353590 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:47.218200 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=8.990182406999793 future=<Future at 0x721834353590 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:47.220825 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] Emitting event <LifecycleEvent: 1779166052.2169034, e2017472-4da3-4676-b614-3e7039fedef3 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:47:47.221053 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] VM Stopped (Lifecycle Event)
May 19 04:47:47.327641 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:47:47.723971 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ffe54ba4-f401-49bb-86a9-02f9a5798949 tempest-AttachVolumeMultiAttachTest-1659172696 tempest-AttachVolumeMultiAttachTest-1659172696-project-member] [instance: e2017472-4da3-4676-b614-3e7039fedef3] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:47:47.834672 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:47:47.834910 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.298s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:47.835272 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.99 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:47:48.489979 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:49.952282 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:50.882852 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:47:51.620485 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:51.724704 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:53.493037 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:53.888227 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4b27f91e-8d2a-4ee7-9b56-5d8624e371ce req-98090bab-14b4-4569-acb2-0e979655720f service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Received event network-changed-0f376d17-e9e6-4eba-9d70-70960eadb9a4 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:53.888615 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4b27f91e-8d2a-4ee7-9b56-5d8624e371ce req-98090bab-14b4-4569-acb2-0e979655720f service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Refreshing instance network info cache due to event network-changed-0f376d17-e9e6-4eba-9d70-70960eadb9a4. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:47:53.888850 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4b27f91e-8d2a-4ee7-9b56-5d8624e371ce req-98090bab-14b4-4569-acb2-0e979655720f service nova] Acquiring lock "refresh_cache-f1eb2456-2f51-4465-b6ff-0f76439f3029" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:47:53.889026 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4b27f91e-8d2a-4ee7-9b56-5d8624e371ce req-98090bab-14b4-4569-acb2-0e979655720f service nova] Acquired lock "refresh_cache-f1eb2456-2f51-4465-b6ff-0f76439f3029" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:47:53.889245 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4b27f91e-8d2a-4ee7-9b56-5d8624e371ce req-98090bab-14b4-4569-acb2-0e979655720f service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Refreshing network info cache for port 0f376d17-e9e6-4eba-9d70-70960eadb9a4 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:47:54.391432 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-4b27f91e-8d2a-4ee7-9b56-5d8624e371ce req-98090bab-14b4-4569-acb2-0e979655720f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:54.404072 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "f1eb2456-2f51-4465-b6ff-0f76439f3029" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:54.404352 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "f1eb2456-2f51-4465-b6ff-0f76439f3029" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:54.405144 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "f1eb2456-2f51-4465-b6ff-0f76439f3029-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:54.407163 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "f1eb2456-2f51-4465-b6ff-0f76439f3029-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:54.407432 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "f1eb2456-2f51-4465-b6ff-0f76439f3029-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:54.411690 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Terminating instance
May 19 04:47:54.697810 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-4b27f91e-8d2a-4ee7-9b56-5d8624e371ce req-98090bab-14b4-4569-acb2-0e979655720f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:54.850356 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4b27f91e-8d2a-4ee7-9b56-5d8624e371ce req-98090bab-14b4-4569-acb2-0e979655720f service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Updated VIF entry in instance network info cache for port 0f376d17-e9e6-4eba-9d70-70960eadb9a4. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:47:54.850749 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4b27f91e-8d2a-4ee7-9b56-5d8624e371ce req-98090bab-14b4-4569-acb2-0e979655720f service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Updating instance_info_cache with network_info: [{"id": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "address": "fa:16:3e:3c:09:8a", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f376d17-e9", "ovs_interfaceid": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:47:54.916185 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:47:54.933195 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:54.935687 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:54.954982 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:55.045788 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:55.050873 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:55.251964 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999702140999943 future=<Future at 0x721834310440 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:55.254302 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Instance destroyed successfully.
May 19 04:47:55.255628 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'resources' on Instance uuid f1eb2456-2f51-4465-b6ff-0f76439f3029 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:47:55.314701 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:55.352699 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4b27f91e-8d2a-4ee7-9b56-5d8624e371ce req-98090bab-14b4-4569-acb2-0e979655720f service nova] Releasing lock "refresh_cache-f1eb2456-2f51-4465-b6ff-0f76439f3029" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:47:55.757836 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-557872007',display_name='tempest-TestVolumeBootPattern-server-557872007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-557872007',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN64hvrIGybIwAElinLKo/VbG9hSjSUs/ze49uyTKPWXsdeqEUWn/Lpvjt2B+Fess/qheYjdkiwQfjT63zoCE3gTtilbfESU8llxkXIh3KDQg4BSLPbR62uq8/NYye8VAw==',key_name='tempest-TestVolumeBootPattern-644793043',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:47:14Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-u1ua99mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:47:15Z,user_data=None,user_id='5c46088fb3e74b819bb456461716a801',uuid=f1eb2456-2f51-4465-b6ff-0f76439f3029,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "address": "fa:16:3e:3c:09:8a", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f376d17-e9", "ovs_interfaceid": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:47:55.758329 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "address": "fa:16:3e:3c:09:8a", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f376d17-e9", "ovs_interfaceid": "0f376d17-e9e6-4eba-9d70-70960eadb9a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:47:55.758796 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:09:8a,bridge_name='br-int',has_traffic_filtering=True,id=0f376d17-e9e6-4eba-9d70-70960eadb9a4,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f376d17-e9') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:47:55.759039 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:09:8a,bridge_name='br-int',has_traffic_filtering=True,id=0f376d17-e9e6-4eba-9d70-70960eadb9a4,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f376d17-e9') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:47:55.760355 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:55.760514 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f376d17-e9, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:47:55.762516 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:47:55.763399 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:55.764043 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:55.764233 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40ee99c7-3330-4efe-bdb0-e6f405d4ec61) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:47:55.766578 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:47:55.768685 np0000001025 nova-compute[97981]: INFO os_vif [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:09:8a,bridge_name='br-int',has_traffic_filtering=True,id=0f376d17-e9e6-4eba-9d70-70960eadb9a4,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f376d17-e9')
May 19 04:47:55.770045 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:47:55.770396 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06a16928-529f-4113-9ad7-db1ca59c0485', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:47:55.770569 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:47:55.945245 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-19270298-a5ea-40ae-a6a1-31cce9a30cec req-7014634c-6b76-4efb-a036-7f13e9e32697 service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Received event network-vif-unplugged-0f376d17-e9e6-4eba-9d70-70960eadb9a4 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:55.953823 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-19270298-a5ea-40ae-a6a1-31cce9a30cec req-7014634c-6b76-4efb-a036-7f13e9e32697 service nova] Acquiring lock "f1eb2456-2f51-4465-b6ff-0f76439f3029-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:55.953823 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-19270298-a5ea-40ae-a6a1-31cce9a30cec req-7014634c-6b76-4efb-a036-7f13e9e32697 service nova] Lock "f1eb2456-2f51-4465-b6ff-0f76439f3029-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:55.953823 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-19270298-a5ea-40ae-a6a1-31cce9a30cec req-7014634c-6b76-4efb-a036-7f13e9e32697 service nova] Lock "f1eb2456-2f51-4465-b6ff-0f76439f3029-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:55.953823 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-19270298-a5ea-40ae-a6a1-31cce9a30cec req-7014634c-6b76-4efb-a036-7f13e9e32697 service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] No waiting events found dispatching network-vif-unplugged-0f376d17-e9e6-4eba-9d70-70960eadb9a4 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:47:55.953823 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-19270298-a5ea-40ae-a6a1-31cce9a30cec req-7014634c-6b76-4efb-a036-7f13e9e32697 service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Received event network-vif-unplugged-0f376d17-e9e6-4eba-9d70-70960eadb9a4 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:47:55.953823 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-19270298-a5ea-40ae-a6a1-31cce9a30cec req-7014634c-6b76-4efb-a036-7f13e9e32697 service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Received event network-vif-unplugged-0f376d17-e9e6-4eba-9d70-70960eadb9a4 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:55.953823 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-19270298-a5ea-40ae-a6a1-31cce9a30cec req-7014634c-6b76-4efb-a036-7f13e9e32697 service nova] Acquiring lock "f1eb2456-2f51-4465-b6ff-0f76439f3029-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:55.953823 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-19270298-a5ea-40ae-a6a1-31cce9a30cec req-7014634c-6b76-4efb-a036-7f13e9e32697 service nova] Lock "f1eb2456-2f51-4465-b6ff-0f76439f3029-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:47:55.953823 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-19270298-a5ea-40ae-a6a1-31cce9a30cec req-7014634c-6b76-4efb-a036-7f13e9e32697 service nova] Lock "f1eb2456-2f51-4465-b6ff-0f76439f3029-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:47:55.953823 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-19270298-a5ea-40ae-a6a1-31cce9a30cec req-7014634c-6b76-4efb-a036-7f13e9e32697 service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] No waiting events found dispatching network-vif-unplugged-0f376d17-e9e6-4eba-9d70-70960eadb9a4 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:47:55.953823 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-19270298-a5ea-40ae-a6a1-31cce9a30cec req-7014634c-6b76-4efb-a036-7f13e9e32697 service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Received event network-vif-unplugged-0f376d17-e9e6-4eba-9d70-70960eadb9a4 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:47:56.208728 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0003034520000255725 future=<Future at 0x721834353590 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:56.209607 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Emitting event <LifecycleEvent: 1779166061.2083259, 032576d0-ced0-4686-8aad-26b4e06a4d67 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:47:56.209607 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:56.209860 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] VM Stopped (Lifecycle Event)
May 19 04:47:56.211041 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.04058332500017 future=<Future at 0x721834310440 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:56.211226 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.040405392000139 future=<Future at 0x721834310440 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:47:56.713487 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 032576d0-ced0-4686-8aad-26b4e06a4d67] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:47:56.722999 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.952s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:47:56.723372 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06a16928-529f-4113-9ad7-db1ca59c0485', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:47:56.723538 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:47:56.749530 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:56.749530 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:56.749530 np0000001025 nova-compute[97981]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:56.749530 np0000001025 nova-compute[97981]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:56.749530 np0000001025 nova-compute[97981]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35bd42de-1ea9-4e84-bad3-977aec60740d (non-flash)
May 19 04:47:56.749530 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:47:56.749843 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:56.749843 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:47:56.749843 np0000001025 nova-compute[97981]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:56.749843 np0000001025 nova-compute[97981]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485 (non-flash)
May 19 04:47:56.749843 np0000001025 nova-compute[97981]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35bd42de-1ea9-4e84-bad3-977aec60740d (non-flash)
May 19 04:47:56.749843 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:47:56.750043 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '127'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', '138'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35bd42de-1ea9-4e84-bad3-977aec60740d', '143')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:47:56.750137 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', '138')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:47:56.751100 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485', '139')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:47:56.751781 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721834447100>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485'): ({'sdj'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:47:56.751969 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Removing multipathed devices sdj, sdi {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:47:56.752658 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flush multipath device 33000000009a7684d {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:47:56.820491 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:47:56.865576 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:47:56.909476 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Checking to see if SCSI volumes sdj, sdi have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:47:56.909715 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] SCSI volumes sdj, sdi have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:47:56.910790 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Checking to see if device paths {'sdj', 'sdi'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:47:56.921787 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Device paths {'sdj', 'sdi'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:47:56.922066 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:47:56.933457 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:56.963203 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 138, target: iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485, portal: 192.168.40.100,3260]
May 19 04:47:56.963203 np0000001025 nova-compute[97981]: Logout of [sid: 138, target: iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485, portal: 192.168.40.100,3260] successful.
May 19 04:47:56.963203 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:56.977588 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:56.989991 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:57.021249 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 139, target: iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485, portal: 192.168.50.100,3260]
May 19 04:47:57.021249 np0000001025 nova-compute[97981]: Logout of [sid: 139, target: iqn.2023-03.storpool.com:os--volume-06a16928-529f-4113-9ad7-db1ca59c0485, portal: 192.168.50.100,3260] successful.
May 19 04:47:57.021249 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:57.037162 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:47:57.037365 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:47:57.037557 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== disconnect_volume: return (1266ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:47:57.037808 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:47:57.038257 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Deleting instance files /opt/stack/data/nova/instances/f1eb2456-2f51-4465-b6ff-0f76439f3029_del
May 19 04:47:57.039465 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Deletion of /opt/stack/data/nova/instances/f1eb2456-2f51-4465-b6ff-0f76439f3029_del complete
May 19 04:47:57.181405 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:57.549312 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Took 2.63 seconds to destroy the instance on the hypervisor.
May 19 04:47:57.549312 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:47:57.549312 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:47:57.549312 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:47:57.549312 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:57.663398 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:47:57.955600 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1099ed16-728f-406a-9b7d-e1d2bb90068a req-8e1fb50b-f423-4b30-9008-dfca22c20725 service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Received event network-vif-deleted-0f376d17-e9e6-4eba-9d70-70960eadb9a4 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:47:57.955600 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-1099ed16-728f-406a-9b7d-e1d2bb90068a req-8e1fb50b-f423-4b30-9008-dfca22c20725 service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Neutron deleted interface 0f376d17-e9e6-4eba-9d70-70960eadb9a4; detaching it from the instance and deleting it from the info cache
May 19 04:47:57.955600 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1099ed16-728f-406a-9b7d-e1d2bb90068a req-8e1fb50b-f423-4b30-9008-dfca22c20725 service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:47:58.406901 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:47:58.459942 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1099ed16-728f-406a-9b7d-e1d2bb90068a req-8e1fb50b-f423-4b30-9008-dfca22c20725 service nova] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Detach interface failed, port_id=0f376d17-e9e6-4eba-9d70-70960eadb9a4, reason: Instance f1eb2456-2f51-4465-b6ff-0f76439f3029 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:47:58.495995 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:58.909288 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Took 1.36 seconds to deallocate network for instance.
May 19 04:47:59.460583 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Took 0.55 seconds to detach 1 volumes for instance.
May 19 04:47:59.943522 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:47:59.966891 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:47:59.967094 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:00.175318 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:48:00.175543 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:48:00.680878 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:48:00.765286 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:01.188226 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.220s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:01.255884 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Deleted allocations for instance f1eb2456-2f51-4465-b6ff-0f76439f3029
May 19 04:48:01.943713 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:02.263371 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3532057-099f-49ab-a57d-684b1b0713a3 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "f1eb2456-2f51-4465-b6ff-0f76439f3029" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.859s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:02.560358 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:03.497863 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:04.104120 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:04.855626 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5a60002d-529c-40d4-a51c-af50ceb0348e req-04da1109-20be-4e03-a7b6-91dfd38f7e3b service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Received event network-changed-a4300743-f053-4dd3-a562-c9458d9c1453 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:48:04.855626 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5a60002d-529c-40d4-a51c-af50ceb0348e req-04da1109-20be-4e03-a7b6-91dfd38f7e3b service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Refreshing instance network info cache due to event network-changed-a4300743-f053-4dd3-a562-c9458d9c1453. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:48:04.856067 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5a60002d-529c-40d4-a51c-af50ceb0348e req-04da1109-20be-4e03-a7b6-91dfd38f7e3b service nova] Acquiring lock "refresh_cache-ab009682-2d6f-4f7a-b23d-95fd5f4d3f15" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:48:04.856067 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5a60002d-529c-40d4-a51c-af50ceb0348e req-04da1109-20be-4e03-a7b6-91dfd38f7e3b service nova] Acquired lock "refresh_cache-ab009682-2d6f-4f7a-b23d-95fd5f4d3f15" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:48:04.856067 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5a60002d-529c-40d4-a51c-af50ceb0348e req-04da1109-20be-4e03-a7b6-91dfd38f7e3b service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Refreshing network info cache for port a4300743-f053-4dd3-a562-c9458d9c1453 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:48:05.360329 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-5a60002d-529c-40d4-a51c-af50ceb0348e req-04da1109-20be-4e03-a7b6-91dfd38f7e3b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:05.397901 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "ab009682-2d6f-4f7a-b23d-95fd5f4d3f15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:05.398125 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "ab009682-2d6f-4f7a-b23d-95fd5f4d3f15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:05.398330 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "ab009682-2d6f-4f7a-b23d-95fd5f4d3f15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:05.398485 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "ab009682-2d6f-4f7a-b23d-95fd5f4d3f15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:05.398615 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "ab009682-2d6f-4f7a-b23d-95fd5f4d3f15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:05.401143 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Terminating instance
May 19 04:48:05.643044 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-5a60002d-529c-40d4-a51c-af50ceb0348e req-04da1109-20be-4e03-a7b6-91dfd38f7e3b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:05.767135 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:05.783212 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5a60002d-529c-40d4-a51c-af50ceb0348e req-04da1109-20be-4e03-a7b6-91dfd38f7e3b service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Updated VIF entry in instance network info cache for port a4300743-f053-4dd3-a562-c9458d9c1453. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:48:05.783575 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5a60002d-529c-40d4-a51c-af50ceb0348e req-04da1109-20be-4e03-a7b6-91dfd38f7e3b service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Updating instance_info_cache with network_info: [{"id": "a4300743-f053-4dd3-a562-c9458d9c1453", "address": "fa:16:3e:95:86:d9", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4300743-f0", "ovs_interfaceid": "a4300743-f053-4dd3-a562-c9458d9c1453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:48:05.908068 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:48:05.925516 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:05.927556 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:05.944445 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:05.946560 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:05.964019 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:05.968078 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:06.219862 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.99970357300026 future=<Future at 0x7218342ca780 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:48:06.221279 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Instance destroyed successfully.
May 19 04:48:06.222182 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lazy-loading 'resources' on Instance uuid ab009682-2d6f-4f7a-b23d-95fd5f4d3f15 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:48:06.268498 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:06.285485 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5a60002d-529c-40d4-a51c-af50ceb0348e req-04da1109-20be-4e03-a7b6-91dfd38f7e3b service nova] Releasing lock "refresh_cache-ab009682-2d6f-4f7a-b23d-95fd5f4d3f15" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:48:06.307284 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:06.307506 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:06.724568 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:45:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1790855730',display_name='tempest-TestVolumeBootPattern-server-1790855730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpattern-server-1790855730',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN64hvrIGybIwAElinLKo/VbG9hSjSUs/ze49uyTKPWXsdeqEUWn/Lpvjt2B+Fess/qheYjdkiwQfjT63zoCE3gTtilbfESU8llxkXIh3KDQg4BSLPbR62uq8/NYye8VAw==',key_name='tempest-TestVolumeBootPattern-644793043',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:46:14Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28b3c0fa8f894ed2a7c3bcfac99ce74c',ramdisk_id='',reservation_id='r-yol0x0y7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1071176852',owner_user_name='tempest-TestVolumeBootPattern-1071176852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:46:15Z,user_data=None,user_id='5c46088fb3e74b819bb456461716a801',uuid=ab009682-2d6f-4f7a-b23d-95fd5f4d3f15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4300743-f053-4dd3-a562-c9458d9c1453", "address": "fa:16:3e:95:86:d9", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4300743-f0", "ovs_interfaceid": "a4300743-f053-4dd3-a562-c9458d9c1453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:48:06.724752 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converting VIF {"id": "a4300743-f053-4dd3-a562-c9458d9c1453", "address": "fa:16:3e:95:86:d9", "network": {"id": "ebf779fa-0af9-442b-b6c9-4882b7cc0534", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1129056928-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "28b3c0fa8f894ed2a7c3bcfac99ce74c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4300743-f0", "ovs_interfaceid": "a4300743-f053-4dd3-a562-c9458d9c1453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:48:06.725281 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:86:d9,bridge_name='br-int',has_traffic_filtering=True,id=a4300743-f053-4dd3-a562-c9458d9c1453,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4300743-f0') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:48:06.725529 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:86:d9,bridge_name='br-int',has_traffic_filtering=True,id=a4300743-f053-4dd3-a562-c9458d9c1453,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4300743-f0') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:48:06.727060 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:06.727244 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4300743-f0, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:48:06.729072 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:06.729922 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:48:06.730328 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:06.730438 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2639dcea-b374-47b1-94fc-86d7053e7c6f) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:48:06.730808 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:06.731274 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:48:06.731738 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:06.733613 np0000001025 nova-compute[97981]: INFO os_vif [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:86:d9,bridge_name='br-int',has_traffic_filtering=True,id=a4300743-f053-4dd3-a562-c9458d9c1453,network=Network(ebf779fa-0af9-442b-b6c9-4882b7cc0534),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4300743-f0')
May 19 04:48:06.735407 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:48:06.735692 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:48:06.735805 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:48:06.736146 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:48:06.736398 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:48:06.736518 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:48:06.758892 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:48:06.758892 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:48:06.758892 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:48:06.759070 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsi session list stdout=tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:48:06.759070 np0000001025 nova-compute[97981]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531 (non-flash)
May 19 04:48:06.759070 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:48:06.759177 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '127'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '128')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:48:06.759324 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '127')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:48:06.760243 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531', '128')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:48:06.761033 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218342a11c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531'): ({'sde'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:48:06.761350 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Removing multipathed devices sde, sdd {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:48:06.761530 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Flush multipath device 33000000039c706b0 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:48:06.809153 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:48:06.819799 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:48:06.874665 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:48:06.921479 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:48:06.921910 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:48:06.922480 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:48:06.933123 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:48:06.933344 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:48:06.942970 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:06.975368 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 127, target: iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531, portal: 192.168.40.100,3260]
May 19 04:48:06.975368 np0000001025 nova-compute[97981]: Logout of [sid: 127, target: iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531, portal: 192.168.40.100,3260] successful.
May 19 04:48:06.975368 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:06.986655 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:06.995956 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:07.024058 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 128, target: iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531, portal: 192.168.50.100,3260]
May 19 04:48:07.024058 np0000001025 nova-compute[97981]: Logout of [sid: 128, target: iqn.2023-03.storpool.com:os--volume-1bdfa1a6-fb6c-4690-8dd6-a14e0926d531, portal: 192.168.50.100,3260] successful.
May 19 04:48:07.024058 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:07.036130 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:07.036347 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:48:07.036486 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] <== disconnect_volume: return (300ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:48:07.036626 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:48:07.036890 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Deleting instance files /opt/stack/data/nova/instances/ab009682-2d6f-4f7a-b23d-95fd5f4d3f15_del
May 19 04:48:07.037449 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Deletion of /opt/stack/data/nova/instances/ab009682-2d6f-4f7a-b23d-95fd5f4d3f15_del complete
May 19 04:48:07.357231 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:07.357425 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:07.360675 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:48:07.360805 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Claim successful on node np0000001025
May 19 04:48:07.543055 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Took 1.63 seconds to destroy the instance on the hypervisor.
May 19 04:48:07.543602 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:48:07.543899 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:48:07.544019 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:48:07.544261 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:07.598749 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:07.854431 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-839d03b9-828b-4fb6-9fe6-3db594bdeaf6 req-a5996283-9e29-49a4-bcfa-477adc5b8f63 service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Received event network-vif-deleted-a4300743-f053-4dd3-a562-c9458d9c1453 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:48:07.854813 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-839d03b9-828b-4fb6-9fe6-3db594bdeaf6 req-a5996283-9e29-49a4-bcfa-477adc5b8f63 service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Neutron deleted interface a4300743-f053-4dd3-a562-c9458d9c1453; detaching it from the instance and deleting it from the info cache
May 19 04:48:07.855030 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-839d03b9-828b-4fb6-9fe6-3db594bdeaf6 req-a5996283-9e29-49a4-bcfa-477adc5b8f63 service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:48:08.307697 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:48:08.358615 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-839d03b9-828b-4fb6-9fe6-3db594bdeaf6 req-a5996283-9e29-49a4-bcfa-477adc5b8f63 service nova] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Detach interface failed, port_id=a4300743-f053-4dd3-a562-c9458d9c1453, reason: Instance ab009682-2d6f-4f7a-b23d-95fd5f4d3f15 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:48:08.504817 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:08.547178 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:48:08.547381 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:48:08.597461 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:08.809608 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Took 1.27 seconds to deallocate network for instance.
May 19 04:48:09.049674 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:48:09.352005 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Took 0.54 seconds to detach 1 volumes for instance.
May 19 04:48:09.555705 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.198s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:09.556213 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:48:09.857680 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:09.857880 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:09.998747 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:10.062220 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:48:10.062954 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:48:10.062954 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:10.063237 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:10.081845 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:48:10.082083 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:48:10.165595 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b0cd08b7f014743a849982c90b5bd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f67462305b466bac5791264c17cf14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:48:10.252044 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00039051299972925335 future=<Future at 0x721834310440 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:48:10.252182 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:48:10.253851 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Emitting event <LifecycleEvent: 1779166075.2515452, f1eb2456-2f51-4465-b6ff-0f76439f3029 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:48:10.253851 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] VM Stopped (Lifecycle Event)
May 19 04:48:10.254622 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=10.964939035000043 future=<Future at 0x7218342ca780 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:48:10.255652 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=10.96394688600003 future=<Future at 0x7218342ca780 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:48:10.519212 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Successfully created port: 53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:48:10.565656 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:48:10.584384 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:48:10.755881 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: f1eb2456-2f51-4465-b6ff-0f76439f3029] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:48:11.068352 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:48:11.090900 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.233s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:11.138207 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Deleted allocations for instance ab009682-2d6f-4f7a-b23d-95fd5f4d3f15
May 19 04:48:11.260606 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Successfully updated port: 53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:48:11.315087 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-04d1f5ba-43ca-4855-ae02-771b4d6496b8 req-aa4da4cf-0ae6-4192-b3cc-a8d46a5923d6 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Received event network-changed-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:48:11.315489 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-04d1f5ba-43ca-4855-ae02-771b4d6496b8 req-aa4da4cf-0ae6-4192-b3cc-a8d46a5923d6 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Refreshing instance network info cache due to event network-changed-53e6eaf0-1553-4cbe-874a-c98dce3a96fd. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:48:11.315638 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-04d1f5ba-43ca-4855-ae02-771b4d6496b8 req-aa4da4cf-0ae6-4192-b3cc-a8d46a5923d6 service nova] Acquiring lock "refresh_cache-e1c00d98-c68b-45cd-b4f6-6c6d62b54290" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:48:11.315729 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-04d1f5ba-43ca-4855-ae02-771b4d6496b8 req-aa4da4cf-0ae6-4192-b3cc-a8d46a5923d6 service nova] Acquired lock "refresh_cache-e1c00d98-c68b-45cd-b4f6-6c6d62b54290" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:48:11.315845 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-04d1f5ba-43ca-4855-ae02-771b4d6496b8 req-aa4da4cf-0ae6-4192-b3cc-a8d46a5923d6 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Refreshing network info cache for port 53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:48:11.731638 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:11.762419 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "refresh_cache-e1c00d98-c68b-45cd-b4f6-6c6d62b54290" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:48:11.817590 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-04d1f5ba-43ca-4855-ae02-771b4d6496b8 req-aa4da4cf-0ae6-4192-b3cc-a8d46a5923d6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:11.872571 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-04d1f5ba-43ca-4855-ae02-771b4d6496b8 req-aa4da4cf-0ae6-4192-b3cc-a8d46a5923d6 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:48:11.993056 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-04d1f5ba-43ca-4855-ae02-771b4d6496b8 req-aa4da4cf-0ae6-4192-b3cc-a8d46a5923d6 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:48:12.075801 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:48:12.076998 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:48:12.077323 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Creating image(s)
May 19 04:48:12.078096 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:12.078324 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "/opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:12.078873 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "/opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:12.079261 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:12.079603 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:12.147132 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ac0ba36b-1a65-438e-8b35-36c17a9ce86e tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Lock "ab009682-2d6f-4f7a-b23d-95fd5f4d3f15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.749s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:12.495486 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-04d1f5ba-43ca-4855-ae02-771b4d6496b8 req-aa4da4cf-0ae6-4192-b3cc-a8d46a5923d6 service nova] Releasing lock "refresh_cache-e1c00d98-c68b-45cd-b4f6-6c6d62b54290" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:48:12.497125 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquired lock "refresh_cache-e1c00d98-c68b-45cd-b4f6-6c6d62b54290" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:48:12.497125 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:48:12.561211 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:48:12.563418 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:48:12.563684 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8.part --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:12.659749 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8.part --force-share --output=json" returned: 0 in 0.096s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:12.660263 np0000001025 nova-compute[97981]: DEBUG nova.virt.images [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] 0f9e8183-efda-4ea7-80fb-acb10d593d2d was qcow2, converting to raw {{(pid=97981) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 19 04:48:12.660820 np0000001025 nova-compute[97981]: DEBUG nova.privsep.utils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97981) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 19 04:48:12.661091 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8.part /opt/stack/data/nova/instances/_base/86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8.converted {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:12.806328 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8.part /opt/stack/data/nova/instances/_base/86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8.converted" returned: 0 in 0.145s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:12.811429 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8.converted --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:12.913276 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8.converted --force-share --output=json" returned: 0 in 0.101s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:12.914103 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.834s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:12.914629 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:48:12.917522 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:48:12.918845 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8 --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:13.009573 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8 --force-share --output=json" returned: 0 in 0.090s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:13.009573 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:13.010134 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:13.010687 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:48:13.014330 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:48:13.015073 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8 --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:13.087393 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:48:13.125440 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8 --force-share --output=json" returned: 0 in 0.111s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:13.126143 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8,backing_fmt=raw /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:13.189653 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8,backing_fmt=raw /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk 1073741824" returned: 0 in 0.063s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:13.190269 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.180s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:13.190776 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8 --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:13.257790 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:13.279629 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8 --force-share --output=json" returned: 0 in 0.089s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:13.280090 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:48:13.280322 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:13.381025 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:13.381487 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Cannot resize image /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:48:13.382200 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:48:13.382376 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Ensure instance console log exists: /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:48:13.382624 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:13.382862 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:13.383022 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:13.410542 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Updating instance_info_cache with network_info: [{"id": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "address": "fa:16:3e:1e:3f:68", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e6eaf0-15", "ovs_interfaceid": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:48:13.506134 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:13.586083 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Acquiring lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:13.586339 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:13.912995 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Releasing lock "refresh_cache-e1c00d98-c68b-45cd-b4f6-6c6d62b54290" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:48:13.913504 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Instance network_info: |[{"id": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "address": "fa:16:3e:1e:3f:68", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e6eaf0-15", "ovs_interfaceid": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:48:13.915080 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Start _get_guest_xml network_info=[{"id": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "address": "fa:16:3e:1e:3f:68", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e6eaf0-15", "ovs_interfaceid": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:48:03Z,direct_url=<?>,disk_format='qcow2',id=0f9e8183-efda-4ea7-80fb-acb10d593d2d,min_disk=0,min_ram=0,name='tempest-scenario-img--1105002272',owner='99f67462305b466bac5791264c17cf14',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:48:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '0f9e8183-efda-4ea7-80fb-acb10d593d2d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:48:13.918683 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:48:13.919926 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0f9e8183-efda-4ea7-80fb-acb10d593d2d', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1450609139', uuid='e1c00d98-c68b-45cd-b4f6-6c6d62b54290'), owner=OwnerMeta(userid='5b0cd08b7f014743a849982c90b5bd7a', username='tempest-TestMinimumBasicScenario-545024582-project-member', projectid='99f67462305b466bac5791264c17cf14', projectname='tempest-TestMinimumBasicScenario-545024582'), image=ImageMeta(id='0f9e8183-efda-4ea7-80fb-acb10d593d2d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "address": "fa:16:3e:1e:3f:68", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e6eaf0-15", "ovs_interfaceid": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166093.919526) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:48:13.920909 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:48:13.921264 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:48:13.922062 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:48:13.922246 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:48:13.923263 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:48:13.923542 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:48:03Z,direct_url=<?>,disk_format='qcow2',id=0f9e8183-efda-4ea7-80fb-acb10d593d2d,min_disk=0,min_ram=0,name='tempest-scenario-img--1105002272',owner='99f67462305b466bac5791264c17cf14',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:48:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:48:13.923672 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:48:13.923760 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:48:13.923872 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:48:13.923950 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:48:13.924054 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:48:13.924221 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:48:13.924314 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:48:13.924416 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:48:13.924509 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:48:13.924616 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:48:13.934005 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:48:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1450609139',display_name='tempest-TestMinimumBasicScenario-server-1450609139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testminimumbasicscenario-server-1450609139',id=63,image_ref='0f9e8183-efda-4ea7-80fb-acb10d593d2d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIB2eolkmA0oGE6NqabyY6MG9iWEJx9Lgf5y0C4v8ioS/wY56vg4wpxKxgtFjyFfgrd7edvEVhStgPFxYsyN7SqG7D8n5QW7cs32maHjoiY+yjq6YaIqG2ghwHVuE5DKg==',key_name='tempest-TestMinimumBasicScenario-315335831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99f67462305b466bac5791264c17cf14',ramdisk_id='',reservation_id='r-ggcof1af',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0f9e8183-efda-4ea7-80fb-acb10d593d2d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-545024582',owner_user_name='tempest-TestMinimumBasicScenario-545024582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:48:11Z,user_data=None,user_id='5b0cd08b7f014743a849982c90b5bd7a',uuid=e1c00d98-c68b-45cd-b4f6-6c6d62b54290,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "address": "fa:16:3e:1e:3f:68", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e6eaf0-15", "ovs_interfaceid": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:48:13.934178 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Converting VIF {"id": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "address": "fa:16:3e:1e:3f:68", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e6eaf0-15", "ovs_interfaceid": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:48:13.934759 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=53e6eaf0-1553-4cbe-874a-c98dce3a96fd,network=Network(08400d14-ac42-4046-ae13-082939c8e0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e6eaf0-15') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:48:13.935483 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lazy-loading 'pci_devices' on Instance uuid e1c00d98-c68b-45cd-b4f6-6c6d62b54290 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:48:14.088500 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:48:14.438001 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] End _get_guest_xml xml=<domain type="qemu">
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:   <uuid>e1c00d98-c68b-45cd-b4f6-6c6d62b54290</uuid>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:   <name>instance-0000003f</name>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestMinimumBasicScenario-server-1450609139</nova:name>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:48:13</nova:creationTime>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <nova:image uuid="0f9e8183-efda-4ea7-80fb-acb10d593d2d">
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:         <nova:properties/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:         <nova:user uuid="5b0cd08b7f014743a849982c90b5bd7a">tempest-TestMinimumBasicScenario-545024582-project-member</nova:user>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:         <nova:project uuid="99f67462305b466bac5791264c17cf14">tempest-TestMinimumBasicScenario-545024582</nova:project>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="0f9e8183-efda-4ea7-80fb-acb10d593d2d"/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:         <nova:port uuid="53e6eaf0-1553-4cbe-874a-c98dce3a96fd">
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     <system>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <entry name="serial">e1c00d98-c68b-45cd-b4f6-6c6d62b54290</entry>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <entry name="uuid">e1c00d98-c68b-45cd-b4f6-6c6d62b54290</entry>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     </system>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:   <os>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:   </os>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:   <features>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:   </features>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:   <devices>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk"/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     </disk>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk.config"/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     </disk>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:1e:3f:68"/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <target dev="tap53e6eaf0-15"/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     </interface>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/console.log" append="off"/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     </serial>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     <video>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     </video>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     </rng>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:   </devices>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]: </domain>
May 19 04:48:14.438001 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:48:14.440199 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Preparing to wait for external event network-vif-plugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:48:14.440199 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:14.440199 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:14.440199 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:14.440199 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:48:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1450609139',display_name='tempest-TestMinimumBasicScenario-server-1450609139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testminimumbasicscenario-server-1450609139',id=63,image_ref='0f9e8183-efda-4ea7-80fb-acb10d593d2d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIB2eolkmA0oGE6NqabyY6MG9iWEJx9Lgf5y0C4v8ioS/wY56vg4wpxKxgtFjyFfgrd7edvEVhStgPFxYsyN7SqG7D8n5QW7cs32maHjoiY+yjq6YaIqG2ghwHVuE5DKg==',key_name='tempest-TestMinimumBasicScenario-315335831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99f67462305b466bac5791264c17cf14',ramdisk_id='',reservation_id='r-ggcof1af',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0f9e8183-efda-4ea7-80fb-acb10d593d2d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-545024582',owner_user_name='tempest-TestMinimumBasicScenario-545024582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:48:11Z,user_data=None,user_id='5b0cd08b7f014743a849982c90b5bd7a',uuid=e1c00d98-c68b-45cd-b4f6-6c6d62b54290,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "address": "fa:16:3e:1e:3f:68", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e6eaf0-15", "ovs_interfaceid": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:48:14.440199 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Converting VIF {"id": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "address": "fa:16:3e:1e:3f:68", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e6eaf0-15", "ovs_interfaceid": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:48:14.440199 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=53e6eaf0-1553-4cbe-874a-c98dce3a96fd,network=Network(08400d14-ac42-4046-ae13-082939c8e0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e6eaf0-15') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:48:14.440805 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=53e6eaf0-1553-4cbe-874a-c98dce3a96fd,network=Network(08400d14-ac42-4046-ae13-082939c8e0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e6eaf0-15') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:48:14.440805 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:14.441131 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:48:14.441389 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:48:14.442123 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:14.442288 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c950405-5fc4-5783-8a07-b80b98a286d7', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:48:14.452959 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:14.453924 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:48:14.458537 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:14.458747 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53e6eaf0-15, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:48:14.459079 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53e6eaf0-15, col_values=(('qos', UUID('bfd30535-2685-4e03-a169-4e2469efe1f3')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:48:14.459247 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53e6eaf0-15, col_values=(('external_ids', {'iface-id': '53e6eaf0-1553-4cbe-874a-c98dce3a96fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:3f:68', 'vm-uuid': 'e1c00d98-c68b-45cd-b4f6-6c6d62b54290'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:48:14.463069 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:14.464298 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:48:14.468557 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:14.469230 np0000001025 nova-compute[97981]: INFO os_vif [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=53e6eaf0-1553-4cbe-874a-c98dce3a96fd,network=Network(08400d14-ac42-4046-ae13-082939c8e0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e6eaf0-15')
May 19 04:48:14.512392 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:14.513312 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:14.664352 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:14.664636 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:14.668892 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:48:14.669083 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Claim successful on node np0000001025
May 19 04:48:14.804299 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:15.016605 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lazy-loading 'flavor' on Instance uuid 3bd17542-9a9b-4bda-80a6-413cb4c2091d {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:48:15.879621 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:48:15.879870 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:48:15.983792 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:48:15.983946 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:48:15.983946 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] No VIF found with MAC fa:16:3e:1e:3f:68, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:48:15.984383 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Using config drive
May 19 04:48:16.021608 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:16.360928 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:16.384738 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:48:16.489914 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:16.620768 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Creating config drive at /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk.config
May 19 04:48:16.623966 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyfs8_d90 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:16.679477 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyfs8_d90" returned: 0 in 0.055s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:16.828687 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9f6cf513-15d7-41e4-8d47-5c29a34e5b2a req-9f5cb128-a47e-46a0-b252-2136b54ac4d2 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Received event network-vif-unplugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:48:16.828925 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9f6cf513-15d7-41e4-8d47-5c29a34e5b2a req-9f5cb128-a47e-46a0-b252-2136b54ac4d2 service nova] Acquiring lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:16.829141 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9f6cf513-15d7-41e4-8d47-5c29a34e5b2a req-9f5cb128-a47e-46a0-b252-2136b54ac4d2 service nova] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:16.829297 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9f6cf513-15d7-41e4-8d47-5c29a34e5b2a req-9f5cb128-a47e-46a0-b252-2136b54ac4d2 service nova] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:16.829452 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9f6cf513-15d7-41e4-8d47-5c29a34e5b2a req-9f5cb128-a47e-46a0-b252-2136b54ac4d2 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] No event matching network-vif-unplugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd in dict_keys([('network-vif-plugged', '53e6eaf0-1553-4cbe-874a-c98dce3a96fd')]) {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 19 04:48:16.829595 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-9f6cf513-15d7-41e4-8d47-5c29a34e5b2a req-9f5cb128-a47e-46a0-b252-2136b54ac4d2 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Received unexpected event network-vif-unplugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd for instance with vm_state building and task_state spawning.
May 19 04:48:16.891911 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.227s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:16.892358 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:48:17.079556 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:17.079913 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:17.080098 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Attaching volume 64a2b2e9-8d96-47c3-9e90-5bd517ca8932 to /dev/vdb
May 19 04:48:17.091340 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:17.116507 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:17.145433 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:48:17.166411 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:48:17.194492 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:17.212749 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:17.249594 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:48:17.250346 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:48:17.261171 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:48:17.263679 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fe9b:910a', 'fe80::c897:1dff:fede:235c', 'fe80::fc16:3eff:fe1e:3f68', 'fe80::1c08:7bff:fe57:c536'] 
May 19 04:48:17.263679 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:48:17.263679 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:48:17.263679 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:48:17.263930 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Updating existing volume attachment record: 0f0a5c21-b01b-4625-85d6-2d2c2b8e491c {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:48:17.403318 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:48:17.403318 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:48:17.403545 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:17.403925 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:17.443325 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:17.443325 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:17.449069 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:17.470677 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:17.498563 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46d4604f9bb344e3833d45a1ffbac88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69aba65177bf4f4a8e2d9a253aee056f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:48:17.827290 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:48:17.827415 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932', 'iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '64a2b2e9-8d96-47c3-9e90-5bd517ca8932', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:48:17.828166 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:48:17.828166 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:48:17.828463 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932', 'iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '64a2b2e9-8d96-47c3-9e90-5bd517ca8932', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:48:17.843080 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:48:17.843969 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:48:17.844462 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:48:17.846255 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:48:17.846646 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:48:17.847071 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:48:17.859892 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:48:17.859892 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:17.862981 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:48:17.862981 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:17.879057 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932] added
May 19 04:48:17.879057 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:48:17.879057 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:48:17.879057 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:48:17.879057 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:48:17.879057 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:48:17.879057 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:17.879057 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:48:17.879395 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0327(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:48:17.879456 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:48:17.889728 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932] added
May 19 04:48:17.889728 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:48:17.889728 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:48:17.889728 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:48:17.889728 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:48:17.889728 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:48:17.889728 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:17.889955 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:48:17.890069 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0439(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:48:17.890545 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:48:17.911902 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:48:17.953661 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166097.9531953, e1c00d98-c68b-45cd-b4f6-6c6d62b54290 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:48:17.954980 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] VM Started (Lifecycle Event)
May 19 04:48:17.979531 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Successfully created port: 67249ead-b56a-452d-a316-b41f76171452 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:48:18.416541 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:48:18.436443 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Successfully updated port: 67249ead-b56a-452d-a316-b41f76171452 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:48:18.457926 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:48:18.459903 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166098.4597223, e1c00d98-c68b-45cd-b4f6-6c6d62b54290 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:48:18.460018 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] VM Paused (Lifecycle Event)
May 19 04:48:18.507461 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:18.879921 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:48:18.891242 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:48:18.893252 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:48:18.893252 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:18.898003 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-40c2833a-d651-4d98-8741-61e04052a261 req-ebf05e9b-7af3-4181-bbb9-58d8fc3d3ec7 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Received event network-vif-plugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:48:18.898003 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-40c2833a-d651-4d98-8741-61e04052a261 req-ebf05e9b-7af3-4181-bbb9-58d8fc3d3ec7 service nova] Acquiring lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:18.898460 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-40c2833a-d651-4d98-8741-61e04052a261 req-ebf05e9b-7af3-4181-bbb9-58d8fc3d3ec7 service nova] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:18.898460 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-40c2833a-d651-4d98-8741-61e04052a261 req-ebf05e9b-7af3-4181-bbb9-58d8fc3d3ec7 service nova] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:18.898685 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-40c2833a-d651-4d98-8741-61e04052a261 req-ebf05e9b-7af3-4181-bbb9-58d8fc3d3ec7 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Processing event network-vif-plugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:48:18.898685 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-40c2833a-d651-4d98-8741-61e04052a261 req-ebf05e9b-7af3-4181-bbb9-58d8fc3d3ec7 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Received event network-vif-plugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:48:18.898873 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-40c2833a-d651-4d98-8741-61e04052a261 req-ebf05e9b-7af3-4181-bbb9-58d8fc3d3ec7 service nova] Acquiring lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:18.899074 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-40c2833a-d651-4d98-8741-61e04052a261 req-ebf05e9b-7af3-4181-bbb9-58d8fc3d3ec7 service nova] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:18.899273 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-40c2833a-d651-4d98-8741-61e04052a261 req-ebf05e9b-7af3-4181-bbb9-58d8fc3d3ec7 service nova] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:18.899454 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-40c2833a-d651-4d98-8741-61e04052a261 req-ebf05e9b-7af3-4181-bbb9-58d8fc3d3ec7 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] No waiting events found dispatching network-vif-plugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:48:18.899607 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-40c2833a-d651-4d98-8741-61e04052a261 req-ebf05e9b-7af3-4181-bbb9-58d8fc3d3ec7 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Received unexpected event network-vif-plugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd for instance with vm_state building and task_state spawning.
May 19 04:48:18.899796 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-40c2833a-d651-4d98-8741-61e04052a261 req-ebf05e9b-7af3-4181-bbb9-58d8fc3d3ec7 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Received event network-changed-67249ead-b56a-452d-a316-b41f76171452 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:48:18.899946 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-40c2833a-d651-4d98-8741-61e04052a261 req-ebf05e9b-7af3-4181-bbb9-58d8fc3d3ec7 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Refreshing instance network info cache due to event network-changed-67249ead-b56a-452d-a316-b41f76171452. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:48:18.900098 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-40c2833a-d651-4d98-8741-61e04052a261 req-ebf05e9b-7af3-4181-bbb9-58d8fc3d3ec7 service nova] Acquiring lock "refresh_cache-6c90d07e-25cd-4d8d-b134-f77a1de1b37a" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:48:18.900284 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-40c2833a-d651-4d98-8741-61e04052a261 req-ebf05e9b-7af3-4181-bbb9-58d8fc3d3ec7 service nova] Acquired lock "refresh_cache-6c90d07e-25cd-4d8d-b134-f77a1de1b37a" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:48:18.900393 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-40c2833a-d651-4d98-8741-61e04052a261 req-ebf05e9b-7af3-4181-bbb9-58d8fc3d3ec7 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Refreshing network info cache for port 67249ead-b56a-452d-a316-b41f76171452 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:48:18.901827 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:48:18.903611 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:48:18.903611 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:18.907197 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:48:18.911561 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Instance spawned successfully.
May 19 04:48:18.911854 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:48:18.913599 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:18.924583 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:18.929335 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a7640b8-89c9-4c46-8875-b47d290eb6f0 (non-flash)
May 19 04:48:18.929335 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:48:18.929463 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsi session list stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a7640b8-89c9-4c46-8875-b47d290eb6f0 (non-flash)
May 19 04:48:18.929463 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:48:18.938546 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a7640b8-89c9-4c46-8875-b47d290eb6f0 (non-flash)
May 19 04:48:18.938546 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:48:18.938546 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsi session list stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a7640b8-89c9-4c46-8875-b47d290eb6f0 (non-flash)
May 19 04:48:18.938546 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:48:18.943127 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Acquiring lock "refresh_cache-6c90d07e-25cd-4d8d-b134-f77a1de1b37a" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:48:18.963681 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:48:18.967088 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166098.9668007, e1c00d98-c68b-45cd-b4f6-6c6d62b54290 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:48:18.967240 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] VM Resumed (Lifecycle Event)
May 19 04:48:18.974859 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932, portal: 192.168.40.100,3260]
May 19 04:48:18.974859 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932, portal: 192.168.40.100,3260] successful.
May 19 04:48:18.974859 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:18.988225 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:19.003399 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a7640b8-89c9-4c46-8875-b47d290eb6f0 (non-flash)
May 19 04:48:19.003399 np0000001025 nova-compute[97981]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:19.003399 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:48:19.003557 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsi session list stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a7640b8-89c9-4c46-8875-b47d290eb6f0 (non-flash)
May 19 04:48:19.003557 np0000001025 nova-compute[97981]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:19.003557 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:48:19.003834 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:48:19.003967 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:48:19.004964 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] HCTL ('8', '-', '-', 0) found on session 145 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:48:19.004964 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:48:19.025746 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Searching for a device in session 145 and hctl ['8', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:48:19.404717 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-40c2833a-d651-4d98-8741-61e04052a261 req-ebf05e9b-7af3-4181-bbb9-58d8fc3d3ec7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:19.418627 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:48:19.418991 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:48:19.419536 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:48:19.419858 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:48:19.420287 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:48:19.420749 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:48:19.426362 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:48:19.427548 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:48:19.427874 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Creating image(s)
May 19 04:48:19.428476 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c90d07e-25cd-4d8d-b134-f77a1de1b37a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:19.428690 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "/opt/stack/data/nova/instances/6c90d07e-25cd-4d8d-b134-f77a1de1b37a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:19.429375 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "/opt/stack/data/nova/instances/6c90d07e-25cd-4d8d-b134-f77a1de1b37a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:19.430027 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:48:19.432409 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:48:19.433740 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:19.461625 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:19.473146 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:48:19.478487 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:48:19.489524 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-40c2833a-d651-4d98-8741-61e04052a261 req-ebf05e9b-7af3-4181-bbb9-58d8fc3d3ec7 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:48:19.535774 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.102s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:19.536425 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:19.536730 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:19.537169 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:48:19.540214 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:48:19.540935 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:19.637894 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.097s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:19.638302 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/6c90d07e-25cd-4d8d-b134-f77a1de1b37a/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:19.659562 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-40c2833a-d651-4d98-8741-61e04052a261 req-ebf05e9b-7af3-4181-bbb9-58d8fc3d3ec7 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:48:19.699619 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/6c90d07e-25cd-4d8d-b134-f77a1de1b37a/disk 1073741824" returned: 0 in 0.061s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:19.699993 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.163s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:19.700329 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:19.798603 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.098s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:19.799037 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c90d07e-25cd-4d8d-b134-f77a1de1b37a/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:48:19.799286 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c90d07e-25cd-4d8d-b134-f77a1de1b37a/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:19.887672 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c90d07e-25cd-4d8d-b134-f77a1de1b37a/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:19.888074 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Cannot resize image /opt/stack/data/nova/instances/6c90d07e-25cd-4d8d-b134-f77a1de1b37a/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:48:19.888432 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:48:19.888579 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Ensure instance console log exists: /opt/stack/data/nova/instances/6c90d07e-25cd-4d8d-b134-f77a1de1b37a/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:48:19.888849 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:19.889059 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:19.889247 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:19.928055 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Took 7.85 seconds to spawn the instance on the hypervisor.
May 19 04:48:19.928055 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:48:19.976412 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932, portal: 192.168.50.100,3260]
May 19 04:48:19.976412 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932, portal: 192.168.50.100,3260] successful.
May 19 04:48:19.976412 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:19.981588 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:48:19.988794 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:20.002312 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a7640b8-89c9-4c46-8875-b47d290eb6f0 (non-flash)
May 19 04:48:20.002312 np0000001025 nova-compute[97981]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:20.002312 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:20.002312 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:48:20.002312 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsi session list stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a7640b8-89c9-4c46-8875-b47d290eb6f0 (non-flash)
May 19 04:48:20.002312 np0000001025 nova-compute[97981]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:20.002312 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:20.002312 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:48:20.002312 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.157s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:48:20.002312 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:48:20.002312 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] HCTL ('9', '-', '-', 0) found on session 146 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:48:20.002312 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:48:20.018523 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Searching for a device in session 146 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:48:20.018523 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '64a2b2e9-8d96-47c3-9e90-5bd517ca8932', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:48:20.031848 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Searching for a device in session 145 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:48:20.031848 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '64a2b2e9-8d96-47c3-9e90-5bd517ca8932', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:48:20.163354 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-40c2833a-d651-4d98-8741-61e04052a261 req-ebf05e9b-7af3-4181-bbb9-58d8fc3d3ec7 service nova] Releasing lock "refresh_cache-6c90d07e-25cd-4d8d-b134-f77a1de1b37a" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:48:20.164041 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Acquired lock "refresh_cache-6c90d07e-25cd-4d8d-b134-f77a1de1b37a" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:48:20.164903 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:48:20.440937 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Took 13.13 seconds to build instance.
May 19 04:48:20.726934 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:48:20.845844 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:48:20.867914 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:20.942482 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.635s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:20.984323 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Updating instance_info_cache with network_info: [{"id": "67249ead-b56a-452d-a316-b41f76171452", "address": "fa:16:3e:d1:69:8e", "network": {"id": "12ac3fba-8b64-437c-8857-40535b1bd97a", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-226631955-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "69aba65177bf4f4a8e2d9a253aee056f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67249ead-b5", "ovs_interfaceid": "67249ead-b56a-452d-a316-b41f76171452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:48:21.219971 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0004058139998051047 future=<Future at 0x7218342ca780 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:48:21.220090 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:48:21.220587 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Emitting event <LifecycleEvent: 1779166086.219469, ab009682-2d6f-4f7a-b23d-95fd5f4d3f15 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:48:21.220710 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] VM Stopped (Lifecycle Event)
May 19 04:48:21.486260 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Releasing lock "refresh_cache-6c90d07e-25cd-4d8d-b134-f77a1de1b37a" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:48:21.486655 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Instance network_info: |[{"id": "67249ead-b56a-452d-a316-b41f76171452", "address": "fa:16:3e:d1:69:8e", "network": {"id": "12ac3fba-8b64-437c-8857-40535b1bd97a", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-226631955-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "69aba65177bf4f4a8e2d9a253aee056f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67249ead-b5", "ovs_interfaceid": "67249ead-b56a-452d-a316-b41f76171452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:48:21.488772 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Start _get_guest_xml network_info=[{"id": "67249ead-b56a-452d-a316-b41f76171452", "address": "fa:16:3e:d1:69:8e", "network": {"id": "12ac3fba-8b64-437c-8857-40535b1bd97a", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-226631955-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "69aba65177bf4f4a8e2d9a253aee056f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67249ead-b5", "ovs_interfaceid": "67249ead-b56a-452d-a316-b41f76171452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:48:21.494157 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:48:21.495319 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-VolumesExtendAttachedTest-instance-1451311913', uuid='6c90d07e-25cd-4d8d-b134-f77a1de1b37a'), owner=OwnerMeta(userid='46d4604f9bb344e3833d45a1ffbac88c', username='tempest-VolumesExtendAttachedTest-896639250-project-member', projectid='69aba65177bf4f4a8e2d9a253aee056f', projectname='tempest-VolumesExtendAttachedTest-896639250'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "67249ead-b56a-452d-a316-b41f76171452", "address": "fa:16:3e:d1:69:8e", "network": {"id": "12ac3fba-8b64-437c-8857-40535b1bd97a", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-226631955-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "69aba65177bf4f4a8e2d9a253aee056f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67249ead-b5", "ovs_interfaceid": "67249ead-b56a-452d-a316-b41f76171452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166101.4949763) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:48:21.498238 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:48:21.499581 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:48:21.500979 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:48:21.501191 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:48:21.502037 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:48:21.502356 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:48:21.502483 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:48:21.502567 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:48:21.502681 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:48:21.502756 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:48:21.502849 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:48:21.502990 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:48:21.503124 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:48:21.503236 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:48:21.503339 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:48:21.503450 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:48:21.521339 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:48:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1451311913',display_name='tempest-VolumesExtendAttachedTest-instance-1451311913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesextendattachedtest-instance-1451311913',id=64,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGiNrADa49zS2pAzsjLbCqhTajtqnwwl08ofV2QiUXITohMSfkLmc+jcZmf1jNQUXy0UZJYqKiPg8OToqYPrxhcpmAH0qRdFRvZHBB+ZviyZhS+Nkz6NoRjkbCwwlzMJg==',key_name='tempest-keypair-796413133',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69aba65177bf4f4a8e2d9a253aee056f',ramdisk_id='',reservation_id='r-v8j0w626',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-896639250',owner_user_name='tempest-VolumesExtendAttachedTest-896639250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:48:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46d4604f9bb344e3833d45a1ffbac88c',uuid=6c90d07e-25cd-4d8d-b134-f77a1de1b37a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67249ead-b56a-452d-a316-b41f76171452", "address": "fa:16:3e:d1:69:8e", "network": {"id": "12ac3fba-8b64-437c-8857-40535b1bd97a", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-226631955-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "69aba65177bf4f4a8e2d9a253aee056f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67249ead-b5", "ovs_interfaceid": "67249ead-b56a-452d-a316-b41f76171452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:48:21.522455 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Converting VIF {"id": "67249ead-b56a-452d-a316-b41f76171452", "address": "fa:16:3e:d1:69:8e", "network": {"id": "12ac3fba-8b64-437c-8857-40535b1bd97a", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-226631955-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "69aba65177bf4f4a8e2d9a253aee056f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67249ead-b5", "ovs_interfaceid": "67249ead-b56a-452d-a316-b41f76171452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:48:21.522999 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:69:8e,bridge_name='br-int',has_traffic_filtering=True,id=67249ead-b56a-452d-a316-b41f76171452,network=Network(12ac3fba-8b64-437c-8857-40535b1bd97a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67249ead-b5') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:48:21.527387 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c90d07e-25cd-4d8d-b134-f77a1de1b37a {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:48:21.724565 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-151f13fa-0489-406a-9c3a-fa700a2f701d tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: ab009682-2d6f-4f7a-b23d-95fd5f4d3f15] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:48:21.866373 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Found WWN 330000000267bf8b9 for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:48:21.866373 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.037s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:48:21.866373 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] <== connect_volume: return (4037ms) {'type': 'block', 'scsi_wwn': '330000000267bf8b9', 'path': '/dev/dm-0', 'multipath_id': '330000000267bf8b9'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:48:21.866373 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000267bf8b9', 'path': '/dev/dm-0', 'multipath_id': '330000000267bf8b9'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:48:21.868533 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lazy-loading 'flavor' on Instance uuid 3bd17542-9a9b-4bda-80a6-413cb4c2091d {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:48:22.030096 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] End _get_guest_xml xml=<domain type="qemu">
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:   <uuid>6c90d07e-25cd-4d8d-b134-f77a1de1b37a</uuid>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:   <name>instance-00000040</name>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <nova:name>tempest-VolumesExtendAttachedTest-instance-1451311913</nova:name>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:48:21</nova:creationTime>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:         <nova:user uuid="46d4604f9bb344e3833d45a1ffbac88c">tempest-VolumesExtendAttachedTest-896639250-project-member</nova:user>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:         <nova:project uuid="69aba65177bf4f4a8e2d9a253aee056f">tempest-VolumesExtendAttachedTest-896639250</nova:project>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:         <nova:port uuid="67249ead-b56a-452d-a316-b41f76171452">
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     <system>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <entry name="serial">6c90d07e-25cd-4d8d-b134-f77a1de1b37a</entry>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <entry name="uuid">6c90d07e-25cd-4d8d-b134-f77a1de1b37a</entry>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     </system>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:   <os>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:   </os>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:   <features>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:   </features>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:   <devices>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/6c90d07e-25cd-4d8d-b134-f77a1de1b37a/disk"/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     </disk>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/6c90d07e-25cd-4d8d-b134-f77a1de1b37a/disk.config"/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     </disk>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:d1:69:8e"/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <target dev="tap67249ead-b5"/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     </interface>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/6c90d07e-25cd-4d8d-b134-f77a1de1b37a/console.log" append="off"/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     </serial>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     <video>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     </video>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     </rng>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:   </devices>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]: </domain>
May 19 04:48:22.030096 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:48:22.032788 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Preparing to wait for external event network-vif-plugged-67249ead-b56a-452d-a316-b41f76171452 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:48:22.032788 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Acquiring lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:22.032788 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:22.032788 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:22.032788 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:48:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1451311913',display_name='tempest-VolumesExtendAttachedTest-instance-1451311913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesextendattachedtest-instance-1451311913',id=64,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGiNrADa49zS2pAzsjLbCqhTajtqnwwl08ofV2QiUXITohMSfkLmc+jcZmf1jNQUXy0UZJYqKiPg8OToqYPrxhcpmAH0qRdFRvZHBB+ZviyZhS+Nkz6NoRjkbCwwlzMJg==',key_name='tempest-keypair-796413133',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69aba65177bf4f4a8e2d9a253aee056f',ramdisk_id='',reservation_id='r-v8j0w626',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-896639250',owner_user_name='tempest-VolumesExtendAttachedTest-896639250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:48:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46d4604f9bb344e3833d45a1ffbac88c',uuid=6c90d07e-25cd-4d8d-b134-f77a1de1b37a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67249ead-b56a-452d-a316-b41f76171452", "address": "fa:16:3e:d1:69:8e", "network": {"id": "12ac3fba-8b64-437c-8857-40535b1bd97a", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-226631955-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "69aba65177bf4f4a8e2d9a253aee056f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67249ead-b5", "ovs_interfaceid": "67249ead-b56a-452d-a316-b41f76171452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:48:22.032788 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Converting VIF {"id": "67249ead-b56a-452d-a316-b41f76171452", "address": "fa:16:3e:d1:69:8e", "network": {"id": "12ac3fba-8b64-437c-8857-40535b1bd97a", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-226631955-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "69aba65177bf4f4a8e2d9a253aee056f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67249ead-b5", "ovs_interfaceid": "67249ead-b56a-452d-a316-b41f76171452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:48:22.032788 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:69:8e,bridge_name='br-int',has_traffic_filtering=True,id=67249ead-b56a-452d-a316-b41f76171452,network=Network(12ac3fba-8b64-437c-8857-40535b1bd97a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67249ead-b5') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:48:22.032788 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:69:8e,bridge_name='br-int',has_traffic_filtering=True,id=67249ead-b56a-452d-a316-b41f76171452,network=Network(12ac3fba-8b64-437c-8857-40535b1bd97a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67249ead-b5') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:48:22.033135 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:22.033741 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:48:22.033741 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:48:22.034429 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:22.034621 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd71b2eb8-d66a-582d-9e75-2a101b4dbd11', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:48:22.035416 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:22.036080 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:48:22.037252 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:22.039148 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:22.039300 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67249ead-b5, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:48:22.039601 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67249ead-b5, col_values=(('qos', UUID('e35ce89b-d1da-4234-afee-3ab2da9d0da8')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:48:22.039748 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67249ead-b5, col_values=(('external_ids', {'iface-id': '67249ead-b56a-452d-a316-b41f76171452', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:69:8e', 'vm-uuid': '6c90d07e-25cd-4d8d-b134-f77a1de1b37a'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:48:22.040466 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:22.041779 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:48:22.046680 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:22.047642 np0000001025 nova-compute[97981]: INFO os_vif [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:69:8e,bridge_name='br-int',has_traffic_filtering=True,id=67249ead-b56a-452d-a316-b41f76171452,network=Network(12ac3fba-8b64-437c-8857-40535b1bd97a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67249ead-b5')
May 19 04:48:22.371917 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Attempting to attach volume 64a2b2e9-8d96-47c3-9e90-5bd517ca8932 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:48:22.372529 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:48:22.372529 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:48:22.372529 np0000001025 nova-compute[97981]:   <alias name="ua-64a2b2e9-8d96-47c3-9e90-5bd517ca8932"/>
May 19 04:48:22.372529 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:48:22.372529 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:48:22.372529 np0000001025 nova-compute[97981]:   <serial>64a2b2e9-8d96-47c3-9e90-5bd517ca8932</serial>
May 19 04:48:22.372529 np0000001025 nova-compute[97981]: </disk>
May 19 04:48:22.372529 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:48:23.036928 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:23.037303 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:23.517192 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:23.540218 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lazy-loading 'flavor' on Instance uuid e1c00d98-c68b-45cd-b4f6-6c6d62b54290 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:48:23.563654 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:48:23.563817 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:48:23.563923 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] No VIF found with MAC fa:16:3e:d1:69:8e, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:48:23.564375 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Using config drive
May 19 04:48:24.016021 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:48:24.016216 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:48:24.016323 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:48:24.016419 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No VIF found with MAC fa:16:3e:9b:91:0a, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:48:24.068588 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:24.165901 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Creating config drive at /opt/stack/data/nova/instances/6c90d07e-25cd-4d8d-b134-f77a1de1b37a/disk.config
May 19 04:48:24.169750 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6c90d07e-25cd-4d8d-b134-f77a1de1b37a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6_1jt9g_ {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:24.220292 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6c90d07e-25cd-4d8d-b134-f77a1de1b37a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6_1jt9g_" returned: 0 in 0.050s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:24.544732 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:24.695479 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:24.717821 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:24.810562 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:24.883128 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-469e4ef6-6910-420d-bd45-0cfe6a3d4f52 req-4fbc0666-a068-4e0f-a808-176c67fea479 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Received event network-vif-plugged-67249ead-b56a-452d-a316-b41f76171452 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:48:24.883727 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-469e4ef6-6910-420d-bd45-0cfe6a3d4f52 req-4fbc0666-a068-4e0f-a808-176c67fea479 service nova] Acquiring lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:24.883994 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-469e4ef6-6910-420d-bd45-0cfe6a3d4f52 req-4fbc0666-a068-4e0f-a808-176c67fea479 service nova] Lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:24.884244 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-469e4ef6-6910-420d-bd45-0cfe6a3d4f52 req-4fbc0666-a068-4e0f-a808-176c67fea479 service nova] Lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:24.884450 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-469e4ef6-6910-420d-bd45-0cfe6a3d4f52 req-4fbc0666-a068-4e0f-a808-176c67fea479 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Processing event network-vif-plugged-67249ead-b56a-452d-a316-b41f76171452 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:48:25.096027 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:25.098394 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:25.102235 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:25.122017 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:25.532998 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166105.531629, 6c90d07e-25cd-4d8d-b134-f77a1de1b37a => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:48:25.532998 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] VM Started (Lifecycle Event)
May 19 04:48:25.537233 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:48:25.542019 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:48:25.553732 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Instance spawned successfully.
May 19 04:48:25.554866 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:48:25.598159 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84bfecb9-31d0-49dc-8908-140121cb23c8 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.518s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:25.658040 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:25.658236 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:25.658459 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Attaching volume 3e80ea54-ae38-4c23-9325-bfe45dfb1d4d to /dev/vdb
May 19 04:48:25.712261 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:48:25.723607 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:48:25.754098 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:25.806589 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:48:25.806957 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:48:25.816719 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:48:25.818185 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fe9b:910a', 'fe80::c897:1dff:fede:235c', 'fe80::fc16:3eff:fe1e:3f68', 'fe80::1c08:7bff:fe57:c536', 'fe80::fc16:3eff:fed1:698e', 'fe80::6c2f:1bff:fe3b:4a7d'] 
May 19 04:48:25.818345 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:48:25.818472 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:48:25.818779 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:48:25.819081 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Updating existing volume attachment record: 4a60f073-b977-4c6d-9667-93090f2a9f62 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:48:26.036670 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:48:26.041747 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:48:26.063905 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:48:26.064035 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:48:26.067135 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:48:26.067135 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:48:26.067135 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:48:26.067135 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:48:26.380302 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:48:26.380754 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:48:26.380847 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:48:26.381259 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:48:26.381453 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:48:26.393485 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:48:26.394152 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:48:26.394687 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:48:26.394873 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:48:26.395230 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:48:26.395426 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:48:26.410720 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:48:26.410720 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:26.412446 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:48:26.412446 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:26.424886 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d] added
May 19 04:48:26.424886 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:48:26.424886 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:48:26.424886 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:48:26.424886 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:48:26.424886 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:48:26.424886 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:26.425237 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:48:26.425237 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:48:26.425429 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:48:26.427540 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d] added
May 19 04:48:26.427540 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:48:26.427540 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:48:26.427540 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:48:26.427540 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:48:26.427540 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:48:26.427540 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:26.427946 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:48:26.427946 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0324(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:48:26.427946 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:48:26.544103 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:48:26.544378 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166106.544182, 6c90d07e-25cd-4d8d-b134-f77a1de1b37a => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:48:26.544479 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] VM Paused (Lifecycle Event)
May 19 04:48:26.570501 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Took 7.14 seconds to spawn the instance on the hypervisor.
May 19 04:48:26.570958 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:48:27.043188 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:27.046774 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:48:27.049836 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166107.0495813, 6c90d07e-25cd-4d8d-b134-f77a1de1b37a => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:48:27.049999 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] VM Resumed (Lifecycle Event)
May 19 04:48:27.083940 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Took 12.49 seconds to build instance.
May 19 04:48:27.195976 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-42c23dfb-c86b-45d4-b5a8-196184d75068 req-c6984ed4-5073-41cf-a4ad-39a9368af321 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Received event network-vif-plugged-67249ead-b56a-452d-a316-b41f76171452 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:48:27.196337 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-42c23dfb-c86b-45d4-b5a8-196184d75068 req-c6984ed4-5073-41cf-a4ad-39a9368af321 service nova] Acquiring lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:27.196574 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-42c23dfb-c86b-45d4-b5a8-196184d75068 req-c6984ed4-5073-41cf-a4ad-39a9368af321 service nova] Lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:27.196753 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-42c23dfb-c86b-45d4-b5a8-196184d75068 req-c6984ed4-5073-41cf-a4ad-39a9368af321 service nova] Lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:27.197023 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-42c23dfb-c86b-45d4-b5a8-196184d75068 req-c6984ed4-5073-41cf-a4ad-39a9368af321 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] No waiting events found dispatching network-vif-plugged-67249ead-b56a-452d-a316-b41f76171452 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:48:27.197124 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-42c23dfb-c86b-45d4-b5a8-196184d75068 req-c6984ed4-5073-41cf-a4ad-39a9368af321 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Received unexpected event network-vif-plugged-67249ead-b56a-452d-a316-b41f76171452 for instance with vm_state active and task_state None.
May 19 04:48:27.425875 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:48:27.428419 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:48:27.438274 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:48:27.438274 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:48:27.444118 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:48:27.444118 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:27.453316 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:27.459557 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:27.467245 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a7640b8-89c9-4c46-8875-b47d290eb6f0 (non-flash)
May 19 04:48:27.467245 np0000001025 nova-compute[97981]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:27.467245 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:27.467245 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:48:27.467506 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsi session list stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a7640b8-89c9-4c46-8875-b47d290eb6f0 (non-flash)
May 19 04:48:27.467506 np0000001025 nova-compute[97981]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:27.467506 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:27.467506 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:48:27.474450 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a7640b8-89c9-4c46-8875-b47d290eb6f0 (non-flash)
May 19 04:48:27.474450 np0000001025 nova-compute[97981]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:27.474450 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:27.474450 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:48:27.474624 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsi session list stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a7640b8-89c9-4c46-8875-b47d290eb6f0 (non-flash)
May 19 04:48:27.474624 np0000001025 nova-compute[97981]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:27.474624 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:27.474624 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:48:27.494349 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d, portal: 192.168.40.100,3260]
May 19 04:48:27.494349 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d, portal: 192.168.40.100,3260] successful.
May 19 04:48:27.494349 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:27.507207 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:27.516616 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d, portal: 192.168.50.100,3260]
May 19 04:48:27.516616 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d, portal: 192.168.50.100,3260] successful.
May 19 04:48:27.516616 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:27.521393 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a7640b8-89c9-4c46-8875-b47d290eb6f0 (non-flash)
May 19 04:48:27.521393 np0000001025 nova-compute[97981]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:27.521393 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:27.521393 np0000001025 nova-compute[97981]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:48:27.521393 np0000001025 nova-compute[97981]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:48:27.521393 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:48:27.521633 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsi session list stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a7640b8-89c9-4c46-8875-b47d290eb6f0 (non-flash)
May 19 04:48:27.521633 np0000001025 nova-compute[97981]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:27.521633 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:27.521633 np0000001025 nova-compute[97981]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:48:27.521633 np0000001025 nova-compute[97981]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:48:27.521633 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:48:27.521910 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.127s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:48:27.522032 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:48:27.522638 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] HCTL ('10', '-', '-', 0) found on session 147 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:48:27.522735 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:48:27.528288 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:27.538532 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Searching for a device in session 147 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:48:27.538685 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:48:27.545783 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a7640b8-89c9-4c46-8875-b47d290eb6f0 (non-flash)
May 19 04:48:27.545783 np0000001025 nova-compute[97981]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:27.545783 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:27.545783 np0000001025 nova-compute[97981]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:48:27.545783 np0000001025 nova-compute[97981]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:48:27.545783 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:48:27.546101 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsi session list stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a7640b8-89c9-4c46-8875-b47d290eb6f0 (non-flash)
May 19 04:48:27.546101 np0000001025 nova-compute[97981]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:27.546101 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:27.546101 np0000001025 nova-compute[97981]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:48:27.546101 np0000001025 nova-compute[97981]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:48:27.546101 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:48:27.546293 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:48:27.546397 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:48:27.546920 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] HCTL ('11', '-', '-', 0) found on session 148 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:48:27.547018 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:48:27.552670 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:48:27.554795 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:48:27.565173 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Searching for a device in session 148 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:48:27.565173 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:48:27.585718 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2790c685-6fb9-4c8a-8c65-38065215c2a9 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.999s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:27.732687 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "0ad59512-92c0-43d3-bd72-b318240b579f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:27.732960 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "0ad59512-92c0-43d3-bd72-b318240b579f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:28.236320 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:48:28.395389 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:48:28.519461 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:28.795237 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:28.795465 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:28.798322 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:48:28.798443 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Claim successful on node np0000001025
May 19 04:48:29.259531 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-19818323-22ec-4f60-93cf-115bf47cddfd req-d5e7b777-54aa-44a1-b75a-1c73944569e0 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Received event network-changed-67249ead-b56a-452d-a316-b41f76171452 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:48:29.259712 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-19818323-22ec-4f60-93cf-115bf47cddfd req-d5e7b777-54aa-44a1-b75a-1c73944569e0 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Refreshing instance network info cache due to event network-changed-67249ead-b56a-452d-a316-b41f76171452. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:48:29.259893 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-19818323-22ec-4f60-93cf-115bf47cddfd req-d5e7b777-54aa-44a1-b75a-1c73944569e0 service nova] Acquiring lock "refresh_cache-6c90d07e-25cd-4d8d-b134-f77a1de1b37a" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:48:29.260011 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-19818323-22ec-4f60-93cf-115bf47cddfd req-d5e7b777-54aa-44a1-b75a-1c73944569e0 service nova] Acquired lock "refresh_cache-6c90d07e-25cd-4d8d-b134-f77a1de1b37a" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:48:29.260188 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-19818323-22ec-4f60-93cf-115bf47cddfd req-d5e7b777-54aa-44a1-b75a-1c73944569e0 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Refreshing network info cache for port 67249ead-b56a-452d-a316-b41f76171452 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:48:29.444683 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Found WWN 330000000d6085c62 for multipath device dm-1 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:48:29.444683 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:48:29.444683 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '330000000d6085c62', 'path': '/dev/dm-1', 'multipath_id': '330000000d6085c62'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:48:29.444683 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d6085c62', 'path': '/dev/dm-1', 'multipath_id': '330000000d6085c62'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:48:29.444683 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lazy-loading 'flavor' on Instance uuid e1c00d98-c68b-45cd-b4f6-6c6d62b54290 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:48:29.762203 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-19818323-22ec-4f60-93cf-115bf47cddfd req-d5e7b777-54aa-44a1-b75a-1c73944569e0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:29.923997 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Attempting to attach volume 3e80ea54-ae38-4c23-9325-bfe45dfb1d4d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:48:29.925396 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:48:29.925396 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:48:29.925396 np0000001025 nova-compute[97981]:   <alias name="ua-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d"/>
May 19 04:48:29.925396 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-1"/>
May 19 04:48:29.925396 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:48:29.925396 np0000001025 nova-compute[97981]:   <serial>3e80ea54-ae38-4c23-9325-bfe45dfb1d4d</serial>
May 19 04:48:29.925396 np0000001025 nova-compute[97981]: </disk>
May 19 04:48:29.925396 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:48:30.038565 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:48:30.038817 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:48:30.082727 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-19818323-22ec-4f60-93cf-115bf47cddfd req-d5e7b777-54aa-44a1-b75a-1c73944569e0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:30.204126 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-19818323-22ec-4f60-93cf-115bf47cddfd req-d5e7b777-54aa-44a1-b75a-1c73944569e0 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Updated VIF entry in instance network info cache for port 67249ead-b56a-452d-a316-b41f76171452. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:48:30.204457 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-19818323-22ec-4f60-93cf-115bf47cddfd req-d5e7b777-54aa-44a1-b75a-1c73944569e0 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Updating instance_info_cache with network_info: [{"id": "67249ead-b56a-452d-a316-b41f76171452", "address": "fa:16:3e:d1:69:8e", "network": {"id": "12ac3fba-8b64-437c-8857-40535b1bd97a", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-226631955-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "69aba65177bf4f4a8e2d9a253aee056f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67249ead-b5", "ovs_interfaceid": "67249ead-b56a-452d-a316-b41f76171452", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:48:30.541634 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:48:30.706344 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-19818323-22ec-4f60-93cf-115bf47cddfd req-d5e7b777-54aa-44a1-b75a-1c73944569e0 service nova] Releasing lock "refresh_cache-6c90d07e-25cd-4d8d-b134-f77a1de1b37a" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:48:31.047874 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.252s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:31.048272 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:48:31.553527 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:48:31.553696 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:48:31.553930 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:31.554298 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:31.586161 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:48:31.586394 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:48:31.586502 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:48:31.586618 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] No VIF found with MAC fa:16:3e:1e:3f:68, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:48:31.626335 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fd3d5c8cf5c41589ceb1e2a5a9813c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e16e702e1284e7fbba4184913a43de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:48:32.031242 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Successfully created port: 23e3b074-7f3a-4cd9-8618-42df2f2c9ac9 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:48:32.044955 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:32.054907 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:48:32.506269 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Successfully updated port: 23e3b074-7f3a-4cd9-8618-42df2f2c9ac9 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:48:32.554646 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d40bff85-9afe-4251-882c-e24ee271353e req-b4012e8e-2e4f-419e-99d4-da0be9f3101c service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Received event network-changed-23e3b074-7f3a-4cd9-8618-42df2f2c9ac9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:48:32.555080 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d40bff85-9afe-4251-882c-e24ee271353e req-b4012e8e-2e4f-419e-99d4-da0be9f3101c service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Refreshing instance network info cache due to event network-changed-23e3b074-7f3a-4cd9-8618-42df2f2c9ac9. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:48:32.555296 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d40bff85-9afe-4251-882c-e24ee271353e req-b4012e8e-2e4f-419e-99d4-da0be9f3101c service nova] Acquiring lock "refresh_cache-0ad59512-92c0-43d3-bd72-b318240b579f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:48:32.555390 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d40bff85-9afe-4251-882c-e24ee271353e req-b4012e8e-2e4f-419e-99d4-da0be9f3101c service nova] Acquired lock "refresh_cache-0ad59512-92c0-43d3-bd72-b318240b579f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:48:32.555491 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d40bff85-9afe-4251-882c-e24ee271353e req-b4012e8e-2e4f-419e-99d4-da0be9f3101c service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Refreshing network info cache for port 23e3b074-7f3a-4cd9-8618-42df2f2c9ac9 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:48:32.557975 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:48:33.008326 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "refresh_cache-0ad59512-92c0-43d3-bd72-b318240b579f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:48:33.057223 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-d40bff85-9afe-4251-882c-e24ee271353e req-b4012e8e-2e4f-419e-99d4-da0be9f3101c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:33.117607 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d40bff85-9afe-4251-882c-e24ee271353e req-b4012e8e-2e4f-419e-99d4-da0be9f3101c service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:48:33.139350 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7a11df30-f881-4e67-b37e-185ceade038e tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.481s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:33.245386 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d40bff85-9afe-4251-882c-e24ee271353e req-b4012e8e-2e4f-419e-99d4-da0be9f3101c service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:48:33.519707 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:33.565874 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:48:33.566792 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:48:33.567005 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Creating image(s)
May 19 04:48:33.567516 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ad59512-92c0-43d3-bd72-b318240b579f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:33.567716 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "/opt/stack/data/nova/instances/0ad59512-92c0-43d3-bd72-b318240b579f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:33.568143 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "/opt/stack/data/nova/instances/0ad59512-92c0-43d3-bd72-b318240b579f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:33.568628 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:48:33.570968 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:48:33.571949 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:33.660070 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.088s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:33.660513 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:33.660994 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:33.661461 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:48:33.664028 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:48:33.664400 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:33.748036 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d40bff85-9afe-4251-882c-e24ee271353e req-b4012e8e-2e4f-419e-99d4-da0be9f3101c service nova] Releasing lock "refresh_cache-0ad59512-92c0-43d3-bd72-b318240b579f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:48:33.748718 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquired lock "refresh_cache-0ad59512-92c0-43d3-bd72-b318240b579f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:48:33.748988 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:48:33.750867 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.086s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:33.751613 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/0ad59512-92c0-43d3-bd72-b318240b579f/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:33.806536 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/0ad59512-92c0-43d3-bd72-b318240b579f/disk 1073741824" returned: 0 in 0.055s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:33.806955 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.146s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:33.807361 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:33.919418 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.112s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:33.919852 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ad59512-92c0-43d3-bd72-b318240b579f/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:48:33.920128 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad59512-92c0-43d3-bd72-b318240b579f/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:34.031449 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad59512-92c0-43d3-bd72-b318240b579f/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:34.031845 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Cannot resize image /opt/stack/data/nova/instances/0ad59512-92c0-43d3-bd72-b318240b579f/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:48:34.032278 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:48:34.032471 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Ensure instance console log exists: /opt/stack/data/nova/instances/0ad59512-92c0-43d3-bd72-b318240b579f/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:48:34.032751 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:34.033003 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:34.033199 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:34.313742 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:48:34.461438 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:34.590944 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Updating instance_info_cache with network_info: [{"id": "23e3b074-7f3a-4cd9-8618-42df2f2c9ac9", "address": "fa:16:3e:7c:53:9c", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e3b074-7f", "ovs_interfaceid": "23e3b074-7f3a-4cd9-8618-42df2f2c9ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:48:35.093837 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Releasing lock "refresh_cache-0ad59512-92c0-43d3-bd72-b318240b579f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:48:35.094300 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Instance network_info: |[{"id": "23e3b074-7f3a-4cd9-8618-42df2f2c9ac9", "address": "fa:16:3e:7c:53:9c", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e3b074-7f", "ovs_interfaceid": "23e3b074-7f3a-4cd9-8618-42df2f2c9ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:48:35.096468 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Start _get_guest_xml network_info=[{"id": "23e3b074-7f3a-4cd9-8618-42df2f2c9ac9", "address": "fa:16:3e:7c:53:9c", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e3b074-7f", "ovs_interfaceid": "23e3b074-7f3a-4cd9-8618-42df2f2c9ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:48:35.100781 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:48:35.102279 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-921353086', uuid='0ad59512-92c0-43d3-bd72-b318240b579f'), owner=OwnerMeta(userid='3fd3d5c8cf5c41589ceb1e2a5a9813c9', username='tempest-AttachVolumeNegativeTest-198121636-project-member', projectid='2e16e702e1284e7fbba4184913a43de7', projectname='tempest-AttachVolumeNegativeTest-198121636'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "23e3b074-7f3a-4cd9-8618-42df2f2c9ac9", "address": "fa:16:3e:7c:53:9c", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e3b074-7f", "ovs_interfaceid": "23e3b074-7f3a-4cd9-8618-42df2f2c9ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166115.1018083) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:48:35.103475 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:48:35.103894 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:48:35.105001 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:48:35.105234 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:48:35.106176 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:48:35.106921 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:48:35.107148 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:48:35.107302 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:48:35.107485 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:48:35.107622 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:48:35.107922 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:48:35.108010 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:48:35.108568 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:48:35.108754 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:48:35.108917 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:48:35.109122 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:48:35.125848 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-921353086',display_name='tempest-AttachVolumeNegativeTest-server-921353086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumenegativetest-server-921353086',id=65,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZISScPbjLLYaB/1xQcXIvFQ7qfTDc/AKXszYCYIXqQsW+6zTvtrNQnm+V7R/qCTmy1ja1IpveXCXslCG267DfaRoTS+QXFPlrHgVq/5DjETSHenh0To1vMJNzAU9aZsg==',key_name='tempest-keypair-395921467',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e16e702e1284e7fbba4184913a43de7',ramdisk_id='',reservation_id='r-hh95ebtk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-198121636',owner_user_name='tempest-AttachVolumeNegativeTest-198121636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:48:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fd3d5c8cf5c41589ceb1e2a5a9813c9',uuid=0ad59512-92c0-43d3-bd72-b318240b579f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23e3b074-7f3a-4cd9-8618-42df2f2c9ac9", "address": "fa:16:3e:7c:53:9c", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e3b074-7f", "ovs_interfaceid": "23e3b074-7f3a-4cd9-8618-42df2f2c9ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:48:35.126073 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converting VIF {"id": "23e3b074-7f3a-4cd9-8618-42df2f2c9ac9", "address": "fa:16:3e:7c:53:9c", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e3b074-7f", "ovs_interfaceid": "23e3b074-7f3a-4cd9-8618-42df2f2c9ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:48:35.128621 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:53:9c,bridge_name='br-int',has_traffic_filtering=True,id=23e3b074-7f3a-4cd9-8618-42df2f2c9ac9,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e3b074-7f') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:48:35.128621 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ad59512-92c0-43d3-bd72-b318240b579f {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:48:35.398043 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-19b30485-4d48-4cfe-a91b-887563f33b7d req-e25da990-dc78-44a7-a9d8-ee87522c749b service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Received event network-changed-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:48:35.398043 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-19b30485-4d48-4cfe-a91b-887563f33b7d req-e25da990-dc78-44a7-a9d8-ee87522c749b service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Refreshing instance network info cache due to event network-changed-53e6eaf0-1553-4cbe-874a-c98dce3a96fd. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:48:35.398043 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-19b30485-4d48-4cfe-a91b-887563f33b7d req-e25da990-dc78-44a7-a9d8-ee87522c749b service nova] Acquiring lock "refresh_cache-e1c00d98-c68b-45cd-b4f6-6c6d62b54290" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:48:35.398624 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-19b30485-4d48-4cfe-a91b-887563f33b7d req-e25da990-dc78-44a7-a9d8-ee87522c749b service nova] Acquired lock "refresh_cache-e1c00d98-c68b-45cd-b4f6-6c6d62b54290" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:48:35.398624 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-19b30485-4d48-4cfe-a91b-887563f33b7d req-e25da990-dc78-44a7-a9d8-ee87522c749b service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Refreshing network info cache for port 53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:48:35.630860 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] End _get_guest_xml xml=<domain type="qemu">
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:   <uuid>0ad59512-92c0-43d3-bd72-b318240b579f</uuid>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:   <name>instance-00000041</name>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <nova:name>tempest-AttachVolumeNegativeTest-server-921353086</nova:name>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:48:35</nova:creationTime>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:         <nova:user uuid="3fd3d5c8cf5c41589ceb1e2a5a9813c9">tempest-AttachVolumeNegativeTest-198121636-project-member</nova:user>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:         <nova:project uuid="2e16e702e1284e7fbba4184913a43de7">tempest-AttachVolumeNegativeTest-198121636</nova:project>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:         <nova:port uuid="23e3b074-7f3a-4cd9-8618-42df2f2c9ac9">
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     <system>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <entry name="serial">0ad59512-92c0-43d3-bd72-b318240b579f</entry>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <entry name="uuid">0ad59512-92c0-43d3-bd72-b318240b579f</entry>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     </system>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:   <os>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:   </os>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:   <features>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:   </features>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:   <devices>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/0ad59512-92c0-43d3-bd72-b318240b579f/disk"/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     </disk>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/0ad59512-92c0-43d3-bd72-b318240b579f/disk.config"/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     </disk>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:7c:53:9c"/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <target dev="tap23e3b074-7f"/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     </interface>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/0ad59512-92c0-43d3-bd72-b318240b579f/console.log" append="off"/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     </serial>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     <video>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     </video>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     </rng>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:   </devices>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]: </domain>
May 19 04:48:35.630860 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:48:35.632864 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Preparing to wait for external event network-vif-plugged-23e3b074-7f3a-4cd9-8618-42df2f2c9ac9 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:48:35.632864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "0ad59512-92c0-43d3-bd72-b318240b579f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:35.632864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "0ad59512-92c0-43d3-bd72-b318240b579f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:35.632864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "0ad59512-92c0-43d3-bd72-b318240b579f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:35.632864 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-921353086',display_name='tempest-AttachVolumeNegativeTest-server-921353086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumenegativetest-server-921353086',id=65,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZISScPbjLLYaB/1xQcXIvFQ7qfTDc/AKXszYCYIXqQsW+6zTvtrNQnm+V7R/qCTmy1ja1IpveXCXslCG267DfaRoTS+QXFPlrHgVq/5DjETSHenh0To1vMJNzAU9aZsg==',key_name='tempest-keypair-395921467',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e16e702e1284e7fbba4184913a43de7',ramdisk_id='',reservation_id='r-hh95ebtk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-198121636',owner_user_name='tempest-AttachVolumeNegativeTest-198121636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:48:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fd3d5c8cf5c41589ceb1e2a5a9813c9',uuid=0ad59512-92c0-43d3-bd72-b318240b579f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23e3b074-7f3a-4cd9-8618-42df2f2c9ac9", "address": "fa:16:3e:7c:53:9c", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e3b074-7f", "ovs_interfaceid": "23e3b074-7f3a-4cd9-8618-42df2f2c9ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:48:35.632864 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converting VIF {"id": "23e3b074-7f3a-4cd9-8618-42df2f2c9ac9", "address": "fa:16:3e:7c:53:9c", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e3b074-7f", "ovs_interfaceid": "23e3b074-7f3a-4cd9-8618-42df2f2c9ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:48:35.633194 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:53:9c,bridge_name='br-int',has_traffic_filtering=True,id=23e3b074-7f3a-4cd9-8618-42df2f2c9ac9,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e3b074-7f') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:48:35.634346 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:53:9c,bridge_name='br-int',has_traffic_filtering=True,id=23e3b074-7f3a-4cd9-8618-42df2f2c9ac9,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e3b074-7f') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:48:35.634346 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:35.634346 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:48:35.634519 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:48:35.635132 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:35.635316 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4bcc9541-0b69-5c20-ac31-046f663617b0', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:48:35.637252 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:35.637653 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:48:35.640193 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:35.640424 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23e3b074-7f, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:48:35.642471 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23e3b074-7f, col_values=(('qos', UUID('1494c2ec-fad6-43c9-97d9-53edefb1eea7')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:48:35.642471 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23e3b074-7f, col_values=(('external_ids', {'iface-id': '23e3b074-7f3a-4cd9-8618-42df2f2c9ac9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:53:9c', 'vm-uuid': '0ad59512-92c0-43d3-bd72-b318240b579f'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:48:35.643859 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:35.645621 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:48:35.649351 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:35.650058 np0000001025 nova-compute[97981]: INFO os_vif [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:53:9c,bridge_name='br-int',has_traffic_filtering=True,id=23e3b074-7f3a-4cd9-8618-42df2f2c9ac9,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e3b074-7f')
May 19 04:48:35.901188 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-19b30485-4d48-4cfe-a91b-887563f33b7d req-e25da990-dc78-44a7-a9d8-ee87522c749b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:36.208647 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-19b30485-4d48-4cfe-a91b-887563f33b7d req-e25da990-dc78-44a7-a9d8-ee87522c749b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:36.346585 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-19b30485-4d48-4cfe-a91b-887563f33b7d req-e25da990-dc78-44a7-a9d8-ee87522c749b service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Updated VIF entry in instance network info cache for port 53e6eaf0-1553-4cbe-874a-c98dce3a96fd. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:48:36.346902 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-19b30485-4d48-4cfe-a91b-887563f33b7d req-e25da990-dc78-44a7-a9d8-ee87522c749b service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Updating instance_info_cache with network_info: [{"id": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "address": "fa:16:3e:1e:3f:68", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e6eaf0-15", "ovs_interfaceid": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:48:36.795875 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b7963257-1624-4629-8e3c-2d7df02100ab req-670f331c-8ae1-491b-8b6d-1cea26cd5521 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Received event network-changed-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:48:36.796210 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b7963257-1624-4629-8e3c-2d7df02100ab req-670f331c-8ae1-491b-8b6d-1cea26cd5521 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Refreshing instance network info cache due to event network-changed-53e6eaf0-1553-4cbe-874a-c98dce3a96fd. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:48:36.796284 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b7963257-1624-4629-8e3c-2d7df02100ab req-670f331c-8ae1-491b-8b6d-1cea26cd5521 service nova] Acquiring lock "refresh_cache-e1c00d98-c68b-45cd-b4f6-6c6d62b54290" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:48:36.849076 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-19b30485-4d48-4cfe-a91b-887563f33b7d req-e25da990-dc78-44a7-a9d8-ee87522c749b service nova] Releasing lock "refresh_cache-e1c00d98-c68b-45cd-b4f6-6c6d62b54290" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:48:36.849405 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b7963257-1624-4629-8e3c-2d7df02100ab req-670f331c-8ae1-491b-8b6d-1cea26cd5521 service nova] Acquired lock "refresh_cache-e1c00d98-c68b-45cd-b4f6-6c6d62b54290" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:48:36.849548 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-b7963257-1624-4629-8e3c-2d7df02100ab req-670f331c-8ae1-491b-8b6d-1cea26cd5521 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Refreshing network info cache for port 53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:48:37.169525 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:48:37.169631 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:48:37.169746 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No VIF found with MAC fa:16:3e:7c:53:9c, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:48:37.170224 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Using config drive
May 19 04:48:37.351887 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-b7963257-1624-4629-8e3c-2d7df02100ab req-670f331c-8ae1-491b-8b6d-1cea26cd5521 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:37.675970 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:37.705359 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-b7963257-1624-4629-8e3c-2d7df02100ab req-670f331c-8ae1-491b-8b6d-1cea26cd5521 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:37.843078 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Creating config drive at /opt/stack/data/nova/instances/0ad59512-92c0-43d3-bd72-b318240b579f/disk.config
May 19 04:48:37.846761 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0ad59512-92c0-43d3-bd72-b318240b579f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnqkwqxoo {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:37.863580 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-b7963257-1624-4629-8e3c-2d7df02100ab req-670f331c-8ae1-491b-8b6d-1cea26cd5521 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Updated VIF entry in instance network info cache for port 53e6eaf0-1553-4cbe-874a-c98dce3a96fd. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:48:37.864527 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-b7963257-1624-4629-8e3c-2d7df02100ab req-670f331c-8ae1-491b-8b6d-1cea26cd5521 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Updating instance_info_cache with network_info: [{"id": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "address": "fa:16:3e:1e:3f:68", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e6eaf0-15", "ovs_interfaceid": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:48:37.909479 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0ad59512-92c0-43d3-bd72-b318240b579f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnqkwqxoo" returned: 0 in 0.062s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:38.294022 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:38.315930 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:38.318356 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:38.368890 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b7963257-1624-4629-8e3c-2d7df02100ab req-670f331c-8ae1-491b-8b6d-1cea26cd5521 service nova] Releasing lock "refresh_cache-e1c00d98-c68b-45cd-b4f6-6c6d62b54290" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:48:38.405842 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:38.426602 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:38.430288 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:38.494714 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-34c1e81c-f93a-40ab-b53a-fcd32bbce30e req-02755c17-c974-461d-9478-fa3e4d1ca9c0 service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Received event network-vif-plugged-23e3b074-7f3a-4cd9-8618-42df2f2c9ac9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:48:38.495279 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-34c1e81c-f93a-40ab-b53a-fcd32bbce30e req-02755c17-c974-461d-9478-fa3e4d1ca9c0 service nova] Acquiring lock "0ad59512-92c0-43d3-bd72-b318240b579f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:38.495555 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-34c1e81c-f93a-40ab-b53a-fcd32bbce30e req-02755c17-c974-461d-9478-fa3e4d1ca9c0 service nova] Lock "0ad59512-92c0-43d3-bd72-b318240b579f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:38.495749 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-34c1e81c-f93a-40ab-b53a-fcd32bbce30e req-02755c17-c974-461d-9478-fa3e4d1ca9c0 service nova] Lock "0ad59512-92c0-43d3-bd72-b318240b579f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:38.495913 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-34c1e81c-f93a-40ab-b53a-fcd32bbce30e req-02755c17-c974-461d-9478-fa3e4d1ca9c0 service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Processing event network-vif-plugged-23e3b074-7f3a-4cd9-8618-42df2f2c9ac9 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:48:38.522816 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:39.010157 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166119.0097196, 0ad59512-92c0-43d3-bd72-b318240b579f => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:48:39.010572 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] VM Started (Lifecycle Event)
May 19 04:48:39.011820 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:48:39.014708 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:48:39.016761 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Instance spawned successfully.
May 19 04:48:39.017361 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:48:39.513317 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:48:39.515775 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:48:39.533530 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:48:39.533530 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:48:39.533889 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:48:39.534140 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:48:39.534412 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:48:39.534695 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:48:40.019712 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:48:40.020061 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166120.0197504, 0ad59512-92c0-43d3-bd72-b318240b579f => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:48:40.020061 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] VM Paused (Lifecycle Event)
May 19 04:48:40.042439 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Took 6.48 seconds to spawn the instance on the hypervisor.
May 19 04:48:40.042649 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:48:40.522441 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:48:40.525467 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166120.5252652, 0ad59512-92c0-43d3-bd72-b318240b579f => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:48:40.525578 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] VM Resumed (Lifecycle Event)
May 19 04:48:40.553951 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Took 11.81 seconds to build instance.
May 19 04:48:40.557030 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-24611141-acb8-4ac4-a9e9-a17d8fedf5b5 req-7acf6b72-8dc3-4b09-a016-741d7ac75e8e service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Received event network-vif-plugged-23e3b074-7f3a-4cd9-8618-42df2f2c9ac9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:48:40.560464 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-24611141-acb8-4ac4-a9e9-a17d8fedf5b5 req-7acf6b72-8dc3-4b09-a016-741d7ac75e8e service nova] Acquiring lock "0ad59512-92c0-43d3-bd72-b318240b579f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:40.560464 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-24611141-acb8-4ac4-a9e9-a17d8fedf5b5 req-7acf6b72-8dc3-4b09-a016-741d7ac75e8e service nova] Lock "0ad59512-92c0-43d3-bd72-b318240b579f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:40.560464 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-24611141-acb8-4ac4-a9e9-a17d8fedf5b5 req-7acf6b72-8dc3-4b09-a016-741d7ac75e8e service nova] Lock "0ad59512-92c0-43d3-bd72-b318240b579f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:40.560464 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-24611141-acb8-4ac4-a9e9-a17d8fedf5b5 req-7acf6b72-8dc3-4b09-a016-741d7ac75e8e service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] No waiting events found dispatching network-vif-plugged-23e3b074-7f3a-4cd9-8618-42df2f2c9ac9 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:48:40.560464 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-24611141-acb8-4ac4-a9e9-a17d8fedf5b5 req-7acf6b72-8dc3-4b09-a016-741d7ac75e8e service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Received unexpected event network-vif-plugged-23e3b074-7f3a-4cd9-8618-42df2f2c9ac9 for instance with vm_state active and task_state None.
May 19 04:48:40.642471 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:40.829941 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:48:40.830241 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:48:40.830436 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:48:40.830588 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:48:40.830762 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:48:40.831045 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.78 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:48:41.028529 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:48:41.030215 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:48:41.057510 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8c8d756e-75c3-49c5-8911-bbf2eb8bd803 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "0ad59512-92c0-43d3-bd72-b318240b579f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.324s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:41.872623 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8878db2e-c58a-409d-b232-f2bbddaf8985 req-49471da6-cf39-4609-9b51-d324971a340a service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Received event network-changed-23e3b074-7f3a-4cd9-8618-42df2f2c9ac9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:48:41.872954 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8878db2e-c58a-409d-b232-f2bbddaf8985 req-49471da6-cf39-4609-9b51-d324971a340a service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Refreshing instance network info cache due to event network-changed-23e3b074-7f3a-4cd9-8618-42df2f2c9ac9. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:48:41.873140 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8878db2e-c58a-409d-b232-f2bbddaf8985 req-49471da6-cf39-4609-9b51-d324971a340a service nova] Acquiring lock "refresh_cache-0ad59512-92c0-43d3-bd72-b318240b579f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:48:41.873263 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8878db2e-c58a-409d-b232-f2bbddaf8985 req-49471da6-cf39-4609-9b51-d324971a340a service nova] Acquired lock "refresh_cache-0ad59512-92c0-43d3-bd72-b318240b579f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:48:41.873408 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-8878db2e-c58a-409d-b232-f2bbddaf8985 req-49471da6-cf39-4609-9b51-d324971a340a service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Refreshing network info cache for port 23e3b074-7f3a-4cd9-8618-42df2f2c9ac9 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:48:42.375869 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-8878db2e-c58a-409d-b232-f2bbddaf8985 req-49471da6-cf39-4609-9b51-d324971a340a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:42.615086 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:48:42.616072 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:48:42.686829 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-8878db2e-c58a-409d-b232-f2bbddaf8985 req-49471da6-cf39-4609-9b51-d324971a340a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:42.827786 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-8878db2e-c58a-409d-b232-f2bbddaf8985 req-49471da6-cf39-4609-9b51-d324971a340a service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Updated VIF entry in instance network info cache for port 23e3b074-7f3a-4cd9-8618-42df2f2c9ac9. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:48:42.828082 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-8878db2e-c58a-409d-b232-f2bbddaf8985 req-49471da6-cf39-4609-9b51-d324971a340a service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Updating instance_info_cache with network_info: [{"id": "23e3b074-7f3a-4cd9-8618-42df2f2c9ac9", "address": "fa:16:3e:7c:53:9c", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e3b074-7f", "ovs_interfaceid": "23e3b074-7f3a-4cd9-8618-42df2f2c9ac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:48:43.330015 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8878db2e-c58a-409d-b232-f2bbddaf8985 req-49471da6-cf39-4609-9b51-d324971a340a service nova] Releasing lock "refresh_cache-0ad59512-92c0-43d3-bd72-b318240b579f" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:48:43.524126 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:44.614987 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:48:44.615468 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:48:44.616149 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:48:45.615272 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:48:45.643611 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:46.119752 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:46.119976 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:46.120118 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:46.120289 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:48:47.142738 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:47.237245 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:47.237870 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:47.326345 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:47.326859 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:48:47.331172 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c90d07e-25cd-4d8d-b134-f77a1de1b37a/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:47.420850 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c90d07e-25cd-4d8d-b134-f77a1de1b37a/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:47.421415 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c90d07e-25cd-4d8d-b134-f77a1de1b37a/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:47.523191 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c90d07e-25cd-4d8d-b134-f77a1de1b37a/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:47.528751 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:47.648406 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:47.648925 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:47.735429 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:47.736312 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:48:47.742124 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad59512-92c0-43d3-bd72-b318240b579f/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:47.834172 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad59512-92c0-43d3-bd72-b318240b579f/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:47.834662 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad59512-92c0-43d3-bd72-b318240b579f/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:47.918289 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad59512-92c0-43d3-bd72-b318240b579f/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:47.921937 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:48:47.923059 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:47.967188 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:47.967506 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=12600MB free_disk=72.80642700195312GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:48:47.967650 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:47.967913 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:48.525099 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:49.036718 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 3bd17542-9a9b-4bda-80a6-413cb4c2091d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:48:49.036809 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance e1c00d98-c68b-45cd-b4f6-6c6d62b54290 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:48:49.036922 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 6c90d07e-25cd-4d8d-b134-f77a1de1b37a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:48:49.037005 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 0ad59512-92c0-43d3-bd72-b318240b579f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:48:49.037136 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:48:49.037289 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:48:47 up 39 min,  2 users,  load average: 4.09, 5.07, 4.13\n', 'num_instances': '4', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '4', 'num_proj_2e16e702e1284e7fbba4184913a43de7': '2', 'io_workload': '0', 'num_proj_99f67462305b466bac5791264c17cf14': '1', 'num_proj_69aba65177bf4f4a8e2d9a253aee056f': '1'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:48:49.242838 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:48:49.242838 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:48:49.747125 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:48:49.951803 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:49.951963 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:49.952099 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Rebooting instance
May 19 04:48:50.251600 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:48:50.251600 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.284s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:50.252175 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:48:50.515219 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "refresh_cache-e1c00d98-c68b-45cd-b4f6-6c6d62b54290" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:48:50.515494 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquired lock "refresh_cache-e1c00d98-c68b-45cd-b4f6-6c6d62b54290" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:48:50.515653 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:48:50.645082 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:51.017808 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:51.300544 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:51.418385 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Updating instance_info_cache with network_info: [{"id": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "address": "fa:16:3e:1e:3f:68", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e6eaf0-15", "ovs_interfaceid": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:48:51.923095 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Releasing lock "refresh_cache-e1c00d98-c68b-45cd-b4f6-6c6d62b54290" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:48:52.428476 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:48:52.583325 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:52.583519 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:53.085890 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:48:53.472606 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:53.495587 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:53.499682 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:53.518235 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:53.525494 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:53.531505 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:53.647361 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:53.647642 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:53.662800 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:48:53.663848 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Claim successful on node np0000001025
May 19 04:48:53.683773 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3a54cc79-dce4-4eb2-a77c-ba4a0bbb4f03 req-c97ce7bd-2c23-41b4-b953-5d0975565998 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Received event network-vif-unplugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:48:53.687735 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3a54cc79-dce4-4eb2-a77c-ba4a0bbb4f03 req-c97ce7bd-2c23-41b4-b953-5d0975565998 service nova] Acquiring lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:53.688027 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3a54cc79-dce4-4eb2-a77c-ba4a0bbb4f03 req-c97ce7bd-2c23-41b4-b953-5d0975565998 service nova] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:53.688196 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3a54cc79-dce4-4eb2-a77c-ba4a0bbb4f03 req-c97ce7bd-2c23-41b4-b953-5d0975565998 service nova] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:53.688425 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3a54cc79-dce4-4eb2-a77c-ba4a0bbb4f03 req-c97ce7bd-2c23-41b4-b953-5d0975565998 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] No waiting events found dispatching network-vif-unplugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:48:53.688627 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-3a54cc79-dce4-4eb2-a77c-ba4a0bbb4f03 req-c97ce7bd-2c23-41b4-b953-5d0975565998 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Received unexpected event network-vif-unplugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd for instance with vm_state active and task_state reboot_started_hard.
May 19 04:48:53.782122 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999624567999945 future=<Future at 0x721850304e60 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:48:53.784044 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.997701439000139 future=<Future at 0x721850304e60 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:48:53.784339 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.997419862000243 future=<Future at 0x721850304e60 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:48:53.786678 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Instance destroyed successfully.
May 19 04:48:53.787266 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lazy-loading 'resources' on Instance uuid e1c00d98-c68b-45cd-b4f6-6c6d62b54290 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:48:54.289910 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:48:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1450609139',display_name='tempest-TestMinimumBasicScenario-server-1450609139',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testminimumbasicscenario-server-1450609139',id=63,image_ref='0f9e8183-efda-4ea7-80fb-acb10d593d2d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIB2eolkmA0oGE6NqabyY6MG9iWEJx9Lgf5y0C4v8ioS/wY56vg4wpxKxgtFjyFfgrd7edvEVhStgPFxYsyN7SqG7D8n5QW7cs32maHjoiY+yjq6YaIqG2ghwHVuE5DKg==',key_name='tempest-TestMinimumBasicScenario-315335831',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:48:19Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99f67462305b466bac5791264c17cf14',ramdisk_id='',reservation_id='r-ggcof1af',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0f9e8183-efda-4ea7-80fb-acb10d593d2d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-545024582',owner_user_name='tempest-TestMinimumBasicScenario-545024582-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:48:52Z,user_data=None,user_id='5b0cd08b7f014743a849982c90b5bd7a',uuid=e1c00d98-c68b-45cd-b4f6-6c6d62b54290,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "address": "fa:16:3e:1e:3f:68", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e6eaf0-15", "ovs_interfaceid": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:48:54.290183 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Converting VIF {"id": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "address": "fa:16:3e:1e:3f:68", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e6eaf0-15", "ovs_interfaceid": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:48:54.290710 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=53e6eaf0-1553-4cbe-874a-c98dce3a96fd,network=Network(08400d14-ac42-4046-ae13-082939c8e0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e6eaf0-15') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:48:54.290945 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=53e6eaf0-1553-4cbe-874a-c98dce3a96fd,network=Network(08400d14-ac42-4046-ae13-082939c8e0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e6eaf0-15') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:48:54.292036 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:54.292247 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53e6eaf0-15, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:48:54.293151 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:54.293893 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:48:54.294143 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:54.294814 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:54.294969 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bfd30535-2685-4e03-a169-4e2469efe1f3) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:48:54.295411 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:54.295885 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:48:54.296176 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:54.299484 np0000001025 nova-compute[97981]: INFO os_vif [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=53e6eaf0-1553-4cbe-874a-c98dce3a96fd,network=Network(08400d14-ac42-4046-ae13-082939c8e0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e6eaf0-15')
May 19 04:48:54.301208 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:48:54.301549 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:48:54.301698 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:48:54.302060 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:48:54.302405 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:48:54.302579 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:48:54.326385 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:54.326385 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:54.326385 np0000001025 nova-compute[97981]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:48:54.326385 np0000001025 nova-compute[97981]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:48:54.326385 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:48:54.326624 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:54.326624 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:54.326624 np0000001025 nova-compute[97981]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:48:54.326624 np0000001025 nova-compute[97981]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:48:54.326624 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:48:54.326741 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932', '145'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', '147'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', '148')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:48:54.326813 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', '147')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:48:54.327832 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', '148')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:48:54.328644 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185025efc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d'): ({'sdf'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:48:54.329027 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Removing multipathed devices sdf, sde {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:48:54.329133 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Flush multipath device 330000000d6085c62 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:48:54.371696 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:48:54.424721 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:48:54.476739 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:48:54.477178 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] SCSI volumes sdf, sde have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:48:54.477906 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:48:54.491610 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:48:54.491886 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:48:54.505386 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:54.536292 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 147, target: iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d, portal: 192.168.40.100,3260]
May 19 04:48:54.536292 np0000001025 nova-compute[97981]: Logout of [sid: 147, target: iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d, portal: 192.168.40.100,3260] successful.
May 19 04:48:54.536292 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:54.554324 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:54.571547 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:54.601726 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 148, target: iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d, portal: 192.168.50.100,3260]
May 19 04:48:54.601726 np0000001025 nova-compute[97981]: Logout of [sid: 148, target: iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d, portal: 192.168.50.100,3260] successful.
May 19 04:48:54.601726 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:54.615860 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:54.616126 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:48:54.616295 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] <== disconnect_volume: return (314ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:48:54.616474 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:48:54.622849 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Start _get_guest_xml network_info=[{"id": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "address": "fa:16:3e:1e:3f:68", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e6eaf0-15", "ovs_interfaceid": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0f9e8183-efda-4ea7-80fb-acb10d593d2d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '0f9e8183-efda-4ea7-80fb-acb10d593d2d'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '4a60f073-b977-4c6d-9667-93090f2a9f62', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, 'status': 'reserved', 'instance': 'e1c00d98-c68b-45cd-b4f6-6c6d62b54290', 'attached_at': '', 'detached_at': '', 'volume_id': '3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'serial': '3e80ea54-ae38-4c23-9325-bfe45dfb1d4d'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:48:54.624793 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:48:54.626082 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0f9e8183-efda-4ea7-80fb-acb10d593d2d', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1450609139', uuid='e1c00d98-c68b-45cd-b4f6-6c6d62b54290'), owner=OwnerMeta(userid='5b0cd08b7f014743a849982c90b5bd7a', username='tempest-TestMinimumBasicScenario-545024582-project-member', projectid='99f67462305b466bac5791264c17cf14', projectname='tempest-TestMinimumBasicScenario-545024582'), image=ImageMeta(id='0f9e8183-efda-4ea7-80fb-acb10d593d2d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "address": "fa:16:3e:1e:3f:68", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e6eaf0-15", "ovs_interfaceid": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166134.6257193) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:48:54.627260 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:48:54.627645 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:48:54.628641 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:48:54.628907 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:48:54.630621 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:48:54.630906 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0f9e8183-efda-4ea7-80fb-acb10d593d2d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:48:54.631137 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:48:54.631290 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:48:54.631330 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:48:54.631420 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:48:54.631517 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:48:54.631683 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:48:54.631789 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:48:54.631879 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:48:54.632007 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:48:54.632192 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:48:54.632353 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lazy-loading 'vcpu_model' on Instance uuid e1c00d98-c68b-45cd-b4f6-6c6d62b54290 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:48:54.974288 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:48:54.974626 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:48:55.135030 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Object Instance<e1c00d98-c68b-45cd-b4f6-6c6d62b54290> lazy-loaded attributes: resources,vcpu_model {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:48:55.146531 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk.config --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:55.245948 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk.config --force-share --output=json" returned: 0 in 0.099s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:55.246578 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:55.246909 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "/opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:55.247704 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "/opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:55.248270 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:48:55.248812 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:48:55.248995 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:48:55.249461 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:48:55.249766 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:48:55.261875 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:48:55.262408 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:48:55.262776 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:48:55.262974 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:48:55.263349 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:48:55.263587 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:48:55.274755 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:48:55.274755 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:55.280466 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:48:55.280466 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:55.290081 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d] added
May 19 04:48:55.290081 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:48:55.290081 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:48:55.290081 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:48:55.290081 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:48:55.290081 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:48:55.290081 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:55.290423 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:48:55.290577 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:48:55.290773 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:48:55.292459 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d] added
May 19 04:48:55.292459 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:48:55.292459 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:48:55.292459 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:48:55.292459 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:48:55.292459 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:48:55.292459 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:55.292659 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:48:55.292833 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0293(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:48:55.292987 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:48:55.478173 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:48:55.745840 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7aea5f39-c883-49b8-897d-3bcf59b9cad7 req-4a0781d1-99c3-4f16-95e8-5eadbf2755de service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Received event network-vif-unplugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:48:55.746742 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7aea5f39-c883-49b8-897d-3bcf59b9cad7 req-4a0781d1-99c3-4f16-95e8-5eadbf2755de service nova] Acquiring lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:55.746742 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7aea5f39-c883-49b8-897d-3bcf59b9cad7 req-4a0781d1-99c3-4f16-95e8-5eadbf2755de service nova] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:55.746857 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7aea5f39-c883-49b8-897d-3bcf59b9cad7 req-4a0781d1-99c3-4f16-95e8-5eadbf2755de service nova] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:55.746992 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7aea5f39-c883-49b8-897d-3bcf59b9cad7 req-4a0781d1-99c3-4f16-95e8-5eadbf2755de service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] No waiting events found dispatching network-vif-unplugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:48:55.747357 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-7aea5f39-c883-49b8-897d-3bcf59b9cad7 req-4a0781d1-99c3-4f16-95e8-5eadbf2755de service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Received unexpected event network-vif-unplugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd for instance with vm_state active and task_state reboot_started_hard.
May 19 04:48:55.984732 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.337s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:55.985275 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:48:56.291571 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:48:56.293470 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:48:56.304232 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:48:56.304232 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:48:56.311426 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:48:56.311426 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:56.317604 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:56.324283 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:56.329351 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:56.329351 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:56.329351 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:48:56.329562 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:56.329562 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:56.329562 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:48:56.336069 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:56.336069 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:56.336069 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:48:56.336256 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:56.336256 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:56.336256 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:48:56.359615 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d, portal: 192.168.40.100,3260]
May 19 04:48:56.359615 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d, portal: 192.168.40.100,3260] successful.
May 19 04:48:56.359615 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:56.373544 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d, portal: 192.168.50.100,3260]
May 19 04:48:56.373544 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d, portal: 192.168.50.100,3260] successful.
May 19 04:48:56.373544 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:56.374215 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:56.387390 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:48:56.392329 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:56.392329 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:56.392329 np0000001025 nova-compute[97981]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:48:56.392329 np0000001025 nova-compute[97981]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:48:56.392329 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:48:56.392627 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:56.392627 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:56.392627 np0000001025 nova-compute[97981]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:48:56.392627 np0000001025 nova-compute[97981]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:48:56.392627 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:48:56.392797 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.130s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:48:56.392797 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:48:56.393402 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] HCTL ('7', '-', '-', 0) found on session 150 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:48:56.393516 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:48:56.403865 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:56.403865 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:56.403865 np0000001025 nova-compute[97981]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:48:56.403865 np0000001025 nova-compute[97981]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:48:56.403865 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:48:56.403865 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:56.403865 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:48:56.403865 np0000001025 nova-compute[97981]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:48:56.403865 np0000001025 nova-compute[97981]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:48:56.403865 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:48:56.403865 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:48:56.403865 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:48:56.407963 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] HCTL ('10', '-', '-', 0) found on session 151 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:48:56.407963 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:48:56.408136 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Searching for a device in session 150 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:48:56.408307 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:48:56.420659 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Searching for a device in session 151 and hctl ['10', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:48:56.490496 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:48:56.490963 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:48:56.491204 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:56.491480 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:56.568973 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '40f0313124fa425c916b6ad44fe2d7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4a48491cc047108747a22e8c63c3ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:48:56.970828 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Successfully created port: 6165ab31-3be2-438a-aa2a-3f5e345e1107 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:48:56.995643 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:48:57.372212 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Successfully updated port: 6165ab31-3be2-438a-aa2a-3f5e345e1107 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:48:57.415296 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7d612a70-64dc-4d41-81fa-a3ac01bc1541 req-b031fd29-fea1-4f3f-9326-0c103f87c92f service nova] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Received event network-changed-6165ab31-3be2-438a-aa2a-3f5e345e1107 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:48:57.415475 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7d612a70-64dc-4d41-81fa-a3ac01bc1541 req-b031fd29-fea1-4f3f-9326-0c103f87c92f service nova] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Refreshing instance network info cache due to event network-changed-6165ab31-3be2-438a-aa2a-3f5e345e1107. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:48:57.415701 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7d612a70-64dc-4d41-81fa-a3ac01bc1541 req-b031fd29-fea1-4f3f-9326-0c103f87c92f service nova] Acquiring lock "refresh_cache-c39e9766-74e5-49fc-bd3a-aa1400e1458b" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:48:57.415859 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7d612a70-64dc-4d41-81fa-a3ac01bc1541 req-b031fd29-fea1-4f3f-9326-0c103f87c92f service nova] Acquired lock "refresh_cache-c39e9766-74e5-49fc-bd3a-aa1400e1458b" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:48:57.416031 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-7d612a70-64dc-4d41-81fa-a3ac01bc1541 req-b031fd29-fea1-4f3f-9326-0c103f87c92f service nova] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Refreshing network info cache for port 6165ab31-3be2-438a-aa2a-3f5e345e1107 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:48:57.420723 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Searching for a device in session 151 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:48:57.420904 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:48:57.498816 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:48:57.873996 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "refresh_cache-c39e9766-74e5-49fc-bd3a-aa1400e1458b" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:48:57.918037 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-7d612a70-64dc-4d41-81fa-a3ac01bc1541 req-b031fd29-fea1-4f3f-9326-0c103f87c92f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:57.985978 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-7d612a70-64dc-4d41-81fa-a3ac01bc1541 req-b031fd29-fea1-4f3f-9326-0c103f87c92f service nova] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:48:58.121999 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-7d612a70-64dc-4d41-81fa-a3ac01bc1541 req-b031fd29-fea1-4f3f-9326-0c103f87c92f service nova] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:48:58.278488 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Found WWN 330000000d6085c62 for multipath device dm-1 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:48:58.279156 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:48:58.279156 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '330000000d6085c62', 'path': '/dev/dm-1', 'multipath_id': '330000000d6085c62'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:48:58.279156 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d6085c62', 'path': '/dev/dm-1', 'multipath_id': '330000000d6085c62'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:48:58.506901 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:48:58.507894 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:48:58.508155 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Creating image(s)
May 19 04:48:58.508646 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "/opt/stack/data/nova/instances/c39e9766-74e5-49fc-bd3a-aa1400e1458b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:58.508819 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "/opt/stack/data/nova/instances/c39e9766-74e5-49fc-bd3a-aa1400e1458b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:58.509318 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "/opt/stack/data/nova/instances/c39e9766-74e5-49fc-bd3a-aa1400e1458b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:58.509855 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:48:58.514041 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:48:58.515080 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:58.533289 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:58.605596 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.090s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:58.606057 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:58.606591 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:58.607075 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:48:58.610750 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:48:58.611141 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:58.627721 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7d612a70-64dc-4d41-81fa-a3ac01bc1541 req-b031fd29-fea1-4f3f-9326-0c103f87c92f service nova] Releasing lock "refresh_cache-c39e9766-74e5-49fc-bd3a-aa1400e1458b" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:48:58.628856 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquired lock "refresh_cache-c39e9766-74e5-49fc-bd3a-aa1400e1458b" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:48:58.629273 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:48:58.699264 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.088s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:58.699641 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/c39e9766-74e5-49fc-bd3a-aa1400e1458b/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:58.757035 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/c39e9766-74e5-49fc-bd3a-aa1400e1458b/disk 1073741824" returned: 0 in 0.057s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:58.757535 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.151s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:58.757916 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:58.786844 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:48:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1450609139',display_name='tempest-TestMinimumBasicScenario-server-1450609139',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testminimumbasicscenario-server-1450609139',id=63,image_ref='0f9e8183-efda-4ea7-80fb-acb10d593d2d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIB2eolkmA0oGE6NqabyY6MG9iWEJx9Lgf5y0C4v8ioS/wY56vg4wpxKxgtFjyFfgrd7edvEVhStgPFxYsyN7SqG7D8n5QW7cs32maHjoiY+yjq6YaIqG2ghwHVuE5DKg==',key_name='tempest-TestMinimumBasicScenario-315335831',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:48:19Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99f67462305b466bac5791264c17cf14',ramdisk_id='',reservation_id='r-ggcof1af',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0f9e8183-efda-4ea7-80fb-acb10d593d2d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-545024582',owner_user_name='tempest-TestMinimumBasicScenario-545024582-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:48:52Z,user_data=None,user_id='5b0cd08b7f014743a849982c90b5bd7a',uuid=e1c00d98-c68b-45cd-b4f6-6c6d62b54290,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "address": "fa:16:3e:1e:3f:68", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e6eaf0-15", "ovs_interfaceid": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:48:58.787203 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Converting VIF {"id": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "address": "fa:16:3e:1e:3f:68", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e6eaf0-15", "ovs_interfaceid": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:48:58.788299 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=53e6eaf0-1553-4cbe-874a-c98dce3a96fd,network=Network(08400d14-ac42-4046-ae13-082939c8e0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e6eaf0-15') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:48:58.789503 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lazy-loading 'pci_devices' on Instance uuid e1c00d98-c68b-45cd-b4f6-6c6d62b54290 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:48:58.851078 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.093s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:58.851473 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c39e9766-74e5-49fc-bd3a-aa1400e1458b/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:48:58.851733 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c39e9766-74e5-49fc-bd3a-aa1400e1458b/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:58.944936 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c39e9766-74e5-49fc-bd3a-aa1400e1458b/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:58.945382 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Cannot resize image /opt/stack/data/nova/instances/c39e9766-74e5-49fc-bd3a-aa1400e1458b/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:48:58.945821 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:48:58.945993 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Ensure instance console log exists: /opt/stack/data/nova/instances/c39e9766-74e5-49fc-bd3a-aa1400e1458b/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:48:58.946325 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:48:58.946606 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:48:58.946784 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:48:59.193281 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:48:59.292902 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Object Instance<e1c00d98-c68b-45cd-b4f6-6c6d62b54290> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:48:59.294946 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] End _get_guest_xml xml=<domain type="qemu">
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:   <uuid>e1c00d98-c68b-45cd-b4f6-6c6d62b54290</uuid>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:   <name>instance-0000003f</name>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestMinimumBasicScenario-server-1450609139</nova:name>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:48:54</nova:creationTime>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <nova:image uuid="0f9e8183-efda-4ea7-80fb-acb10d593d2d">
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:           <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:           <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:         <nova:user uuid="5b0cd08b7f014743a849982c90b5bd7a">tempest-TestMinimumBasicScenario-545024582-project-member</nova:user>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:         <nova:project uuid="99f67462305b466bac5791264c17cf14">tempest-TestMinimumBasicScenario-545024582</nova:project>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="0f9e8183-efda-4ea7-80fb-acb10d593d2d"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:         <nova:port uuid="53e6eaf0-1553-4cbe-874a-c98dce3a96fd">
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     <system>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <entry name="serial">e1c00d98-c68b-45cd-b4f6-6c6d62b54290</entry>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <entry name="uuid">e1c00d98-c68b-45cd-b4f6-6c6d62b54290</entry>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     </system>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:   <os>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:   </os>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:   <features>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:   </features>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:   <devices>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     </disk>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk.config"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     </disk>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <alias name="ua-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-1"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <target dev="vdb" bus="virtio"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <serial>3e80ea54-ae38-4c23-9325-bfe45dfb1d4d</serial>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     </disk>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:1e:3f:68"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <target dev="tap53e6eaf0-15"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     </interface>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/console.log" append="off"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     </serial>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     <video>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     </video>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     </rng>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:   </devices>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]: </domain>
May 19 04:48:59.294946 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:48:59.297321 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:59.312244 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:48:59.349944 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:48:59.404600 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:59.405051 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:48:59.491374 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Updating instance_info_cache with network_info: [{"id": "6165ab31-3be2-438a-aa2a-3f5e345e1107", "address": "fa:16:3e:19:90:62", "network": {"id": "8a07682e-aaf0-4a4f-8bc0-70db155f01be", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2139331559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec4a48491cc047108747a22e8c63c3ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6165ab31-3b", "ovs_interfaceid": "6165ab31-3be2-438a-aa2a-3f5e345e1107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:48:59.493139 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:48:59.493831 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:48:59.494483 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lazy-loading 'trusted_certs' on Instance uuid e1c00d98-c68b-45cd-b4f6-6c6d62b54290 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:48:59.993965 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Releasing lock "refresh_cache-c39e9766-74e5-49fc-bd3a-aa1400e1458b" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:48:59.994417 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Instance network_info: |[{"id": "6165ab31-3be2-438a-aa2a-3f5e345e1107", "address": "fa:16:3e:19:90:62", "network": {"id": "8a07682e-aaf0-4a4f-8bc0-70db155f01be", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2139331559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec4a48491cc047108747a22e8c63c3ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6165ab31-3b", "ovs_interfaceid": "6165ab31-3be2-438a-aa2a-3f5e345e1107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:48:59.996475 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Start _get_guest_xml network_info=[{"id": "6165ab31-3be2-438a-aa2a-3f5e345e1107", "address": "fa:16:3e:19:90:62", "network": {"id": "8a07682e-aaf0-4a4f-8bc0-70db155f01be", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2139331559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec4a48491cc047108747a22e8c63c3ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6165ab31-3b", "ovs_interfaceid": "6165ab31-3be2-438a-aa2a-3f5e345e1107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:48:59.997243 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Object Instance<e1c00d98-c68b-45cd-b4f6-6c6d62b54290> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:48:59.997579 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8 --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:00.017259 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:49:00.020371 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-1105237569', uuid='c39e9766-74e5-49fc-bd3a-aa1400e1458b'), owner=OwnerMeta(userid='40f0313124fa425c916b6ad44fe2d7f3', username='tempest-VolumesBackupsTest-1527553839-project-member', projectid='ec4a48491cc047108747a22e8c63c3ac', projectname='tempest-VolumesBackupsTest-1527553839'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6165ab31-3be2-438a-aa2a-3f5e345e1107", "address": "fa:16:3e:19:90:62", "network": {"id": "8a07682e-aaf0-4a4f-8bc0-70db155f01be", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2139331559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec4a48491cc047108747a22e8c63c3ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6165ab31-3b", "ovs_interfaceid": "6165ab31-3be2-438a-aa2a-3f5e345e1107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166140.0195076) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:49:00.023259 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:49:00.023670 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:49:00.024551 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:49:00.024713 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:49:00.026121 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:49:00.026609 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:49:00.026774 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:49:00.026874 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:49:00.027000 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:49:00.027095 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:49:00.027202 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:49:00.027394 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:49:00.027502 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:49:00.027632 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:49:00.027735 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:49:00.027868 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:49:00.038415 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:48:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1105237569',display_name='tempest-VolumesBackupsTest-instance-1105237569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesbackupstest-instance-1105237569',id=66,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJMp2P20XaTYc1u2txDfoVoo2BHJc5ifVDrg0NxI8d3uGMTzoPWgtIWoWwBEOnkwnuHJeT6wVUtnGYrq/AvMMuIl7AIb3e2taxUKsBlGsRxETxlqZc7Qf8nDSIZN3CaRA==',key_name='tempest-keypair-415237631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec4a48491cc047108747a22e8c63c3ac',ramdisk_id='',reservation_id='r-zr1acz03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1527553839',owner_user_name='tempest-VolumesBackupsTest-1527553839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:48:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40f0313124fa425c916b6ad44fe2d7f3',uuid=c39e9766-74e5-49fc-bd3a-aa1400e1458b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6165ab31-3be2-438a-aa2a-3f5e345e1107", "address": "fa:16:3e:19:90:62", "network": {"id": "8a07682e-aaf0-4a4f-8bc0-70db155f01be", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2139331559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec4a48491cc047108747a22e8c63c3ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6165ab31-3b", "ovs_interfaceid": "6165ab31-3be2-438a-aa2a-3f5e345e1107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:49:00.038596 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Converting VIF {"id": "6165ab31-3be2-438a-aa2a-3f5e345e1107", "address": "fa:16:3e:19:90:62", "network": {"id": "8a07682e-aaf0-4a4f-8bc0-70db155f01be", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2139331559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec4a48491cc047108747a22e8c63c3ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6165ab31-3b", "ovs_interfaceid": "6165ab31-3be2-438a-aa2a-3f5e345e1107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:49:00.039176 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:90:62,bridge_name='br-int',has_traffic_filtering=True,id=6165ab31-3be2-438a-aa2a-3f5e345e1107,network=Network(8a07682e-aaf0-4a4f-8bc0-70db155f01be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6165ab31-3b') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:49:00.039852 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lazy-loading 'pci_devices' on Instance uuid c39e9766-74e5-49fc-bd3a-aa1400e1458b {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:49:00.082193 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ad16dd28445fe9ca431d01a6ac1ab1a051b6c8 --force-share --output=json" returned: 0 in 0.084s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:00.082522 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:49:00.082735 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:00.168647 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:00.169524 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Cannot resize image /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:49:00.169524 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lazy-loading 'migration_context' on Instance uuid e1c00d98-c68b-45cd-b4f6-6c6d62b54290 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:49:00.543623 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] End _get_guest_xml xml=<domain type="qemu">
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:   <uuid>c39e9766-74e5-49fc-bd3a-aa1400e1458b</uuid>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:   <name>instance-00000042</name>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <nova:name>tempest-VolumesBackupsTest-instance-1105237569</nova:name>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:49:00</nova:creationTime>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:         <nova:user uuid="40f0313124fa425c916b6ad44fe2d7f3">tempest-VolumesBackupsTest-1527553839-project-member</nova:user>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:         <nova:project uuid="ec4a48491cc047108747a22e8c63c3ac">tempest-VolumesBackupsTest-1527553839</nova:project>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:         <nova:port uuid="6165ab31-3be2-438a-aa2a-3f5e345e1107">
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     <system>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <entry name="serial">c39e9766-74e5-49fc-bd3a-aa1400e1458b</entry>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <entry name="uuid">c39e9766-74e5-49fc-bd3a-aa1400e1458b</entry>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     </system>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:   <os>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:   </os>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:   <features>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:   </features>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:   <devices>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/c39e9766-74e5-49fc-bd3a-aa1400e1458b/disk"/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     </disk>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/c39e9766-74e5-49fc-bd3a-aa1400e1458b/disk.config"/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     </disk>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:19:90:62"/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <target dev="tap6165ab31-3b"/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     </interface>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/c39e9766-74e5-49fc-bd3a-aa1400e1458b/console.log" append="off"/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     </serial>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     <video>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     </video>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     </rng>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:   </devices>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]: </domain>
May 19 04:49:00.543623 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:49:00.545564 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Preparing to wait for external event network-vif-plugged-6165ab31-3be2-438a-aa2a-3f5e345e1107 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:49:00.545564 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:00.545564 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:00.545564 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:00.545564 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:48:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1105237569',display_name='tempest-VolumesBackupsTest-instance-1105237569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesbackupstest-instance-1105237569',id=66,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJMp2P20XaTYc1u2txDfoVoo2BHJc5ifVDrg0NxI8d3uGMTzoPWgtIWoWwBEOnkwnuHJeT6wVUtnGYrq/AvMMuIl7AIb3e2taxUKsBlGsRxETxlqZc7Qf8nDSIZN3CaRA==',key_name='tempest-keypair-415237631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec4a48491cc047108747a22e8c63c3ac',ramdisk_id='',reservation_id='r-zr1acz03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1527553839',owner_user_name='tempest-VolumesBackupsTest-1527553839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:48:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40f0313124fa425c916b6ad44fe2d7f3',uuid=c39e9766-74e5-49fc-bd3a-aa1400e1458b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6165ab31-3be2-438a-aa2a-3f5e345e1107", "address": "fa:16:3e:19:90:62", "network": {"id": "8a07682e-aaf0-4a4f-8bc0-70db155f01be", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2139331559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec4a48491cc047108747a22e8c63c3ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6165ab31-3b", "ovs_interfaceid": "6165ab31-3be2-438a-aa2a-3f5e345e1107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:49:00.545564 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Converting VIF {"id": "6165ab31-3be2-438a-aa2a-3f5e345e1107", "address": "fa:16:3e:19:90:62", "network": {"id": "8a07682e-aaf0-4a4f-8bc0-70db155f01be", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2139331559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec4a48491cc047108747a22e8c63c3ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6165ab31-3b", "ovs_interfaceid": "6165ab31-3be2-438a-aa2a-3f5e345e1107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:49:00.545979 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:90:62,bridge_name='br-int',has_traffic_filtering=True,id=6165ab31-3be2-438a-aa2a-3f5e345e1107,network=Network(8a07682e-aaf0-4a4f-8bc0-70db155f01be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6165ab31-3b') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:49:00.546217 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:90:62,bridge_name='br-int',has_traffic_filtering=True,id=6165ab31-3be2-438a-aa2a-3f5e345e1107,network=Network(8a07682e-aaf0-4a4f-8bc0-70db155f01be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6165ab31-3b') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:49:00.546875 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:00.546875 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:00.547401 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:49:00.547856 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:00.547966 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3b06447-f931-5766-853a-f210292dea7c', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:00.548736 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:00.549413 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:49:00.549603 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:00.551416 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:00.551609 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6165ab31-3b, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:00.551918 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6165ab31-3b, col_values=(('qos', UUID('33d7c82d-18ca-4e1a-92e7-e64a2cb30fbc')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:00.552067 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6165ab31-3b, col_values=(('external_ids', {'iface-id': '6165ab31-3be2-438a-aa2a-3f5e345e1107', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:90:62', 'vm-uuid': 'c39e9766-74e5-49fc-bd3a-aa1400e1458b'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:00.554052 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:49:00.557742 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:00.558361 np0000001025 nova-compute[97981]: INFO os_vif [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:90:62,bridge_name='br-int',has_traffic_filtering=True,id=6165ab31-3be2-438a-aa2a-3f5e345e1107,network=Network(8a07682e-aaf0-4a4f-8bc0-70db155f01be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6165ab31-3b')
May 19 04:49:00.672056 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Object Instance<e1c00d98-c68b-45cd-b4f6-6c6d62b54290> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:49:00.673049 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:48:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1450609139',display_name='tempest-TestMinimumBasicScenario-server-1450609139',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testminimumbasicscenario-server-1450609139',id=63,image_ref='0f9e8183-efda-4ea7-80fb-acb10d593d2d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIB2eolkmA0oGE6NqabyY6MG9iWEJx9Lgf5y0C4v8ioS/wY56vg4wpxKxgtFjyFfgrd7edvEVhStgPFxYsyN7SqG7D8n5QW7cs32maHjoiY+yjq6YaIqG2ghwHVuE5DKg==',key_name='tempest-TestMinimumBasicScenario-315335831',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:48:19Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='99f67462305b466bac5791264c17cf14',ramdisk_id='',reservation_id='r-ggcof1af',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0f9e8183-efda-4ea7-80fb-acb10d593d2d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-545024582',owner_user_name='tempest-TestMinimumBasicScenario-545024582-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:48:52Z,user_data=None,user_id='5b0cd08b7f014743a849982c90b5bd7a',uuid=e1c00d98-c68b-45cd-b4f6-6c6d62b54290,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "address": "fa:16:3e:1e:3f:68", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e6eaf0-15", "ovs_interfaceid": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:49:00.673316 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Converting VIF {"id": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "address": "fa:16:3e:1e:3f:68", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e6eaf0-15", "ovs_interfaceid": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:49:00.673858 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=53e6eaf0-1553-4cbe-874a-c98dce3a96fd,network=Network(08400d14-ac42-4046-ae13-082939c8e0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e6eaf0-15') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:49:00.674123 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=53e6eaf0-1553-4cbe-874a-c98dce3a96fd,network=Network(08400d14-ac42-4046-ae13-082939c8e0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e6eaf0-15') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:49:00.674754 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:00.675085 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:00.675346 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:49:00.676023 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:00.676243 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c950405-5fc4-5783-8a07-b80b98a286d7', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:00.677342 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:00.678135 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:49:00.682223 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:00.683897 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:00.684057 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53e6eaf0-15, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:00.684372 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53e6eaf0-15, col_values=(('qos', UUID('3edb40e2-6c97-4824-abe8-b2f7a9227424')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:00.684566 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53e6eaf0-15, col_values=(('external_ids', {'iface-id': '53e6eaf0-1553-4cbe-874a-c98dce3a96fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:3f:68', 'vm-uuid': 'e1c00d98-c68b-45cd-b4f6-6c6d62b54290'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:00.685340 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:00.686698 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:49:00.694758 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:00.695552 np0000001025 nova-compute[97981]: INFO os_vif [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=53e6eaf0-1553-4cbe-874a-c98dce3a96fd,network=Network(08400d14-ac42-4046-ae13-082939c8e0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e6eaf0-15')
May 19 04:49:01.075168 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:01.100239 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:01.102009 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:01.188698 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:01.244175 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4c9ecc9a-c6e5-414f-b9e8-1ef4f7104639 req-701f11f2-52f6-4355-8c3f-65952aece6ff service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Received event network-vif-plugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:01.244298 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4c9ecc9a-c6e5-414f-b9e8-1ef4f7104639 req-701f11f2-52f6-4355-8c3f-65952aece6ff service nova] Acquiring lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:01.244472 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4c9ecc9a-c6e5-414f-b9e8-1ef4f7104639 req-701f11f2-52f6-4355-8c3f-65952aece6ff service nova] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:01.244613 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4c9ecc9a-c6e5-414f-b9e8-1ef4f7104639 req-701f11f2-52f6-4355-8c3f-65952aece6ff service nova] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:01.244736 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4c9ecc9a-c6e5-414f-b9e8-1ef4f7104639 req-701f11f2-52f6-4355-8c3f-65952aece6ff service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] No waiting events found dispatching network-vif-plugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:49:01.244850 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-4c9ecc9a-c6e5-414f-b9e8-1ef4f7104639 req-701f11f2-52f6-4355-8c3f-65952aece6ff service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Received unexpected event network-vif-plugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd for instance with vm_state active and task_state reboot_started_hard.
May 19 04:49:01.378906 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:01.385526 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:01.388518 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:01.408742 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:01.415351 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:01.789928 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Removed pending STOPPED event for e1c00d98-c68b-45cd-b4f6-6c6d62b54290 due to new event <LifecycleEvent: 1779166141.7895875, e1c00d98-c68b-45cd-b4f6-6c6d62b54290 => Resumed> {{(pid=97981) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 19 04:49:01.790508 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Instance event wait completed in 0 seconds for  {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:49:01.792226 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166141.7895875, e1c00d98-c68b-45cd-b4f6-6c6d62b54290 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:49:01.792226 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] VM Resumed (Lifecycle Event)
May 19 04:49:01.794487 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Instance rebooted successfully.
May 19 04:49:02.074844 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:49:02.074966 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:49:02.075123 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] No VIF found with MAC fa:16:3e:19:90:62, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:49:02.075654 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Using config drive
May 19 04:49:02.294575 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:49:02.299095 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:49:02.580840 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:02.682491 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Creating config drive at /opt/stack/data/nova/instances/c39e9766-74e5-49fc-bd3a-aa1400e1458b/disk.config
May 19 04:49:02.686224 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c39e9766-74e5-49fc-bd3a-aa1400e1458b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpekmjpuii {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:02.738817 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c39e9766-74e5-49fc-bd3a-aa1400e1458b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpekmjpuii" returned: 0 in 0.052s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:02.802884 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 19 04:49:02.803404 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166142.8031247, e1c00d98-c68b-45cd-b4f6-6c6d62b54290 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:49:02.803523 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] VM Started (Lifecycle Event)
May 19 04:49:03.177682 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:03.202141 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:03.295942 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:03.308670 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:49:03.313115 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:49:03.313294 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:49:03.313437 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:49:03.313690 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] No VIF found with MAC fa:16:3e:1e:3f:68, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:49:03.317093 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:49:03.317093 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:49:03.343161 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-40bf6607-8edc-478a-bd45-53bf94c4ca25 req-dc36f659-fc44-49bb-98c9-e2a88c707662 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Received event network-vif-plugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:03.344093 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-40bf6607-8edc-478a-bd45-53bf94c4ca25 req-dc36f659-fc44-49bb-98c9-e2a88c707662 service nova] Acquiring lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:03.344337 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-40bf6607-8edc-478a-bd45-53bf94c4ca25 req-dc36f659-fc44-49bb-98c9-e2a88c707662 service nova] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:03.344887 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-40bf6607-8edc-478a-bd45-53bf94c4ca25 req-dc36f659-fc44-49bb-98c9-e2a88c707662 service nova] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:03.344887 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-40bf6607-8edc-478a-bd45-53bf94c4ca25 req-dc36f659-fc44-49bb-98c9-e2a88c707662 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] No waiting events found dispatching network-vif-plugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:49:03.344887 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-40bf6607-8edc-478a-bd45-53bf94c4ca25 req-dc36f659-fc44-49bb-98c9-e2a88c707662 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Received unexpected event network-vif-plugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd for instance with vm_state active and task_state reboot_started_hard.
May 19 04:49:03.530479 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:03.537630 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:03.562213 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:03.821591 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 19 04:49:03.838015 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-0dcd20bb-03e2-41dc-b0a7-85983cf9a965 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 13.886s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:04.017505 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166144.0171897, c39e9766-74e5-49fc-bd3a-aa1400e1458b => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:49:04.017764 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] VM Started (Lifecycle Event)
May 19 04:49:04.428208 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Acquiring lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:04.428634 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:04.519976 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:49:04.522884 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166144.5226626, c39e9766-74e5-49fc-bd3a-aa1400e1458b => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:49:04.522997 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] VM Paused (Lifecycle Event)
May 19 04:49:04.931388 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lazy-loading 'flavor' on Instance uuid 6c90d07e-25cd-4d8d-b134-f77a1de1b37a {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:49:04.983926 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "0ad59512-92c0-43d3-bd72-b318240b579f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:04.984089 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "0ad59512-92c0-43d3-bd72-b318240b579f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:04.984293 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "0ad59512-92c0-43d3-bd72-b318240b579f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:04.984433 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "0ad59512-92c0-43d3-bd72-b318240b579f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:04.984558 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "0ad59512-92c0-43d3-bd72-b318240b579f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:04.986459 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Terminating instance
May 19 04:49:05.025271 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:49:05.027508 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:49:05.429937 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-dbc0bfb2-3161-4232-9b65-111e48a7615e req-dc7bcee2-c6af-4925-93f4-90d99ecb65e7 service nova] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Received event network-vif-plugged-6165ab31-3be2-438a-aa2a-3f5e345e1107 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:05.430326 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-dbc0bfb2-3161-4232-9b65-111e48a7615e req-dc7bcee2-c6af-4925-93f4-90d99ecb65e7 service nova] Acquiring lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:05.430326 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-dbc0bfb2-3161-4232-9b65-111e48a7615e req-dc7bcee2-c6af-4925-93f4-90d99ecb65e7 service nova] Lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:05.430517 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-dbc0bfb2-3161-4232-9b65-111e48a7615e req-dc7bcee2-c6af-4925-93f4-90d99ecb65e7 service nova] Lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:05.430707 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-dbc0bfb2-3161-4232-9b65-111e48a7615e req-dc7bcee2-c6af-4925-93f4-90d99ecb65e7 service nova] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Processing event network-vif-plugged-6165ab31-3be2-438a-aa2a-3f5e345e1107 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:49:05.430891 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-dbc0bfb2-3161-4232-9b65-111e48a7615e req-dc7bcee2-c6af-4925-93f4-90d99ecb65e7 service nova] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Received event network-vif-plugged-6165ab31-3be2-438a-aa2a-3f5e345e1107 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:05.431060 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-dbc0bfb2-3161-4232-9b65-111e48a7615e req-dc7bcee2-c6af-4925-93f4-90d99ecb65e7 service nova] Acquiring lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:05.431258 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-dbc0bfb2-3161-4232-9b65-111e48a7615e req-dc7bcee2-c6af-4925-93f4-90d99ecb65e7 service nova] Lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:05.433834 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-dbc0bfb2-3161-4232-9b65-111e48a7615e req-dc7bcee2-c6af-4925-93f4-90d99ecb65e7 service nova] Lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:05.433834 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-dbc0bfb2-3161-4232-9b65-111e48a7615e req-dc7bcee2-c6af-4925-93f4-90d99ecb65e7 service nova] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] No waiting events found dispatching network-vif-plugged-6165ab31-3be2-438a-aa2a-3f5e345e1107 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:49:05.433834 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-dbc0bfb2-3161-4232-9b65-111e48a7615e req-dc7bcee2-c6af-4925-93f4-90d99ecb65e7 service nova] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Received unexpected event network-vif-plugged-6165ab31-3be2-438a-aa2a-3f5e345e1107 for instance with vm_state building and task_state spawning.
May 19 04:49:05.434170 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Ignoring supplied device name: /dev/vdb
May 19 04:49:05.436515 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:49:05.439321 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:49:05.446403 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Instance spawned successfully.
May 19 04:49:05.446403 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:49:05.489929 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:49:05.509934 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:05.516865 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:05.529527 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:49:05.529772 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166145.5295963, c39e9766-74e5-49fc-bd3a-aa1400e1458b => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:49:05.529870 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] VM Resumed (Lifecycle Event)
May 19 04:49:05.545297 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:05.665042 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:05.670256 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:05.685624 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:05.810580 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Instance destroyed successfully.
May 19 04:49:05.811216 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lazy-loading 'resources' on Instance uuid 0ad59512-92c0-43d3-bd72-b318240b579f {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:49:05.936883 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:05.952100 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:49:05.952301 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:49:05.952706 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:49:05.953010 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:49:05.953374 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:49:05.953705 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:49:06.039096 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:49:06.041036 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:49:06.315468 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-921353086',display_name='tempest-AttachVolumeNegativeTest-server-921353086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumenegativetest-server-921353086',id=65,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZISScPbjLLYaB/1xQcXIvFQ7qfTDc/AKXszYCYIXqQsW+6zTvtrNQnm+V7R/qCTmy1ja1IpveXCXslCG267DfaRoTS+QXFPlrHgVq/5DjETSHenh0To1vMJNzAU9aZsg==',key_name='tempest-keypair-395921467',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:48:40Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e16e702e1284e7fbba4184913a43de7',ramdisk_id='',reservation_id='r-hh95ebtk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-198121636',owner_user_name='tempest-AttachVolumeNegativeTest-198121636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:48:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fd3d5c8cf5c41589ceb1e2a5a9813c9',uuid=0ad59512-92c0-43d3-bd72-b318240b579f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23e3b074-7f3a-4cd9-8618-42df2f2c9ac9", "address": "fa:16:3e:7c:53:9c", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e3b074-7f", "ovs_interfaceid": "23e3b074-7f3a-4cd9-8618-42df2f2c9ac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:49:06.315727 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converting VIF {"id": "23e3b074-7f3a-4cd9-8618-42df2f2c9ac9", "address": "fa:16:3e:7c:53:9c", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e3b074-7f", "ovs_interfaceid": "23e3b074-7f3a-4cd9-8618-42df2f2c9ac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:49:06.316613 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:53:9c,bridge_name='br-int',has_traffic_filtering=True,id=23e3b074-7f3a-4cd9-8618-42df2f2c9ac9,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e3b074-7f') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:49:06.316941 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:53:9c,bridge_name='br-int',has_traffic_filtering=True,id=23e3b074-7f3a-4cd9-8618-42df2f2c9ac9,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e3b074-7f') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:49:06.318262 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:06.318510 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23e3b074-7f, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:06.319819 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:06.320581 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:49:06.320974 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:06.321678 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:06.321822 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1494c2ec-fad6-43c9-97d9-53edefb1eea7) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:06.323049 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:49:06.324516 np0000001025 nova-compute[97981]: INFO os_vif [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:53:9c,bridge_name='br-int',has_traffic_filtering=True,id=23e3b074-7f3a-4cd9-8618-42df2f2c9ac9,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e3b074-7f')
May 19 04:49:06.324770 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Deleting instance files /opt/stack/data/nova/instances/0ad59512-92c0-43d3-bd72-b318240b579f_del
May 19 04:49:06.325386 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Deletion of /opt/stack/data/nova/instances/0ad59512-92c0-43d3-bd72-b318240b579f_del complete
May 19 04:49:06.459376 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Took 7.95 seconds to spawn the instance on the hypervisor.
May 19 04:49:06.460847 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:49:06.543715 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:49:06.544026 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999852675000056 future=<Future at 0x7218341355b0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:49:06.830548 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Took 1.34 seconds to destroy the instance on the hypervisor.
May 19 04:49:06.831309 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:49:06.831653 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:49:06.831820 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:49:06.832078 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:06.918574 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:06.971560 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Took 13.38 seconds to build instance.
May 19 04:49:07.003552 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Acquiring lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:07.003868 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:07.004101 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Attaching volume eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 to /dev/vdb
May 19 04:49:07.047970 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:49:07.060814 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:49:07.083519 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:07.151265 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:49:07.151568 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:49:07.161767 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:49:07.162901 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fe9b:910a', 'fe80::c897:1dff:fede:235c', 'fe80::fc16:3eff:fed1:698e', 'fe80::6c2f:1bff:fe3b:4a7d', 'fe80::fc16:3eff:fe1e:3f68', 'fe80::1c08:7bff:fe57:c536', 'fe80::fc16:3eff:fe19:9062', 'fe80::b02a:c2ff:fe71:d502'] 
May 19 04:49:07.163140 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:49:07.163258 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:49:07.163509 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:49:07.163777 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Updating existing volume attachment record: 59d49b8c-d107-4cf9-8534-0ccf5694cd29 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:49:07.475491 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.891s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:07.496880 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7a1b5a99-67e5-4cab-94d0-d086653ea010 req-fb959766-f905-442a-a078-2d5f0239b199 service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Received event network-vif-unplugged-23e3b074-7f3a-4cd9-8618-42df2f2c9ac9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:07.497344 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7a1b5a99-67e5-4cab-94d0-d086653ea010 req-fb959766-f905-442a-a078-2d5f0239b199 service nova] Acquiring lock "0ad59512-92c0-43d3-bd72-b318240b579f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:07.497543 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7a1b5a99-67e5-4cab-94d0-d086653ea010 req-fb959766-f905-442a-a078-2d5f0239b199 service nova] Lock "0ad59512-92c0-43d3-bd72-b318240b579f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:07.497760 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7a1b5a99-67e5-4cab-94d0-d086653ea010 req-fb959766-f905-442a-a078-2d5f0239b199 service nova] Lock "0ad59512-92c0-43d3-bd72-b318240b579f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:07.497905 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7a1b5a99-67e5-4cab-94d0-d086653ea010 req-fb959766-f905-442a-a078-2d5f0239b199 service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] No waiting events found dispatching network-vif-unplugged-23e3b074-7f3a-4cd9-8618-42df2f2c9ac9 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:49:07.497960 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7a1b5a99-67e5-4cab-94d0-d086653ea010 req-fb959766-f905-442a-a078-2d5f0239b199 service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Received event network-vif-unplugged-23e3b074-7f3a-4cd9-8618-42df2f2c9ac9 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:49:07.498073 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7a1b5a99-67e5-4cab-94d0-d086653ea010 req-fb959766-f905-442a-a078-2d5f0239b199 service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Received event network-vif-unplugged-23e3b074-7f3a-4cd9-8618-42df2f2c9ac9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:07.498237 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7a1b5a99-67e5-4cab-94d0-d086653ea010 req-fb959766-f905-442a-a078-2d5f0239b199 service nova] Acquiring lock "0ad59512-92c0-43d3-bd72-b318240b579f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:07.498352 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7a1b5a99-67e5-4cab-94d0-d086653ea010 req-fb959766-f905-442a-a078-2d5f0239b199 service nova] Lock "0ad59512-92c0-43d3-bd72-b318240b579f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:07.498452 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7a1b5a99-67e5-4cab-94d0-d086653ea010 req-fb959766-f905-442a-a078-2d5f0239b199 service nova] Lock "0ad59512-92c0-43d3-bd72-b318240b579f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:07.498563 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7a1b5a99-67e5-4cab-94d0-d086653ea010 req-fb959766-f905-442a-a078-2d5f0239b199 service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] No waiting events found dispatching network-vif-unplugged-23e3b074-7f3a-4cd9-8618-42df2f2c9ac9 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:49:07.498692 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7a1b5a99-67e5-4cab-94d0-d086653ea010 req-fb959766-f905-442a-a078-2d5f0239b199 service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Received event network-vif-unplugged-23e3b074-7f3a-4cd9-8618-42df2f2c9ac9 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:49:07.498786 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7a1b5a99-67e5-4cab-94d0-d086653ea010 req-fb959766-f905-442a-a078-2d5f0239b199 service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Received event network-vif-deleted-23e3b074-7f3a-4cd9-8618-42df2f2c9ac9 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:07.498898 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-7a1b5a99-67e5-4cab-94d0-d086653ea010 req-fb959766-f905-442a-a078-2d5f0239b199 service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Neutron deleted interface 23e3b074-7f3a-4cd9-8618-42df2f2c9ac9; detaching it from the instance and deleting it from the info cache
May 19 04:49:07.499034 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-7a1b5a99-67e5-4cab-94d0-d086653ea010 req-fb959766-f905-442a-a078-2d5f0239b199 service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:49:07.738010 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:49:07.738792 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:49:07.738965 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:49:07.739402 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:49:07.739870 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:49:07.753630 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:49:07.754258 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:49:07.754792 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:49:07.755301 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:49:07.755666 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:49:07.755883 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:49:07.769476 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:49:07.769476 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:07.777605 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:49:07.777605 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:07.785515 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22] added
May 19 04:49:07.785515 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:49:07.785515 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:49:07.785515 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:49:07.785515 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:49:07.785515 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:49:07.785515 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:07.785515 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:49:07.785515 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0301(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:49:07.785515 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:49:07.791289 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22] added
May 19 04:49:07.791289 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:49:07.791289 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:49:07.791289 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:49:07.791289 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:49:07.791289 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:49:07.791289 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:07.791512 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:49:07.791626 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0361(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:49:07.791761 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:49:07.856293 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:49:08.154356 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-34554815-8ee3-4dda-abe2-136c81aa2c1b req-b7823200-3e60-4ab3-8920-8ee387c6e442 service nova] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Received event network-changed-6165ab31-3be2-438a-aa2a-3f5e345e1107 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:08.154472 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-34554815-8ee3-4dda-abe2-136c81aa2c1b req-b7823200-3e60-4ab3-8920-8ee387c6e442 service nova] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Refreshing instance network info cache due to event network-changed-6165ab31-3be2-438a-aa2a-3f5e345e1107. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:49:08.154645 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-34554815-8ee3-4dda-abe2-136c81aa2c1b req-b7823200-3e60-4ab3-8920-8ee387c6e442 service nova] Acquiring lock "refresh_cache-c39e9766-74e5-49fc-bd3a-aa1400e1458b" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:49:08.154728 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-34554815-8ee3-4dda-abe2-136c81aa2c1b req-b7823200-3e60-4ab3-8920-8ee387c6e442 service nova] Acquired lock "refresh_cache-c39e9766-74e5-49fc-bd3a-aa1400e1458b" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:49:08.154835 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-34554815-8ee3-4dda-abe2-136c81aa2c1b req-b7823200-3e60-4ab3-8920-8ee387c6e442 service nova] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Refreshing network info cache for port 6165ab31-3be2-438a-aa2a-3f5e345e1107 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:49:08.156421 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7a1b5a99-67e5-4cab-94d0-d086653ea010 req-fb959766-f905-442a-a078-2d5f0239b199 service nova] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Detach interface failed, port_id=23e3b074-7f3a-4cd9-8618-42df2f2c9ac9, reason: Instance 0ad59512-92c0-43d3-bd72-b318240b579f could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:49:08.358200 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Took 1.53 seconds to deallocate network for instance.
May 19 04:49:08.567639 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:08.657352 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-34554815-8ee3-4dda-abe2-136c81aa2c1b req-b7823200-3e60-4ab3-8920-8ee387c6e442 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:08.782049 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00033467799994468805 future=<Future at 0x721850304e60 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:49:08.782213 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:49:08.782277 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=12.76157669999975 future=<Future at 0x7218341355b0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:49:08.782463 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=12.76149452699974 future=<Future at 0x7218341355b0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:49:08.786015 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:49:08.792624 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:49:08.798749 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:49:08.798749 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:49:08.805824 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:49:08.805824 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:08.816875 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:08.821179 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:08.829879 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:49:08.829879 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:49:08.829879 np0000001025 nova-compute[97981]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:08.829879 np0000001025 nova-compute[97981]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:08.829879 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:49:08.829879 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:49:08.829879 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:49:08.829879 np0000001025 nova-compute[97981]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:08.829879 np0000001025 nova-compute[97981]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:08.829879 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:49:08.834812 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:49:08.834812 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:49:08.834812 np0000001025 nova-compute[97981]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:08.834812 np0000001025 nova-compute[97981]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:08.834812 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:49:08.837870 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:49:08.837870 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:49:08.837870 np0000001025 nova-compute[97981]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:08.837870 np0000001025 nova-compute[97981]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:08.837870 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:49:08.864742 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:08.864893 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:08.865854 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22, portal: 192.168.40.100,3260]
May 19 04:49:08.865854 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22, portal: 192.168.40.100,3260] successful.
May 19 04:49:08.865854 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:08.879897 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:08.888932 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22, portal: 192.168.50.100,3260]
May 19 04:49:08.888932 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22, portal: 192.168.50.100,3260] successful.
May 19 04:49:08.888932 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:08.898299 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:49:08.898299 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:49:08.898299 np0000001025 nova-compute[97981]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:08.898299 np0000001025 nova-compute[97981]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:08.898299 np0000001025 nova-compute[97981]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 (non-flash)
May 19 04:49:08.898299 np0000001025 nova-compute[97981]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 (non-flash)
May 19 04:49:08.898299 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:49:08.900359 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:49:08.900359 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:49:08.900359 np0000001025 nova-compute[97981]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:08.900359 np0000001025 nova-compute[97981]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:08.900359 np0000001025 nova-compute[97981]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 (non-flash)
May 19 04:49:08.900359 np0000001025 nova-compute[97981]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 (non-flash)
May 19 04:49:08.900359 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:49:08.900359 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:49:08.900359 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:49:08.900359 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] HCTL ('11', '-', '-', 0) found on session 152 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:49:08.900359 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:49:08.901322 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:08.915572 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Searching for a device in session 152 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:49:08.916033 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:49:08.921772 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:49:08.921772 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:49:08.921772 np0000001025 nova-compute[97981]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:08.921772 np0000001025 nova-compute[97981]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:08.921772 np0000001025 nova-compute[97981]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 (non-flash)
May 19 04:49:08.921772 np0000001025 nova-compute[97981]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 (non-flash)
May 19 04:49:08.921772 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:49:08.922043 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:49:08.922043 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:49:08.922043 np0000001025 nova-compute[97981]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:08.922043 np0000001025 nova-compute[97981]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:08.922043 np0000001025 nova-compute[97981]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 (non-flash)
May 19 04:49:08.922043 np0000001025 nova-compute[97981]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 (non-flash)
May 19 04:49:08.922043 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:49:08.922284 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:49:08.922284 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:49:08.922933 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] HCTL ('12', '-', '-', 0) found on session 153 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:49:08.923004 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:49:08.946226 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Searching for a device in session 153 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:49:08.946226 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:49:09.020939 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-34554815-8ee3-4dda-abe2-136c81aa2c1b req-b7823200-3e60-4ab3-8920-8ee387c6e442 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:09.170689 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-34554815-8ee3-4dda-abe2-136c81aa2c1b req-b7823200-3e60-4ab3-8920-8ee387c6e442 service nova] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Updated VIF entry in instance network info cache for port 6165ab31-3be2-438a-aa2a-3f5e345e1107. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:49:09.170885 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-34554815-8ee3-4dda-abe2-136c81aa2c1b req-b7823200-3e60-4ab3-8920-8ee387c6e442 service nova] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Updating instance_info_cache with network_info: [{"id": "6165ab31-3be2-438a-aa2a-3f5e345e1107", "address": "fa:16:3e:19:90:62", "network": {"id": "8a07682e-aaf0-4a4f-8bc0-70db155f01be", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2139331559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec4a48491cc047108747a22e8c63c3ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6165ab31-3b", "ovs_interfaceid": "6165ab31-3be2-438a-aa2a-3f5e345e1107", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:49:09.185467 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:49:09.185775 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:49:09.672960 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-34554815-8ee3-4dda-abe2-136c81aa2c1b req-b7823200-3e60-4ab3-8920-8ee387c6e442 service nova] Releasing lock "refresh_cache-c39e9766-74e5-49fc-bd3a-aa1400e1458b" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:49:09.687950 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:49:09.754885 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:49:10.194536 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.329s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:10.239185 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Deleted allocations for instance 0ad59512-92c0-43d3-bd72-b318240b579f
May 19 04:49:10.775832 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Found WWN 33000000058daed38 for multipath device dm-2 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:49:10.776307 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:49:10.776307 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '33000000058daed38', 'path': '/dev/dm-2', 'multipath_id': '33000000058daed38'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:49:10.776383 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000058daed38', 'path': '/dev/dm-2', 'multipath_id': '33000000058daed38'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:49:10.778905 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lazy-loading 'flavor' on Instance uuid 6c90d07e-25cd-4d8d-b134-f77a1de1b37a {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:49:11.246887 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-aa8bf284-fb7c-48c0-90b4-456e6458f763 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "0ad59512-92c0-43d3-bd72-b318240b579f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.263s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:11.281675 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Attempting to attach volume eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:49:11.282848 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:49:11.282848 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:49:11.282848 np0000001025 nova-compute[97981]:   <alias name="ua-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22"/>
May 19 04:49:11.282848 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-2"/>
May 19 04:49:11.282848 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:49:11.282848 np0000001025 nova-compute[97981]:   <serial>eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22</serial>
May 19 04:49:11.282848 np0000001025 nova-compute[97981]: </disk>
May 19 04:49:11.282848 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:49:11.322764 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:11.579493 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:12.455822 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:12.456236 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:12.923665 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:49:12.923810 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:49:12.923908 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:49:12.923995 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] No VIF found with MAC fa:16:3e:d1:69:8e, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:49:12.958121 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Detaching volume 64a2b2e9-8d96-47c3-9e90-5bd517ca8932
May 19 04:49:13.064578 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Attempting to driver detach volume 64a2b2e9-8d96-47c3-9e90-5bd517ca8932 from mountpoint /dev/vdb
May 19 04:49:13.069349 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Found disk vdb by alias ua-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:49:13.070616 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Found disk vdb by alias ua-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:49:13.070719 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Attempting to detach device vdb from instance 3bd17542-9a9b-4bda-80a6-413cb4c2091d from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:49:13.070981 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:49:13.070981 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:49:13.070981 np0000001025 nova-compute[97981]:   <alias name="ua-64a2b2e9-8d96-47c3-9e90-5bd517ca8932"/>
May 19 04:49:13.070981 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:49:13.070981 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:49:13.070981 np0000001025 nova-compute[97981]:   <serial>64a2b2e9-8d96-47c3-9e90-5bd517ca8932</serial>
May 19 04:49:13.070981 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:49:13.070981 np0000001025 nova-compute[97981]: </disk>
May 19 04:49:13.070981 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:49:13.076003 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Successfully detached device vdb from instance 3bd17542-9a9b-4bda-80a6-413cb4c2091d from the persistent domain config.
May 19 04:49:13.076278 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] (1/8): Attempting to detach device vdb with device alias ua-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 from instance 3bd17542-9a9b-4bda-80a6-413cb4c2091d from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:49:13.076539 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:49:13.076539 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:49:13.076539 np0000001025 nova-compute[97981]:   <alias name="ua-64a2b2e9-8d96-47c3-9e90-5bd517ca8932"/>
May 19 04:49:13.076539 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:49:13.076539 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:49:13.076539 np0000001025 nova-compute[97981]:   <serial>64a2b2e9-8d96-47c3-9e90-5bd517ca8932</serial>
May 19 04:49:13.076539 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:49:13.076539 np0000001025 nova-compute[97981]: </disk>
May 19 04:49:13.076539 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:49:13.579957 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:13.596049 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779166153.5957053, 3bd17542-9a9b-4bda-80a6-413cb4c2091d => ua-64a2b2e9-8d96-47c3-9e90-5bd517ca8932> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:49:13.597008 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 for instance 3bd17542-9a9b-4bda-80a6-413cb4c2091d {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:49:13.599061 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Successfully detached device vdb from instance 3bd17542-9a9b-4bda-80a6-413cb4c2091d from the live domain config.
May 19 04:49:13.600191 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:49:13.600503 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932', 'iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '64a2b2e9-8d96-47c3-9e90-5bd517ca8932', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:49:13.600664 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:49:13.601013 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:49:13.601260 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932', 'iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '64a2b2e9-8d96-47c3-9e90-5bd517ca8932', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:49:13.601396 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:49:13.627055 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:49:13.627055 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:49:13.627055 np0000001025 nova-compute[97981]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:13.627055 np0000001025 nova-compute[97981]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:13.627055 np0000001025 nova-compute[97981]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 (non-flash)
May 19 04:49:13.627055 np0000001025 nova-compute[97981]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 (non-flash)
May 19 04:49:13.627055 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:49:13.627401 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:49:13.627401 np0000001025 nova-compute[97981]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932 (non-flash)
May 19 04:49:13.627401 np0000001025 nova-compute[97981]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:13.627401 np0000001025 nova-compute[97981]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:13.627401 np0000001025 nova-compute[97981]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 (non-flash)
May 19 04:49:13.627401 np0000001025 nova-compute[97981]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 (non-flash)
May 19 04:49:13.627401 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:49:13.627401 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932', '145'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', '152'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', '153')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:49:13.627401 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932', '145')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:49:13.628174 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932', '146')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:49:13.628830 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185018db20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932'): ({'sdd'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:49:13.629015 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Removing multipathed devices sdc, sdd {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:49:13.629239 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Flush multipath device 330000000267bf8b9 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:49:13.659515 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:49:13.704678 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:49:13.747487 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Checking to see if SCSI volumes sdc, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:49:13.747653 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] SCSI volumes sdc, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:49:13.748747 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Checking to see if device paths {'sdc', 'sdd'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:49:13.762692 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Device paths {'sdc', 'sdd'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:49:13.762905 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:49:13.774084 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:13.801169 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 145, target: iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932, portal: 192.168.40.100,3260]
May 19 04:49:13.801169 np0000001025 nova-compute[97981]: Logout of [sid: 145, target: iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932, portal: 192.168.40.100,3260] successful.
May 19 04:49:13.801169 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:13.816032 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:13.827043 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:13.852186 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 146, target: iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932, portal: 192.168.50.100,3260]
May 19 04:49:13.852186 np0000001025 nova-compute[97981]: Logout of [sid: 146, target: iqn.2023-03.storpool.com:os--volume-64a2b2e9-8d96-47c3-9e90-5bd517ca8932, portal: 192.168.50.100,3260] successful.
May 19 04:49:13.852186 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:13.865382 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:13.865634 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:49:13.865751 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] <== disconnect_volume: return (265ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:49:13.865857 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:49:14.411064 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lazy-loading 'flavor' on Instance uuid 3bd17542-9a9b-4bda-80a6-413cb4c2091d {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:49:14.469837 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c2828554-419e-4cab-8221-23d4dc480b21 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.466s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:14.571539 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Received event volume-extended-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:15.074330 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Handling volume-extended event for volume eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 {{(pid=97981) extend_volume /opt/stack/nova/nova/compute/manager.py:11834}}
May 19 04:49:15.416452 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4663ca90-5b0c-493a-8754-72f305ce7d73 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.960s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:15.576395 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Cinder extended volume eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22; extending it to detect new size
May 19 04:49:15.688234 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:15.688436 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:15.688609 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:15.688765 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:15.688869 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:15.690777 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Terminating instance
May 19 04:49:16.112283 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] calling os-brick to extend iSCSI Volume {{(pid=97981) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:88}}
May 19 04:49:16.112820 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] ==> extend_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}), 'kwargs': {}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:49:16.112820 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] Acquiring lock "extend_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:49:16.113216 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] Lock "extend_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:49:16.113503 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] Extend volume for {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}
May 19 04:49:16.113659 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] Multipath discovery for iSCSI enabled
May 19 04:49:16.113850 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] Found paths for volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22-lun-0']
May 19 04:49:16.113987 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] Checking paths are valid ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22-lun-0'] {{(pid=97981) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:711}}
May 19 04:49:16.132513 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] extend volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22-lun-0'] {{(pid=97981) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:718}}
May 19 04:49:16.132785 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] Running cmd (subprocess): lsscsi {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:16.185452 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] CMD "lsscsi" returned: 0 in 0.052s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:16.185949 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22-lun-0', 'host': '11', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=97981) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 19 04:49:16.186154 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22-lun-0', 'host': '11', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=97981) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 19 04:49:16.194772 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:49:16.196807 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] Starting size: 1073741824 {{(pid=97981) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 19 04:49:16.216846 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:16.221431 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:16.222446 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] volume size after scsi device rescan 2147483648 {{(pid=97981) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 19 04:49:16.222672 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] Running cmd (subprocess): lsscsi {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:16.236100 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:16.242751 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:16.265732 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:16.276366 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] CMD "lsscsi" returned: 0 in 0.053s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:16.276871 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22-lun-0', 'host': '12', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=97981) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 19 04:49:16.277041 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22-lun-0', 'host': '12', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=97981) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 19 04:49:16.285760 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] Starting size: 1073741824 {{(pid=97981) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 19 04:49:16.306834 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] volume size after scsi device rescan 2147483648 {{(pid=97981) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 19 04:49:16.319338 np0000001025 nova-compute[97981]: INFO os_brick.initiator.linuxscsi [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] Find Multipath device file for volume WWN 33000000058daed38
May 19 04:49:16.319769 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] Checking to see if /dev/disk/by-id/dm-uuid-mpath-33000000058daed38 exists yet. {{(pid=97981) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:482}}
May 19 04:49:16.319907 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] /dev/disk/by-id/dm-uuid-mpath-33000000058daed38 has shown up. {{(pid=97981) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:489}}
May 19 04:49:16.324203 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:16.340101 np0000001025 nova-compute[97981]: INFO os_brick.initiator.linuxscsi [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-33000000058daed38) current size 1073741824
May 19 04:49:16.369172 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3d521821-b49f-467c-8278-04396ede21e8 req-812c350f-c587-4e5c-8947-721a85f50e1f service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Received event network-vif-unplugged-4a0502dc-0324-428b-b82c-e3ef9fc303e8 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:16.369442 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3d521821-b49f-467c-8278-04396ede21e8 req-812c350f-c587-4e5c-8947-721a85f50e1f service nova] Acquiring lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:16.369687 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3d521821-b49f-467c-8278-04396ede21e8 req-812c350f-c587-4e5c-8947-721a85f50e1f service nova] Lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:16.369843 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3d521821-b49f-467c-8278-04396ede21e8 req-812c350f-c587-4e5c-8947-721a85f50e1f service nova] Lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:16.372233 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3d521821-b49f-467c-8278-04396ede21e8 req-812c350f-c587-4e5c-8947-721a85f50e1f service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] No waiting events found dispatching network-vif-unplugged-4a0502dc-0324-428b-b82c-e3ef9fc303e8 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:49:16.372368 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3d521821-b49f-467c-8278-04396ede21e8 req-812c350f-c587-4e5c-8947-721a85f50e1f service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Received event network-vif-unplugged-4a0502dc-0324-428b-b82c-e3ef9fc303e8 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:49:16.407196 np0000001025 nova-compute[97981]: INFO os_brick.initiator.linuxscsi [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-33000000058daed38) new size 2147483648
May 19 04:49:16.407455 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] Lock "extend_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: held 0.294s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:49:16.407590 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] <== extend_volume: return (294ms) 2147483648 {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:49:16.407728 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Extend iSCSI Volume: new_size=2147483648 {{(pid=97981) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:90}}
May 19 04:49:16.413001 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [req-7080beb9-90f7-4323-9373-f392288aee15 req-4b3edffa-8e0f-4a0d-807d-f28f9ddf3e36 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Resizing target device /dev/dm-2 to 2147483648 {{(pid=97981) _resize_attached_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2945}}
May 19 04:49:16.507240 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:16.514291 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:16.527544 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999677307000184 future=<Future at 0x7218340fd490 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:49:16.529190 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Instance destroyed successfully.
May 19 04:49:16.530159 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lazy-loading 'resources' on Instance uuid 3bd17542-9a9b-4bda-80a6-413cb4c2091d {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:49:17.031913 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:47:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1519602058',display_name='tempest-AttachVolumeNegativeTest-server-1519602058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumenegativetest-server-1519602058',id=62,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiwvfOeciIOcJOeucaJt13r8OQ9LXJLgM+W8vXWJc5gkCuVE9A7LrgCN4JdEQ2Wp3m8aXka335aN8TxivFJ0U50jwtVNuMtnsiYK7tEwyqWqo0d1GurulEHCTPxl3EcOg==',key_name='tempest-keypair-437911657',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:47:35Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e16e702e1284e7fbba4184913a43de7',ramdisk_id='',reservation_id='r-zv6wm6fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-198121636',owner_user_name='tempest-AttachVolumeNegativeTest-198121636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:47:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fd3d5c8cf5c41589ceb1e2a5a9813c9',uuid=3bd17542-9a9b-4bda-80a6-413cb4c2091d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "address": "fa:16:3e:9b:91:0a", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0502dc-03", "ovs_interfaceid": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:49:17.032165 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converting VIF {"id": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "address": "fa:16:3e:9b:91:0a", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a0502dc-03", "ovs_interfaceid": "4a0502dc-0324-428b-b82c-e3ef9fc303e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:49:17.032790 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:91:0a,bridge_name='br-int',has_traffic_filtering=True,id=4a0502dc-0324-428b-b82c-e3ef9fc303e8,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a0502dc-03') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:49:17.033030 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:91:0a,bridge_name='br-int',has_traffic_filtering=True,id=4a0502dc-0324-428b-b82c-e3ef9fc303e8,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a0502dc-03') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:49:17.034352 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:17.034622 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a0502dc-03, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:17.036456 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:17.037370 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:49:17.037981 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:17.038169 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e85f56ca-89b8-4a07-8592-fc7bbd3c76e4) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:17.039804 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:49:17.041127 np0000001025 nova-compute[97981]: INFO os_vif [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:91:0a,bridge_name='br-int',has_traffic_filtering=True,id=4a0502dc-0324-428b-b82c-e3ef9fc303e8,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a0502dc-03')
May 19 04:49:17.041377 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Deleting instance files /opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d_del
May 19 04:49:17.042208 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Deletion of /opt/stack/data/nova/instances/3bd17542-9a9b-4bda-80a6-413cb4c2091d_del complete
May 19 04:49:17.228289 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Acquiring lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:17.228730 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:17.547581 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Took 1.35 seconds to destroy the instance on the hypervisor.
May 19 04:49:17.548482 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:49:17.548679 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:49:17.552129 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:49:17.552129 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:17.612177 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:17.730733 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Detaching volume eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22
May 19 04:49:17.777442 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Attempting to driver detach volume eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 from mountpoint /dev/vdb
May 19 04:49:17.782866 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Found disk vdb by alias ua-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:49:17.784132 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Found disk vdb by alias ua-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:49:17.784275 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Attempting to detach device vdb from instance 6c90d07e-25cd-4d8d-b134-f77a1de1b37a from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:49:17.784853 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:49:17.784853 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:49:17.784853 np0000001025 nova-compute[97981]:   <alias name="ua-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22"/>
May 19 04:49:17.784853 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-2"/>
May 19 04:49:17.784853 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:49:17.784853 np0000001025 nova-compute[97981]:   <serial>eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22</serial>
May 19 04:49:17.784853 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:49:17.784853 np0000001025 nova-compute[97981]: </disk>
May 19 04:49:17.784853 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:49:17.793057 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Successfully detached device vdb from instance 6c90d07e-25cd-4d8d-b134-f77a1de1b37a from the persistent domain config.
May 19 04:49:17.793228 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] (1/8): Attempting to detach device vdb with device alias ua-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 from instance 6c90d07e-25cd-4d8d-b134-f77a1de1b37a from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:49:17.793455 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:49:17.793455 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:49:17.793455 np0000001025 nova-compute[97981]:   <alias name="ua-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22"/>
May 19 04:49:17.793455 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-2"/>
May 19 04:49:17.793455 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:49:17.793455 np0000001025 nova-compute[97981]:   <serial>eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22</serial>
May 19 04:49:17.793455 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:49:17.793455 np0000001025 nova-compute[97981]: </disk>
May 19 04:49:17.793455 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:49:17.985334 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b40e2073-1215-45b1-b8c0-4a452fe8a06b req-e69b4e83-a971-479c-83f3-cf3047ae1e25 service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Received event network-vif-deleted-4a0502dc-0324-428b-b82c-e3ef9fc303e8 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:17.985460 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-b40e2073-1215-45b1-b8c0-4a452fe8a06b req-e69b4e83-a971-479c-83f3-cf3047ae1e25 service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Neutron deleted interface 4a0502dc-0324-428b-b82c-e3ef9fc303e8; detaching it from the instance and deleting it from the info cache
May 19 04:49:17.985575 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-b40e2073-1215-45b1-b8c0-4a452fe8a06b req-e69b4e83-a971-479c-83f3-cf3047ae1e25 service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:49:18.266133 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779166158.2658124, 6c90d07e-25cd-4d8d-b134-f77a1de1b37a => ua-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:49:18.267525 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 for instance 6c90d07e-25cd-4d8d-b134-f77a1de1b37a {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:49:18.269813 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Successfully detached device vdb from instance 6c90d07e-25cd-4d8d-b134-f77a1de1b37a from the live domain config.
May 19 04:49:18.270753 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:49:18.271091 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:49:18.271254 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:49:18.271635 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:49:18.271993 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:49:18.272176 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:49:18.295404 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:18.295404 np0000001025 nova-compute[97981]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:18.295404 np0000001025 nova-compute[97981]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 (non-flash)
May 19 04:49:18.295404 np0000001025 nova-compute[97981]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 (non-flash)
May 19 04:49:18.295404 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:49:18.295608 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsi session list stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:18.295608 np0000001025 nova-compute[97981]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:18.295608 np0000001025 nova-compute[97981]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 (non-flash)
May 19 04:49:18.295608 np0000001025 nova-compute[97981]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22 (non-flash)
May 19 04:49:18.295608 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:49:18.295731 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', '152'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', '153')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:49:18.295838 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', '152')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:49:18.296909 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22', '153')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:49:18.297837 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218507420c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22'): ({'sdg'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:49:18.298162 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Removing multipathed devices sdf, sdg {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:49:18.298420 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Flush multipath device 33000000058daed38 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:49:18.336538 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:49:18.390591 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:49:18.423592 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-470294f2-ce63-47ed-9389-24e9465aa0a3 req-e0565cba-883d-4743-8b49-9a8f1d93eff9 service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Received event network-vif-unplugged-4a0502dc-0324-428b-b82c-e3ef9fc303e8 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:18.423806 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-470294f2-ce63-47ed-9389-24e9465aa0a3 req-e0565cba-883d-4743-8b49-9a8f1d93eff9 service nova] Acquiring lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:18.423994 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-470294f2-ce63-47ed-9389-24e9465aa0a3 req-e0565cba-883d-4743-8b49-9a8f1d93eff9 service nova] Lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:18.424152 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-470294f2-ce63-47ed-9389-24e9465aa0a3 req-e0565cba-883d-4743-8b49-9a8f1d93eff9 service nova] Lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:18.424521 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-470294f2-ce63-47ed-9389-24e9465aa0a3 req-e0565cba-883d-4743-8b49-9a8f1d93eff9 service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] No waiting events found dispatching network-vif-unplugged-4a0502dc-0324-428b-b82c-e3ef9fc303e8 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:49:18.424711 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-470294f2-ce63-47ed-9389-24e9465aa0a3 req-e0565cba-883d-4743-8b49-9a8f1d93eff9 service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Received event network-vif-unplugged-4a0502dc-0324-428b-b82c-e3ef9fc303e8 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:49:18.437455 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:49:18.437595 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:49:18.438343 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:49:18.441233 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:49:18.449726 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:49:18.449939 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:49:18.460798 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:18.483724 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 152, target: iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22, portal: 192.168.40.100,3260]
May 19 04:49:18.483724 np0000001025 nova-compute[97981]: Logout of [sid: 152, target: iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22, portal: 192.168.40.100,3260] successful.
May 19 04:49:18.483724 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:18.489370 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b40e2073-1215-45b1-b8c0-4a452fe8a06b req-e69b4e83-a971-479c-83f3-cf3047ae1e25 service nova] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Detach interface failed, port_id=4a0502dc-0324-428b-b82c-e3ef9fc303e8, reason: Instance 3bd17542-9a9b-4bda-80a6-413cb4c2091d could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:49:18.496967 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:18.507089 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:18.538910 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 153, target: iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22, portal: 192.168.50.100,3260]
May 19 04:49:18.538910 np0000001025 nova-compute[97981]: Logout of [sid: 153, target: iqn.2023-03.storpool.com:os--volume-eafc9d8b-daf6-4922-9c7f-bfd9d6ad4c22, portal: 192.168.50.100,3260] successful.
May 19 04:49:18.538910 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:18.550997 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:18.551198 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:49:18.551305 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] <== disconnect_volume: return (279ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:49:18.551406 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:49:18.592341 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:18.942327 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Took 1.39 seconds to deallocate network for instance.
May 19 04:49:19.093360 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lazy-loading 'flavor' on Instance uuid 6c90d07e-25cd-4d8d-b134-f77a1de1b37a {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:49:19.447833 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:19.448239 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:19.635444 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:49:19.635628 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:49:20.098404 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-63704056-c594-481d-ad58-445e3f4d0d93 tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.870s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:20.137929 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:49:20.410441 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Acquiring lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:20.410541 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:20.410746 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Acquiring lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:20.410867 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:20.410966 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:20.412725 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Terminating instance
May 19 04:49:20.643721 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.196s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:20.687620 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Deleted allocations for instance 3bd17542-9a9b-4bda-80a6-413cb4c2091d
May 19 04:49:20.915256 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:49:20.935712 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:20.937659 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:20.957140 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:20.959799 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:20.980709 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:21.181625 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-363a18ee-ec1a-414f-9963-86ea8775fcb5 req-d51e39f9-d93f-46cf-ba1a-ee3d514c9b6d service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Received event network-vif-unplugged-67249ead-b56a-452d-a316-b41f76171452 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:21.182014 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-363a18ee-ec1a-414f-9963-86ea8775fcb5 req-d51e39f9-d93f-46cf-ba1a-ee3d514c9b6d service nova] Acquiring lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:21.182199 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-363a18ee-ec1a-414f-9963-86ea8775fcb5 req-d51e39f9-d93f-46cf-ba1a-ee3d514c9b6d service nova] Lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:21.182333 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-363a18ee-ec1a-414f-9963-86ea8775fcb5 req-d51e39f9-d93f-46cf-ba1a-ee3d514c9b6d service nova] Lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:21.182459 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-363a18ee-ec1a-414f-9963-86ea8775fcb5 req-d51e39f9-d93f-46cf-ba1a-ee3d514c9b6d service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] No waiting events found dispatching network-vif-unplugged-67249ead-b56a-452d-a316-b41f76171452 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:49:21.182567 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-363a18ee-ec1a-414f-9963-86ea8775fcb5 req-d51e39f9-d93f-46cf-ba1a-ee3d514c9b6d service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Received event network-vif-unplugged-67249ead-b56a-452d-a316-b41f76171452 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:49:21.251461 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999693327000386 future=<Future at 0x7218503b0560 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:49:21.253234 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Instance destroyed successfully.
May 19 04:49:21.253603 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lazy-loading 'resources' on Instance uuid 6c90d07e-25cd-4d8d-b134-f77a1de1b37a {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:49:21.544341 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0004226060000291909 future=<Future at 0x7218341355b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:49:21.544840 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Emitting event <LifecycleEvent: 1779166146.5437963, 0ad59512-92c0-43d3-bd72-b318240b579f => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:49:21.545036 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:49:21.545244 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] VM Stopped (Lifecycle Event)
May 19 04:49:21.546067 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=9.981078310000157 future=<Future at 0x7218340fd490 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:49:21.546308 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=9.980807222999829 future=<Future at 0x7218340fd490 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:49:21.695791 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-815e118c-8005-41c7-99d5-cd3629638cc9 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "3bd17542-9a9b-4bda-80a6-413cb4c2091d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.007s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:21.756591 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:48:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1451311913',display_name='tempest-VolumesExtendAttachedTest-instance-1451311913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesextendattachedtest-instance-1451311913',id=64,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGiNrADa49zS2pAzsjLbCqhTajtqnwwl08ofV2QiUXITohMSfkLmc+jcZmf1jNQUXy0UZJYqKiPg8OToqYPrxhcpmAH0qRdFRvZHBB+ZviyZhS+Nkz6NoRjkbCwwlzMJg==',key_name='tempest-keypair-796413133',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:48:26Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69aba65177bf4f4a8e2d9a253aee056f',ramdisk_id='',reservation_id='r-v8j0w626',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesExtendAttachedTest-896639250',owner_user_name='tempest-VolumesExtendAttachedTest-896639250-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:48:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46d4604f9bb344e3833d45a1ffbac88c',uuid=6c90d07e-25cd-4d8d-b134-f77a1de1b37a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67249ead-b56a-452d-a316-b41f76171452", "address": "fa:16:3e:d1:69:8e", "network": {"id": "12ac3fba-8b64-437c-8857-40535b1bd97a", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-226631955-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "69aba65177bf4f4a8e2d9a253aee056f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67249ead-b5", "ovs_interfaceid": "67249ead-b56a-452d-a316-b41f76171452", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:49:21.756780 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Converting VIF {"id": "67249ead-b56a-452d-a316-b41f76171452", "address": "fa:16:3e:d1:69:8e", "network": {"id": "12ac3fba-8b64-437c-8857-40535b1bd97a", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-226631955-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "69aba65177bf4f4a8e2d9a253aee056f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67249ead-b5", "ovs_interfaceid": "67249ead-b56a-452d-a316-b41f76171452", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:49:21.757840 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:69:8e,bridge_name='br-int',has_traffic_filtering=True,id=67249ead-b56a-452d-a316-b41f76171452,network=Network(12ac3fba-8b64-437c-8857-40535b1bd97a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67249ead-b5') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:49:21.758058 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:69:8e,bridge_name='br-int',has_traffic_filtering=True,id=67249ead-b56a-452d-a316-b41f76171452,network=Network(12ac3fba-8b64-437c-8857-40535b1bd97a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67249ead-b5') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:49:21.758770 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:21.758925 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67249ead-b5, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:21.759925 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:21.760651 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:49:21.760938 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:21.761512 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:21.761626 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e35ce89b-d1da-4234-afee-3ab2da9d0da8) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:21.762021 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:21.762409 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:49:21.762595 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:21.763976 np0000001025 nova-compute[97981]: INFO os_vif [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:69:8e,bridge_name='br-int',has_traffic_filtering=True,id=67249ead-b56a-452d-a316-b41f76171452,network=Network(12ac3fba-8b64-437c-8857-40535b1bd97a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67249ead-b5')
May 19 04:49:21.764215 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Deleting instance files /opt/stack/data/nova/instances/6c90d07e-25cd-4d8d-b134-f77a1de1b37a_del
May 19 04:49:21.764920 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Deletion of /opt/stack/data/nova/instances/6c90d07e-25cd-4d8d-b134-f77a1de1b37a_del complete
May 19 04:49:22.047920 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-680bdc76-d4e9-43a8-83a5-6a3314b419af tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: 0ad59512-92c0-43d3-bd72-b318240b579f] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:49:22.269911 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Took 1.35 seconds to destroy the instance on the hypervisor.
May 19 04:49:22.270488 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:49:22.270676 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:49:22.271085 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:49:22.271280 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:22.331005 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:22.719745 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3b4a41a6-9a6a-4617-ad27-af9af0d60aaf req-0cff1a5a-7c43-4c27-890e-bfcb8f545654 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Received event network-vif-deleted-67249ead-b56a-452d-a316-b41f76171452 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:22.719745 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-3b4a41a6-9a6a-4617-ad27-af9af0d60aaf req-0cff1a5a-7c43-4c27-890e-bfcb8f545654 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Neutron deleted interface 67249ead-b56a-452d-a316-b41f76171452; detaching it from the instance and deleting it from the info cache
May 19 04:49:22.719745 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3b4a41a6-9a6a-4617-ad27-af9af0d60aaf req-0cff1a5a-7c43-4c27-890e-bfcb8f545654 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:49:23.172221 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:49:23.224207 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3b4a41a6-9a6a-4617-ad27-af9af0d60aaf req-0cff1a5a-7c43-4c27-890e-bfcb8f545654 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Detach interface failed, port_id=67249ead-b56a-452d-a316-b41f76171452, reason: Instance 6c90d07e-25cd-4d8d-b134-f77a1de1b37a could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:49:23.249560 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-eaa848d8-0bae-4ee0-9311-ea0b9c57f4df req-e4d5a8fd-e664-4fc7-b2aa-282f2f840e78 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Received event network-vif-unplugged-67249ead-b56a-452d-a316-b41f76171452 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:23.250033 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-eaa848d8-0bae-4ee0-9311-ea0b9c57f4df req-e4d5a8fd-e664-4fc7-b2aa-282f2f840e78 service nova] Acquiring lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:23.250607 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-eaa848d8-0bae-4ee0-9311-ea0b9c57f4df req-e4d5a8fd-e664-4fc7-b2aa-282f2f840e78 service nova] Lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:23.250607 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-eaa848d8-0bae-4ee0-9311-ea0b9c57f4df req-e4d5a8fd-e664-4fc7-b2aa-282f2f840e78 service nova] Lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:23.250813 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-eaa848d8-0bae-4ee0-9311-ea0b9c57f4df req-e4d5a8fd-e664-4fc7-b2aa-282f2f840e78 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] No waiting events found dispatching network-vif-unplugged-67249ead-b56a-452d-a316-b41f76171452 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:49:23.251000 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-eaa848d8-0bae-4ee0-9311-ea0b9c57f4df req-e4d5a8fd-e664-4fc7-b2aa-282f2f840e78 service nova] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Received event network-vif-unplugged-67249ead-b56a-452d-a316-b41f76171452 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:49:23.593601 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:23.674009 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Took 1.40 seconds to deallocate network for instance.
May 19 04:49:24.178841 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:24.179277 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:24.371759 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:49:24.371963 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:49:24.551395 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "54c8f283-1771-4202-836d-df17111dba25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:24.551395 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "54c8f283-1771-4202-836d-df17111dba25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:24.874525 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:49:25.052338 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:49:25.382809 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.204s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:25.435848 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Deleted allocations for instance 6c90d07e-25cd-4d8d-b134-f77a1de1b37a
May 19 04:49:25.502348 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-96ca4801-0ff7-4f08-aa05-5f7578fad748 req-f4bda359-3935-4cb5-beaa-7c0d0bc66d5a service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Received event network-changed-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:25.502842 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-96ca4801-0ff7-4f08-aa05-5f7578fad748 req-f4bda359-3935-4cb5-beaa-7c0d0bc66d5a service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Refreshing instance network info cache due to event network-changed-53e6eaf0-1553-4cbe-874a-c98dce3a96fd. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:49:25.503085 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-96ca4801-0ff7-4f08-aa05-5f7578fad748 req-f4bda359-3935-4cb5-beaa-7c0d0bc66d5a service nova] Acquiring lock "refresh_cache-e1c00d98-c68b-45cd-b4f6-6c6d62b54290" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:49:25.503255 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-96ca4801-0ff7-4f08-aa05-5f7578fad748 req-f4bda359-3935-4cb5-beaa-7c0d0bc66d5a service nova] Acquired lock "refresh_cache-e1c00d98-c68b-45cd-b4f6-6c6d62b54290" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:49:25.503416 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-96ca4801-0ff7-4f08-aa05-5f7578fad748 req-f4bda359-3935-4cb5-beaa-7c0d0bc66d5a service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Refreshing network info cache for port 53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:49:25.612891 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:25.613660 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:25.618124 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:49:25.618124 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Claim successful on node np0000001025
May 19 04:49:25.929145 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-89594d25-31e6-4d6a-9a7e-ba8876b56f12 req-eeaf403d-2bf4-40d9-9e25-65191459c515 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Received event network-changed-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:25.929207 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-89594d25-31e6-4d6a-9a7e-ba8876b56f12 req-eeaf403d-2bf4-40d9-9e25-65191459c515 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Refreshing instance network info cache due to event network-changed-53e6eaf0-1553-4cbe-874a-c98dce3a96fd. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:49:25.929325 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-89594d25-31e6-4d6a-9a7e-ba8876b56f12 req-eeaf403d-2bf4-40d9-9e25-65191459c515 service nova] Acquiring lock "refresh_cache-e1c00d98-c68b-45cd-b4f6-6c6d62b54290" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:49:26.005322 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-96ca4801-0ff7-4f08-aa05-5f7578fad748 req-f4bda359-3935-4cb5-beaa-7c0d0bc66d5a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:26.323155 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-96ca4801-0ff7-4f08-aa05-5f7578fad748 req-f4bda359-3935-4cb5-beaa-7c0d0bc66d5a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:26.440506 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-96ca4801-0ff7-4f08-aa05-5f7578fad748 req-f4bda359-3935-4cb5-beaa-7c0d0bc66d5a service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Updated VIF entry in instance network info cache for port 53e6eaf0-1553-4cbe-874a-c98dce3a96fd. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:49:26.440981 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-96ca4801-0ff7-4f08-aa05-5f7578fad748 req-f4bda359-3935-4cb5-beaa-7c0d0bc66d5a service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Updating instance_info_cache with network_info: [{"id": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "address": "fa:16:3e:1e:3f:68", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e6eaf0-15", "ovs_interfaceid": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:49:26.445178 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-84beb563-92e4-435b-80f8-2660e70ac43e tempest-VolumesExtendAttachedTest-896639250 tempest-VolumesExtendAttachedTest-896639250-project-member] Lock "6c90d07e-25cd-4d8d-b134-f77a1de1b37a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.034s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:26.504835 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:26.505020 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:26.763364 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:26.776477 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:49:26.776728 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:49:26.945695 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-96ca4801-0ff7-4f08-aa05-5f7578fad748 req-f4bda359-3935-4cb5-beaa-7c0d0bc66d5a service nova] Releasing lock "refresh_cache-e1c00d98-c68b-45cd-b4f6-6c6d62b54290" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:49:26.946058 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-89594d25-31e6-4d6a-9a7e-ba8876b56f12 req-eeaf403d-2bf4-40d9-9e25-65191459c515 service nova] Acquired lock "refresh_cache-e1c00d98-c68b-45cd-b4f6-6c6d62b54290" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:49:26.946242 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-89594d25-31e6-4d6a-9a7e-ba8876b56f12 req-eeaf403d-2bf4-40d9-9e25-65191459c515 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Refreshing network info cache for port 53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:49:27.007182 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Detaching volume 3e80ea54-ae38-4c23-9325-bfe45dfb1d4d
May 19 04:49:27.040819 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Attempting to driver detach volume 3e80ea54-ae38-4c23-9325-bfe45dfb1d4d from mountpoint /dev/vdb
May 19 04:49:27.044827 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Found disk vdb by alias ua-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:49:27.046054 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Found disk vdb by alias ua-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:49:27.046551 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Attempting to detach device vdb from instance e1c00d98-c68b-45cd-b4f6-6c6d62b54290 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:49:27.046775 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:49:27.046775 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:49:27.046775 np0000001025 nova-compute[97981]:   <alias name="ua-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d"/>
May 19 04:49:27.046775 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-1"/>
May 19 04:49:27.046775 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:49:27.046775 np0000001025 nova-compute[97981]:   <serial>3e80ea54-ae38-4c23-9325-bfe45dfb1d4d</serial>
May 19 04:49:27.046775 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 19 04:49:27.046775 np0000001025 nova-compute[97981]: </disk>
May 19 04:49:27.046775 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:49:27.053126 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Successfully detached device vdb from instance e1c00d98-c68b-45cd-b4f6-6c6d62b54290 from the persistent domain config.
May 19 04:49:27.053263 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] (1/8): Attempting to detach device vdb with device alias ua-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d from instance e1c00d98-c68b-45cd-b4f6-6c6d62b54290 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:49:27.053510 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:49:27.053510 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:49:27.053510 np0000001025 nova-compute[97981]:   <alias name="ua-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d"/>
May 19 04:49:27.053510 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-1"/>
May 19 04:49:27.053510 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:49:27.053510 np0000001025 nova-compute[97981]:   <serial>3e80ea54-ae38-4c23-9325-bfe45dfb1d4d</serial>
May 19 04:49:27.053510 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 19 04:49:27.053510 np0000001025 nova-compute[97981]: </disk>
May 19 04:49:27.053510 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:49:27.279046 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:49:27.448503 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-89594d25-31e6-4d6a-9a7e-ba8876b56f12 req-eeaf403d-2bf4-40d9-9e25-65191459c515 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:27.555957 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779166167.5556026, e1c00d98-c68b-45cd-b4f6-6c6d62b54290 => ua-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:49:27.556962 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d for instance e1c00d98-c68b-45cd-b4f6-6c6d62b54290 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:49:27.559092 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Successfully detached device vdb from instance e1c00d98-c68b-45cd-b4f6-6c6d62b54290 from the live domain config.
May 19 04:49:27.560126 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:49:27.560409 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:49:27.560534 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:49:27.560859 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:49:27.561098 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:49:27.561237 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:49:27.582442 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:27.582442 np0000001025 nova-compute[97981]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:27.582442 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:49:27.582659 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsi session list stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:27.582659 np0000001025 nova-compute[97981]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d (non-flash)
May 19 04:49:27.582659 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:49:27.582759 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', '151')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:49:27.582831 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', '150')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:49:27.583501 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d', '151')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:49:27.584090 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185041e3e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d'): ({'sde'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:49:27.584278 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Removing multipathed devices sde, sdb {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:49:27.584482 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Flush multipath device 330000000d6085c62 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:49:27.611902 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:49:27.657438 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:49:27.695976 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-89594d25-31e6-4d6a-9a7e-ba8876b56f12 req-eeaf403d-2bf4-40d9-9e25-65191459c515 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:27.715541 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Checking to see if SCSI volumes sde, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:49:27.715754 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] SCSI volumes sde, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:49:27.716370 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Checking to see if device paths {'sde', 'sdb'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:49:27.727889 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Device paths {'sde', 'sdb'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:49:27.728140 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:49:27.738084 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:27.764218 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 150, target: iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d, portal: 192.168.40.100,3260]
May 19 04:49:27.764218 np0000001025 nova-compute[97981]: Logout of [sid: 150, target: iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d, portal: 192.168.40.100,3260] successful.
May 19 04:49:27.764218 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:27.775832 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:27.785630 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.172s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:27.786042 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:49:27.788958 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:27.810553 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-89594d25-31e6-4d6a-9a7e-ba8876b56f12 req-eeaf403d-2bf4-40d9-9e25-65191459c515 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Updated VIF entry in instance network info cache for port 53e6eaf0-1553-4cbe-874a-c98dce3a96fd. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:49:27.811263 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-89594d25-31e6-4d6a-9a7e-ba8876b56f12 req-eeaf403d-2bf4-40d9-9e25-65191459c515 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Updating instance_info_cache with network_info: [{"id": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "address": "fa:16:3e:1e:3f:68", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e6eaf0-15", "ovs_interfaceid": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:49:27.818299 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 151, target: iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d, portal: 192.168.50.100,3260]
May 19 04:49:27.818299 np0000001025 nova-compute[97981]: Logout of [sid: 151, target: iqn.2023-03.storpool.com:os--volume-3e80ea54-ae38-4c23-9325-bfe45dfb1d4d, portal: 192.168.50.100,3260] successful.
May 19 04:49:27.818299 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:27.828064 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:27.828598 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:49:27.828732 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] <== disconnect_volume: return (268ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:49:27.828856 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:49:28.294783 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:49:28.294783 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:49:28.294783 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:28.294783 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:28.313406 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-89594d25-31e6-4d6a-9a7e-ba8876b56f12 req-eeaf403d-2bf4-40d9-9e25-65191459c515 service nova] Releasing lock "refresh_cache-e1c00d98-c68b-45cd-b4f6-6c6d62b54290" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:49:28.360066 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fd3d5c8cf5c41589ceb1e2a5a9813c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e16e702e1284e7fbba4184913a43de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:49:28.371526 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lazy-loading 'flavor' on Instance uuid e1c00d98-c68b-45cd-b4f6-6c6d62b54290 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:49:28.595514 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:28.795858 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:49:28.798709 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Successfully created port: cd2c3270-7cb1-46d5-9746-c05acbe0d0d1 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:49:29.292219 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Successfully updated port: cd2c3270-7cb1-46d5-9746-c05acbe0d0d1 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:49:29.302021 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:49:29.343651 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2f88e2f7-af86-417a-a917-327ec5f414ba req-86ab281c-ab88-45d8-bef3-22d42ebc3ad4 service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] Received event network-changed-cd2c3270-7cb1-46d5-9746-c05acbe0d0d1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:29.343796 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2f88e2f7-af86-417a-a917-327ec5f414ba req-86ab281c-ab88-45d8-bef3-22d42ebc3ad4 service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] Refreshing instance network info cache due to event network-changed-cd2c3270-7cb1-46d5-9746-c05acbe0d0d1. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:49:29.343979 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2f88e2f7-af86-417a-a917-327ec5f414ba req-86ab281c-ab88-45d8-bef3-22d42ebc3ad4 service nova] Acquiring lock "refresh_cache-54c8f283-1771-4202-836d-df17111dba25" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:49:29.344075 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2f88e2f7-af86-417a-a917-327ec5f414ba req-86ab281c-ab88-45d8-bef3-22d42ebc3ad4 service nova] Acquired lock "refresh_cache-54c8f283-1771-4202-836d-df17111dba25" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:49:29.344212 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2f88e2f7-af86-417a-a917-327ec5f414ba req-86ab281c-ab88-45d8-bef3-22d42ebc3ad4 service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] Refreshing network info cache for port cd2c3270-7cb1-46d5-9746-c05acbe0d0d1 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:49:29.376714 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4dd529e7-5934-4d99-9dd7-10645807af54 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.871s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:29.674818 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:29.794317 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "refresh_cache-54c8f283-1771-4202-836d-df17111dba25" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:49:29.846592 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-2f88e2f7-af86-417a-a917-327ec5f414ba req-86ab281c-ab88-45d8-bef3-22d42ebc3ad4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:29.907296 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2f88e2f7-af86-417a-a917-327ec5f414ba req-86ab281c-ab88-45d8-bef3-22d42ebc3ad4 service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:49:30.033806 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2f88e2f7-af86-417a-a917-327ec5f414ba req-86ab281c-ab88-45d8-bef3-22d42ebc3ad4 service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:49:30.310878 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:49:30.311733 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:49:30.311968 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Creating image(s)
May 19 04:49:30.312388 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "/opt/stack/data/nova/instances/54c8f283-1771-4202-836d-df17111dba25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:30.312529 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "/opt/stack/data/nova/instances/54c8f283-1771-4202-836d-df17111dba25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:30.312991 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "/opt/stack/data/nova/instances/54c8f283-1771-4202-836d-df17111dba25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:30.314393 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:49:30.317354 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:49:30.318664 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:30.412874 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:30.413306 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:30.413831 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:30.414294 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:49:30.417626 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:49:30.417933 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:30.508832 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.090s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:30.509331 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/54c8f283-1771-4202-836d-df17111dba25/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:30.538076 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2f88e2f7-af86-417a-a917-327ec5f414ba req-86ab281c-ab88-45d8-bef3-22d42ebc3ad4 service nova] Releasing lock "refresh_cache-54c8f283-1771-4202-836d-df17111dba25" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:49:30.541576 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquired lock "refresh_cache-54c8f283-1771-4202-836d-df17111dba25" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:49:30.541900 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:49:30.572135 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/54c8f283-1771-4202-836d-df17111dba25/disk 1073741824" returned: 0 in 0.063s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:30.572499 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:30.572810 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:30.677094 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.104s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:30.677513 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Checking if we can resize image /opt/stack/data/nova/instances/54c8f283-1771-4202-836d-df17111dba25/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:49:30.677698 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c8f283-1771-4202-836d-df17111dba25/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:30.781771 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c8f283-1771-4202-836d-df17111dba25/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:30.782658 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Cannot resize image /opt/stack/data/nova/instances/54c8f283-1771-4202-836d-df17111dba25/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:49:30.783068 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:49:30.783643 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Ensure instance console log exists: /opt/stack/data/nova/instances/54c8f283-1771-4202-836d-df17111dba25/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:49:30.783921 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:30.784132 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:30.784263 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:30.846761 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:30.846965 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:30.847219 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:30.847425 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:30.847517 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:30.850368 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Terminating instance
May 19 04:49:31.121749 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:49:31.265287 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:31.298793 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:31.354508 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:49:31.374251 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:31.375870 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:31.391207 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:31.394941 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:31.412473 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:31.418258 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:31.429350 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Updating instance_info_cache with network_info: [{"id": "cd2c3270-7cb1-46d5-9746-c05acbe0d0d1", "address": "fa:16:3e:8f:ee:76", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2c3270-7c", "ovs_interfaceid": "cd2c3270-7cb1-46d5-9746-c05acbe0d0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:49:31.527674 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0003839730002255237 future=<Future at 0x7218340fd490 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:49:31.527870 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:49:31.528010 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=4.723108469000181 future=<Future at 0x7218503b0560 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:49:31.528126 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=4.722997742000189 future=<Future at 0x7218503b0560 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:49:31.529805 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Emitting event <LifecycleEvent: 1779166156.5270443, 3bd17542-9a9b-4bda-80a6-413cb4c2091d => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:49:31.529805 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] VM Stopped (Lifecycle Event)
May 19 04:49:31.599095 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2bd32549-fbbe-4374-9cd0-050af6b9e6a9 req-70e48000-a857-4a3a-9daf-e139d0e5c2bf service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Received event network-vif-unplugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:31.599316 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2bd32549-fbbe-4374-9cd0-050af6b9e6a9 req-70e48000-a857-4a3a-9daf-e139d0e5c2bf service nova] Acquiring lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:31.599475 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2bd32549-fbbe-4374-9cd0-050af6b9e6a9 req-70e48000-a857-4a3a-9daf-e139d0e5c2bf service nova] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:31.599588 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2bd32549-fbbe-4374-9cd0-050af6b9e6a9 req-70e48000-a857-4a3a-9daf-e139d0e5c2bf service nova] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:31.599716 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2bd32549-fbbe-4374-9cd0-050af6b9e6a9 req-70e48000-a857-4a3a-9daf-e139d0e5c2bf service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] No waiting events found dispatching network-vif-unplugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:49:31.599835 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2bd32549-fbbe-4374-9cd0-050af6b9e6a9 req-70e48000-a857-4a3a-9daf-e139d0e5c2bf service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Received event network-vif-unplugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:49:31.659537 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:31.665175 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:31.701247 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.99967541299975 future=<Future at 0x72185042dee0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:49:31.702323 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Instance destroyed successfully.
May 19 04:49:31.703746 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lazy-loading 'resources' on Instance uuid e1c00d98-c68b-45cd-b4f6-6c6d62b54290 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:49:31.764567 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:31.931234 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Releasing lock "refresh_cache-54c8f283-1771-4202-836d-df17111dba25" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:49:31.931491 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Instance network_info: |[{"id": "cd2c3270-7cb1-46d5-9746-c05acbe0d0d1", "address": "fa:16:3e:8f:ee:76", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2c3270-7c", "ovs_interfaceid": "cd2c3270-7cb1-46d5-9746-c05acbe0d0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:49:31.933553 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Start _get_guest_xml network_info=[{"id": "cd2c3270-7cb1-46d5-9746-c05acbe0d0d1", "address": "fa:16:3e:8f:ee:76", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2c3270-7c", "ovs_interfaceid": "cd2c3270-7cb1-46d5-9746-c05acbe0d0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:49:31.939429 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:49:31.940534 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1233666835', uuid='54c8f283-1771-4202-836d-df17111dba25'), owner=OwnerMeta(userid='3fd3d5c8cf5c41589ceb1e2a5a9813c9', username='tempest-AttachVolumeNegativeTest-198121636-project-member', projectid='2e16e702e1284e7fbba4184913a43de7', projectname='tempest-AttachVolumeNegativeTest-198121636'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cd2c3270-7cb1-46d5-9746-c05acbe0d0d1", "address": "fa:16:3e:8f:ee:76", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2c3270-7c", "ovs_interfaceid": "cd2c3270-7cb1-46d5-9746-c05acbe0d0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166171.9402232) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:49:31.942440 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:49:31.942739 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:49:31.944661 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:49:31.944841 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:49:31.945684 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:49:31.945986 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:49:31.946127 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:49:31.946229 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:49:31.946344 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:49:31.946423 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:49:31.946511 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:49:31.946650 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:49:31.946767 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:49:31.946877 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:49:31.946968 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:49:31.947073 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:49:31.959684 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1233666835',display_name='tempest-AttachVolumeNegativeTest-server-1233666835',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumenegativetest-server-1233666835',id=67,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPo1WUSD7wl78kgD4jLX0TNxyTUl/1z0s0J1l70YxuB+IPo585e6APHc5jHiTdjUI/qWVhJDinAGqmsjXJRMasERqMeVA9XD4O0W5rC9bo2pGlFLT9Ld5OesOTQkuaAQwA==',key_name='tempest-keypair-799215441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e16e702e1284e7fbba4184913a43de7',ramdisk_id='',reservation_id='r-zk5531l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-198121636',owner_user_name='tempest-AttachVolumeNegativeTest-198121636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:49:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fd3d5c8cf5c41589ceb1e2a5a9813c9',uuid=54c8f283-1771-4202-836d-df17111dba25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd2c3270-7cb1-46d5-9746-c05acbe0d0d1", "address": "fa:16:3e:8f:ee:76", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2c3270-7c", "ovs_interfaceid": "cd2c3270-7cb1-46d5-9746-c05acbe0d0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:49:31.959923 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converting VIF {"id": "cd2c3270-7cb1-46d5-9746-c05acbe0d0d1", "address": "fa:16:3e:8f:ee:76", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2c3270-7c", "ovs_interfaceid": "cd2c3270-7cb1-46d5-9746-c05acbe0d0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:49:31.960384 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ee:76,bridge_name='br-int',has_traffic_filtering=True,id=cd2c3270-7cb1-46d5-9746-c05acbe0d0d1,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd2c3270-7c') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:49:31.960864 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lazy-loading 'pci_devices' on Instance uuid 54c8f283-1771-4202-836d-df17111dba25 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:49:32.032938 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 3bd17542-9a9b-4bda-80a6-413cb4c2091d] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:49:32.205972 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:48:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1450609139',display_name='tempest-TestMinimumBasicScenario-server-1450609139',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testminimumbasicscenario-server-1450609139',id=63,image_ref='0f9e8183-efda-4ea7-80fb-acb10d593d2d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIB2eolkmA0oGE6NqabyY6MG9iWEJx9Lgf5y0C4v8ioS/wY56vg4wpxKxgtFjyFfgrd7edvEVhStgPFxYsyN7SqG7D8n5QW7cs32maHjoiY+yjq6YaIqG2ghwHVuE5DKg==',key_name='tempest-TestMinimumBasicScenario-315335831',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:48:19Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99f67462305b466bac5791264c17cf14',ramdisk_id='',reservation_id='r-ggcof1af',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0f9e8183-efda-4ea7-80fb-acb10d593d2d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-545024582',owner_user_name='tempest-TestMinimumBasicScenario-545024582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:49:03Z,user_data=None,user_id='5b0cd08b7f014743a849982c90b5bd7a',uuid=e1c00d98-c68b-45cd-b4f6-6c6d62b54290,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "address": "fa:16:3e:1e:3f:68", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e6eaf0-15", "ovs_interfaceid": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:49:32.206337 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Converting VIF {"id": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "address": "fa:16:3e:1e:3f:68", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e6eaf0-15", "ovs_interfaceid": "53e6eaf0-1553-4cbe-874a-c98dce3a96fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:49:32.207087 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=53e6eaf0-1553-4cbe-874a-c98dce3a96fd,network=Network(08400d14-ac42-4046-ae13-082939c8e0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e6eaf0-15') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:49:32.207468 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=53e6eaf0-1553-4cbe-874a-c98dce3a96fd,network=Network(08400d14-ac42-4046-ae13-082939c8e0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e6eaf0-15') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:49:32.211786 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:32.212042 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53e6eaf0-15, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:32.213077 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:32.214019 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:49:32.214208 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:32.214923 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:32.215066 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3edb40e2-6c97-4824-abe8-b2f7a9227424) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:32.215515 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:32.216028 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:49:32.216184 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:32.219264 np0000001025 nova-compute[97981]: INFO os_vif [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=53e6eaf0-1553-4cbe-874a-c98dce3a96fd,network=Network(08400d14-ac42-4046-ae13-082939c8e0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e6eaf0-15')
May 19 04:49:32.219634 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Deleting instance files /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290_del
May 19 04:49:32.220636 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Deletion of /opt/stack/data/nova/instances/e1c00d98-c68b-45cd-b4f6-6c6d62b54290_del complete
May 19 04:49:32.463648 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] End _get_guest_xml xml=<domain type="qemu">
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:   <uuid>54c8f283-1771-4202-836d-df17111dba25</uuid>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:   <name>instance-00000043</name>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1233666835</nova:name>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:49:31</nova:creationTime>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:         <nova:user uuid="3fd3d5c8cf5c41589ceb1e2a5a9813c9">tempest-AttachVolumeNegativeTest-198121636-project-member</nova:user>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:         <nova:project uuid="2e16e702e1284e7fbba4184913a43de7">tempest-AttachVolumeNegativeTest-198121636</nova:project>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:         <nova:port uuid="cd2c3270-7cb1-46d5-9746-c05acbe0d0d1">
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     <system>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <entry name="serial">54c8f283-1771-4202-836d-df17111dba25</entry>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <entry name="uuid">54c8f283-1771-4202-836d-df17111dba25</entry>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     </system>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:   <os>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:   </os>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:   <features>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:   </features>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:   <devices>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/54c8f283-1771-4202-836d-df17111dba25/disk"/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     </disk>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/54c8f283-1771-4202-836d-df17111dba25/disk.config"/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     </disk>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:8f:ee:76"/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <target dev="tapcd2c3270-7c"/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     </interface>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/54c8f283-1771-4202-836d-df17111dba25/console.log" append="off"/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     </serial>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     <video>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     </video>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     </rng>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:   </devices>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]: </domain>
May 19 04:49:32.463648 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:49:32.466499 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Preparing to wait for external event network-vif-plugged-cd2c3270-7cb1-46d5-9746-c05acbe0d0d1 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:49:32.466499 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "54c8f283-1771-4202-836d-df17111dba25-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:32.466499 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "54c8f283-1771-4202-836d-df17111dba25-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:32.466499 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "54c8f283-1771-4202-836d-df17111dba25-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:32.466499 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1233666835',display_name='tempest-AttachVolumeNegativeTest-server-1233666835',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumenegativetest-server-1233666835',id=67,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPo1WUSD7wl78kgD4jLX0TNxyTUl/1z0s0J1l70YxuB+IPo585e6APHc5jHiTdjUI/qWVhJDinAGqmsjXJRMasERqMeVA9XD4O0W5rC9bo2pGlFLT9Ld5OesOTQkuaAQwA==',key_name='tempest-keypair-799215441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e16e702e1284e7fbba4184913a43de7',ramdisk_id='',reservation_id='r-zk5531l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-198121636',owner_user_name='tempest-AttachVolumeNegativeTest-198121636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:49:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fd3d5c8cf5c41589ceb1e2a5a9813c9',uuid=54c8f283-1771-4202-836d-df17111dba25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd2c3270-7cb1-46d5-9746-c05acbe0d0d1", "address": "fa:16:3e:8f:ee:76", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2c3270-7c", "ovs_interfaceid": "cd2c3270-7cb1-46d5-9746-c05acbe0d0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:49:32.466499 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converting VIF {"id": "cd2c3270-7cb1-46d5-9746-c05acbe0d0d1", "address": "fa:16:3e:8f:ee:76", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2c3270-7c", "ovs_interfaceid": "cd2c3270-7cb1-46d5-9746-c05acbe0d0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:49:32.466499 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ee:76,bridge_name='br-int',has_traffic_filtering=True,id=cd2c3270-7cb1-46d5-9746-c05acbe0d0d1,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd2c3270-7c') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:49:32.466812 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ee:76,bridge_name='br-int',has_traffic_filtering=True,id=cd2c3270-7cb1-46d5-9746-c05acbe0d0d1,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd2c3270-7c') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:49:32.466935 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:32.467145 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:32.467528 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:49:32.469168 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:32.469306 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07360406-9d64-57b2-bc84-99496fca26b7', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:32.469932 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:32.470483 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:49:32.470889 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:32.472652 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:32.472774 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd2c3270-7c, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:32.473045 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd2c3270-7c, col_values=(('qos', UUID('a817ce82-2273-41ef-840e-03d3c60f7588')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:32.473204 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd2c3270-7c, col_values=(('external_ids', {'iface-id': 'cd2c3270-7cb1-46d5-9746-c05acbe0d0d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:ee:76', 'vm-uuid': '54c8f283-1771-4202-836d-df17111dba25'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:32.473870 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:32.474930 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:49:32.479498 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:32.480501 np0000001025 nova-compute[97981]: INFO os_vif [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ee:76,bridge_name='br-int',has_traffic_filtering=True,id=cd2c3270-7cb1-46d5-9746-c05acbe0d0d1,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd2c3270-7c')
May 19 04:49:32.726667 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Took 1.37 seconds to destroy the instance on the hypervisor.
May 19 04:49:32.727407 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:49:32.727751 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:49:32.727862 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:49:32.728127 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:32.835742 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:33.059512 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a1be6d08-3921-4be8-8a2c-0451521c97df req-faf62096-4923-4641-86ff-94469593cd63 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Received event network-vif-deleted-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:33.059635 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-a1be6d08-3921-4be8-8a2c-0451521c97df req-faf62096-4923-4641-86ff-94469593cd63 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Neutron deleted interface 53e6eaf0-1553-4cbe-874a-c98dce3a96fd; detaching it from the instance and deleting it from the info cache
May 19 04:49:33.059747 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a1be6d08-3921-4be8-8a2c-0451521c97df req-faf62096-4923-4641-86ff-94469593cd63 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:49:33.518607 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:49:33.564075 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a1be6d08-3921-4be8-8a2c-0451521c97df req-faf62096-4923-4641-86ff-94469593cd63 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Detach interface failed, port_id=53e6eaf0-1553-4cbe-874a-c98dce3a96fd, reason: Instance e1c00d98-c68b-45cd-b4f6-6c6d62b54290 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:49:33.597345 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:33.654968 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5ea9ee94-a317-4abe-97b3-c063e984f06a req-ac12c132-8c65-4500-80dd-eefa25166956 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Received event network-vif-unplugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:33.655719 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5ea9ee94-a317-4abe-97b3-c063e984f06a req-ac12c132-8c65-4500-80dd-eefa25166956 service nova] Acquiring lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:33.655927 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5ea9ee94-a317-4abe-97b3-c063e984f06a req-ac12c132-8c65-4500-80dd-eefa25166956 service nova] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:33.656055 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5ea9ee94-a317-4abe-97b3-c063e984f06a req-ac12c132-8c65-4500-80dd-eefa25166956 service nova] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:33.656243 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5ea9ee94-a317-4abe-97b3-c063e984f06a req-ac12c132-8c65-4500-80dd-eefa25166956 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] No waiting events found dispatching network-vif-unplugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:49:33.656445 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5ea9ee94-a317-4abe-97b3-c063e984f06a req-ac12c132-8c65-4500-80dd-eefa25166956 service nova] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Received event network-vif-unplugged-53e6eaf0-1553-4cbe-874a-c98dce3a96fd for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:49:34.000156 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:49:34.000156 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:49:34.000156 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No VIF found with MAC fa:16:3e:8f:ee:76, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:49:34.000156 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Using config drive
May 19 04:49:34.020325 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Took 1.29 seconds to deallocate network for instance.
May 19 04:49:34.510137 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:34.530041 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:34.530041 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:34.635287 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Creating config drive at /opt/stack/data/nova/instances/54c8f283-1771-4202-836d-df17111dba25/disk.config
May 19 04:49:34.639281 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/54c8f283-1771-4202-836d-df17111dba25/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwmfc76zq {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:34.693746 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/54c8f283-1771-4202-836d-df17111dba25/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwmfc76zq" returned: 0 in 0.054s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:34.749410 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:49:34.749410 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:49:34.877997 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:35.124342 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:35.145155 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:35.147306 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:35.245973 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:35.253035 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:49:35.485395 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:35.489392 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:35.492543 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:35.494627 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:35.512482 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:35.563828 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ba92e5c1-895e-43a4-b073-b1c568a92da2 req-41f7f20d-89e5-461f-9289-f28fcbee2f75 service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] Received event network-vif-plugged-cd2c3270-7cb1-46d5-9746-c05acbe0d0d1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:35.564250 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ba92e5c1-895e-43a4-b073-b1c568a92da2 req-41f7f20d-89e5-461f-9289-f28fcbee2f75 service nova] Acquiring lock "54c8f283-1771-4202-836d-df17111dba25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:35.564499 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ba92e5c1-895e-43a4-b073-b1c568a92da2 req-41f7f20d-89e5-461f-9289-f28fcbee2f75 service nova] Lock "54c8f283-1771-4202-836d-df17111dba25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:35.564673 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ba92e5c1-895e-43a4-b073-b1c568a92da2 req-41f7f20d-89e5-461f-9289-f28fcbee2f75 service nova] Lock "54c8f283-1771-4202-836d-df17111dba25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:35.564819 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ba92e5c1-895e-43a4-b073-b1c568a92da2 req-41f7f20d-89e5-461f-9289-f28fcbee2f75 service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] Processing event network-vif-plugged-cd2c3270-7cb1-46d5-9746-c05acbe0d0d1 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:49:35.761913 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.233s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:35.807643 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Deleted allocations for instance e1c00d98-c68b-45cd-b4f6-6c6d62b54290
May 19 04:49:35.868033 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166175.8675838, 54c8f283-1771-4202-836d-df17111dba25 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:49:35.868182 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 54c8f283-1771-4202-836d-df17111dba25] VM Started (Lifecycle Event)
May 19 04:49:35.869901 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:49:35.872537 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:49:35.874882 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 54c8f283-1771-4202-836d-df17111dba25] Instance spawned successfully.
May 19 04:49:35.875212 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:49:36.251538 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00038641499986624694 future=<Future at 0x7218503b0560 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:49:36.252173 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Emitting event <LifecycleEvent: 1779166161.251054, 6c90d07e-25cd-4d8d-b134-f77a1de1b37a => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:49:36.252366 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:49:36.254501 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] VM Stopped (Lifecycle Event)
May 19 04:49:36.254501 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=10.44819839899992 future=<Future at 0x72185042dee0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:49:36.254501 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=10.448097609999877 future=<Future at 0x72185042dee0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:49:36.370812 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 54c8f283-1771-4202-836d-df17111dba25] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:49:36.372623 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 54c8f283-1771-4202-836d-df17111dba25] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:49:36.381495 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:49:36.381634 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:49:36.381972 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:49:36.382229 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:49:36.382506 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:49:36.382836 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:49:36.755658 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 6c90d07e-25cd-4d8d-b134-f77a1de1b37a] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:49:36.815337 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-604bb436-8094-49c8-adf6-33affd4c7199 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "e1c00d98-c68b-45cd-b4f6-6c6d62b54290" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.968s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:36.874579 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 54c8f283-1771-4202-836d-df17111dba25] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:49:36.874887 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166176.8746762, 54c8f283-1771-4202-836d-df17111dba25 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:49:36.875015 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 54c8f283-1771-4202-836d-df17111dba25] VM Paused (Lifecycle Event)
May 19 04:49:36.888147 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Took 6.58 seconds to spawn the instance on the hypervisor.
May 19 04:49:36.889290 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:49:36.898418 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:37.377311 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 54c8f283-1771-4202-836d-df17111dba25] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:49:37.381633 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166177.3814228, 54c8f283-1771-4202-836d-df17111dba25 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:49:37.381745 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 54c8f283-1771-4202-836d-df17111dba25] VM Resumed (Lifecycle Event)
May 19 04:49:37.396635 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Took 11.84 seconds to build instance.
May 19 04:49:37.482316 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:37.633635 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3fd9955e-abec-4cfb-8d00-dca400e8fca3 req-e7faf7a6-b503-4e4a-8b76-876cc6924820 service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] Received event network-vif-plugged-cd2c3270-7cb1-46d5-9746-c05acbe0d0d1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:37.637025 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3fd9955e-abec-4cfb-8d00-dca400e8fca3 req-e7faf7a6-b503-4e4a-8b76-876cc6924820 service nova] Acquiring lock "54c8f283-1771-4202-836d-df17111dba25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:37.637221 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3fd9955e-abec-4cfb-8d00-dca400e8fca3 req-e7faf7a6-b503-4e4a-8b76-876cc6924820 service nova] Lock "54c8f283-1771-4202-836d-df17111dba25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:37.637339 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3fd9955e-abec-4cfb-8d00-dca400e8fca3 req-e7faf7a6-b503-4e4a-8b76-876cc6924820 service nova] Lock "54c8f283-1771-4202-836d-df17111dba25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:37.637447 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3fd9955e-abec-4cfb-8d00-dca400e8fca3 req-e7faf7a6-b503-4e4a-8b76-876cc6924820 service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] No waiting events found dispatching network-vif-plugged-cd2c3270-7cb1-46d5-9746-c05acbe0d0d1 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:49:37.637577 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-3fd9955e-abec-4cfb-8d00-dca400e8fca3 req-e7faf7a6-b503-4e4a-8b76-876cc6924820 service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] Received unexpected event network-vif-plugged-cd2c3270-7cb1-46d5-9746-c05acbe0d0d1 for instance with vm_state active and task_state None.
May 19 04:49:37.883924 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 54c8f283-1771-4202-836d-df17111dba25] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:49:37.886259 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 54c8f283-1771-4202-836d-df17111dba25] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:49:37.898194 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c3deeaa7-d7c3-45e2-b6f6-1b9ef8326bda tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "54c8f283-1771-4202-836d-df17111dba25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.347s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:38.606330 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c05d3198-b2e0-446e-8013-15740ca338a2 req-b10d38a6-8e70-4aa0-8986-bee1c4115255 service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] Received event network-changed-cd2c3270-7cb1-46d5-9746-c05acbe0d0d1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:38.606705 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c05d3198-b2e0-446e-8013-15740ca338a2 req-b10d38a6-8e70-4aa0-8986-bee1c4115255 service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] Refreshing instance network info cache due to event network-changed-cd2c3270-7cb1-46d5-9746-c05acbe0d0d1. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:49:38.606705 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c05d3198-b2e0-446e-8013-15740ca338a2 req-b10d38a6-8e70-4aa0-8986-bee1c4115255 service nova] Acquiring lock "refresh_cache-54c8f283-1771-4202-836d-df17111dba25" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:49:38.606705 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c05d3198-b2e0-446e-8013-15740ca338a2 req-b10d38a6-8e70-4aa0-8986-bee1c4115255 service nova] Acquired lock "refresh_cache-54c8f283-1771-4202-836d-df17111dba25" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:49:38.606886 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c05d3198-b2e0-446e-8013-15740ca338a2 req-b10d38a6-8e70-4aa0-8986-bee1c4115255 service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] Refreshing network info cache for port cd2c3270-7cb1-46d5-9746-c05acbe0d0d1 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:49:38.609104 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:39.108732 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-c05d3198-b2e0-446e-8013-15740ca338a2 req-b10d38a6-8e70-4aa0-8986-bee1c4115255 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:39.423395 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:39.507548 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-c05d3198-b2e0-446e-8013-15740ca338a2 req-b10d38a6-8e70-4aa0-8986-bee1c4115255 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:39.663483 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c05d3198-b2e0-446e-8013-15740ca338a2 req-b10d38a6-8e70-4aa0-8986-bee1c4115255 service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] Updated VIF entry in instance network info cache for port cd2c3270-7cb1-46d5-9746-c05acbe0d0d1. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:49:39.663870 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c05d3198-b2e0-446e-8013-15740ca338a2 req-b10d38a6-8e70-4aa0-8986-bee1c4115255 service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] Updating instance_info_cache with network_info: [{"id": "cd2c3270-7cb1-46d5-9746-c05acbe0d0d1", "address": "fa:16:3e:8f:ee:76", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2c3270-7c", "ovs_interfaceid": "cd2c3270-7cb1-46d5-9746-c05acbe0d0d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:49:40.165629 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c05d3198-b2e0-446e-8013-15740ca338a2 req-b10d38a6-8e70-4aa0-8986-bee1c4115255 service nova] Releasing lock "refresh_cache-54c8f283-1771-4202-836d-df17111dba25" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:49:40.704052 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "a5adaab6-42dd-473d-95fe-c966eaf93017" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:40.704537 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:41.206399 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:49:41.419798 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:41.752917 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:41.753336 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:41.756313 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:49:41.756409 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Claim successful on node np0000001025
May 19 04:49:42.252123 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:49:42.252372 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:49:42.252553 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:49:42.252720 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:49:42.252927 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:49:42.253172 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.36 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:49:42.484121 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:42.918366 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:49:42.918693 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:49:43.420710 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:49:43.610475 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:43.927234 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.174s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:43.927613 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:49:44.354604 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:44.355089 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:44.432655 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:49:44.432879 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:49:44.433646 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:44.433646 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:44.506533 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b0cd08b7f014743a849982c90b5bd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f67462305b466bac5791264c17cf14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:49:44.614920 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:49:44.615195 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:49:44.857944 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lazy-loading 'flavor' on Instance uuid c39e9766-74e5-49fc-bd3a-aa1400e1458b {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:49:44.870007 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Successfully created port: ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:49:44.935383 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:49:44.971455 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:44.971718 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:45.270202 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Successfully updated port: ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:49:45.347827 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7ab1352d-43f4-404d-81f9-dcfd649481f7 req-38984dd0-fe31-4fc4-a85f-0e0efc8ce331 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Received event network-changed-ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:45.347905 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7ab1352d-43f4-404d-81f9-dcfd649481f7 req-38984dd0-fe31-4fc4-a85f-0e0efc8ce331 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Refreshing instance network info cache due to event network-changed-ef81a86f-9ae0-4139-829c-31d487be0a6f. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:49:45.348407 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7ab1352d-43f4-404d-81f9-dcfd649481f7 req-38984dd0-fe31-4fc4-a85f-0e0efc8ce331 service nova] Acquiring lock "refresh_cache-a5adaab6-42dd-473d-95fe-c966eaf93017" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:49:45.348599 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7ab1352d-43f4-404d-81f9-dcfd649481f7 req-38984dd0-fe31-4fc4-a85f-0e0efc8ce331 service nova] Acquired lock "refresh_cache-a5adaab6-42dd-473d-95fe-c966eaf93017" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:49:45.348763 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-7ab1352d-43f4-404d-81f9-dcfd649481f7 req-38984dd0-fe31-4fc4-a85f-0e0efc8ce331 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Refreshing network info cache for port ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:49:45.361425 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Ignoring supplied device name: /dev/vdb
May 19 04:49:45.438514 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:49:45.473283 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:49:45.610435 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:49:45.610794 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:49:45.772071 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "refresh_cache-a5adaab6-42dd-473d-95fe-c966eaf93017" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:49:45.850655 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-7ab1352d-43f4-404d-81f9-dcfd649481f7 req-38984dd0-fe31-4fc4-a85f-0e0efc8ce331 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:45.865552 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:45.903034 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-7ab1352d-43f4-404d-81f9-dcfd649481f7 req-38984dd0-fe31-4fc4-a85f-0e0efc8ce331 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:49:46.023454 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:46.023836 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:46.026253 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:49:46.026351 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Claim successful on node np0000001025
May 19 04:49:46.030364 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-7ab1352d-43f4-404d-81f9-dcfd649481f7 req-38984dd0-fe31-4fc4-a85f-0e0efc8ce331 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:49:46.446259 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:49:46.447229 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:49:46.447440 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Creating image(s)
May 19 04:49:46.447852 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5adaab6-42dd-473d-95fe-c966eaf93017/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:46.448016 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "/opt/stack/data/nova/instances/a5adaab6-42dd-473d-95fe-c966eaf93017/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:46.448445 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "/opt/stack/data/nova/instances/a5adaab6-42dd-473d-95fe-c966eaf93017/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:46.448649 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "4f0b7ae80be2ba3ecd8b847e661e65d507eaef92" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:46.448948 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "4f0b7ae80be2ba3ecd8b847e661e65d507eaef92" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:46.533585 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7ab1352d-43f4-404d-81f9-dcfd649481f7 req-38984dd0-fe31-4fc4-a85f-0e0efc8ce331 service nova] Releasing lock "refresh_cache-a5adaab6-42dd-473d-95fe-c966eaf93017" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:49:46.533925 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquired lock "refresh_cache-a5adaab6-42dd-473d-95fe-c966eaf93017" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:49:46.534050 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:49:46.617704 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:49:46.618419 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:49:46.618703 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:49:46.701279 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0003389690000403789 future=<Future at 0x72185042dee0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:49:46.701365 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:49:46.701782 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Emitting event <LifecycleEvent: 1779166171.7008314, e1c00d98-c68b-45cd-b4f6-6c6d62b54290 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:49:46.701942 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] VM Stopped (Lifecycle Event)
May 19 04:49:46.889015 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:49:46.892510 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:49:46.892798 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f0b7ae80be2ba3ecd8b847e661e65d507eaef92.part --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:46.919125 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:46.919125 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:46.919125 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Attaching volume 7856517b-4587-4efb-bf9d-b771dbe10335 to /dev/vdb
May 19 04:49:46.956884 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:49:46.966931 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:49:46.985378 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f0b7ae80be2ba3ecd8b847e661e65d507eaef92.part --force-share --output=json" returned: 0 in 0.092s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:46.985698 np0000001025 nova-compute[97981]: DEBUG nova.virt.images [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] c0fc0bc8-8c65-4a6e-959b-a6b2ed62d0be was qcow2, converting to raw {{(pid=97981) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 19 04:49:46.986164 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:46.996924 np0000001025 nova-compute[97981]: DEBUG nova.privsep.utils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97981) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 19 04:49:46.997697 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4f0b7ae80be2ba3ecd8b847e661e65d507eaef92.part /opt/stack/data/nova/instances/_base/4f0b7ae80be2ba3ecd8b847e661e65d507eaef92.converted {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:47.030394 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:49:47.031677 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:49:47.047806 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:49:47.051597 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fe19:9062', 'fe80::b02a:c2ff:fe71:d502', 'fe80::fc16:3eff:fe8f:ee76', 'fe80::c897:1dff:fede:235c'] 
May 19 04:49:47.051597 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:49:47.051597 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:49:47.051597 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:49:47.051597 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Updating existing volume attachment record: 085374ff-c890-4452-9966-db523808d229 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:49:47.133655 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:49:47.166737 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4f0b7ae80be2ba3ecd8b847e661e65d507eaef92.part /opt/stack/data/nova/instances/_base/4f0b7ae80be2ba3ecd8b847e661e65d507eaef92.converted" returned: 0 in 0.169s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:47.171758 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f0b7ae80be2ba3ecd8b847e661e65d507eaef92.converted --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:47.208229 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: e1c00d98-c68b-45cd-b4f6-6c6d62b54290] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:49:47.268349 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f0b7ae80be2ba3ecd8b847e661e65d507eaef92.converted --force-share --output=json" returned: 0 in 0.097s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:47.268882 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "4f0b7ae80be2ba3ecd8b847e661e65d507eaef92" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.820s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:47.269313 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:49:47.271828 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:49:47.273064 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f0b7ae80be2ba3ecd8b847e661e65d507eaef92 --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:47.337830 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:47.351329 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:49:47.351329 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:49:47.366127 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f0b7ae80be2ba3ecd8b847e661e65d507eaef92 --force-share --output=json" returned: 0 in 0.093s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:47.366689 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "4f0b7ae80be2ba3ecd8b847e661e65d507eaef92" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:47.367337 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "4f0b7ae80be2ba3ecd8b847e661e65d507eaef92" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:47.367795 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:49:47.371629 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:49:47.372007 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f0b7ae80be2ba3ecd8b847e661e65d507eaef92 --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:47.458628 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Updating instance_info_cache with network_info: [{"id": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "address": "fa:16:3e:de:92:b6", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef81a86f-9a", "ovs_interfaceid": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:49:47.462678 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f0b7ae80be2ba3ecd8b847e661e65d507eaef92 --force-share --output=json" returned: 0 in 0.090s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:47.462982 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f0b7ae80be2ba3ecd8b847e661e65d507eaef92,backing_fmt=raw /opt/stack/data/nova/instances/a5adaab6-42dd-473d-95fe-c966eaf93017/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:47.486309 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:47.517771 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f0b7ae80be2ba3ecd8b847e661e65d507eaef92,backing_fmt=raw /opt/stack/data/nova/instances/a5adaab6-42dd-473d-95fe-c966eaf93017/disk 1073741824" returned: 0 in 0.055s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:47.518226 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "4f0b7ae80be2ba3ecd8b847e661e65d507eaef92" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.151s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:47.518518 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f0b7ae80be2ba3ecd8b847e661e65d507eaef92 --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:47.605158 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:49:47.605158 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335', 'iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7856517b-4587-4efb-bf9d-b771dbe10335', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:49:47.605158 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:49:47.605158 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:49:47.605158 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335', 'iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7856517b-4587-4efb-bf9d-b771dbe10335', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:49:47.606223 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f0b7ae80be2ba3ecd8b847e661e65d507eaef92 --force-share --output=json" returned: 0 in 0.088s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:47.606632 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5adaab6-42dd-473d-95fe-c966eaf93017/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:49:47.606853 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5adaab6-42dd-473d-95fe-c966eaf93017/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:47.619131 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:49:47.627097 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:49:47.631375 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:49:47.632185 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:49:47.632529 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:49:47.637457 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.009s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:49:47.637671 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:49:47.643889 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:49:47.643889 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:47.651061 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:49:47.651061 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:47.656236 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335] added
May 19 04:49:47.656236 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:49:47.656236 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:49:47.656236 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:49:47.656236 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:49:47.656236 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:49:47.656236 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:47.656414 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:49:47.656662 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0241(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:49:47.656820 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:49:47.664346 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335] added
May 19 04:49:47.664346 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:49:47.664346 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:49:47.664346 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:49:47.664346 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:49:47.664346 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:49:47.664346 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:47.664523 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:49:47.664651 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.027(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:49:47.664774 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:49:47.716747 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5adaab6-42dd-473d-95fe-c966eaf93017/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:47.717120 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Cannot resize image /opt/stack/data/nova/instances/a5adaab6-42dd-473d-95fe-c966eaf93017/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:49:47.717500 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:49:47.717692 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Ensure instance console log exists: /opt/stack/data/nova/instances/a5adaab6-42dd-473d-95fe-c966eaf93017/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:49:47.717947 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:47.718143 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:47.718272 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:47.855283 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:49:47.961822 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Releasing lock "refresh_cache-a5adaab6-42dd-473d-95fe-c966eaf93017" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:49:47.962268 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Instance network_info: |[{"id": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "address": "fa:16:3e:de:92:b6", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef81a86f-9a", "ovs_interfaceid": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:49:47.964339 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Start _get_guest_xml network_info=[{"id": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "address": "fa:16:3e:de:92:b6", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef81a86f-9a", "ovs_interfaceid": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:49:38Z,direct_url=<?>,disk_format='qcow2',id=c0fc0bc8-8c65-4a6e-959b-a6b2ed62d0be,min_disk=0,min_ram=0,name='tempest-scenario-img--2071012198',owner='99f67462305b466bac5791264c17cf14',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:49:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': 'c0fc0bc8-8c65-4a6e-959b-a6b2ed62d0be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:49:47.966491 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:49:47.967703 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='c0fc0bc8-8c65-4a6e-959b-a6b2ed62d0be', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-2059753753', uuid='a5adaab6-42dd-473d-95fe-c966eaf93017'), owner=OwnerMeta(userid='5b0cd08b7f014743a849982c90b5bd7a', username='tempest-TestMinimumBasicScenario-545024582-project-member', projectid='99f67462305b466bac5791264c17cf14', projectname='tempest-TestMinimumBasicScenario-545024582'), image=ImageMeta(id='c0fc0bc8-8c65-4a6e-959b-a6b2ed62d0be', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "address": "fa:16:3e:de:92:b6", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef81a86f-9a", "ovs_interfaceid": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166187.967354) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:49:47.968675 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:49:47.969043 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:49:47.970019 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:49:47.970194 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:49:47.971095 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:49:47.971439 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:49:38Z,direct_url=<?>,disk_format='qcow2',id=c0fc0bc8-8c65-4a6e-959b-a6b2ed62d0be,min_disk=0,min_ram=0,name='tempest-scenario-img--2071012198',owner='99f67462305b466bac5791264c17cf14',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:49:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:49:47.971574 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:49:47.971662 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:49:47.971766 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:49:47.971844 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:49:47.971948 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:49:47.973762 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:49:47.973907 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:49:47.974029 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:49:47.974151 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:49:47.974282 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:49:47.983941 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2059753753',display_name='tempest-TestMinimumBasicScenario-server-2059753753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testminimumbasicscenario-server-2059753753',id=68,image_ref='c0fc0bc8-8c65-4a6e-959b-a6b2ed62d0be',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFE0tBN9GzG6SxVu8Fu506tLSbobMhIXU3ZQscVC7ev5IfJaRf/LHt8reXVUYlxk2Su0V7Y12RRo7FQPS6hBP6bZ7wcxU9dA0kRn68Eo/qjAivZcHXpAp82KVoOZUKgmpg==',key_name='tempest-TestMinimumBasicScenario-1194764858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99f67462305b466bac5791264c17cf14',ramdisk_id='',reservation_id='r-gsi3zt8l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c0fc0bc8-8c65-4a6e-959b-a6b2ed62d0be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-545024582',owner_user_name='tempest-TestMinimumBasicScenario-545024582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:49:45Z,user_data=None,user_id='5b0cd08b7f014743a849982c90b5bd7a',uuid=a5adaab6-42dd-473d-95fe-c966eaf93017,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "address": "fa:16:3e:de:92:b6", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef81a86f-9a", "ovs_interfaceid": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:49:47.984117 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Converting VIF {"id": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "address": "fa:16:3e:de:92:b6", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef81a86f-9a", "ovs_interfaceid": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:49:47.984666 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:92:b6,bridge_name='br-int',has_traffic_filtering=True,id=ef81a86f-9ae0-4139-829c-31d487be0a6f,network=Network(08400d14-ac42-4046-ae13-082939c8e0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef81a86f-9a') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:49:47.985272 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lazy-loading 'pci_devices' on Instance uuid a5adaab6-42dd-473d-95fe-c966eaf93017 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:49:48.139616 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:48.361459 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.338s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:48.361957 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.222s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:48.362232 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:49:48.364384 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:48.364544 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:49:48.487557 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] End _get_guest_xml xml=<domain type="qemu">
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:   <uuid>a5adaab6-42dd-473d-95fe-c966eaf93017</uuid>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:   <name>instance-00000044</name>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestMinimumBasicScenario-server-2059753753</nova:name>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:49:47</nova:creationTime>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <nova:image uuid="c0fc0bc8-8c65-4a6e-959b-a6b2ed62d0be">
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:         <nova:properties/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:         <nova:user uuid="5b0cd08b7f014743a849982c90b5bd7a">tempest-TestMinimumBasicScenario-545024582-project-member</nova:user>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:         <nova:project uuid="99f67462305b466bac5791264c17cf14">tempest-TestMinimumBasicScenario-545024582</nova:project>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="c0fc0bc8-8c65-4a6e-959b-a6b2ed62d0be"/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:         <nova:port uuid="ef81a86f-9ae0-4139-829c-31d487be0a6f">
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     <system>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <entry name="serial">a5adaab6-42dd-473d-95fe-c966eaf93017</entry>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <entry name="uuid">a5adaab6-42dd-473d-95fe-c966eaf93017</entry>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     </system>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:   <os>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:   </os>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:   <features>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:   </features>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:   <devices>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/a5adaab6-42dd-473d-95fe-c966eaf93017/disk"/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     </disk>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/a5adaab6-42dd-473d-95fe-c966eaf93017/disk.config"/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     </disk>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:de:92:b6"/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <target dev="tapef81a86f-9a"/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     </interface>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/a5adaab6-42dd-473d-95fe-c966eaf93017/console.log" append="off"/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     </serial>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     <video>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     </video>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     </rng>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:   </devices>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]: </domain>
May 19 04:49:48.487557 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:49:48.489344 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Preparing to wait for external event network-vif-plugged-ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:49:48.489344 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:48.489344 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:48.489344 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:48.489344 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2059753753',display_name='tempest-TestMinimumBasicScenario-server-2059753753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testminimumbasicscenario-server-2059753753',id=68,image_ref='c0fc0bc8-8c65-4a6e-959b-a6b2ed62d0be',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFE0tBN9GzG6SxVu8Fu506tLSbobMhIXU3ZQscVC7ev5IfJaRf/LHt8reXVUYlxk2Su0V7Y12RRo7FQPS6hBP6bZ7wcxU9dA0kRn68Eo/qjAivZcHXpAp82KVoOZUKgmpg==',key_name='tempest-TestMinimumBasicScenario-1194764858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99f67462305b466bac5791264c17cf14',ramdisk_id='',reservation_id='r-gsi3zt8l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c0fc0bc8-8c65-4a6e-959b-a6b2ed62d0be',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-545024582',owner_user_name='tempest-TestMinimumBasicScenario-545024582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:49:45Z,user_data=None,user_id='5b0cd08b7f014743a849982c90b5bd7a',uuid=a5adaab6-42dd-473d-95fe-c966eaf93017,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "address": "fa:16:3e:de:92:b6", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef81a86f-9a", "ovs_interfaceid": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:49:48.489344 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Converting VIF {"id": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "address": "fa:16:3e:de:92:b6", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef81a86f-9a", "ovs_interfaceid": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:49:48.489648 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:92:b6,bridge_name='br-int',has_traffic_filtering=True,id=ef81a86f-9ae0-4139-829c-31d487be0a6f,network=Network(08400d14-ac42-4046-ae13-082939c8e0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef81a86f-9a') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:49:48.489648 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:92:b6,bridge_name='br-int',has_traffic_filtering=True,id=ef81a86f-9ae0-4139-829c-31d487be0a6f,network=Network(08400d14-ac42-4046-ae13-082939c8e0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef81a86f-9a') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:49:48.489909 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:48.490209 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:48.490479 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:49:48.491057 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:48.491218 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5bc0b967-f308-5351-8f0f-a2579ce992a3', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:48.500392 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:48.501319 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:49:48.502989 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:48.503118 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef81a86f-9a, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:48.503386 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef81a86f-9a, col_values=(('qos', UUID('2d76062f-a934-454b-9c3b-85a399b46570')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:48.503549 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef81a86f-9a, col_values=(('external_ids', {'iface-id': 'ef81a86f-9ae0-4139-829c-31d487be0a6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:92:b6', 'vm-uuid': 'a5adaab6-42dd-473d-95fe-c966eaf93017'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:48.504212 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:48.505362 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:49:48.508947 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:48.509610 np0000001025 nova-compute[97981]: INFO os_vif [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:92:b6,bridge_name='br-int',has_traffic_filtering=True,id=ef81a86f-9ae0-4139-829c-31d487be0a6f,network=Network(08400d14-ac42-4046-ae13-082939c8e0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef81a86f-9a')
May 19 04:49:48.611304 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:48.657318 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:49:48.665174 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:49:48.670391 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:49:48.670391 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:49:48.675994 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:49:48.675994 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:48.681252 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:48.687263 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:48.692072 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 19 04:49:48.692072 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:49:48.692236 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 19 04:49:48.692236 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:49:48.692284 np0000001025 nova-compute[97981]: WARNING os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 19 04:49:48.692284 np0000001025 nova-compute[97981]: 
May 19 04:49:48.697429 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 19 04:49:48.697429 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:49:48.697586 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 19 04:49:48.697586 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:49:48.697717 np0000001025 nova-compute[97981]: WARNING os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 19 04:49:48.697717 np0000001025 nova-compute[97981]: 
May 19 04:49:48.868637 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:49:48.868878 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:49:48.869312 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:48.869591 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:48.946563 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eafa3940f19346c8b574aa03335a0528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16b1deed8084634b3a8120ef6795f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:49:49.337765 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Successfully created port: 692f80db-61ab-40d0-8f40-0e6bf8a2cdf5 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:49:49.370529 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:49:49.385034 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c8f283-1771-4202-836d-df17111dba25/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:49.473422 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c8f283-1771-4202-836d-df17111dba25/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:49.473849 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c8f283-1771-4202-836d-df17111dba25/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:49.561482 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c8f283-1771-4202-836d-df17111dba25/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:49.566515 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c39e9766-74e5-49fc-bd3a-aa1400e1458b/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:49.659928 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c39e9766-74e5-49fc-bd3a-aa1400e1458b/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:49.660537 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c39e9766-74e5-49fc-bd3a-aa1400e1458b/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:49.720697 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335, portal: 192.168.40.100,3260]
May 19 04:49:49.720697 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335, portal: 192.168.40.100,3260] successful.
May 19 04:49:49.720697 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:49.726438 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335, portal: 192.168.50.100,3260]
May 19 04:49:49.726438 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335, portal: 192.168.50.100,3260] successful.
May 19 04:49:49.726438 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:49.732598 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:49.739169 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:49.747920 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:49.747920 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:49.747920 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:49:49.747920 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:49.747920 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:49.747920 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:49:49.747920 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.115s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:49:49.747920 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:49:49.747920 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] HCTL ('7', '-', '-', 0) found on session 154 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:49:49.747920 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:49:49.754390 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Successfully updated port: 692f80db-61ab-40d0-8f40-0e6bf8a2cdf5 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:49:49.757040 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:49.757040 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:49.757040 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:49:49.757693 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c39e9766-74e5-49fc-bd3a-aa1400e1458b/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:49.758684 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:49.758684 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:49.758684 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:49:49.758684 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.121s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:49:49.758684 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:49:49.759289 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] HCTL ('8', '-', '-', 0) found on session 155 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:49:49.759394 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:49:49.764926 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:49:49.764926 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:49.785049 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Searching for a device in session 154 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:49:49.785049 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7856517b-4587-4efb-bf9d-b771dbe10335', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:49:49.785463 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Searching for a device in session 155 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:49:49.785632 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7856517b-4587-4efb-bf9d-b771dbe10335', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:49:49.808783 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-66860e8e-4601-4cc9-82a1-74fd0846314c req-86f28eb8-4e2c-4971-b2c4-8476f1272f48 service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Received event network-changed-692f80db-61ab-40d0-8f40-0e6bf8a2cdf5 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:49.810062 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-66860e8e-4601-4cc9-82a1-74fd0846314c req-86f28eb8-4e2c-4971-b2c4-8476f1272f48 service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Refreshing instance network info cache due to event network-changed-692f80db-61ab-40d0-8f40-0e6bf8a2cdf5. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:49:49.810308 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-66860e8e-4601-4cc9-82a1-74fd0846314c req-86f28eb8-4e2c-4971-b2c4-8476f1272f48 service nova] Acquiring lock "refresh_cache-9c2a46cb-f9b2-4c34-a041-2bda0bc64051" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:49:49.810393 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-66860e8e-4601-4cc9-82a1-74fd0846314c req-86f28eb8-4e2c-4971-b2c4-8476f1272f48 service nova] Acquired lock "refresh_cache-9c2a46cb-f9b2-4c34-a041-2bda0bc64051" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:49:49.810513 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-66860e8e-4601-4cc9-82a1-74fd0846314c req-86f28eb8-4e2c-4971-b2c4-8476f1272f48 service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Refreshing network info cache for port 692f80db-61ab-40d0-8f40-0e6bf8a2cdf5 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:49:49.815167 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:49.815322 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=13613MB free_disk=72.78451156616211GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:49:49.815440 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:49.815614 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:49.873378 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:49:50.024730 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:49:50.024860 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:49:50.024938 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] No VIF found with MAC fa:16:3e:de:92:b6, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:49:50.025363 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Using config drive
May 19 04:49:50.258234 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "refresh_cache-9c2a46cb-f9b2-4c34-a041-2bda0bc64051" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:49:50.312564 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-66860e8e-4601-4cc9-82a1-74fd0846314c req-86f28eb8-4e2c-4971-b2c4-8476f1272f48 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:50.374540 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-66860e8e-4601-4cc9-82a1-74fd0846314c req-86f28eb8-4e2c-4971-b2c4-8476f1272f48 service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:49:50.377728 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Booting with volume ba8032c3-139a-415e-a854-4c627e2b5553 at /dev/vda
May 19 04:49:50.420095 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:49:50.430767 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:49:50.448249 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:50.490942 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:49:50.491329 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:49:50.500015 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:49:50.501501 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fe19:9062', 'fe80::b02a:c2ff:fe71:d502', 'fe80::fc16:3eff:fe8f:ee76', 'fe80::c897:1dff:fede:235c'] 
May 19 04:49:50.501694 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:49:50.501853 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:49:50.502230 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:49:50.502556 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Updating existing volume attachment record: 7bb3ecb0-0d9d-4f3c-b8a7-84955e28317d {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:49:50.516663 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-66860e8e-4601-4cc9-82a1-74fd0846314c req-86f28eb8-4e2c-4971-b2c4-8476f1272f48 service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:49:50.533815 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:50.632875 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:49:50.660547 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Creating config drive at /opt/stack/data/nova/instances/a5adaab6-42dd-473d-95fe-c966eaf93017/disk.config
May 19 04:49:50.663751 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a5adaab6-42dd-473d-95fe-c966eaf93017/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmkzxvnet {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:50.715416 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a5adaab6-42dd-473d-95fe-c966eaf93017/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmkzxvnet" returned: 0 in 0.051s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:50.868569 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance c39e9766-74e5-49fc-bd3a-aa1400e1458b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:49:50.868705 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 54c8f283-1771-4202-836d-df17111dba25 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:49:50.868816 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance a5adaab6-42dd-473d-95fe-c966eaf93017 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:49:50.868930 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 9c2a46cb-f9b2-4c34-a041-2bda0bc64051 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:49:50.869126 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:49:50.869340 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:49:49 up 40 min,  2 users,  load average: 3.42, 4.72, 4.06\n', 'num_instances': '4', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '4', 'num_proj_ec4a48491cc047108747a22e8c63c3ac': '1', 'io_workload': '2', 'num_proj_2e16e702e1284e7fbba4184913a43de7': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_99f67462305b466bac5791264c17cf14': '1', 'num_task_networking': '1', 'num_proj_d16b1deed8084634b3a8120ef6795f34': '1'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:49:50.884292 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:49:51.021438 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-66860e8e-4601-4cc9-82a1-74fd0846314c req-86f28eb8-4e2c-4971-b2c4-8476f1272f48 service nova] Releasing lock "refresh_cache-9c2a46cb-f9b2-4c34-a041-2bda0bc64051" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:49:51.021915 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquired lock "refresh_cache-9c2a46cb-f9b2-4c34-a041-2bda0bc64051" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:49:51.022122 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:49:51.081457 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:49:51.081649 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:49:51.106293 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:51.128420 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:51.232199 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:51.295726 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4d7ca714-7d1b-431c-9eb4-eb1ea2667f21 req-1470fee7-e82c-427b-858b-2be0a7bca4fc service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Received event network-vif-plugged-ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:51.296026 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4d7ca714-7d1b-431c-9eb4-eb1ea2667f21 req-1470fee7-e82c-427b-858b-2be0a7bca4fc service nova] Acquiring lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:51.296309 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4d7ca714-7d1b-431c-9eb4-eb1ea2667f21 req-1470fee7-e82c-427b-858b-2be0a7bca4fc service nova] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:51.296518 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4d7ca714-7d1b-431c-9eb4-eb1ea2667f21 req-1470fee7-e82c-427b-858b-2be0a7bca4fc service nova] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:51.296721 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4d7ca714-7d1b-431c-9eb4-eb1ea2667f21 req-1470fee7-e82c-427b-858b-2be0a7bca4fc service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Processing event network-vif-plugged-ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:49:51.433611 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:51.437098 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:51.457727 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:51.579069 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:49:51.584509 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:49:51.648303 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Found WWN 330000000b8d07993 for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:49:51.648828 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.044s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:49:51.649038 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] <== connect_volume: return (4044ms) {'type': 'block', 'scsi_wwn': '330000000b8d07993', 'path': '/dev/dm-0', 'multipath_id': '330000000b8d07993'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:49:51.649322 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b8d07993', 'path': '/dev/dm-0', 'multipath_id': '330000000b8d07993'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:49:51.652683 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lazy-loading 'flavor' on Instance uuid c39e9766-74e5-49fc-bd3a-aa1400e1458b {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:49:51.722605 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:51.828373 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166191.827929, a5adaab6-42dd-473d-95fe-c966eaf93017 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:49:51.829003 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:49:51.829470 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] VM Started (Lifecycle Event)
May 19 04:49:51.831168 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:49:51.833699 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Instance spawned successfully.
May 19 04:49:51.834033 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:49:51.854633 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Updating instance_info_cache with network_info: [{"id": "692f80db-61ab-40d0-8f40-0e6bf8a2cdf5", "address": "fa:16:3e:c1:94:ac", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap692f80db-61", "ovs_interfaceid": "692f80db-61ab-40d0-8f40-0e6bf8a2cdf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:49:52.093601 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:49:52.093774 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.278s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:52.094180 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:49:52.155711 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Attempting to attach volume 7856517b-4587-4efb-bf9d-b771dbe10335 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:49:52.156964 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:49:52.156964 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:49:52.156964 np0000001025 nova-compute[97981]:   <alias name="ua-7856517b-4587-4efb-bf9d-b771dbe10335"/>
May 19 04:49:52.156964 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:49:52.156964 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:49:52.156964 np0000001025 nova-compute[97981]:   <serial>7856517b-4587-4efb-bf9d-b771dbe10335</serial>
May 19 04:49:52.156964 np0000001025 nova-compute[97981]: </disk>
May 19 04:49:52.156964 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:49:52.332987 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:49:52.338459 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:49:52.340164 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:49:52.340305 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:49:52.340578 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:49:52.340798 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:49:52.341103 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:49:52.341380 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:49:52.356512 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Releasing lock "refresh_cache-9c2a46cb-f9b2-4c34-a041-2bda0bc64051" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:49:52.356837 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Instance network_info: |[{"id": "692f80db-61ab-40d0-8f40-0e6bf8a2cdf5", "address": "fa:16:3e:c1:94:ac", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap692f80db-61", "ovs_interfaceid": "692f80db-61ab-40d0-8f40-0e6bf8a2cdf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:49:52.605545 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:49:52.606603 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:49:52.606867 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Creating image(s)
May 19 04:49:52.607197 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:49:52.607331 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Ensure instance console log exists: /opt/stack/data/nova/instances/9c2a46cb-f9b2-4c34-a041-2bda0bc64051/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:49:52.607541 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:52.607676 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:52.607806 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:52.608403 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Start _get_guest_xml network_info=[{"id": "692f80db-61ab-40d0-8f40-0e6bf8a2cdf5", "address": "fa:16:3e:c1:94:ac", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap692f80db-61", "ovs_interfaceid": "692f80db-61ab-40d0-8f40-0e6bf8a2cdf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '7bb3ecb0-0d9d-4f3c-b8a7-84955e28317d', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba8032c3-139a-415e-a854-4c627e2b5553', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9c2a46cb-f9b2-4c34-a041-2bda0bc64051', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba8032c3-139a-415e-a854-4c627e2b5553', 'serial': 'ba8032c3-139a-415e-a854-4c627e2b5553'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:49:52.610333 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:49:52.611268 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-1200456181', uuid='9c2a46cb-f9b2-4c34-a041-2bda0bc64051'), owner=OwnerMeta(userid='eafa3940f19346c8b574aa03335a0528', username='tempest-TestVolumeBootPatternV346-1959285151-project-member', projectid='d16b1deed8084634b3a8120ef6795f34', projectname='tempest-TestVolumeBootPatternV346-1959285151'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "692f80db-61ab-40d0-8f40-0e6bf8a2cdf5", "address": "fa:16:3e:c1:94:ac", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap692f80db-61", "ovs_interfaceid": "692f80db-61ab-40d0-8f40-0e6bf8a2cdf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166192.6109645) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:49:52.612246 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:49:52.612592 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:49:52.613429 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:49:52.613597 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:49:52.614544 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:49:52.614871 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:49:52.615079 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:49:52.615233 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:49:52.615389 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:49:52.615511 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:49:52.615640 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:49:52.615824 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:49:52.615967 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:49:52.616076 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:49:52.616214 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:49:52.616329 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:49:52.626498 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:49:52.626808 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba8032c3-139a-415e-a854-4c627e2b5553', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:49:52.626978 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:49:52.627448 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:49:52.627637 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba8032c3-139a-415e-a854-4c627e2b5553', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:49:52.639186 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:49:52.639760 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:49:52.640223 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:49:52.640413 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:49:52.640676 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:49:52.640827 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:49:52.653614 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:49:52.653614 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:52.654141 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:49:52.654141 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:52.664804 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553] added
May 19 04:49:52.664804 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:49:52.664804 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:49:52.664804 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:49:52.664804 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:49:52.664804 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:49:52.664804 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:52.665150 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:49:52.665150 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0246(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:49:52.665252 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:49:52.668926 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553] added
May 19 04:49:52.668926 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:49:52.668926 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:49:52.668926 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:49:52.668926 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:49:52.668926 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:49:52.668926 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:52.669134 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:49:52.669505 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0284(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:49:52.669505 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:49:52.845355 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:49:52.846953 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Took 6.40 seconds to spawn the instance on the hypervisor.
May 19 04:49:52.847173 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:49:52.847466 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166192.8472989, a5adaab6-42dd-473d-95fe-c966eaf93017 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:49:52.847580 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] VM Paused (Lifecycle Event)
May 19 04:49:53.349725 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:49:53.351649 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166193.3513918, a5adaab6-42dd-473d-95fe-c966eaf93017 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:49:53.351773 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] VM Resumed (Lifecycle Event)
May 19 04:49:53.358340 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Took 11.65 seconds to build instance.
May 19 04:49:53.374337 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fd8d11de-96c7-4efa-93e0-4e78c8c23cdb req-159a51d1-3986-4ecb-a533-5798502758b8 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Received event network-vif-plugged-ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:53.374504 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fd8d11de-96c7-4efa-93e0-4e78c8c23cdb req-159a51d1-3986-4ecb-a533-5798502758b8 service nova] Acquiring lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:53.374659 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fd8d11de-96c7-4efa-93e0-4e78c8c23cdb req-159a51d1-3986-4ecb-a533-5798502758b8 service nova] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:53.374774 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-fd8d11de-96c7-4efa-93e0-4e78c8c23cdb req-159a51d1-3986-4ecb-a533-5798502758b8 service nova] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:53.374882 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-fd8d11de-96c7-4efa-93e0-4e78c8c23cdb req-159a51d1-3986-4ecb-a533-5798502758b8 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] No waiting events found dispatching network-vif-plugged-ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:49:53.375005 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-fd8d11de-96c7-4efa-93e0-4e78c8c23cdb req-159a51d1-3986-4ecb-a533-5798502758b8 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Received unexpected event network-vif-plugged-ef81a86f-9ae0-4139-829c-31d487be0a6f for instance with vm_state active and task_state None.
May 19 04:49:53.505123 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:53.612383 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:53.665600 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:49:53.669885 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:49:53.677652 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:49:53.677652 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:49:53.683592 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:49:53.683592 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:53.689128 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:53.695622 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:53.701470 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:53.701470 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:53.701470 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:49:53.701608 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:53.701608 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:53.701608 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:49:53.708751 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:53.708751 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:53.708751 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:49:53.708899 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:53.708899 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:53.708899 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:49:53.731031 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553, portal: 192.168.40.100,3260]
May 19 04:49:53.731031 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553, portal: 192.168.40.100,3260] successful.
May 19 04:49:53.731031 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:53.744064 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:53.755907 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553, portal: 192.168.50.100,3260]
May 19 04:49:53.755907 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553, portal: 192.168.50.100,3260] successful.
May 19 04:49:53.755907 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:53.761284 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:53.761284 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:53.761284 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:49:53.761284 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:49:53.761284 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:49:53.761464 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:53.761464 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:53.761464 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:49:53.761464 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:49:53.761464 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:49:53.761661 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.121s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:49:53.761772 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:49:53.762466 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] HCTL ('9', '-', '-', 0) found on session 156 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:49:53.762559 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:49:53.770298 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:53.779262 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Searching for a device in session 156 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:49:53.779262 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba8032c3-139a-415e-a854-4c627e2b5553', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:49:53.789597 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:53.789597 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:53.789597 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:49:53.789597 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:49:53.789597 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:49:53.789753 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:53.789753 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:49:53.789753 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:49:53.789753 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:49:53.789753 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:49:53.790007 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:49:53.790093 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:49:53.790668 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] HCTL ('10', '-', '-', 0) found on session 157 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:49:53.790763 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:49:53.807549 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Searching for a device in session 157 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:49:53.807549 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ba8032c3-139a-415e-a854-4c627e2b5553', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:49:53.807549 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:49:53.807549 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:49:53.807549 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:49:53.807549 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] No VIF found with MAC fa:16:3e:19:90:62, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:49:53.858662 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:49:53.861547 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:49:53.866572 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c90528bb-5f98-4011-aeb9-10bbcdf54e71 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.160s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:54.640989 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:49:55.364727 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d5cfb329-ebca-4f01-bf79-526d76708205 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.446s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:55.670155 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Found WWN 330000000c8523fa1 for multipath device dm-1 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:49:55.670562 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:49:55.670708 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] <== connect_volume: return (3043ms) {'type': 'block', 'scsi_wwn': '330000000c8523fa1', 'path': '/dev/dm-1', 'multipath_id': '330000000c8523fa1'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:49:55.670900 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c8523fa1', 'path': '/dev/dm-1', 'multipath_id': '330000000c8523fa1'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:49:55.734975 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "a5adaab6-42dd-473d-95fe-c966eaf93017" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:55.735326 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:56.176228 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:49:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1200456181',display_name='tempest-TestVolumeBootPatternV346-server-1200456181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpatternv346-server-1200456181',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYZqiv3dqislx5kGihScnnnlvE9m1bfjtN8S86vxi3TzHNUoRNlM9NWwD3SJ3yNbf83hAmFkM0jNfDoM2jKDTbGOHIvlJqKEJ94hJRj5FSbH/P7IaTzsOU0+2RaWRW8Kg==',key_name='tempest-keypair-1600845828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d16b1deed8084634b3a8120ef6795f34',ramdisk_id='',reservation_id='r-1nxk54v4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1959285151',owner_user_name='tempest-TestVolumeBootPatternV346-1959285151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:49:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eafa3940f19346c8b574aa03335a0528',uuid=9c2a46cb-f9b2-4c34-a041-2bda0bc64051,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "692f80db-61ab-40d0-8f40-0e6bf8a2cdf5", "address": "fa:16:3e:c1:94:ac", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap692f80db-61", "ovs_interfaceid": "692f80db-61ab-40d0-8f40-0e6bf8a2cdf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:49:56.176466 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Converting VIF {"id": "692f80db-61ab-40d0-8f40-0e6bf8a2cdf5", "address": "fa:16:3e:c1:94:ac", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap692f80db-61", "ovs_interfaceid": "692f80db-61ab-40d0-8f40-0e6bf8a2cdf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:49:56.176916 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:94:ac,bridge_name='br-int',has_traffic_filtering=True,id=692f80db-61ab-40d0-8f40-0e6bf8a2cdf5,network=Network(2bd74629-3dde-4be7-94c2-1550e25e2dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap692f80db-61') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:49:56.177476 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c2a46cb-f9b2-4c34-a041-2bda0bc64051 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:49:56.237997 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lazy-loading 'flavor' on Instance uuid a5adaab6-42dd-473d-95fe-c966eaf93017 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:49:56.680480 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] End _get_guest_xml xml=<domain type="qemu">
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:   <uuid>9c2a46cb-f9b2-4c34-a041-2bda0bc64051</uuid>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:   <name>instance-00000045</name>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestVolumeBootPatternV346-server-1200456181</nova:name>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:49:52</nova:creationTime>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:         <nova:user uuid="eafa3940f19346c8b574aa03335a0528">tempest-TestVolumeBootPatternV346-1959285151-project-member</nova:user>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:         <nova:project uuid="d16b1deed8084634b3a8120ef6795f34">tempest-TestVolumeBootPatternV346-1959285151</nova:project>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:         <nova:port uuid="692f80db-61ab-40d0-8f40-0e6bf8a2cdf5">
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     <system>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <entry name="serial">9c2a46cb-f9b2-4c34-a041-2bda0bc64051</entry>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <entry name="uuid">9c2a46cb-f9b2-4c34-a041-2bda0bc64051</entry>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     </system>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:   <os>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:   </os>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:   <features>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:   </features>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:   <devices>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/9c2a46cb-f9b2-4c34-a041-2bda0bc64051/disk.config"/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     </disk>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <alias name="ua-ba8032c3-139a-415e-a854-4c627e2b5553"/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-1"/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <serial>ba8032c3-139a-415e-a854-4c627e2b5553</serial>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     </disk>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:c1:94:ac"/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <target dev="tap692f80db-61"/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     </interface>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/9c2a46cb-f9b2-4c34-a041-2bda0bc64051/console.log" append="off"/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     </serial>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     <video>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     </video>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     </rng>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:   </devices>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]: </domain>
May 19 04:49:56.680480 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:49:56.684748 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Preparing to wait for external event network-vif-plugged-692f80db-61ab-40d0-8f40-0e6bf8a2cdf5 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:49:56.684748 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:56.684748 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:56.684748 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:56.684748 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:49:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1200456181',display_name='tempest-TestVolumeBootPatternV346-server-1200456181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpatternv346-server-1200456181',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYZqiv3dqislx5kGihScnnnlvE9m1bfjtN8S86vxi3TzHNUoRNlM9NWwD3SJ3yNbf83hAmFkM0jNfDoM2jKDTbGOHIvlJqKEJ94hJRj5FSbH/P7IaTzsOU0+2RaWRW8Kg==',key_name='tempest-keypair-1600845828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d16b1deed8084634b3a8120ef6795f34',ramdisk_id='',reservation_id='r-1nxk54v4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1959285151',owner_user_name='tempest-TestVolumeBootPatternV346-1959285151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:49:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eafa3940f19346c8b574aa03335a0528',uuid=9c2a46cb-f9b2-4c34-a041-2bda0bc64051,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "692f80db-61ab-40d0-8f40-0e6bf8a2cdf5", "address": "fa:16:3e:c1:94:ac", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap692f80db-61", "ovs_interfaceid": "692f80db-61ab-40d0-8f40-0e6bf8a2cdf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:49:56.684748 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Converting VIF {"id": "692f80db-61ab-40d0-8f40-0e6bf8a2cdf5", "address": "fa:16:3e:c1:94:ac", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap692f80db-61", "ovs_interfaceid": "692f80db-61ab-40d0-8f40-0e6bf8a2cdf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:49:56.684748 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:94:ac,bridge_name='br-int',has_traffic_filtering=True,id=692f80db-61ab-40d0-8f40-0e6bf8a2cdf5,network=Network(2bd74629-3dde-4be7-94c2-1550e25e2dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap692f80db-61') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:49:56.684748 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:94:ac,bridge_name='br-int',has_traffic_filtering=True,id=692f80db-61ab-40d0-8f40-0e6bf8a2cdf5,network=Network(2bd74629-3dde-4be7-94c2-1550e25e2dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap692f80db-61') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:49:56.684748 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:56.684748 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:56.685328 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:49:56.685535 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:56.685699 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7138c2e9-0650-5db4-84a4-de1c26f3087f', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:56.686491 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:56.687060 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:49:56.687492 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:56.689323 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:56.689459 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap692f80db-61, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:56.689739 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap692f80db-61, col_values=(('qos', UUID('1bd95d1a-a9b0-4bde-a26b-9e11983f482a')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:56.689879 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap692f80db-61, col_values=(('external_ids', {'iface-id': '692f80db-61ab-40d0-8f40-0e6bf8a2cdf5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:94:ac', 'vm-uuid': '9c2a46cb-f9b2-4c34-a041-2bda0bc64051'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:49:56.690779 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:56.691835 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:49:56.697699 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:56.698648 np0000001025 nova-compute[97981]: INFO os_vif [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:94:ac,bridge_name='br-int',has_traffic_filtering=True,id=692f80db-61ab-40d0-8f40-0e6bf8a2cdf5,network=Network(2bd74629-3dde-4be7-94c2-1550e25e2dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap692f80db-61')
May 19 04:49:57.242733 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:58.213194 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:49:58.213624 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:49:58.213624 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] No VIF found with MAC fa:16:3e:c1:94:ac, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:49:58.213788 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Using config drive
May 19 04:49:58.307693 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "a5adaab6-42dd-473d-95fe-c966eaf93017" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:58.307890 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:58.308122 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Attaching volume 9328036a-2364-4858-be9d-91de09d2a47e to /dev/vdb
May 19 04:49:58.342531 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:49:58.354611 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:49:58.379102 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:58.489492 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:49:58.489699 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:49:58.509514 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:49:58.510539 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fe19:9062', 'fe80::b02a:c2ff:fe71:d502', 'fe80::fc16:3eff:fe8f:ee76', 'fe80::c897:1dff:fede:235c', 'fe80::fc16:3eff:fede:92b6', 'fe80::1c08:7bff:fe57:c536'] 
May 19 04:49:58.510680 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:49:58.510782 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:49:58.511042 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:49:58.511289 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Updating existing volume attachment record: e41340f0-c5a3-407f-a155-a80cc63d5126 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:49:58.624871 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:58.721197 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:49:58.832434 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Creating config drive at /opt/stack/data/nova/instances/9c2a46cb-f9b2-4c34-a041-2bda0bc64051/disk.config
May 19 04:49:58.836538 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9c2a46cb-f9b2-4c34-a041-2bda0bc64051/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf5dx5sa0 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:49:58.888665 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9c2a46cb-f9b2-4c34-a041-2bda0bc64051/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf5dx5sa0" returned: 0 in 0.052s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:49:59.061053 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:49:59.061430 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e', 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9328036a-2364-4858-be9d-91de09d2a47e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:49:59.061589 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:49:59.062051 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:49:59.062212 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e', 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9328036a-2364-4858-be9d-91de09d2a47e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:49:59.090408 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:49:59.091173 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:49:59.091618 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:49:59.091807 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:49:59.092257 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:49:59.092431 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:49:59.104717 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:49:59.104717 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:59.108798 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:49:59.108798 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:59.115679 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e] added
May 19 04:49:59.115679 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:49:59.115679 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:49:59.115679 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:49:59.115679 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:49:59.115679 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:49:59.115679 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:59.118185 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:49:59.118185 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0242(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:49:59.118185 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:49:59.123505 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e] added
May 19 04:49:59.123505 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:49:59.123505 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:49:59.123505 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:49:59.123505 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:49:59.123505 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:49:59.123505 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:49:59.123740 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:49:59.123811 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0314(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:49:59.123939 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:49:59.362667 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:59.387247 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:59.474417 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:59.546161 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d7091ead-a244-43af-bb2e-1fff8e4affb7 req-ed0ecab9-9fcd-484c-a3a3-eb6fbb628422 service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Received event network-vif-plugged-692f80db-61ab-40d0-8f40-0e6bf8a2cdf5 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:49:59.548573 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d7091ead-a244-43af-bb2e-1fff8e4affb7 req-ed0ecab9-9fcd-484c-a3a3-eb6fbb628422 service nova] Acquiring lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:49:59.548816 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d7091ead-a244-43af-bb2e-1fff8e4affb7 req-ed0ecab9-9fcd-484c-a3a3-eb6fbb628422 service nova] Lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:49:59.549907 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d7091ead-a244-43af-bb2e-1fff8e4affb7 req-ed0ecab9-9fcd-484c-a3a3-eb6fbb628422 service nova] Lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:49:59.550270 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d7091ead-a244-43af-bb2e-1fff8e4affb7 req-ed0ecab9-9fcd-484c-a3a3-eb6fbb628422 service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Processing event network-vif-plugged-692f80db-61ab-40d0-8f40-0e6bf8a2cdf5 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:49:59.704062 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:59.706435 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:59.708284 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:49:59.731275 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:00.116655 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:50:00.124495 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:50:00.130207 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:50:00.130207 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:50:00.137749 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:50:00.137749 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:00.142886 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:00.143543 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:50:00.144351 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166200.144002, 9c2a46cb-f9b2-4c34-a041-2bda0bc64051 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:50:00.144787 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] VM Started (Lifecycle Event)
May 19 04:50:00.146795 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:50:00.150062 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:00.155774 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Instance spawned successfully.
May 19 04:50:00.156490 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:50:00.160343 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:00.160343 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:00.160343 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:00.160343 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:00.160343 np0000001025 nova-compute[97981]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e38d45d7-bf16-42dc-a878-47e5d5d9b19a (non-flash)
May 19 04:50:00.160343 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:50:00.160592 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:00.160592 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:00.160592 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:00.160592 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:00.160592 np0000001025 nova-compute[97981]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e38d45d7-bf16-42dc-a878-47e5d5d9b19a (non-flash)
May 19 04:50:00.160592 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:50:00.172134 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:00.172134 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:00.172134 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:00.172134 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:00.172134 np0000001025 nova-compute[97981]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e38d45d7-bf16-42dc-a878-47e5d5d9b19a (non-flash)
May 19 04:50:00.172134 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:50:00.172134 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:00.172134 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:00.172134 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:00.172134 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:00.172134 np0000001025 nova-compute[97981]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e38d45d7-bf16-42dc-a878-47e5d5d9b19a (non-flash)
May 19 04:50:00.172134 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:50:00.201613 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e, portal: 192.168.40.100,3260]
May 19 04:50:00.201613 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e, portal: 192.168.40.100,3260] successful.
May 19 04:50:00.201613 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:00.209161 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e, portal: 192.168.50.100,3260]
May 19 04:50:00.209161 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e, portal: 192.168.50.100,3260] successful.
May 19 04:50:00.209161 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:00.216421 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:00.225679 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:00.236810 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:00.236810 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:00.236810 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:00.236810 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:00.236810 np0000001025 nova-compute[97981]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e38d45d7-bf16-42dc-a878-47e5d5d9b19a (non-flash)
May 19 04:50:00.236810 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:00.236810 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:00.236810 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:50:00.237033 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:00.237033 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:00.237033 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:00.237033 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:00.237033 np0000001025 nova-compute[97981]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e38d45d7-bf16-42dc-a878-47e5d5d9b19a (non-flash)
May 19 04:50:00.237033 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:00.237033 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:00.237033 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:50:00.237288 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:50:00.237410 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:50:00.238219 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] HCTL ('12', '-', '-', 0) found on session 159 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:50:00.238326 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:50:00.244686 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:00.244686 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:00.244686 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:00.244686 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:00.244686 np0000001025 nova-compute[97981]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e38d45d7-bf16-42dc-a878-47e5d5d9b19a (non-flash)
May 19 04:50:00.244686 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:00.244686 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:00.244686 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:50:00.244686 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:00.244686 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:00.244686 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:00.244686 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:00.244686 np0000001025 nova-compute[97981]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e38d45d7-bf16-42dc-a878-47e5d5d9b19a (non-flash)
May 19 04:50:00.244686 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:00.244686 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:00.244686 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:50:00.244686 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:50:00.244686 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:50:00.246250 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] HCTL ('13', '-', '-', 0) found on session 160 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:50:00.246466 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:50:00.268362 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Searching for a device in session 159 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:50:00.268362 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9328036a-2364-4858-be9d-91de09d2a47e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:50:00.270256 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Searching for a device in session 160 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:50:00.270542 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9328036a-2364-4858-be9d-91de09d2a47e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:50:00.649402 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:50:00.651680 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:50:00.665979 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:50:00.665979 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:50:00.665979 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:50:00.665979 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:50:00.666639 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:50:00.667270 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:50:01.092889 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:50:01.154399 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:50:01.154626 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166201.1544182, 9c2a46cb-f9b2-4c34-a041-2bda0bc64051 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:50:01.154786 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] VM Paused (Lifecycle Event)
May 19 04:50:01.172166 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Took 8.57 seconds to spawn the instance on the hypervisor.
May 19 04:50:01.172272 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:50:01.626457 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-89cc31e7-ef8c-4d3f-bc3c-c88ee5ee9714 req-70655cd1-6b71-47bf-a9f2-2a6b382cea5a service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Received event network-vif-plugged-692f80db-61ab-40d0-8f40-0e6bf8a2cdf5 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:50:01.626631 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-89cc31e7-ef8c-4d3f-bc3c-c88ee5ee9714 req-70655cd1-6b71-47bf-a9f2-2a6b382cea5a service nova] Acquiring lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:01.626787 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-89cc31e7-ef8c-4d3f-bc3c-c88ee5ee9714 req-70655cd1-6b71-47bf-a9f2-2a6b382cea5a service nova] Lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:01.626897 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-89cc31e7-ef8c-4d3f-bc3c-c88ee5ee9714 req-70655cd1-6b71-47bf-a9f2-2a6b382cea5a service nova] Lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:01.630132 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-89cc31e7-ef8c-4d3f-bc3c-c88ee5ee9714 req-70655cd1-6b71-47bf-a9f2-2a6b382cea5a service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] No waiting events found dispatching network-vif-plugged-692f80db-61ab-40d0-8f40-0e6bf8a2cdf5 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:50:01.630132 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-89cc31e7-ef8c-4d3f-bc3c-c88ee5ee9714 req-70655cd1-6b71-47bf-a9f2-2a6b382cea5a service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Received unexpected event network-vif-plugged-692f80db-61ab-40d0-8f40-0e6bf8a2cdf5 for instance with vm_state active and task_state None.
May 19 04:50:01.657331 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:50:01.660036 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166201.659775, 9c2a46cb-f9b2-4c34-a041-2bda0bc64051 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:50:01.660258 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] VM Resumed (Lifecycle Event)
May 19 04:50:01.682841 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Took 15.71 seconds to build instance.
May 19 04:50:01.692169 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:02.024699 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "54c8f283-1771-4202-836d-df17111dba25" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:02.025606 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "54c8f283-1771-4202-836d-df17111dba25" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:02.108512 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Found WWN 3300000007f5efac0 for multipath device dm-4 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:50:02.108756 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:50:02.109015 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] <== connect_volume: return (3047ms) {'type': 'block', 'scsi_wwn': '3300000007f5efac0', 'path': '/dev/dm-4', 'multipath_id': '3300000007f5efac0'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:50:02.109191 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007f5efac0', 'path': '/dev/dm-4', 'multipath_id': '3300000007f5efac0'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:50:02.111290 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lazy-loading 'flavor' on Instance uuid a5adaab6-42dd-473d-95fe-c966eaf93017 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:50:02.162516 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:50:02.164414 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:50:02.184486 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d2b6e015-433c-4f16-b1ff-f4e97b94d9bb tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.213s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:02.528881 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lazy-loading 'flavor' on Instance uuid 54c8f283-1771-4202-836d-df17111dba25 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:50:02.614340 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Attempting to attach volume 9328036a-2364-4858-be9d-91de09d2a47e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:50:02.615937 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:50:02.615937 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:50:02.615937 np0000001025 nova-compute[97981]:   <alias name="ua-9328036a-2364-4858-be9d-91de09d2a47e"/>
May 19 04:50:02.615937 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-4"/>
May 19 04:50:02.615937 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:50:02.615937 np0000001025 nova-compute[97981]:   <serial>9328036a-2364-4858-be9d-91de09d2a47e</serial>
May 19 04:50:02.615937 np0000001025 nova-compute[97981]: </disk>
May 19 04:50:02.615937 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:50:03.535856 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "54c8f283-1771-4202-836d-df17111dba25" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:03.626627 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:03.715906 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d2662475-c8fe-4c4b-9ed4-54bdde21a9b5 req-99b51d48-ea79-441e-b51c-08ec35402991 service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Received event network-changed-692f80db-61ab-40d0-8f40-0e6bf8a2cdf5 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:50:03.716041 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d2662475-c8fe-4c4b-9ed4-54bdde21a9b5 req-99b51d48-ea79-441e-b51c-08ec35402991 service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Refreshing instance network info cache due to event network-changed-692f80db-61ab-40d0-8f40-0e6bf8a2cdf5. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:50:03.716260 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d2662475-c8fe-4c4b-9ed4-54bdde21a9b5 req-99b51d48-ea79-441e-b51c-08ec35402991 service nova] Acquiring lock "refresh_cache-9c2a46cb-f9b2-4c34-a041-2bda0bc64051" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:50:03.716413 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d2662475-c8fe-4c4b-9ed4-54bdde21a9b5 req-99b51d48-ea79-441e-b51c-08ec35402991 service nova] Acquired lock "refresh_cache-9c2a46cb-f9b2-4c34-a041-2bda0bc64051" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:50:03.716558 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d2662475-c8fe-4c4b-9ed4-54bdde21a9b5 req-99b51d48-ea79-441e-b51c-08ec35402991 service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Refreshing network info cache for port 692f80db-61ab-40d0-8f40-0e6bf8a2cdf5 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:50:04.219809 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-d2662475-c8fe-4c4b-9ed4-54bdde21a9b5 req-99b51d48-ea79-441e-b51c-08ec35402991 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:04.286177 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:50:04.286343 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:50:04.286417 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:50:04.286559 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] No VIF found with MAC fa:16:3e:de:92:b6, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:50:04.532181 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-d2662475-c8fe-4c4b-9ed4-54bdde21a9b5 req-99b51d48-ea79-441e-b51c-08ec35402991 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:04.634163 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "54c8f283-1771-4202-836d-df17111dba25" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:04.634611 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "54c8f283-1771-4202-836d-df17111dba25" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:04.634611 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Attaching volume 3a3fd0a2-d022-4f28-b150-0138c57586e7 to /dev/vdb
May 19 04:50:04.686480 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d2662475-c8fe-4c4b-9ed4-54bdde21a9b5 req-99b51d48-ea79-441e-b51c-08ec35402991 service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Updated VIF entry in instance network info cache for port 692f80db-61ab-40d0-8f40-0e6bf8a2cdf5. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:50:04.686717 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d2662475-c8fe-4c4b-9ed4-54bdde21a9b5 req-99b51d48-ea79-441e-b51c-08ec35402991 service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Updating instance_info_cache with network_info: [{"id": "692f80db-61ab-40d0-8f40-0e6bf8a2cdf5", "address": "fa:16:3e:c1:94:ac", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap692f80db-61", "ovs_interfaceid": "692f80db-61ab-40d0-8f40-0e6bf8a2cdf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:50:04.690484 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:50:04.702413 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:50:04.726616 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:50:04.770868 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:50:04.771195 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:50:04.779518 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:50:04.780571 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fe19:9062', 'fe80::b02a:c2ff:fe71:d502', 'fe80::fc16:3eff:fe8f:ee76', 'fe80::c897:1dff:fede:235c', 'fe80::fc16:3eff:fede:92b6', 'fe80::1c08:7bff:fe57:c536', 'fe80::fc16:3eff:fec1:94ac', 'fe80::8c0d:8ff:fec2:525c'] 
May 19 04:50:04.780678 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:50:04.780749 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:50:04.780991 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:50:04.781282 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Updating existing volume attachment record: eb2a4c8a-3a13-4fa0-8f83-adfd3e2be486 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:50:05.190473 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d2662475-c8fe-4c4b-9ed4-54bdde21a9b5 req-99b51d48-ea79-441e-b51c-08ec35402991 service nova] Releasing lock "refresh_cache-9c2a46cb-f9b2-4c34-a041-2bda0bc64051" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:50:05.347335 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:50:05.347746 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7', 'iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a3fd0a2-d022-4f28-b150-0138c57586e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:50:05.347930 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:50:05.348473 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:50:05.348738 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7', 'iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a3fd0a2-d022-4f28-b150-0138c57586e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:50:05.363574 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:50:05.364380 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:50:05.364844 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:50:05.365116 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:50:05.365467 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:50:05.366172 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:50:05.380290 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:50:05.380290 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:05.386253 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:50:05.386253 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:05.395330 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7] added
May 19 04:50:05.395330 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:50:05.395330 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:50:05.395330 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:50:05.395330 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:50:05.395330 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:50:05.395330 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:05.395614 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:50:05.395746 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0306(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:50:05.395946 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:50:05.399201 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7] added
May 19 04:50:05.399201 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:50:05.399201 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:50:05.399201 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:50:05.399201 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:50:05.399201 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:50:05.399201 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:05.399201 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:50:05.399201 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0331(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:50:05.399201 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:50:05.848656 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-772bf1f2-be9f-4175-b445-d5b00df5cd06 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.541s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:06.396529 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:50:06.400261 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:50:06.410145 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:50:06.410145 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:50:06.419990 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:50:06.419990 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:06.426573 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:06.434794 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:06.449411 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:06.449411 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:06.449411 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:06.449411 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:06.449411 np0000001025 nova-compute[97981]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e38d45d7-bf16-42dc-a878-47e5d5d9b19a (non-flash)
May 19 04:50:06.449411 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:06.449411 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:06.449411 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:50:06.449662 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:06.449662 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:06.449662 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:06.449662 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:06.449662 np0000001025 nova-compute[97981]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e38d45d7-bf16-42dc-a878-47e5d5d9b19a (non-flash)
May 19 04:50:06.449662 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:06.449662 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:06.449662 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:50:06.453197 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:06.453197 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:06.453197 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:06.453197 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:06.453197 np0000001025 nova-compute[97981]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e38d45d7-bf16-42dc-a878-47e5d5d9b19a (non-flash)
May 19 04:50:06.453197 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:06.453197 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:06.453197 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:50:06.453378 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:06.453378 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:06.453378 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:06.453378 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:06.453378 np0000001025 nova-compute[97981]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e38d45d7-bf16-42dc-a878-47e5d5d9b19a (non-flash)
May 19 04:50:06.453378 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:06.453378 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:06.453378 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:50:06.493832 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7, portal: 192.168.40.100,3260]
May 19 04:50:06.493832 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7, portal: 192.168.40.100,3260] successful.
May 19 04:50:06.493832 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:06.505917 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:06.506265 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7, portal: 192.168.50.100,3260]
May 19 04:50:06.506265 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7, portal: 192.168.50.100,3260] successful.
May 19 04:50:06.506265 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:06.522274 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:06.522274 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:06.522274 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:06.522274 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:06.522274 np0000001025 nova-compute[97981]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e38d45d7-bf16-42dc-a878-47e5d5d9b19a (non-flash)
May 19 04:50:06.522274 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:06.522274 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:06.522274 np0000001025 nova-compute[97981]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7 (non-flash)
May 19 04:50:06.522274 np0000001025 nova-compute[97981]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7 (non-flash)
May 19 04:50:06.522274 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:50:06.522595 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:06.522595 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:06.522595 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:06.522595 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:06.522595 np0000001025 nova-compute[97981]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e38d45d7-bf16-42dc-a878-47e5d5d9b19a (non-flash)
May 19 04:50:06.522595 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:06.522595 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:06.522595 np0000001025 nova-compute[97981]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7 (non-flash)
May 19 04:50:06.522595 np0000001025 nova-compute[97981]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7 (non-flash)
May 19 04:50:06.522595 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:50:06.522781 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:50:06.522892 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:50:06.523347 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:06.524515 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] HCTL ('14', '-', '-', 0) found on session 161 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:50:06.524640 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:50:06.541709 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Searching for a device in session 161 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:50:06.541709 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a3fd0a2-d022-4f28-b150-0138c57586e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:50:06.544938 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:06.544938 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:06.544938 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:06.544938 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:06.544938 np0000001025 nova-compute[97981]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e38d45d7-bf16-42dc-a878-47e5d5d9b19a (non-flash)
May 19 04:50:06.544938 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:06.544938 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:06.544938 np0000001025 nova-compute[97981]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7 (non-flash)
May 19 04:50:06.544938 np0000001025 nova-compute[97981]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7 (non-flash)
May 19 04:50:06.544938 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:50:06.545384 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:06.545384 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:06.545384 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:06.545384 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:06.545384 np0000001025 nova-compute[97981]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e38d45d7-bf16-42dc-a878-47e5d5d9b19a (non-flash)
May 19 04:50:06.545384 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:06.545384 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:06.545384 np0000001025 nova-compute[97981]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7 (non-flash)
May 19 04:50:06.545384 np0000001025 nova-compute[97981]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7 (non-flash)
May 19 04:50:06.545384 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:50:06.545384 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:50:06.545620 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:50:06.546383 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] HCTL ('15', '-', '-', 0) found on session 162 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:50:06.546512 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:50:06.558952 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Searching for a device in session 162 and hctl ['15', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:50:06.696259 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:07.036319 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d8170299-cc8b-4e53-bfd5-80cedfa52e98 req-592e17c6-82fa-4940-9707-a2c2df62affa service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Received event network-changed-ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:50:07.036777 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d8170299-cc8b-4e53-bfd5-80cedfa52e98 req-592e17c6-82fa-4940-9707-a2c2df62affa service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Refreshing instance network info cache due to event network-changed-ef81a86f-9ae0-4139-829c-31d487be0a6f. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:50:07.036777 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d8170299-cc8b-4e53-bfd5-80cedfa52e98 req-592e17c6-82fa-4940-9707-a2c2df62affa service nova] Acquiring lock "refresh_cache-a5adaab6-42dd-473d-95fe-c966eaf93017" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:50:07.036777 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d8170299-cc8b-4e53-bfd5-80cedfa52e98 req-592e17c6-82fa-4940-9707-a2c2df62affa service nova] Acquired lock "refresh_cache-a5adaab6-42dd-473d-95fe-c966eaf93017" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:50:07.036990 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d8170299-cc8b-4e53-bfd5-80cedfa52e98 req-592e17c6-82fa-4940-9707-a2c2df62affa service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Refreshing network info cache for port ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:50:07.540895 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-d8170299-cc8b-4e53-bfd5-80cedfa52e98 req-592e17c6-82fa-4940-9707-a2c2df62affa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:07.561909 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Searching for a device in session 162 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:50:07.562119 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3a3fd0a2-d022-4f28-b150-0138c57586e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:50:07.905868 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-d8170299-cc8b-4e53-bfd5-80cedfa52e98 req-592e17c6-82fa-4940-9707-a2c2df62affa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:08.050075 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d8170299-cc8b-4e53-bfd5-80cedfa52e98 req-592e17c6-82fa-4940-9707-a2c2df62affa service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Updated VIF entry in instance network info cache for port ef81a86f-9ae0-4139-829c-31d487be0a6f. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:50:08.050528 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d8170299-cc8b-4e53-bfd5-80cedfa52e98 req-592e17c6-82fa-4940-9707-a2c2df62affa service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Updating instance_info_cache with network_info: [{"id": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "address": "fa:16:3e:de:92:b6", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef81a86f-9a", "ovs_interfaceid": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:50:08.389377 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Found WWN 3300000003b0fee8a for multipath device dm-5 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:50:08.389827 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:50:08.389908 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '3300000003b0fee8a', 'path': '/dev/dm-5', 'multipath_id': '3300000003b0fee8a'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:50:08.390005 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003b0fee8a', 'path': '/dev/dm-5', 'multipath_id': '3300000003b0fee8a'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:50:08.393052 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lazy-loading 'flavor' on Instance uuid 54c8f283-1771-4202-836d-df17111dba25 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:50:08.553557 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d8170299-cc8b-4e53-bfd5-80cedfa52e98 req-592e17c6-82fa-4940-9707-a2c2df62affa service nova] Releasing lock "refresh_cache-a5adaab6-42dd-473d-95fe-c966eaf93017" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:50:08.628266 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:08.896253 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Attempting to attach volume 3a3fd0a2-d022-4f28-b150-0138c57586e7 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:50:08.897482 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:50:08.897482 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:50:08.897482 np0000001025 nova-compute[97981]:   <alias name="ua-3a3fd0a2-d022-4f28-b150-0138c57586e7"/>
May 19 04:50:08.897482 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-5"/>
May 19 04:50:08.897482 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:50:08.897482 np0000001025 nova-compute[97981]:   <serial>3a3fd0a2-d022-4f28-b150-0138c57586e7</serial>
May 19 04:50:08.897482 np0000001025 nova-compute[97981]: </disk>
May 19 04:50:08.897482 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:50:09.089131 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5c8b8ae9-e3ad-4017-adf2-651aa26b8920 req-a410c13f-65e9-4b72-ad1e-a88febcf681e service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Received event network-changed-ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:50:09.089131 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5c8b8ae9-e3ad-4017-adf2-651aa26b8920 req-a410c13f-65e9-4b72-ad1e-a88febcf681e service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Refreshing instance network info cache due to event network-changed-ef81a86f-9ae0-4139-829c-31d487be0a6f. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:50:09.089131 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5c8b8ae9-e3ad-4017-adf2-651aa26b8920 req-a410c13f-65e9-4b72-ad1e-a88febcf681e service nova] Acquiring lock "refresh_cache-a5adaab6-42dd-473d-95fe-c966eaf93017" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:50:09.089131 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5c8b8ae9-e3ad-4017-adf2-651aa26b8920 req-a410c13f-65e9-4b72-ad1e-a88febcf681e service nova] Acquired lock "refresh_cache-a5adaab6-42dd-473d-95fe-c966eaf93017" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:50:09.089131 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5c8b8ae9-e3ad-4017-adf2-651aa26b8920 req-a410c13f-65e9-4b72-ad1e-a88febcf681e service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Refreshing network info cache for port ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:50:09.590345 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-5c8b8ae9-e3ad-4017-adf2-651aa26b8920 req-a410c13f-65e9-4b72-ad1e-a88febcf681e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:09.881583 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-5c8b8ae9-e3ad-4017-adf2-651aa26b8920 req-a410c13f-65e9-4b72-ad1e-a88febcf681e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:10.012128 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5c8b8ae9-e3ad-4017-adf2-651aa26b8920 req-a410c13f-65e9-4b72-ad1e-a88febcf681e service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Updated VIF entry in instance network info cache for port ef81a86f-9ae0-4139-829c-31d487be0a6f. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:50:10.012413 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5c8b8ae9-e3ad-4017-adf2-651aa26b8920 req-a410c13f-65e9-4b72-ad1e-a88febcf681e service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Updating instance_info_cache with network_info: [{"id": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "address": "fa:16:3e:de:92:b6", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef81a86f-9a", "ovs_interfaceid": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:50:10.514300 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5c8b8ae9-e3ad-4017-adf2-651aa26b8920 req-a410c13f-65e9-4b72-ad1e-a88febcf681e service nova] Releasing lock "refresh_cache-a5adaab6-42dd-473d-95fe-c966eaf93017" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:50:10.544865 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:50:10.545014 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:50:10.545200 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:50:10.545309 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No VIF found with MAC fa:16:3e:8f:ee:76, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:50:11.696075 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:12.083866 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4a24ded1-d147-481e-9a3c-70f58dd9a519 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "54c8f283-1771-4202-836d-df17111dba25" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.449s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:12.551534 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "54c8f283-1771-4202-836d-df17111dba25" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:12.551722 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "54c8f283-1771-4202-836d-df17111dba25" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:13.054302 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Detaching volume 3a3fd0a2-d022-4f28-b150-0138c57586e7
May 19 04:50:13.094921 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Attempting to driver detach volume 3a3fd0a2-d022-4f28-b150-0138c57586e7 from mountpoint /dev/vdb
May 19 04:50:13.099640 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Found disk vdb by alias ua-3a3fd0a2-d022-4f28-b150-0138c57586e7 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:50:13.100834 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Found disk vdb by alias ua-3a3fd0a2-d022-4f28-b150-0138c57586e7 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:50:13.100972 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Attempting to detach device vdb from instance 54c8f283-1771-4202-836d-df17111dba25 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:50:13.101263 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:50:13.101263 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:50:13.101263 np0000001025 nova-compute[97981]:   <alias name="ua-3a3fd0a2-d022-4f28-b150-0138c57586e7"/>
May 19 04:50:13.101263 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-5"/>
May 19 04:50:13.101263 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:50:13.101263 np0000001025 nova-compute[97981]:   <serial>3a3fd0a2-d022-4f28-b150-0138c57586e7</serial>
May 19 04:50:13.101263 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:50:13.101263 np0000001025 nova-compute[97981]: </disk>
May 19 04:50:13.101263 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:50:13.108508 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Successfully detached device vdb from instance 54c8f283-1771-4202-836d-df17111dba25 from the persistent domain config.
May 19 04:50:13.108665 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] (1/8): Attempting to detach device vdb with device alias ua-3a3fd0a2-d022-4f28-b150-0138c57586e7 from instance 54c8f283-1771-4202-836d-df17111dba25 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:50:13.108968 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:50:13.108968 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:50:13.108968 np0000001025 nova-compute[97981]:   <alias name="ua-3a3fd0a2-d022-4f28-b150-0138c57586e7"/>
May 19 04:50:13.108968 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-5"/>
May 19 04:50:13.108968 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:50:13.108968 np0000001025 nova-compute[97981]:   <serial>3a3fd0a2-d022-4f28-b150-0138c57586e7</serial>
May 19 04:50:13.108968 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:50:13.108968 np0000001025 nova-compute[97981]: </disk>
May 19 04:50:13.108968 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:50:13.623122 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779166213.622741, 54c8f283-1771-4202-836d-df17111dba25 => ua-3a3fd0a2-d022-4f28-b150-0138c57586e7> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:50:13.623972 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3a3fd0a2-d022-4f28-b150-0138c57586e7 for instance 54c8f283-1771-4202-836d-df17111dba25 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:50:13.626176 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Successfully detached device vdb from instance 54c8f283-1771-4202-836d-df17111dba25 from the live domain config.
May 19 04:50:13.627316 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:50:13.627631 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7', 'iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a3fd0a2-d022-4f28-b150-0138c57586e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:50:13.627750 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:50:13.629147 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:15.481646 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.854s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:50:15.481986 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7', 'iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a3fd0a2-d022-4f28-b150-0138c57586e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:50:15.482175 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:50:15.507523 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:15.507523 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:15.507523 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:15.507523 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:15.507523 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:15.507523 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:15.507523 np0000001025 nova-compute[97981]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7 (non-flash)
May 19 04:50:15.507523 np0000001025 nova-compute[97981]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7 (non-flash)
May 19 04:50:15.507523 np0000001025 nova-compute[97981]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e33053a-d5d5-4caa-a5a8-63060aa8f472 (non-flash)
May 19 04:50:15.507523 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:50:15.507982 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:15.507982 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:15.507982 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:15.507982 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:15.507982 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:15.507982 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:15.507982 np0000001025 nova-compute[97981]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7 (non-flash)
May 19 04:50:15.507982 np0000001025 nova-compute[97981]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7 (non-flash)
May 19 04:50:15.507982 np0000001025 nova-compute[97981]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e33053a-d5d5-4caa-a5a8-63060aa8f472 (non-flash)
May 19 04:50:15.507982 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:50:15.508250 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335', '154'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335', '155'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', '156'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e33053a-d5d5-4caa-a5a8-63060aa8f472', '163')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:50:15.508358 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7', '161')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:50:15.509272 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7', '162')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:50:15.510011 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721834486e80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7'): ({'sdj'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:50:15.510266 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Removing multipathed devices sdj, sdi {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:50:15.510485 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Flush multipath device 3300000003b0fee8a {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:50:15.546182 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:50:15.597743 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:50:15.638399 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Checking to see if SCSI volumes sdj, sdi have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:50:15.638581 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] SCSI volumes sdj, sdi have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:50:15.639561 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Checking to see if device paths {'sdj', 'sdi'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:50:15.650588 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Device paths {'sdj', 'sdi'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:50:15.650776 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:50:15.663304 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:15.695339 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 161, target: iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7, portal: 192.168.40.100,3260]
May 19 04:50:15.695339 np0000001025 nova-compute[97981]: Logout of [sid: 161, target: iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7, portal: 192.168.40.100,3260] successful.
May 19 04:50:15.695339 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:15.713634 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:15.725741 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:15.763306 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 162, target: iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7, portal: 192.168.50.100,3260]
May 19 04:50:15.763306 np0000001025 nova-compute[97981]: Logout of [sid: 162, target: iqn.2023-03.storpool.com:os--volume-3a3fd0a2-d022-4f28-b150-0138c57586e7, portal: 192.168.50.100,3260] successful.
May 19 04:50:15.763306 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:15.780601 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:15.780888 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:50:15.781092 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] <== disconnect_volume: return (2153ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:50:15.781289 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:50:16.325448 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lazy-loading 'flavor' on Instance uuid 54c8f283-1771-4202-836d-df17111dba25 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:50:16.699291 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:17.331792 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-8ef67267-b3e2-49b2-bcb1-096f60b6ea44 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "54c8f283-1771-4202-836d-df17111dba25" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.780s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:17.868991 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "54c8f283-1771-4202-836d-df17111dba25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:17.869384 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "54c8f283-1771-4202-836d-df17111dba25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:17.869509 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "54c8f283-1771-4202-836d-df17111dba25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:17.869697 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "54c8f283-1771-4202-836d-df17111dba25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:17.869867 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "54c8f283-1771-4202-836d-df17111dba25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:17.873183 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Terminating instance
May 19 04:50:18.376844 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:50:18.413326 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:18.436015 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:18.441001 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:18.474342 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:18.553029 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7ae24f3b-357e-4add-8213-bcd261a13303 req-d4039b23-c379-4d2c-9763-b62461632d1a service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] Received event network-vif-unplugged-cd2c3270-7cb1-46d5-9746-c05acbe0d0d1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:50:18.553258 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7ae24f3b-357e-4add-8213-bcd261a13303 req-d4039b23-c379-4d2c-9763-b62461632d1a service nova] Acquiring lock "54c8f283-1771-4202-836d-df17111dba25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:18.553439 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7ae24f3b-357e-4add-8213-bcd261a13303 req-d4039b23-c379-4d2c-9763-b62461632d1a service nova] Lock "54c8f283-1771-4202-836d-df17111dba25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:18.553576 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7ae24f3b-357e-4add-8213-bcd261a13303 req-d4039b23-c379-4d2c-9763-b62461632d1a service nova] Lock "54c8f283-1771-4202-836d-df17111dba25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:18.555490 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7ae24f3b-357e-4add-8213-bcd261a13303 req-d4039b23-c379-4d2c-9763-b62461632d1a service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] No waiting events found dispatching network-vif-unplugged-cd2c3270-7cb1-46d5-9746-c05acbe0d0d1 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:50:18.555621 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7ae24f3b-357e-4add-8213-bcd261a13303 req-d4039b23-c379-4d2c-9763-b62461632d1a service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] Received event network-vif-unplugged-cd2c3270-7cb1-46d5-9746-c05acbe0d0d1 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:50:18.630669 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:18.646480 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:18.799880 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999679020000258 future=<Future at 0x7218343297f0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:50:18.801244 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.998062021999885 future=<Future at 0x7218343297f0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:50:18.801528 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.997770978000062 future=<Future at 0x7218343297f0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:50:18.801875 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 54c8f283-1771-4202-836d-df17111dba25] Instance destroyed successfully.
May 19 04:50:18.802401 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lazy-loading 'resources' on Instance uuid 54c8f283-1771-4202-836d-df17111dba25 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:50:19.304865 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1233666835',display_name='tempest-AttachVolumeNegativeTest-server-1233666835',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumenegativetest-server-1233666835',id=67,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPo1WUSD7wl78kgD4jLX0TNxyTUl/1z0s0J1l70YxuB+IPo585e6APHc5jHiTdjUI/qWVhJDinAGqmsjXJRMasERqMeVA9XD4O0W5rC9bo2pGlFLT9Ld5OesOTQkuaAQwA==',key_name='tempest-keypair-799215441',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:49:36Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e16e702e1284e7fbba4184913a43de7',ramdisk_id='',reservation_id='r-zk5531l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-198121636',owner_user_name='tempest-AttachVolumeNegativeTest-198121636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:49:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fd3d5c8cf5c41589ceb1e2a5a9813c9',uuid=54c8f283-1771-4202-836d-df17111dba25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd2c3270-7cb1-46d5-9746-c05acbe0d0d1", "address": "fa:16:3e:8f:ee:76", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2c3270-7c", "ovs_interfaceid": "cd2c3270-7cb1-46d5-9746-c05acbe0d0d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:50:19.305738 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converting VIF {"id": "cd2c3270-7cb1-46d5-9746-c05acbe0d0d1", "address": "fa:16:3e:8f:ee:76", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2c3270-7c", "ovs_interfaceid": "cd2c3270-7cb1-46d5-9746-c05acbe0d0d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:50:19.305738 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:ee:76,bridge_name='br-int',has_traffic_filtering=True,id=cd2c3270-7cb1-46d5-9746-c05acbe0d0d1,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd2c3270-7c') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:50:19.306101 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:ee:76,bridge_name='br-int',has_traffic_filtering=True,id=cd2c3270-7cb1-46d5-9746-c05acbe0d0d1,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd2c3270-7c') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:50:19.307217 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:19.307561 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd2c3270-7c, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:50:19.308862 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:19.310176 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:50:19.311385 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:19.311578 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a817ce82-2273-41ef-840e-03d3c60f7588) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:50:19.312023 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:19.312572 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:50:19.313178 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:19.315524 np0000001025 nova-compute[97981]: INFO os_vif [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:ee:76,bridge_name='br-int',has_traffic_filtering=True,id=cd2c3270-7cb1-46d5-9746-c05acbe0d0d1,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd2c3270-7c')
May 19 04:50:19.315809 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Deleting instance files /opt/stack/data/nova/instances/54c8f283-1771-4202-836d-df17111dba25_del
May 19 04:50:19.316510 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Deletion of /opt/stack/data/nova/instances/54c8f283-1771-4202-836d-df17111dba25_del complete
May 19 04:50:19.828646 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Took 1.45 seconds to destroy the instance on the hypervisor.
May 19 04:50:19.829402 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:50:19.829697 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 54c8f283-1771-4202-836d-df17111dba25] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:50:19.829777 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 54c8f283-1771-4202-836d-df17111dba25] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:50:19.829996 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:19.942246 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:20.365455 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6d4a9239-b542-4110-a730-35e366f69bfc req-2938a01c-5b18-4a7c-952f-955223228110 service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] Received event network-vif-deleted-cd2c3270-7cb1-46d5-9746-c05acbe0d0d1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:50:20.367229 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-6d4a9239-b542-4110-a730-35e366f69bfc req-2938a01c-5b18-4a7c-952f-955223228110 service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] Neutron deleted interface cd2c3270-7cb1-46d5-9746-c05acbe0d0d1; detaching it from the instance and deleting it from the info cache
May 19 04:50:20.367419 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-6d4a9239-b542-4110-a730-35e366f69bfc req-2938a01c-5b18-4a7c-952f-955223228110 service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:50:20.608544 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-eaf65c53-8427-40a3-a216-1a40153a7274 req-945e42a1-e64f-4c98-83e6-bd6b0211d4f0 service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] Received event network-vif-unplugged-cd2c3270-7cb1-46d5-9746-c05acbe0d0d1 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:50:20.608544 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-eaf65c53-8427-40a3-a216-1a40153a7274 req-945e42a1-e64f-4c98-83e6-bd6b0211d4f0 service nova] Acquiring lock "54c8f283-1771-4202-836d-df17111dba25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:20.608544 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-eaf65c53-8427-40a3-a216-1a40153a7274 req-945e42a1-e64f-4c98-83e6-bd6b0211d4f0 service nova] Lock "54c8f283-1771-4202-836d-df17111dba25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:20.608544 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-eaf65c53-8427-40a3-a216-1a40153a7274 req-945e42a1-e64f-4c98-83e6-bd6b0211d4f0 service nova] Lock "54c8f283-1771-4202-836d-df17111dba25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:20.608544 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-eaf65c53-8427-40a3-a216-1a40153a7274 req-945e42a1-e64f-4c98-83e6-bd6b0211d4f0 service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] No waiting events found dispatching network-vif-unplugged-cd2c3270-7cb1-46d5-9746-c05acbe0d0d1 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:50:20.608544 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-eaf65c53-8427-40a3-a216-1a40153a7274 req-945e42a1-e64f-4c98-83e6-bd6b0211d4f0 service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] Received event network-vif-unplugged-cd2c3270-7cb1-46d5-9746-c05acbe0d0d1 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:50:20.801690 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 54c8f283-1771-4202-836d-df17111dba25] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:50:20.872495 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6d4a9239-b542-4110-a730-35e366f69bfc req-2938a01c-5b18-4a7c-952f-955223228110 service nova] [instance: 54c8f283-1771-4202-836d-df17111dba25] Detach interface failed, port_id=cd2c3270-7cb1-46d5-9746-c05acbe0d0d1, reason: Instance 54c8f283-1771-4202-836d-df17111dba25 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:50:21.303672 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 54c8f283-1771-4202-836d-df17111dba25] Took 1.47 seconds to deallocate network for instance.
May 19 04:50:21.809148 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:21.809613 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:22.042383 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:50:22.042565 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:50:22.544954 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:50:22.727752 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-692a03ae-329b-4242-9847-a9f4d2ab9947 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "a5adaab6-42dd-473d-95fe-c966eaf93017" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:22.727901 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-692a03ae-329b-4242-9847-a9f4d2ab9947 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:22.728085 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-692a03ae-329b-4242-9847-a9f4d2ab9947 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Rebooting instance
May 19 04:50:23.050900 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.242s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:23.107013 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Deleted allocations for instance 54c8f283-1771-4202-836d-df17111dba25
May 19 04:50:23.284811 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-692a03ae-329b-4242-9847-a9f4d2ab9947 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "refresh_cache-a5adaab6-42dd-473d-95fe-c966eaf93017" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:50:23.284922 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-692a03ae-329b-4242-9847-a9f4d2ab9947 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquired lock "refresh_cache-a5adaab6-42dd-473d-95fe-c966eaf93017" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:50:23.285066 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-692a03ae-329b-4242-9847-a9f4d2ab9947 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:50:23.631840 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:23.787076 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-692a03ae-329b-4242-9847-a9f4d2ab9947 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:24.047811 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-692a03ae-329b-4242-9847-a9f4d2ab9947 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:24.114573 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4e9af38e-e8f5-42fb-8946-53a94319bc6e tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "54c8f283-1771-4202-836d-df17111dba25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.245s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:24.163430 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-692a03ae-329b-4242-9847-a9f4d2ab9947 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Updating instance_info_cache with network_info: [{"id": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "address": "fa:16:3e:de:92:b6", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef81a86f-9a", "ovs_interfaceid": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:50:24.312698 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:24.665494 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-692a03ae-329b-4242-9847-a9f4d2ab9947 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Releasing lock "refresh_cache-a5adaab6-42dd-473d-95fe-c966eaf93017" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:50:25.169402 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-692a03ae-329b-4242-9847-a9f4d2ab9947 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:50:26.808102 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "4658b92f-849d-4658-b3b1-44b1955800d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:26.808102 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "4658b92f-849d-4658-b3b1-44b1955800d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:27.312773 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:50:27.869178 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:27.869449 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:27.872536 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:50:27.872837 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Claim successful on node np0000001025
May 19 04:50:28.601358 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:28.603344 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:28.623331 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:28.626178 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:28.646609 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:28.784257 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-91c41348-0892-4627-8d87-4391307c1d35 req-914bc18c-603f-484b-ac73-58d46b224ab7 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Received event network-vif-unplugged-ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:50:28.784397 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-91c41348-0892-4627-8d87-4391307c1d35 req-914bc18c-603f-484b-ac73-58d46b224ab7 service nova] Acquiring lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:28.784476 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-91c41348-0892-4627-8d87-4391307c1d35 req-914bc18c-603f-484b-ac73-58d46b224ab7 service nova] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:28.784593 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-91c41348-0892-4627-8d87-4391307c1d35 req-914bc18c-603f-484b-ac73-58d46b224ab7 service nova] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:28.784702 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-91c41348-0892-4627-8d87-4391307c1d35 req-914bc18c-603f-484b-ac73-58d46b224ab7 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] No waiting events found dispatching network-vif-unplugged-ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:50:28.784812 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-91c41348-0892-4627-8d87-4391307c1d35 req-914bc18c-603f-484b-ac73-58d46b224ab7 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Received unexpected event network-vif-unplugged-ef81a86f-9ae0-4139-829c-31d487be0a6f for instance with vm_state active and task_state reboot_started.
May 19 04:50:28.899356 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:28.925677 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.998543530999996 future=<Future at 0x7218506d1040 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:50:29.113165 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:50:29.113332 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:50:29.193332 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-692a03ae-329b-4242-9847-a9f4d2ab9947 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Instance shutdown successfully.
May 19 04:50:29.313451 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:29.617323 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:50:29.654878 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:29.673522 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:29.800936 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:30.005241 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:30.006774 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:30.009137 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:30.027083 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:30.125532 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.256s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:30.125877 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:50:30.432850 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Removed pending STOPPED event for a5adaab6-42dd-473d-95fe-c966eaf93017 due to new event <LifecycleEvent: 1779166230.432548, a5adaab6-42dd-473d-95fe-c966eaf93017 => Resumed> {{(pid=97981) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 19 04:50:30.432996 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166230.432548, a5adaab6-42dd-473d-95fe-c966eaf93017 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:50:30.433097 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] VM Resumed (Lifecycle Event)
May 19 04:50:30.436653 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Instance running successfully.
May 19 04:50:30.436813 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-692a03ae-329b-4242-9847-a9f4d2ab9947 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Instance soft rebooted successfully.
May 19 04:50:30.436925 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-692a03ae-329b-4242-9847-a9f4d2ab9947 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:50:30.632495 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:50:30.632495 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:50:30.632495 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:30.632495 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:30.709049 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fd3d5c8cf5c41589ceb1e2a5a9813c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e16e702e1284e7fbba4184913a43de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:50:30.843239 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2cf4366f-50c5-4dc9-a8eb-8645da049013 req-fef86c14-2988-4ab8-8742-f522512de2f5 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Received event network-vif-unplugged-ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:50:30.843239 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2cf4366f-50c5-4dc9-a8eb-8645da049013 req-fef86c14-2988-4ab8-8742-f522512de2f5 service nova] Acquiring lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:30.843382 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2cf4366f-50c5-4dc9-a8eb-8645da049013 req-fef86c14-2988-4ab8-8742-f522512de2f5 service nova] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:30.843494 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2cf4366f-50c5-4dc9-a8eb-8645da049013 req-fef86c14-2988-4ab8-8742-f522512de2f5 service nova] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:30.843625 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2cf4366f-50c5-4dc9-a8eb-8645da049013 req-fef86c14-2988-4ab8-8742-f522512de2f5 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] No waiting events found dispatching network-vif-unplugged-ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:50:30.843740 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-2cf4366f-50c5-4dc9-a8eb-8645da049013 req-fef86c14-2988-4ab8-8742-f522512de2f5 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Received unexpected event network-vif-unplugged-ef81a86f-9ae0-4139-829c-31d487be0a6f for instance with vm_state active and task_state None.
May 19 04:50:30.843869 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2cf4366f-50c5-4dc9-a8eb-8645da049013 req-fef86c14-2988-4ab8-8742-f522512de2f5 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Received event network-vif-plugged-ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:50:30.844056 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2cf4366f-50c5-4dc9-a8eb-8645da049013 req-fef86c14-2988-4ab8-8742-f522512de2f5 service nova] Acquiring lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:30.846617 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2cf4366f-50c5-4dc9-a8eb-8645da049013 req-fef86c14-2988-4ab8-8742-f522512de2f5 service nova] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:30.846617 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2cf4366f-50c5-4dc9-a8eb-8645da049013 req-fef86c14-2988-4ab8-8742-f522512de2f5 service nova] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:30.846617 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2cf4366f-50c5-4dc9-a8eb-8645da049013 req-fef86c14-2988-4ab8-8742-f522512de2f5 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] No waiting events found dispatching network-vif-plugged-ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:50:30.846617 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-2cf4366f-50c5-4dc9-a8eb-8645da049013 req-fef86c14-2988-4ab8-8742-f522512de2f5 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Received unexpected event network-vif-plugged-ef81a86f-9ae0-4139-829c-31d487be0a6f for instance with vm_state active and task_state None.
May 19 04:50:30.846617 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2cf4366f-50c5-4dc9-a8eb-8645da049013 req-fef86c14-2988-4ab8-8742-f522512de2f5 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Received event network-vif-plugged-ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:50:30.846617 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2cf4366f-50c5-4dc9-a8eb-8645da049013 req-fef86c14-2988-4ab8-8742-f522512de2f5 service nova] Acquiring lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:30.846617 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2cf4366f-50c5-4dc9-a8eb-8645da049013 req-fef86c14-2988-4ab8-8742-f522512de2f5 service nova] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:30.846617 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2cf4366f-50c5-4dc9-a8eb-8645da049013 req-fef86c14-2988-4ab8-8742-f522512de2f5 service nova] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:30.846617 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2cf4366f-50c5-4dc9-a8eb-8645da049013 req-fef86c14-2988-4ab8-8742-f522512de2f5 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] No waiting events found dispatching network-vif-plugged-ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:50:30.846617 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-2cf4366f-50c5-4dc9-a8eb-8645da049013 req-fef86c14-2988-4ab8-8742-f522512de2f5 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Received unexpected event network-vif-plugged-ef81a86f-9ae0-4139-829c-31d487be0a6f for instance with vm_state active and task_state None.
May 19 04:50:30.935433 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:50:30.937950 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:50:30.943038 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-692a03ae-329b-4242-9847-a9f4d2ab9947 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.215s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:31.136584 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:50:31.151503 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Successfully created port: 852e5752-e7de-44df-b335-8ea68b02e9dd {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:50:31.440184 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166231.4398696, a5adaab6-42dd-473d-95fe-c966eaf93017 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:50:31.440323 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] VM Started (Lifecycle Event)
May 19 04:50:31.585307 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Successfully updated port: 852e5752-e7de-44df-b335-8ea68b02e9dd {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:50:31.639815 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:50:31.942396 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:50:31.944728 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:50:32.087230 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "refresh_cache-4658b92f-849d-4658-b3b1-44b1955800d1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:50:32.087347 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquired lock "refresh_cache-4658b92f-849d-4658-b3b1-44b1955800d1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:50:32.087383 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:50:32.643281 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:50:32.646825 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:50:32.647877 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:50:32.648100 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Creating image(s)
May 19 04:50:32.648548 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "/opt/stack/data/nova/instances/4658b92f-849d-4658-b3b1-44b1955800d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:32.648715 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "/opt/stack/data/nova/instances/4658b92f-849d-4658-b3b1-44b1955800d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:32.649176 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "/opt/stack/data/nova/instances/4658b92f-849d-4658-b3b1-44b1955800d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:32.649609 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:50:32.652199 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:50:32.653803 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:50:32.766435 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.112s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:50:32.766864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:32.767422 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:32.767882 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:50:32.772122 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:50:32.772122 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:50:32.811661 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:32.861659 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.091s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:50:32.862063 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/4658b92f-849d-4658-b3b1-44b1955800d1/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:50:32.910646 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5c1fc39e-2f26-4ee8-8192-12e8d48b4ad9 req-2b658fc0-1de4-4e48-b9f7-7920ce83e6d6 service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Received event network-changed-852e5752-e7de-44df-b335-8ea68b02e9dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:50:32.911077 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5c1fc39e-2f26-4ee8-8192-12e8d48b4ad9 req-2b658fc0-1de4-4e48-b9f7-7920ce83e6d6 service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Refreshing instance network info cache due to event network-changed-852e5752-e7de-44df-b335-8ea68b02e9dd. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:50:32.911345 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5c1fc39e-2f26-4ee8-8192-12e8d48b4ad9 req-2b658fc0-1de4-4e48-b9f7-7920ce83e6d6 service nova] Acquiring lock "refresh_cache-4658b92f-849d-4658-b3b1-44b1955800d1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:50:32.924577 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/4658b92f-849d-4658-b3b1-44b1955800d1/disk 1073741824" returned: 0 in 0.062s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:50:32.927181 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.158s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:32.927181 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:50:32.963757 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Updating instance_info_cache with network_info: [{"id": "852e5752-e7de-44df-b335-8ea68b02e9dd", "address": "fa:16:3e:6c:1d:a4", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852e5752-e7", "ovs_interfaceid": "852e5752-e7de-44df-b335-8ea68b02e9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:50:33.019627 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:50:33.021058 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4658b92f-849d-4658-b3b1-44b1955800d1/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:50:33.021352 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658b92f-849d-4658-b3b1-44b1955800d1/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:50:33.124860 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658b92f-849d-4658-b3b1-44b1955800d1/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:50:33.125259 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Cannot resize image /opt/stack/data/nova/instances/4658b92f-849d-4658-b3b1-44b1955800d1/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:50:33.125627 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:50:33.125785 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Ensure instance console log exists: /opt/stack/data/nova/instances/4658b92f-849d-4658-b3b1-44b1955800d1/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:50:33.126046 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:33.126329 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:33.126462 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:33.468288 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Releasing lock "refresh_cache-4658b92f-849d-4658-b3b1-44b1955800d1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:50:33.468749 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Instance network_info: |[{"id": "852e5752-e7de-44df-b335-8ea68b02e9dd", "address": "fa:16:3e:6c:1d:a4", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852e5752-e7", "ovs_interfaceid": "852e5752-e7de-44df-b335-8ea68b02e9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:50:33.469299 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5c1fc39e-2f26-4ee8-8192-12e8d48b4ad9 req-2b658fc0-1de4-4e48-b9f7-7920ce83e6d6 service nova] Acquired lock "refresh_cache-4658b92f-849d-4658-b3b1-44b1955800d1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:50:33.469494 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5c1fc39e-2f26-4ee8-8192-12e8d48b4ad9 req-2b658fc0-1de4-4e48-b9f7-7920ce83e6d6 service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Refreshing network info cache for port 852e5752-e7de-44df-b335-8ea68b02e9dd {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:50:33.472439 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Start _get_guest_xml network_info=[{"id": "852e5752-e7de-44df-b335-8ea68b02e9dd", "address": "fa:16:3e:6c:1d:a4", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852e5752-e7", "ovs_interfaceid": "852e5752-e7de-44df-b335-8ea68b02e9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:50:33.477286 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:50:33.478466 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-79449918', uuid='4658b92f-849d-4658-b3b1-44b1955800d1'), owner=OwnerMeta(userid='3fd3d5c8cf5c41589ceb1e2a5a9813c9', username='tempest-AttachVolumeNegativeTest-198121636-project-member', projectid='2e16e702e1284e7fbba4184913a43de7', projectname='tempest-AttachVolumeNegativeTest-198121636'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "852e5752-e7de-44df-b335-8ea68b02e9dd", "address": "fa:16:3e:6c:1d:a4", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852e5752-e7", "ovs_interfaceid": "852e5752-e7de-44df-b335-8ea68b02e9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166233.4781423) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:50:33.481286 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:50:33.481757 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:50:33.482928 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:50:33.483127 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:50:33.484144 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:50:33.484504 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:50:33.484708 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:50:33.484847 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:50:33.485070 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:50:33.485210 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:50:33.485615 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:50:33.485782 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:50:33.485934 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:50:33.486190 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:50:33.486289 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:50:33.486436 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:50:33.497837 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-79449918',display_name='tempest-AttachVolumeNegativeTest-server-79449918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumenegativetest-server-79449918',id=70,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHerjq0aWPj7LO42+PJqj2QlTgHwEL1aw3ofb61o4GIi8ldltHr9ECTMIIE/xPAVCb+Vh27JgGsMJ0Y6pHSjrhT2F2SWLTK6lneEZZWBTtPIEx/Ni7YLsqbVOCIMK3TWA==',key_name='tempest-keypair-411497837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e16e702e1284e7fbba4184913a43de7',ramdisk_id='',reservation_id='r-xl2jmzrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-198121636',owner_user_name='tempest-AttachVolumeNegativeTest-198121636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:50:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fd3d5c8cf5c41589ceb1e2a5a9813c9',uuid=4658b92f-849d-4658-b3b1-44b1955800d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "852e5752-e7de-44df-b335-8ea68b02e9dd", "address": "fa:16:3e:6c:1d:a4", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852e5752-e7", "ovs_interfaceid": "852e5752-e7de-44df-b335-8ea68b02e9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:50:33.498023 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converting VIF {"id": "852e5752-e7de-44df-b335-8ea68b02e9dd", "address": "fa:16:3e:6c:1d:a4", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852e5752-e7", "ovs_interfaceid": "852e5752-e7de-44df-b335-8ea68b02e9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:50:33.498632 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:1d:a4,bridge_name='br-int',has_traffic_filtering=True,id=852e5752-e7de-44df-b335-8ea68b02e9dd,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852e5752-e7') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:50:33.499182 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lazy-loading 'pci_devices' on Instance uuid 4658b92f-849d-4658-b3b1-44b1955800d1 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:50:33.661706 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:33.799691 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00036360700005388935 future=<Future at 0x7218343297f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:50:33.799834 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:50:33.799960 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=10.124090576000071 future=<Future at 0x7218506d1040 state=cancelled>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:50:33.800046 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=10.124008954000146 future=<Future at 0x7218506d1040 state=cancelled>) was cancelled while queued, skipping {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:50:33.800135 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:50:33.800718 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] Emitting event <LifecycleEvent: 1779166218.7991893, 54c8f283-1771-4202-836d-df17111dba25 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:50:33.800880 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] VM Stopped (Lifecycle Event)
May 19 04:50:33.973684 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-5c1fc39e-2f26-4ee8-8192-12e8d48b4ad9 req-2b658fc0-1de4-4e48-b9f7-7920ce83e6d6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:34.002040 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] End _get_guest_xml xml=<domain type="qemu">
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:   <uuid>4658b92f-849d-4658-b3b1-44b1955800d1</uuid>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:   <name>instance-00000046</name>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <nova:name>tempest-AttachVolumeNegativeTest-server-79449918</nova:name>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:50:33</nova:creationTime>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:         <nova:user uuid="3fd3d5c8cf5c41589ceb1e2a5a9813c9">tempest-AttachVolumeNegativeTest-198121636-project-member</nova:user>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:         <nova:project uuid="2e16e702e1284e7fbba4184913a43de7">tempest-AttachVolumeNegativeTest-198121636</nova:project>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:         <nova:port uuid="852e5752-e7de-44df-b335-8ea68b02e9dd">
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     <system>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <entry name="serial">4658b92f-849d-4658-b3b1-44b1955800d1</entry>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <entry name="uuid">4658b92f-849d-4658-b3b1-44b1955800d1</entry>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     </system>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:   <os>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:   </os>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:   <features>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:   </features>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:   <devices>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/4658b92f-849d-4658-b3b1-44b1955800d1/disk"/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     </disk>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/4658b92f-849d-4658-b3b1-44b1955800d1/disk.config"/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     </disk>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:6c:1d:a4"/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <target dev="tap852e5752-e7"/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     </interface>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/4658b92f-849d-4658-b3b1-44b1955800d1/console.log" append="off"/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     </serial>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     <video>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     </video>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     </rng>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:   </devices>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]: </domain>
May 19 04:50:34.002040 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:50:34.004155 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Preparing to wait for external event network-vif-plugged-852e5752-e7de-44df-b335-8ea68b02e9dd {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:50:34.004155 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "4658b92f-849d-4658-b3b1-44b1955800d1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:34.004155 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "4658b92f-849d-4658-b3b1-44b1955800d1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:34.004155 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "4658b92f-849d-4658-b3b1-44b1955800d1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:34.004155 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-79449918',display_name='tempest-AttachVolumeNegativeTest-server-79449918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumenegativetest-server-79449918',id=70,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHerjq0aWPj7LO42+PJqj2QlTgHwEL1aw3ofb61o4GIi8ldltHr9ECTMIIE/xPAVCb+Vh27JgGsMJ0Y6pHSjrhT2F2SWLTK6lneEZZWBTtPIEx/Ni7YLsqbVOCIMK3TWA==',key_name='tempest-keypair-411497837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e16e702e1284e7fbba4184913a43de7',ramdisk_id='',reservation_id='r-xl2jmzrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-198121636',owner_user_name='tempest-AttachVolumeNegativeTest-198121636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:50:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fd3d5c8cf5c41589ceb1e2a5a9813c9',uuid=4658b92f-849d-4658-b3b1-44b1955800d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "852e5752-e7de-44df-b335-8ea68b02e9dd", "address": "fa:16:3e:6c:1d:a4", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852e5752-e7", "ovs_interfaceid": "852e5752-e7de-44df-b335-8ea68b02e9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:50:34.004155 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converting VIF {"id": "852e5752-e7de-44df-b335-8ea68b02e9dd", "address": "fa:16:3e:6c:1d:a4", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852e5752-e7", "ovs_interfaceid": "852e5752-e7de-44df-b335-8ea68b02e9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:50:34.004155 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:1d:a4,bridge_name='br-int',has_traffic_filtering=True,id=852e5752-e7de-44df-b335-8ea68b02e9dd,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852e5752-e7') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:50:34.004507 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:1d:a4,bridge_name='br-int',has_traffic_filtering=True,id=852e5752-e7de-44df-b335-8ea68b02e9dd,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852e5752-e7') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:50:34.005525 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:34.005525 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:50:34.007879 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:50:34.007879 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:34.007879 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55aec046-7042-5803-b526-b5ee6a8e3dfe', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:50:34.007879 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:34.010154 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:34.010696 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:34.010696 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap852e5752-e7, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:50:34.010910 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap852e5752-e7, col_values=(('qos', UUID('8873ea0e-deca-4330-86ef-afc5ab014803')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:50:34.011142 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap852e5752-e7, col_values=(('external_ids', {'iface-id': '852e5752-e7de-44df-b335-8ea68b02e9dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:1d:a4', 'vm-uuid': '4658b92f-849d-4658-b3b1-44b1955800d1'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:50:34.011915 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:34.013680 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:50:34.019575 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:34.019575 np0000001025 nova-compute[97981]: INFO os_vif [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:1d:a4,bridge_name='br-int',has_traffic_filtering=True,id=852e5752-e7de-44df-b335-8ea68b02e9dd,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852e5752-e7')
May 19 04:50:34.232225 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-5c1fc39e-2f26-4ee8-8192-12e8d48b4ad9 req-2b658fc0-1de4-4e48-b9f7-7920ce83e6d6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:34.306853 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ee749eed-e78e-4620-83b2-172febf66b67 tempest-TestVolumeBackupRestore-89711280 tempest-TestVolumeBackupRestore-89711280-project-member] [instance: 54c8f283-1771-4202-836d-df17111dba25] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:50:34.345414 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5c1fc39e-2f26-4ee8-8192-12e8d48b4ad9 req-2b658fc0-1de4-4e48-b9f7-7920ce83e6d6 service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Updated VIF entry in instance network info cache for port 852e5752-e7de-44df-b335-8ea68b02e9dd. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:50:34.345689 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5c1fc39e-2f26-4ee8-8192-12e8d48b4ad9 req-2b658fc0-1de4-4e48-b9f7-7920ce83e6d6 service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Updating instance_info_cache with network_info: [{"id": "852e5752-e7de-44df-b335-8ea68b02e9dd", "address": "fa:16:3e:6c:1d:a4", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852e5752-e7", "ovs_interfaceid": "852e5752-e7de-44df-b335-8ea68b02e9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:50:34.847605 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5c1fc39e-2f26-4ee8-8192-12e8d48b4ad9 req-2b658fc0-1de4-4e48-b9f7-7920ce83e6d6 service nova] Releasing lock "refresh_cache-4658b92f-849d-4658-b3b1-44b1955800d1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:50:35.087221 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:35.087402 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:35.534676 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:50:35.534812 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:50:35.534940 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No VIF found with MAC fa:16:3e:6c:1d:a4, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:50:35.535433 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Using config drive
May 19 04:50:35.590102 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Detaching volume 7856517b-4587-4efb-bf9d-b771dbe10335
May 19 04:50:35.623360 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Attempting to driver detach volume 7856517b-4587-4efb-bf9d-b771dbe10335 from mountpoint /dev/vdb
May 19 04:50:35.630008 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Found disk vdb by alias ua-7856517b-4587-4efb-bf9d-b771dbe10335 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:50:35.631099 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Found disk vdb by alias ua-7856517b-4587-4efb-bf9d-b771dbe10335 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:50:35.631260 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Attempting to detach device vdb from instance c39e9766-74e5-49fc-bd3a-aa1400e1458b from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:50:35.631466 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:50:35.631466 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:50:35.631466 np0000001025 nova-compute[97981]:   <alias name="ua-7856517b-4587-4efb-bf9d-b771dbe10335"/>
May 19 04:50:35.631466 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:50:35.631466 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:50:35.631466 np0000001025 nova-compute[97981]:   <serial>7856517b-4587-4efb-bf9d-b771dbe10335</serial>
May 19 04:50:35.631466 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:50:35.631466 np0000001025 nova-compute[97981]: </disk>
May 19 04:50:35.631466 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:50:35.636584 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Successfully detached device vdb from instance c39e9766-74e5-49fc-bd3a-aa1400e1458b from the persistent domain config.
May 19 04:50:35.636731 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] (1/8): Attempting to detach device vdb with device alias ua-7856517b-4587-4efb-bf9d-b771dbe10335 from instance c39e9766-74e5-49fc-bd3a-aa1400e1458b from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:50:35.636963 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:50:35.636963 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:50:35.636963 np0000001025 nova-compute[97981]:   <alias name="ua-7856517b-4587-4efb-bf9d-b771dbe10335"/>
May 19 04:50:35.636963 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:50:35.636963 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:50:35.636963 np0000001025 nova-compute[97981]:   <serial>7856517b-4587-4efb-bf9d-b771dbe10335</serial>
May 19 04:50:35.636963 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:50:35.636963 np0000001025 nova-compute[97981]: </disk>
May 19 04:50:35.636963 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:50:36.044241 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:36.113071 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779166236.1127267, c39e9766-74e5-49fc-bd3a-aa1400e1458b => ua-7856517b-4587-4efb-bf9d-b771dbe10335> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:50:36.113885 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7856517b-4587-4efb-bf9d-b771dbe10335 for instance c39e9766-74e5-49fc-bd3a-aa1400e1458b {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:50:36.115776 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Successfully detached device vdb from instance c39e9766-74e5-49fc-bd3a-aa1400e1458b from the live domain config.
May 19 04:50:36.116796 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:50:36.117064 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335', 'iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7856517b-4587-4efb-bf9d-b771dbe10335', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:50:36.117224 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:50:36.117600 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:50:36.117861 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335', 'iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7856517b-4587-4efb-bf9d-b771dbe10335', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:50:36.117986 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:50:36.146692 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:36.146692 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:36.146692 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:36.146692 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:36.146692 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:36.146692 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:36.146692 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:50:36.146983 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:36.146983 np0000001025 nova-compute[97981]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335 (non-flash)
May 19 04:50:36.146983 np0000001025 nova-compute[97981]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:36.146983 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:36.146983 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:36.146983 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:36.146983 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:50:36.146983 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335', '154'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335', '155'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', '156'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e', '160')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:50:36.147303 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335', '154')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:50:36.147927 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335', '155')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:50:36.148614 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218503734c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335'): ({'sdc'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:50:36.148836 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Removing multipathed devices sdc, sdb {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:50:36.149024 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Flush multipath device 330000000b8d07993 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:50:36.172300 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Creating config drive at /opt/stack/data/nova/instances/4658b92f-849d-4658-b3b1-44b1955800d1/disk.config
May 19 04:50:36.175868 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4658b92f-849d-4658-b3b1-44b1955800d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6do0z1jb {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:50:36.188951 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:50:36.231747 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4658b92f-849d-4658-b3b1-44b1955800d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6do0z1jb" returned: 0 in 0.056s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:50:36.236245 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:50:36.283640 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:50:36.283640 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:50:36.284785 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:50:36.295641 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:50:36.295899 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:50:36.306695 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:36.339182 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 154, target: iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335, portal: 192.168.40.100,3260]
May 19 04:50:36.339182 np0000001025 nova-compute[97981]: Logout of [sid: 154, target: iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335, portal: 192.168.40.100,3260] successful.
May 19 04:50:36.339182 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:36.354144 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:36.367551 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:36.404353 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 155, target: iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335, portal: 192.168.50.100,3260]
May 19 04:50:36.404353 np0000001025 nova-compute[97981]: Logout of [sid: 155, target: iqn.2023-03.storpool.com:os--volume-7856517b-4587-4efb-bf9d-b771dbe10335, portal: 192.168.50.100,3260] successful.
May 19 04:50:36.404353 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:36.419022 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:36.419734 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:50:36.419734 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] <== disconnect_volume: return (301ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:50:36.419819 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:50:36.637237 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:36.660550 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:36.663445 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:36.748894 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:36.823045 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8cfea3b5-afbd-43e6-bfc1-1b44500ec3f7 req-b9c66555-6ee9-46e5-b551-38f01df35fb1 service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Received event network-vif-plugged-852e5752-e7de-44df-b335-8ea68b02e9dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:50:36.823557 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8cfea3b5-afbd-43e6-bfc1-1b44500ec3f7 req-b9c66555-6ee9-46e5-b551-38f01df35fb1 service nova] Acquiring lock "4658b92f-849d-4658-b3b1-44b1955800d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:36.823839 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8cfea3b5-afbd-43e6-bfc1-1b44500ec3f7 req-b9c66555-6ee9-46e5-b551-38f01df35fb1 service nova] Lock "4658b92f-849d-4658-b3b1-44b1955800d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:36.824017 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8cfea3b5-afbd-43e6-bfc1-1b44500ec3f7 req-b9c66555-6ee9-46e5-b551-38f01df35fb1 service nova] Lock "4658b92f-849d-4658-b3b1-44b1955800d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:36.824197 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8cfea3b5-afbd-43e6-bfc1-1b44500ec3f7 req-b9c66555-6ee9-46e5-b551-38f01df35fb1 service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Processing event network-vif-plugged-852e5752-e7de-44df-b335-8ea68b02e9dd {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:50:36.964600 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:36.966035 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:36.968195 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:36.975231 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lazy-loading 'flavor' on Instance uuid c39e9766-74e5-49fc-bd3a-aa1400e1458b {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:50:36.986789 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:37.323175 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166237.3227751, 4658b92f-849d-4658-b3b1-44b1955800d1 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:50:37.323692 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] VM Started (Lifecycle Event)
May 19 04:50:37.324615 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:50:37.326924 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:50:37.330366 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Instance spawned successfully.
May 19 04:50:37.330676 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:50:37.825842 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:50:37.836466 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:50:37.843695 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:50:37.843868 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:50:37.844277 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:50:37.844559 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:50:37.844848 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:50:37.845198 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:50:37.991862 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-85368ab3-1c28-4d20-89b9-197ca51e0fbb tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.904s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:38.313167 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:38.313167 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:38.313167 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:38.313167 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:38.313167 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:38.315071 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Terminating instance
May 19 04:50:38.339384 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:50:38.339818 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166238.3394616, 4658b92f-849d-4658-b3b1-44b1955800d1 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:50:38.339818 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] VM Paused (Lifecycle Event)
May 19 04:50:38.349946 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Took 5.70 seconds to spawn the instance on the hypervisor.
May 19 04:50:38.350063 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:50:38.662226 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:38.816925 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:50:38.836842 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:38.838129 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:38.844623 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:50:38.849849 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166238.8495932, 4658b92f-849d-4658-b3b1-44b1955800d1 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:50:38.849979 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] VM Resumed (Lifecycle Event)
May 19 04:50:38.864120 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:38.868270 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Took 11.04 seconds to build instance.
May 19 04:50:38.886446 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:38.922484 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d51d13b8-990d-4e48-8410-014847329275 req-a0b2504c-dee3-4c3c-b28e-0c80e734f3b3 service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Received event network-vif-plugged-852e5752-e7de-44df-b335-8ea68b02e9dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:50:38.922484 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d51d13b8-990d-4e48-8410-014847329275 req-a0b2504c-dee3-4c3c-b28e-0c80e734f3b3 service nova] Acquiring lock "4658b92f-849d-4658-b3b1-44b1955800d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:38.922484 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d51d13b8-990d-4e48-8410-014847329275 req-a0b2504c-dee3-4c3c-b28e-0c80e734f3b3 service nova] Lock "4658b92f-849d-4658-b3b1-44b1955800d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:38.922484 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d51d13b8-990d-4e48-8410-014847329275 req-a0b2504c-dee3-4c3c-b28e-0c80e734f3b3 service nova] Lock "4658b92f-849d-4658-b3b1-44b1955800d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:38.922484 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d51d13b8-990d-4e48-8410-014847329275 req-a0b2504c-dee3-4c3c-b28e-0c80e734f3b3 service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] No waiting events found dispatching network-vif-plugged-852e5752-e7de-44df-b335-8ea68b02e9dd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:50:38.922484 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-d51d13b8-990d-4e48-8410-014847329275 req-a0b2504c-dee3-4c3c-b28e-0c80e734f3b3 service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Received unexpected event network-vif-plugged-852e5752-e7de-44df-b335-8ea68b02e9dd for instance with vm_state active and task_state None.
May 19 04:50:38.989995 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b7d1b160-e5fe-4d28-a98d-366081b37907 req-c18cfa8f-d6a9-4eaf-b9ab-a903899f9e88 service nova] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Received event network-vif-unplugged-6165ab31-3be2-438a-aa2a-3f5e345e1107 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:50:38.993154 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b7d1b160-e5fe-4d28-a98d-366081b37907 req-c18cfa8f-d6a9-4eaf-b9ab-a903899f9e88 service nova] Acquiring lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:38.994702 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b7d1b160-e5fe-4d28-a98d-366081b37907 req-c18cfa8f-d6a9-4eaf-b9ab-a903899f9e88 service nova] Lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:38.995093 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b7d1b160-e5fe-4d28-a98d-366081b37907 req-c18cfa8f-d6a9-4eaf-b9ab-a903899f9e88 service nova] Lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:38.995426 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b7d1b160-e5fe-4d28-a98d-366081b37907 req-c18cfa8f-d6a9-4eaf-b9ab-a903899f9e88 service nova] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] No waiting events found dispatching network-vif-unplugged-6165ab31-3be2-438a-aa2a-3f5e345e1107 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:50:38.995593 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b7d1b160-e5fe-4d28-a98d-366081b37907 req-c18cfa8f-d6a9-4eaf-b9ab-a903899f9e88 service nova] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Received event network-vif-unplugged-6165ab31-3be2-438a-aa2a-3f5e345e1107 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:50:39.019389 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:39.159586 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Instance destroyed successfully.
May 19 04:50:39.159866 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lazy-loading 'resources' on Instance uuid c39e9766-74e5-49fc-bd3a-aa1400e1458b {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:50:39.352842 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:50:39.354926 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:50:39.374259 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "4658b92f-849d-4658-b3b1-44b1955800d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.566s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:39.662710 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:48:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1105237569',display_name='tempest-VolumesBackupsTest-instance-1105237569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesbackupstest-instance-1105237569',id=66,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJMp2P20XaTYc1u2txDfoVoo2BHJc5ifVDrg0NxI8d3uGMTzoPWgtIWoWwBEOnkwnuHJeT6wVUtnGYrq/AvMMuIl7AIb3e2taxUKsBlGsRxETxlqZc7Qf8nDSIZN3CaRA==',key_name='tempest-keypair-415237631',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:49:06Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec4a48491cc047108747a22e8c63c3ac',ramdisk_id='',reservation_id='r-zr1acz03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-1527553839',owner_user_name='tempest-VolumesBackupsTest-1527553839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:49:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40f0313124fa425c916b6ad44fe2d7f3',uuid=c39e9766-74e5-49fc-bd3a-aa1400e1458b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6165ab31-3be2-438a-aa2a-3f5e345e1107", "address": "fa:16:3e:19:90:62", "network": {"id": "8a07682e-aaf0-4a4f-8bc0-70db155f01be", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2139331559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec4a48491cc047108747a22e8c63c3ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6165ab31-3b", "ovs_interfaceid": "6165ab31-3be2-438a-aa2a-3f5e345e1107", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:50:39.662943 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Converting VIF {"id": "6165ab31-3be2-438a-aa2a-3f5e345e1107", "address": "fa:16:3e:19:90:62", "network": {"id": "8a07682e-aaf0-4a4f-8bc0-70db155f01be", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2139331559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec4a48491cc047108747a22e8c63c3ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6165ab31-3b", "ovs_interfaceid": "6165ab31-3be2-438a-aa2a-3f5e345e1107", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:50:39.663530 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:90:62,bridge_name='br-int',has_traffic_filtering=True,id=6165ab31-3be2-438a-aa2a-3f5e345e1107,network=Network(8a07682e-aaf0-4a4f-8bc0-70db155f01be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6165ab31-3b') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:50:39.663744 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:90:62,bridge_name='br-int',has_traffic_filtering=True,id=6165ab31-3be2-438a-aa2a-3f5e345e1107,network=Network(8a07682e-aaf0-4a4f-8bc0-70db155f01be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6165ab31-3b') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:50:39.665001 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:39.665331 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6165ab31-3b, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:50:39.666584 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:39.667885 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:50:39.668480 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:39.668641 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33d7c82d-18ca-4e1a-92e7-e64a2cb30fbc) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:50:39.669062 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:39.669676 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:50:39.669844 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:39.672050 np0000001025 nova-compute[97981]: INFO os_vif [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:90:62,bridge_name='br-int',has_traffic_filtering=True,id=6165ab31-3be2-438a-aa2a-3f5e345e1107,network=Network(8a07682e-aaf0-4a4f-8bc0-70db155f01be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6165ab31-3b')
May 19 04:50:39.672340 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Deleting instance files /opt/stack/data/nova/instances/c39e9766-74e5-49fc-bd3a-aa1400e1458b_del
May 19 04:50:39.673079 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Deletion of /opt/stack/data/nova/instances/c39e9766-74e5-49fc-bd3a-aa1400e1458b_del complete
May 19 04:50:39.717380 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-bdbc79ba-f3a2-4253-b407-ec9fd8694eb9 req-6ef323ff-efa5-43df-9c13-40ef05d0bf80 service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Received event network-changed-852e5752-e7de-44df-b335-8ea68b02e9dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:50:39.717551 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-bdbc79ba-f3a2-4253-b407-ec9fd8694eb9 req-6ef323ff-efa5-43df-9c13-40ef05d0bf80 service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Refreshing instance network info cache due to event network-changed-852e5752-e7de-44df-b335-8ea68b02e9dd. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:50:39.717793 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bdbc79ba-f3a2-4253-b407-ec9fd8694eb9 req-6ef323ff-efa5-43df-9c13-40ef05d0bf80 service nova] Acquiring lock "refresh_cache-4658b92f-849d-4658-b3b1-44b1955800d1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:50:39.717927 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bdbc79ba-f3a2-4253-b407-ec9fd8694eb9 req-6ef323ff-efa5-43df-9c13-40ef05d0bf80 service nova] Acquired lock "refresh_cache-4658b92f-849d-4658-b3b1-44b1955800d1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:50:39.718678 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-bdbc79ba-f3a2-4253-b407-ec9fd8694eb9 req-6ef323ff-efa5-43df-9c13-40ef05d0bf80 service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Refreshing network info cache for port 852e5752-e7de-44df-b335-8ea68b02e9dd {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:50:39.857748 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999679462000131 future=<Future at 0x7218342118b0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:50:39.858120 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.99923494199993 future=<Future at 0x7218342118b0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:50:39.858297 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.998998080000092 future=<Future at 0x7218342118b0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:50:40.179327 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Took 1.36 seconds to destroy the instance on the hypervisor.
May 19 04:50:40.179971 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:50:40.181018 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:50:40.181123 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:50:40.181434 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:40.223269 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-bdbc79ba-f3a2-4253-b407-ec9fd8694eb9 req-6ef323ff-efa5-43df-9c13-40ef05d0bf80 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:40.246121 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:40.573366 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-bdbc79ba-f3a2-4253-b407-ec9fd8694eb9 req-6ef323ff-efa5-43df-9c13-40ef05d0bf80 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:40.748483 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-bdbc79ba-f3a2-4253-b407-ec9fd8694eb9 req-6ef323ff-efa5-43df-9c13-40ef05d0bf80 service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Updated VIF entry in instance network info cache for port 852e5752-e7de-44df-b335-8ea68b02e9dd. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:50:40.748786 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-bdbc79ba-f3a2-4253-b407-ec9fd8694eb9 req-6ef323ff-efa5-43df-9c13-40ef05d0bf80 service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Updating instance_info_cache with network_info: [{"id": "852e5752-e7de-44df-b335-8ea68b02e9dd", "address": "fa:16:3e:6c:1d:a4", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852e5752-e7", "ovs_interfaceid": "852e5752-e7de-44df-b335-8ea68b02e9dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:50:41.056123 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0a574058-0b2d-4524-a7d3-9d0dd83c06cc req-30a66d29-64d2-41b4-b442-4d36e12b5840 service nova] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Received event network-vif-unplugged-6165ab31-3be2-438a-aa2a-3f5e345e1107 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:50:41.056990 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0a574058-0b2d-4524-a7d3-9d0dd83c06cc req-30a66d29-64d2-41b4-b442-4d36e12b5840 service nova] Acquiring lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:41.056990 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0a574058-0b2d-4524-a7d3-9d0dd83c06cc req-30a66d29-64d2-41b4-b442-4d36e12b5840 service nova] Lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:41.056990 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0a574058-0b2d-4524-a7d3-9d0dd83c06cc req-30a66d29-64d2-41b4-b442-4d36e12b5840 service nova] Lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:41.056990 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0a574058-0b2d-4524-a7d3-9d0dd83c06cc req-30a66d29-64d2-41b4-b442-4d36e12b5840 service nova] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] No waiting events found dispatching network-vif-unplugged-6165ab31-3be2-438a-aa2a-3f5e345e1107 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:50:41.056990 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0a574058-0b2d-4524-a7d3-9d0dd83c06cc req-30a66d29-64d2-41b4-b442-4d36e12b5840 service nova] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Received event network-vif-unplugged-6165ab31-3be2-438a-aa2a-3f5e345e1107 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:50:41.150129 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:50:41.250616 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-bdbc79ba-f3a2-4253-b407-ec9fd8694eb9 req-6ef323ff-efa5-43df-9c13-40ef05d0bf80 service nova] Releasing lock "refresh_cache-4658b92f-849d-4658-b3b1-44b1955800d1" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:50:41.653096 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Took 1.47 seconds to deallocate network for instance.
May 19 04:50:41.777268 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4c7876ee-b767-4ef8-ae24-71f95a00c733 req-668ee82c-521b-408e-957e-dc2de61bd514 service nova] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Received event network-vif-deleted-6165ab31-3be2-438a-aa2a-3f5e345e1107 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:50:42.090452 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:50:42.090642 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:50:42.090822 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:50:42.090986 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:50:42.091170 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:50:42.091397 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.52 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:50:42.158308 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:42.158488 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:42.353346 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:50:42.353549 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:50:42.856876 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:50:43.364370 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.206s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:43.419771 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Deleted allocations for instance c39e9766-74e5-49fc-bd3a-aa1400e1458b
May 19 04:50:43.663349 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:44.429207 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e7f927d7-85ca-4b51-8f33-f6fda70738a2 tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Lock "c39e9766-74e5-49fc-bd3a-aa1400e1458b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.117s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:44.614958 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:50:44.617137 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:50:44.677145 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:45.176196 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:45.176582 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:45.678880 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:50:46.222843 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:46.223043 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:46.226054 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:50:46.226188 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Claim successful on node np0000001025
May 19 04:50:47.454984 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:50:47.455377 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:50:47.615191 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:50:47.615339 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:50:47.615537 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:50:47.947531 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:47.958023 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:50:48.465623 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.242s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:48.465623 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:50:48.665087 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:48.971553 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:50:48.971781 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:50:48.972069 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:48.972346 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:49.055403 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eafa3940f19346c8b574aa03335a0528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16b1deed8084634b3a8120ef6795f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:50:49.463511 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Successfully created port: e51bde8b-7b23-4983-99fe-0d79818030e6 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:50:49.475625 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:50:49.614834 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:50:49.678668 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:49.874319 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Successfully updated port: e51bde8b-7b23-4983-99fe-0d79818030e6 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:50:49.915062 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5a56f2a4-d851-40b8-8009-b1ac4e8043ed req-44fa9f96-b21d-47c2-8ef0-01af63e83b56 service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Received event network-changed-e51bde8b-7b23-4983-99fe-0d79818030e6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:50:49.915271 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5a56f2a4-d851-40b8-8009-b1ac4e8043ed req-44fa9f96-b21d-47c2-8ef0-01af63e83b56 service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Refreshing instance network info cache due to event network-changed-e51bde8b-7b23-4983-99fe-0d79818030e6. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:50:49.915468 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5a56f2a4-d851-40b8-8009-b1ac4e8043ed req-44fa9f96-b21d-47c2-8ef0-01af63e83b56 service nova] Acquiring lock "refresh_cache-4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:50:49.915594 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5a56f2a4-d851-40b8-8009-b1ac4e8043ed req-44fa9f96-b21d-47c2-8ef0-01af63e83b56 service nova] Acquired lock "refresh_cache-4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:50:49.915947 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5a56f2a4-d851-40b8-8009-b1ac4e8043ed req-44fa9f96-b21d-47c2-8ef0-01af63e83b56 service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Refreshing network info cache for port e51bde8b-7b23-4983-99fe-0d79818030e6 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:50:49.978814 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:50:50.119720 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:50.119919 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:50.120083 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:50.120259 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:50:50.375994 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "refresh_cache-4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:50:50.417748 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-5a56f2a4-d851-40b8-8009-b1ac4e8043ed req-44fa9f96-b21d-47c2-8ef0-01af63e83b56 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:50.471309 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5a56f2a4-d851-40b8-8009-b1ac4e8043ed req-44fa9f96-b21d-47c2-8ef0-01af63e83b56 service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:50:50.482768 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Booting with volume fabed110-e527-4cce-8fc7-7589a664e611 at /dev/vda
May 19 04:50:50.521764 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:50:50.536450 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:50:50.560798 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:50:50.622223 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:50:50.622568 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:50:50.628435 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-5a56f2a4-d851-40b8-8009-b1ac4e8043ed req-44fa9f96-b21d-47c2-8ef0-01af63e83b56 service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:50:50.631382 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:50:50.632438 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fec1:94ac', 'fe80::8c0d:8ff:fec2:525c', 'fe80::fc16:3eff:fede:92b6', 'fe80::1c08:7bff:fe57:c536', 'fe80::fc16:3eff:fe6c:1da4', 'fe80::c897:1dff:fede:235c'] 
May 19 04:50:50.632561 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:50:50.632655 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:50:50.632861 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:50:50.633049 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Updating existing volume attachment record: fd012020-28c4-4ea3-b3dd-6e7a6d73956e {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:50:51.130899 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5a56f2a4-d851-40b8-8009-b1ac4e8043ed req-44fa9f96-b21d-47c2-8ef0-01af63e83b56 service nova] Releasing lock "refresh_cache-4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:50:51.134432 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquired lock "refresh_cache-4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:50:51.134596 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:50:51.151476 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:50:51.152612 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658b92f-849d-4658-b3b1-44b1955800d1/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:50:51.245405 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658b92f-849d-4658-b3b1-44b1955800d1/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:50:51.245882 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658b92f-849d-4658-b3b1-44b1955800d1/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:50:51.343489 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4658b92f-849d-4658-b3b1-44b1955800d1/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:50:51.345908 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5adaab6-42dd-473d-95fe-c966eaf93017/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:50:51.434353 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5adaab6-42dd-473d-95fe-c966eaf93017/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:50:51.434353 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5adaab6-42dd-473d-95fe-c966eaf93017/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:50:51.520484 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5adaab6-42dd-473d-95fe-c966eaf93017/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:50:51.521060 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:50:51.525201 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:50:51.526587 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:50:51.571831 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:50:51.572255 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=13276MB free_disk=72.76560592651367GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:50:51.572420 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:51.572681 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:51.699878 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:50:51.835572 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:51.950801 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Updating instance_info_cache with network_info: [{"id": "e51bde8b-7b23-4983-99fe-0d79818030e6", "address": "fa:16:3e:3f:ee:f9", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape51bde8b-7b", "ovs_interfaceid": "e51bde8b-7b23-4983-99fe-0d79818030e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:50:52.452743 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Releasing lock "refresh_cache-4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:50:52.453171 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Instance network_info: |[{"id": "e51bde8b-7b23-4983-99fe-0d79818030e6", "address": "fa:16:3e:3f:ee:f9", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape51bde8b-7b", "ovs_interfaceid": "e51bde8b-7b23-4983-99fe-0d79818030e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:50:52.634558 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance a5adaab6-42dd-473d-95fe-c966eaf93017 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:50:52.634906 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 9c2a46cb-f9b2-4c34-a041-2bda0bc64051 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:50:52.634906 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 4658b92f-849d-4658-b3b1-44b1955800d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:50:52.634906 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:50:52.635356 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:50:52.635573 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:50:51 up 41 min,  2 users,  load average: 2.78, 4.31, 3.96\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '4', 'num_proj_99f67462305b466bac5791264c17cf14': '1', 'io_workload': '1', 'num_proj_d16b1deed8084634b3a8120ef6795f34': '2', 'num_proj_2e16e702e1284e7fbba4184913a43de7': '1', 'num_vm_building': '1', 'num_task_block_device_mapping': '1'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:50:52.729653 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:50:52.730843 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:50:52.731069 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Creating image(s)
May 19 04:50:52.731393 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:50:52.731517 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Ensure instance console log exists: /opt/stack/data/nova/instances/4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:50:52.731730 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:52.731882 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:52.731996 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:52.736152 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Start _get_guest_xml network_info=[{"id": "e51bde8b-7b23-4983-99fe-0d79818030e6", "address": "fa:16:3e:3f:ee:f9", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape51bde8b-7b", "ovs_interfaceid": "e51bde8b-7b23-4983-99fe-0d79818030e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'fd012020-28c4-4ea3-b3dd-6e7a6d73956e', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fabed110-e527-4cce-8fc7-7589a664e611', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9', 'attached_at': '', 'detached_at': '', 'volume_id': 'fabed110-e527-4cce-8fc7-7589a664e611', 'serial': 'fabed110-e527-4cce-8fc7-7589a664e611'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:50:52.740321 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:50:52.741453 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-1128698321', uuid='4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9'), owner=OwnerMeta(userid='eafa3940f19346c8b574aa03335a0528', username='tempest-TestVolumeBootPatternV346-1959285151-project-member', projectid='d16b1deed8084634b3a8120ef6795f34', projectname='tempest-TestVolumeBootPatternV346-1959285151'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e51bde8b-7b23-4983-99fe-0d79818030e6", "address": "fa:16:3e:3f:ee:f9", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape51bde8b-7b", "ovs_interfaceid": "e51bde8b-7b23-4983-99fe-0d79818030e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166252.7410734) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:50:52.742609 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:50:52.742906 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:50:52.743753 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:50:52.743899 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:50:52.744764 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:50:52.745013 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:50:52.745162 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:50:52.745246 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:50:52.745368 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:50:52.745446 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:50:52.745534 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:50:52.745668 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:50:52.745761 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:50:52.745856 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:50:52.745947 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:50:52.746054 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:50:52.755280 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:50:52.755601 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fabed110-e527-4cce-8fc7-7589a664e611', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:50:52.755747 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:50:52.756210 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:50:52.756405 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fabed110-e527-4cce-8fc7-7589a664e611', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:50:52.768292 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:50:52.768716 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:50:52.771165 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:50:52.771165 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:50:52.771165 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:50:52.771165 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:50:52.781327 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:50:52.781327 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:52.785706 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:50:52.785706 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:52.791222 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611] added
May 19 04:50:52.791222 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:50:52.791222 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:50:52.791222 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:50:52.791222 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:50:52.791222 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:50:52.791222 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:52.791524 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:50:52.791524 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0221(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:50:52.791681 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:50:52.796611 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611] added
May 19 04:50:52.796611 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:50:52.796611 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:50:52.796611 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:50:52.796611 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:50:52.796611 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:50:52.796611 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:52.796875 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:50:52.796975 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0269(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:50:52.797137 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:50:52.857064 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:50:52.857296 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:50:53.359858 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:50:53.665756 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:53.794512 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:50:53.797547 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:50:53.807071 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:50:53.807071 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:50:53.814424 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:50:53.814424 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:53.819761 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:53.827761 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:53.835867 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:53.835867 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:53.835867 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:53.835867 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:53.835867 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:50:53.836192 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:53.836192 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:53.836192 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:53.836192 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:53.836192 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:50:53.841496 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:53.841496 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:53.841496 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:53.841496 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:53.841496 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:50:53.841623 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:53.841623 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:53.841623 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:53.841623 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:53.841623 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:50:53.867549 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:50:53.867740 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.295s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:53.868754 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 33.75 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:50:53.872330 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611, portal: 192.168.40.100,3260]
May 19 04:50:53.872330 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611, portal: 192.168.40.100,3260] successful.
May 19 04:50:53.872330 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:53.883615 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611, portal: 192.168.50.100,3260]
May 19 04:50:53.883615 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611, portal: 192.168.50.100,3260] successful.
May 19 04:50:53.883615 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:53.883988 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:53.899342 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:50:53.900483 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:53.900483 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:53.900483 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:53.900483 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:53.900483 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:50:53.900483 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:50:53.900483 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:50:53.900731 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:53.900731 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:53.900731 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:53.900731 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:53.900731 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:50:53.900731 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:50:53.900731 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:50:53.903040 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:50:53.903165 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:50:53.903894 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] HCTL ('7', '-', '-', 0) found on session 165 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:50:53.903995 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:50:53.914268 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:53.914268 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:53.914268 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:53.914268 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:53.914268 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:50:53.914268 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:50:53.914268 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:50:53.914540 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:53.914540 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:50:53.914540 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:53.914540 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:50:53.914540 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:50:53.914540 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:50:53.914540 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:50:53.914766 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:50:53.914766 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:50:53.915428 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] HCTL ('8', '-', '-', 0) found on session 166 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:50:53.915527 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:50:53.921545 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Searching for a device in session 165 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:50:53.921545 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fabed110-e527-4cce-8fc7-7589a664e611', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:50:53.933700 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Searching for a device in session 166 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:50:53.933890 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fabed110-e527-4cce-8fc7-7589a664e611', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:50:54.680734 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:54.769501 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:50:54.857721 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0004009389999737323 future=<Future at 0x7218342118b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:50:54.857809 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:50:54.858074 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Emitting event <LifecycleEvent: 1779166239.8572257, c39e9766-74e5-49fc-bd3a-aa1400e1458b => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:50:54.858216 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] VM Stopped (Lifecycle Event)
May 19 04:50:55.360818 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: c39e9766-74e5-49fc-bd3a-aa1400e1458b] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:50:55.784328 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Found WWN 330000000c6fb5b2c for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:50:55.784708 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:50:55.784774 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '330000000c6fb5b2c', 'path': '/dev/dm-0', 'multipath_id': '330000000c6fb5b2c'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:50:55.784894 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c6fb5b2c', 'path': '/dev/dm-0', 'multipath_id': '330000000c6fb5b2c'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:50:56.289551 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1128698321',display_name='tempest-TestVolumeBootPatternV346-server-1128698321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpatternv346-server-1128698321',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWZuTUbMHlt187ST8Ic73xnIBFaXdGZsmJv5qPiYEJFbly0P3DaTlPQaG5CDzQjMd9D7wd92eBqosXxJm4toHoYgyVTndfShgteNVuOhgdzCHQQPowHL9Z/RevU7giw7Q==',key_name='tempest-keypair-668702618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d16b1deed8084634b3a8120ef6795f34',ramdisk_id='',reservation_id='r-d59v1kl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1959285151',owner_user_name='tempest-TestVolumeBootPatternV346-1959285151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:50:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eafa3940f19346c8b574aa03335a0528',uuid=4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e51bde8b-7b23-4983-99fe-0d79818030e6", "address": "fa:16:3e:3f:ee:f9", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape51bde8b-7b", "ovs_interfaceid": "e51bde8b-7b23-4983-99fe-0d79818030e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:50:56.289765 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Converting VIF {"id": "e51bde8b-7b23-4983-99fe-0d79818030e6", "address": "fa:16:3e:3f:ee:f9", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape51bde8b-7b", "ovs_interfaceid": "e51bde8b-7b23-4983-99fe-0d79818030e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:50:56.290453 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:ee:f9,bridge_name='br-int',has_traffic_filtering=True,id=e51bde8b-7b23-4983-99fe-0d79818030e6,network=Network(2bd74629-3dde-4be7-94c2-1550e25e2dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape51bde8b-7b') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:50:56.291065 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lazy-loading 'pci_devices' on Instance uuid 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:50:56.794487 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] End _get_guest_xml xml=<domain type="qemu">
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:   <uuid>4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9</uuid>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:   <name>instance-00000047</name>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestVolumeBootPatternV346-server-1128698321</nova:name>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:50:52</nova:creationTime>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:         <nova:user uuid="eafa3940f19346c8b574aa03335a0528">tempest-TestVolumeBootPatternV346-1959285151-project-member</nova:user>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:         <nova:project uuid="d16b1deed8084634b3a8120ef6795f34">tempest-TestVolumeBootPatternV346-1959285151</nova:project>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:         <nova:port uuid="e51bde8b-7b23-4983-99fe-0d79818030e6">
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     <system>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <entry name="serial">4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9</entry>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <entry name="uuid">4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9</entry>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     </system>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:   <os>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:   </os>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:   <features>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:   </features>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:   <devices>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9/disk.config"/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     </disk>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <alias name="ua-fabed110-e527-4cce-8fc7-7589a664e611"/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-0"/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <serial>fabed110-e527-4cce-8fc7-7589a664e611</serial>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     </disk>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:3f:ee:f9"/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <target dev="tape51bde8b-7b"/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     </interface>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9/console.log" append="off"/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     </serial>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     <video>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     </video>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     </rng>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:   </devices>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]: </domain>
May 19 04:50:56.794487 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:50:56.796917 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Preparing to wait for external event network-vif-plugged-e51bde8b-7b23-4983-99fe-0d79818030e6 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:50:56.796917 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:56.796917 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:56.796917 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:56.796917 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1128698321',display_name='tempest-TestVolumeBootPatternV346-server-1128698321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpatternv346-server-1128698321',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWZuTUbMHlt187ST8Ic73xnIBFaXdGZsmJv5qPiYEJFbly0P3DaTlPQaG5CDzQjMd9D7wd92eBqosXxJm4toHoYgyVTndfShgteNVuOhgdzCHQQPowHL9Z/RevU7giw7Q==',key_name='tempest-keypair-668702618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d16b1deed8084634b3a8120ef6795f34',ramdisk_id='',reservation_id='r-d59v1kl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1959285151',owner_user_name='tempest-TestVolumeBootPatternV346-1959285151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:50:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eafa3940f19346c8b574aa03335a0528',uuid=4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e51bde8b-7b23-4983-99fe-0d79818030e6", "address": "fa:16:3e:3f:ee:f9", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape51bde8b-7b", "ovs_interfaceid": "e51bde8b-7b23-4983-99fe-0d79818030e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:50:56.796917 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Converting VIF {"id": "e51bde8b-7b23-4983-99fe-0d79818030e6", "address": "fa:16:3e:3f:ee:f9", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape51bde8b-7b", "ovs_interfaceid": "e51bde8b-7b23-4983-99fe-0d79818030e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:50:56.797218 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:ee:f9,bridge_name='br-int',has_traffic_filtering=True,id=e51bde8b-7b23-4983-99fe-0d79818030e6,network=Network(2bd74629-3dde-4be7-94c2-1550e25e2dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape51bde8b-7b') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:50:56.797328 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:ee:f9,bridge_name='br-int',has_traffic_filtering=True,id=e51bde8b-7b23-4983-99fe-0d79818030e6,network=Network(2bd74629-3dde-4be7-94c2-1550e25e2dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape51bde8b-7b') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:50:56.797874 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:56.798208 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:50:56.798511 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:50:56.799398 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:56.799595 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '70bb8bdc-6096-5bc5-aff3-b9172765e70a', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:50:56.800857 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:56.801577 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:50:56.801864 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:56.804008 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:56.804215 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape51bde8b-7b, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:50:56.804950 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape51bde8b-7b, col_values=(('qos', UUID('ab1ad6a5-cf3d-4323-8ae3-310d4ff33135')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:50:56.804950 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape51bde8b-7b, col_values=(('external_ids', {'iface-id': 'e51bde8b-7b23-4983-99fe-0d79818030e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:ee:f9', 'vm-uuid': '4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:50:56.805873 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:56.807097 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:50:56.812625 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:56.813758 np0000001025 nova-compute[97981]: INFO os_vif [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:ee:f9,bridge_name='br-int',has_traffic_filtering=True,id=e51bde8b-7b23-4983-99fe-0d79818030e6,network=Network(2bd74629-3dde-4be7-94c2-1550e25e2dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape51bde8b-7b')
May 19 04:50:58.328166 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:50:58.328166 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:50:58.328166 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] No VIF found with MAC fa:16:3e:3f:ee:f9, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:50:58.328661 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Using config drive
May 19 04:50:58.679190 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:58.833779 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:50:58.935613 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Creating config drive at /opt/stack/data/nova/instances/4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9/disk.config
May 19 04:50:58.939118 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyhee6ogt {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:50:58.995331 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyhee6ogt" returned: 0 in 0.056s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:50:59.361755 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:59.387528 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:59.481696 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:59.519745 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:59.520684 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:50:59.532259 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8a1f20b2-a4a5-4c44-bbd7-522e0776a1ab req-46200599-c426-494e-9350-d25b202b24fa service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Received event network-vif-plugged-e51bde8b-7b23-4983-99fe-0d79818030e6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:50:59.532606 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8a1f20b2-a4a5-4c44-bbd7-522e0776a1ab req-46200599-c426-494e-9350-d25b202b24fa service nova] Acquiring lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:50:59.532969 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8a1f20b2-a4a5-4c44-bbd7-522e0776a1ab req-46200599-c426-494e-9350-d25b202b24fa service nova] Lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:50:59.533256 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8a1f20b2-a4a5-4c44-bbd7-522e0776a1ab req-46200599-c426-494e-9350-d25b202b24fa service nova] Lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:50:59.533538 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8a1f20b2-a4a5-4c44-bbd7-522e0776a1ab req-46200599-c426-494e-9350-d25b202b24fa service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Processing event network-vif-plugged-e51bde8b-7b23-4983-99fe-0d79818030e6 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:51:00.182514 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:51:00.182514 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166260.1806965, 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:51:00.182514 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] VM Started (Lifecycle Event)
May 19 04:51:00.185915 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:51:00.189049 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Instance spawned successfully.
May 19 04:51:00.189544 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:51:00.684254 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:51:00.686228 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:51:00.695408 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:51:00.695540 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:51:00.695753 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:51:00.695932 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:51:00.696164 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:51:00.696594 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:51:01.188308 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:51:01.188544 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166261.1883914, 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:51:01.188647 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] VM Paused (Lifecycle Event)
May 19 04:51:01.201277 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Took 8.47 seconds to spawn the instance on the hypervisor.
May 19 04:51:01.201584 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:51:01.612069 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4df1984c-de4b-4ce6-96ea-f12e284c1188 req-363fae19-96a7-4239-abc3-5c0e933bcc99 service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Received event network-vif-plugged-e51bde8b-7b23-4983-99fe-0d79818030e6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:51:01.612271 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4df1984c-de4b-4ce6-96ea-f12e284c1188 req-363fae19-96a7-4239-abc3-5c0e933bcc99 service nova] Acquiring lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:01.612436 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4df1984c-de4b-4ce6-96ea-f12e284c1188 req-363fae19-96a7-4239-abc3-5c0e933bcc99 service nova] Lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:01.612549 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4df1984c-de4b-4ce6-96ea-f12e284c1188 req-363fae19-96a7-4239-abc3-5c0e933bcc99 service nova] Lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:01.612661 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4df1984c-de4b-4ce6-96ea-f12e284c1188 req-363fae19-96a7-4239-abc3-5c0e933bcc99 service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] No waiting events found dispatching network-vif-plugged-e51bde8b-7b23-4983-99fe-0d79818030e6 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:51:01.612791 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-4df1984c-de4b-4ce6-96ea-f12e284c1188 req-363fae19-96a7-4239-abc3-5c0e933bcc99 service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Received unexpected event network-vif-plugged-e51bde8b-7b23-4983-99fe-0d79818030e6 for instance with vm_state active and task_state None.
May 19 04:51:01.690864 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:51:01.693619 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166261.6934023, 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:51:01.693731 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] VM Resumed (Lifecycle Event)
May 19 04:51:01.711231 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Took 15.53 seconds to build instance.
May 19 04:51:01.806368 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:02.196742 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:51:02.198044 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2ceffe5b-b00f-46a0-8345-343245c683f4 req-a836a7d7-1eae-4644-90ca-63454162d06e service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Received event network-changed-e51bde8b-7b23-4983-99fe-0d79818030e6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:51:02.198253 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2ceffe5b-b00f-46a0-8345-343245c683f4 req-a836a7d7-1eae-4644-90ca-63454162d06e service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Refreshing instance network info cache due to event network-changed-e51bde8b-7b23-4983-99fe-0d79818030e6. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:51:02.198451 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2ceffe5b-b00f-46a0-8345-343245c683f4 req-a836a7d7-1eae-4644-90ca-63454162d06e service nova] Acquiring lock "refresh_cache-4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:51:02.198610 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2ceffe5b-b00f-46a0-8345-343245c683f4 req-a836a7d7-1eae-4644-90ca-63454162d06e service nova] Acquired lock "refresh_cache-4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:51:02.198711 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2ceffe5b-b00f-46a0-8345-343245c683f4 req-a836a7d7-1eae-4644-90ca-63454162d06e service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Refreshing network info cache for port e51bde8b-7b23-4983-99fe-0d79818030e6 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:51:02.201911 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:51:02.212711 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9055755b-b9e2-4a94-84d1-76a8bf6c0130 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.036s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:02.700876 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-2ceffe5b-b00f-46a0-8345-343245c683f4 req-a836a7d7-1eae-4644-90ca-63454162d06e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:51:03.037018 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-2ceffe5b-b00f-46a0-8345-343245c683f4 req-a836a7d7-1eae-4644-90ca-63454162d06e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:51:03.176092 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2ceffe5b-b00f-46a0-8345-343245c683f4 req-a836a7d7-1eae-4644-90ca-63454162d06e service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Updated VIF entry in instance network info cache for port e51bde8b-7b23-4983-99fe-0d79818030e6. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:51:03.176517 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-2ceffe5b-b00f-46a0-8345-343245c683f4 req-a836a7d7-1eae-4644-90ca-63454162d06e service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Updating instance_info_cache with network_info: [{"id": "e51bde8b-7b23-4983-99fe-0d79818030e6", "address": "fa:16:3e:3f:ee:f9", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape51bde8b-7b", "ovs_interfaceid": "e51bde8b-7b23-4983-99fe-0d79818030e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:51:03.679208 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2ceffe5b-b00f-46a0-8345-343245c683f4 req-a836a7d7-1eae-4644-90ca-63454162d06e service nova] Releasing lock "refresh_cache-4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:51:03.689121 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:06.808328 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:06.852395 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "4658b92f-849d-4658-b3b1-44b1955800d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:06.852801 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "4658b92f-849d-4658-b3b1-44b1955800d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:07.355790 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lazy-loading 'flavor' on Instance uuid 4658b92f-849d-4658-b3b1-44b1955800d1 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:51:07.590123 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-740f7480-fe51-4129-b288-be7cd2714795 req-3f256125-9e1f-4e4b-861a-d831456b1a90 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Received event network-changed-ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:51:07.590304 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-740f7480-fe51-4129-b288-be7cd2714795 req-3f256125-9e1f-4e4b-861a-d831456b1a90 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Refreshing instance network info cache due to event network-changed-ef81a86f-9ae0-4139-829c-31d487be0a6f. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:51:07.590500 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-740f7480-fe51-4129-b288-be7cd2714795 req-3f256125-9e1f-4e4b-861a-d831456b1a90 service nova] Acquiring lock "refresh_cache-a5adaab6-42dd-473d-95fe-c966eaf93017" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:51:07.590603 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-740f7480-fe51-4129-b288-be7cd2714795 req-3f256125-9e1f-4e4b-861a-d831456b1a90 service nova] Acquired lock "refresh_cache-a5adaab6-42dd-473d-95fe-c966eaf93017" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:51:07.590726 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-740f7480-fe51-4129-b288-be7cd2714795 req-3f256125-9e1f-4e4b-861a-d831456b1a90 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Refreshing network info cache for port ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:51:08.011273 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e83af0ec-a2de-4a47-b105-0d457577db02 req-6903885f-d315-46bd-bc08-ff047b114d6e service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Received event network-changed-ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:51:08.012403 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e83af0ec-a2de-4a47-b105-0d457577db02 req-6903885f-d315-46bd-bc08-ff047b114d6e service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Refreshing instance network info cache due to event network-changed-ef81a86f-9ae0-4139-829c-31d487be0a6f. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:51:08.012403 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e83af0ec-a2de-4a47-b105-0d457577db02 req-6903885f-d315-46bd-bc08-ff047b114d6e service nova] Acquiring lock "refresh_cache-a5adaab6-42dd-473d-95fe-c966eaf93017" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:51:08.093509 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-740f7480-fe51-4129-b288-be7cd2714795 req-3f256125-9e1f-4e4b-861a-d831456b1a90 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:51:08.360458 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "4658b92f-849d-4658-b3b1-44b1955800d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:08.452075 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-740f7480-fe51-4129-b288-be7cd2714795 req-3f256125-9e1f-4e4b-861a-d831456b1a90 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:51:08.569362 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "a5adaab6-42dd-473d-95fe-c966eaf93017" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:08.569362 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:08.613417 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-740f7480-fe51-4129-b288-be7cd2714795 req-3f256125-9e1f-4e4b-861a-d831456b1a90 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Updated VIF entry in instance network info cache for port ef81a86f-9ae0-4139-829c-31d487be0a6f. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:51:08.614047 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-740f7480-fe51-4129-b288-be7cd2714795 req-3f256125-9e1f-4e4b-861a-d831456b1a90 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Updating instance_info_cache with network_info: [{"id": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "address": "fa:16:3e:de:92:b6", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef81a86f-9a", "ovs_interfaceid": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:51:08.690778 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:09.073864 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Detaching volume 9328036a-2364-4858-be9d-91de09d2a47e
May 19 04:51:09.107358 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Attempting to driver detach volume 9328036a-2364-4858-be9d-91de09d2a47e from mountpoint /dev/vdb
May 19 04:51:09.113176 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Found disk vdb by alias ua-9328036a-2364-4858-be9d-91de09d2a47e {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:51:09.113905 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Found disk vdb by alias ua-9328036a-2364-4858-be9d-91de09d2a47e {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:51:09.114075 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Attempting to detach device vdb from instance a5adaab6-42dd-473d-95fe-c966eaf93017 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:51:09.114400 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:51:09.114400 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:51:09.114400 np0000001025 nova-compute[97981]:   <alias name="ua-9328036a-2364-4858-be9d-91de09d2a47e"/>
May 19 04:51:09.114400 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-4"/>
May 19 04:51:09.114400 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:51:09.114400 np0000001025 nova-compute[97981]:   <serial>9328036a-2364-4858-be9d-91de09d2a47e</serial>
May 19 04:51:09.114400 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:51:09.114400 np0000001025 nova-compute[97981]: </disk>
May 19 04:51:09.114400 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:51:09.117799 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-740f7480-fe51-4129-b288-be7cd2714795 req-3f256125-9e1f-4e4b-861a-d831456b1a90 service nova] Releasing lock "refresh_cache-a5adaab6-42dd-473d-95fe-c966eaf93017" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:51:09.118135 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e83af0ec-a2de-4a47-b105-0d457577db02 req-6903885f-d315-46bd-bc08-ff047b114d6e service nova] Acquired lock "refresh_cache-a5adaab6-42dd-473d-95fe-c966eaf93017" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:51:09.118351 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e83af0ec-a2de-4a47-b105-0d457577db02 req-6903885f-d315-46bd-bc08-ff047b114d6e service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Refreshing network info cache for port ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:51:09.124810 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Successfully detached device vdb from instance a5adaab6-42dd-473d-95fe-c966eaf93017 from the persistent domain config.
May 19 04:51:09.126665 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] (1/8): Attempting to detach device vdb with device alias ua-9328036a-2364-4858-be9d-91de09d2a47e from instance a5adaab6-42dd-473d-95fe-c966eaf93017 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:51:09.126665 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:51:09.126665 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:51:09.126665 np0000001025 nova-compute[97981]:   <alias name="ua-9328036a-2364-4858-be9d-91de09d2a47e"/>
May 19 04:51:09.126665 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-4"/>
May 19 04:51:09.126665 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:51:09.126665 np0000001025 nova-compute[97981]:   <serial>9328036a-2364-4858-be9d-91de09d2a47e</serial>
May 19 04:51:09.126665 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:51:09.126665 np0000001025 nova-compute[97981]: </disk>
May 19 04:51:09.126665 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:51:09.425594 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "4658b92f-849d-4658-b3b1-44b1955800d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:09.425594 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "4658b92f-849d-4658-b3b1-44b1955800d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:09.425594 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Attaching volume b7d16359-cbf5-46c1-bfbd-07ec347a6859 to /dev/vdb
May 19 04:51:09.472031 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:51:09.484932 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:51:09.509286 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:51:09.550184 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:51:09.550945 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:51:09.558847 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:51:09.560548 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fec1:94ac', 'fe80::8c0d:8ff:fec2:525c', 'fe80::fc16:3eff:fede:92b6', 'fe80::1c08:7bff:fe57:c536', 'fe80::fc16:3eff:fe6c:1da4', 'fe80::c897:1dff:fede:235c', 'fe80::fc16:3eff:fe3f:eef9'] 
May 19 04:51:09.560548 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:51:09.560548 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:51:09.560548 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:51:09.561075 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Updating existing volume attachment record: b8676354-6fd8-4977-a2f9-050ddd509fcd {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:51:09.621461 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-e83af0ec-a2de-4a47-b105-0d457577db02 req-6903885f-d315-46bd-bc08-ff047b114d6e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:51:09.650387 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779166269.6499376, a5adaab6-42dd-473d-95fe-c966eaf93017 => ua-9328036a-2364-4858-be9d-91de09d2a47e> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:51:09.651066 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-9328036a-2364-4858-be9d-91de09d2a47e for instance a5adaab6-42dd-473d-95fe-c966eaf93017 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:51:09.657140 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Successfully detached device vdb from instance a5adaab6-42dd-473d-95fe-c966eaf93017 from the live domain config.
May 19 04:51:09.658059 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:51:09.658445 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e', 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9328036a-2364-4858-be9d-91de09d2a47e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:51:09.658574 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:51:09.659389 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:51:09.659389 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e', 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9328036a-2364-4858-be9d-91de09d2a47e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:51:09.659389 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:51:09.682875 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:09.682875 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:09.682875 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:51:09.682875 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:51:09.682875 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:09.682875 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:09.682875 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:51:09.683353 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:09.683353 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:09.683353 np0000001025 nova-compute[97981]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:51:09.683353 np0000001025 nova-compute[97981]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e (non-flash)
May 19 04:51:09.683353 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:09.683353 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:09.683353 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:51:09.683353 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', '156'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', '166')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:51:09.683353 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e', '159')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:51:09.684060 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e', '160')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:51:09.684737 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721850107560>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e'): ({'sdh'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:51:09.684918 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Removing multipathed devices sdh, sdg {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:51:09.685122 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Flush multipath device 3300000007f5efac0 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:51:09.716875 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:51:09.765576 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:51:09.821608 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:51:09.821608 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:51:09.822267 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:51:09.837050 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:51:09.837205 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:51:09.848000 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:09.878856 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 159, target: iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e, portal: 192.168.40.100,3260]
May 19 04:51:09.878856 np0000001025 nova-compute[97981]: Logout of [sid: 159, target: iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e, portal: 192.168.40.100,3260] successful.
May 19 04:51:09.878856 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:09.892729 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-e83af0ec-a2de-4a47-b105-0d457577db02 req-6903885f-d315-46bd-bc08-ff047b114d6e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:51:09.894516 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:09.904942 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:09.936097 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 160, target: iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e, portal: 192.168.50.100,3260]
May 19 04:51:09.936097 np0000001025 nova-compute[97981]: Logout of [sid: 160, target: iqn.2023-03.storpool.com:os--volume-9328036a-2364-4858-be9d-91de09d2a47e, portal: 192.168.50.100,3260] successful.
May 19 04:51:09.936097 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:09.950466 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:09.950849 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:51:09.951456 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] <== disconnect_volume: return (292ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:51:09.951577 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:51:10.027559 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e83af0ec-a2de-4a47-b105-0d457577db02 req-6903885f-d315-46bd-bc08-ff047b114d6e service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Updated VIF entry in instance network info cache for port ef81a86f-9ae0-4139-829c-31d487be0a6f. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:51:10.027820 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e83af0ec-a2de-4a47-b105-0d457577db02 req-6903885f-d315-46bd-bc08-ff047b114d6e service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Updating instance_info_cache with network_info: [{"id": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "address": "fa:16:3e:de:92:b6", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef81a86f-9a", "ovs_interfaceid": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:51:10.109655 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:51:10.109655 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859', 'iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7d16359-cbf5-46c1-bfbd-07ec347a6859', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:51:10.109655 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:51:10.109655 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:51:10.109655 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859', 'iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7d16359-cbf5-46c1-bfbd-07ec347a6859', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:51:10.122628 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:51:10.123035 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:51:10.123230 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:51:10.123856 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:51:10.124465 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:51:10.124628 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:51:10.133999 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:51:10.133999 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:10.137666 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:51:10.137666 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:10.143932 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859] added
May 19 04:51:10.143932 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:51:10.143932 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:51:10.143932 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:51:10.143932 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:51:10.143932 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:51:10.143932 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:10.144227 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:51:10.144384 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0211(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:51:10.144595 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:51:10.148904 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859] added
May 19 04:51:10.148904 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:51:10.148904 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:51:10.148904 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:51:10.148904 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:51:10.148904 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:51:10.148904 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:10.149974 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:51:10.149974 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0246(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:51:10.149974 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:51:10.502665 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lazy-loading 'flavor' on Instance uuid a5adaab6-42dd-473d-95fe-c966eaf93017 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:51:10.529994 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-e83af0ec-a2de-4a47-b105-0d457577db02 req-6903885f-d315-46bd-bc08-ff047b114d6e service nova] Releasing lock "refresh_cache-a5adaab6-42dd-473d-95fe-c966eaf93017" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:51:11.145033 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:51:11.150423 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:51:11.161589 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:51:11.161589 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:51:11.166650 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:51:11.166650 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:11.172801 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:11.179833 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:11.186752 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:11.186752 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:11.186752 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:11.186752 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:11.186752 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:51:11.186919 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:11.186919 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:11.186919 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:11.186919 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:11.186919 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:51:11.194059 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:11.194059 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:11.194059 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:11.194059 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:11.194059 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:51:11.194289 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:11.194289 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:11.194289 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:11.194289 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:11.194289 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:51:11.227748 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859, portal: 192.168.40.100,3260]
May 19 04:51:11.227748 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859, portal: 192.168.40.100,3260] successful.
May 19 04:51:11.227748 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:11.245020 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:11.251277 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859, portal: 192.168.50.100,3260]
May 19 04:51:11.251277 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859, portal: 192.168.50.100,3260] successful.
May 19 04:51:11.251277 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:11.262657 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:11.262657 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:11.262657 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:11.262657 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:11.262657 np0000001025 nova-compute[97981]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859 (non-flash)
May 19 04:51:11.262657 np0000001025 nova-compute[97981]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859 (non-flash)
May 19 04:51:11.262657 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:51:11.262867 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:11.262867 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:11.262867 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:11.262867 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:11.262867 np0000001025 nova-compute[97981]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859 (non-flash)
May 19 04:51:11.262867 np0000001025 nova-compute[97981]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859 (non-flash)
May 19 04:51:11.262867 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:51:11.263244 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:51:11.263402 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:51:11.264271 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] HCTL ('11', '-', '-', 0) found on session 169 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:51:11.264590 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:51:11.265197 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:11.287518 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Searching for a device in session 169 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:51:11.287518 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7d16359-cbf5-46c1-bfbd-07ec347a6859', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:51:11.287518 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:11.287518 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:11.287518 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:11.287518 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:11.287518 np0000001025 nova-compute[97981]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859 (non-flash)
May 19 04:51:11.287518 np0000001025 nova-compute[97981]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859 (non-flash)
May 19 04:51:11.287518 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:51:11.287518 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:11.287518 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:11.287518 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:11.287518 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:11.287518 np0000001025 nova-compute[97981]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859 (non-flash)
May 19 04:51:11.287518 np0000001025 nova-compute[97981]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859 (non-flash)
May 19 04:51:11.287518 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:51:11.287925 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:51:11.287925 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:51:11.288659 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] HCTL ('12', '-', '-', 0) found on session 170 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:51:11.288764 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:51:11.305305 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Searching for a device in session 170 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:51:11.305305 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b7d16359-cbf5-46c1-bfbd-07ec347a6859', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:51:11.509968 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-eef36bde-d4ee-4d83-9a59-feaae028cd0c tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.941s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:11.810633 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:12.125011 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:51:12.963757 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "a5adaab6-42dd-473d-95fe-c966eaf93017" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:12.964387 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:12.964387 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:12.964387 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:12.964538 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:12.966218 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Terminating instance
May 19 04:51:13.146785 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Found WWN 330000000dbf42f1d for multipath device dm-4 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:51:13.147127 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:51:13.147432 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000dbf42f1d', 'path': '/dev/dm-4', 'multipath_id': '330000000dbf42f1d'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:51:13.147651 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000dbf42f1d', 'path': '/dev/dm-4', 'multipath_id': '330000000dbf42f1d'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:51:13.150705 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lazy-loading 'flavor' on Instance uuid 4658b92f-849d-4658-b3b1-44b1955800d1 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:51:13.468545 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:51:13.492745 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:13.515584 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:13.539556 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:13.655667 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Attempting to attach volume b7d16359-cbf5-46c1-bfbd-07ec347a6859 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:51:13.658896 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:51:13.658896 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:51:13.658896 np0000001025 nova-compute[97981]:   <alias name="ua-b7d16359-cbf5-46c1-bfbd-07ec347a6859"/>
May 19 04:51:13.658896 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-4"/>
May 19 04:51:13.658896 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:51:13.658896 np0000001025 nova-compute[97981]:   <serial>b7d16359-cbf5-46c1-bfbd-07ec347a6859</serial>
May 19 04:51:13.658896 np0000001025 nova-compute[97981]: </disk>
May 19 04:51:13.658896 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:51:13.671799 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-98ae4455-8bdc-4e2f-96e2-8aa75d972af4 req-f039e661-bf19-40ba-aedc-a589a2ba1718 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Received event network-vif-unplugged-ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:51:13.672001 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-98ae4455-8bdc-4e2f-96e2-8aa75d972af4 req-f039e661-bf19-40ba-aedc-a589a2ba1718 service nova] Acquiring lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:13.672201 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-98ae4455-8bdc-4e2f-96e2-8aa75d972af4 req-f039e661-bf19-40ba-aedc-a589a2ba1718 service nova] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:13.672342 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-98ae4455-8bdc-4e2f-96e2-8aa75d972af4 req-f039e661-bf19-40ba-aedc-a589a2ba1718 service nova] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:13.672723 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-98ae4455-8bdc-4e2f-96e2-8aa75d972af4 req-f039e661-bf19-40ba-aedc-a589a2ba1718 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] No waiting events found dispatching network-vif-unplugged-ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:51:13.674526 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-98ae4455-8bdc-4e2f-96e2-8aa75d972af4 req-f039e661-bf19-40ba-aedc-a589a2ba1718 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Received event network-vif-unplugged-ef81a86f-9ae0-4139-829c-31d487be0a6f for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:51:13.693075 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:13.909268 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999711712000135 future=<Future at 0x7218342c8d70 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:51:13.909730 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999202121000053 future=<Future at 0x7218342c8d70 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:51:13.909878 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999020763000317 future=<Future at 0x7218342c8d70 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:51:13.911393 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Instance destroyed successfully.
May 19 04:51:13.911773 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lazy-loading 'resources' on Instance uuid a5adaab6-42dd-473d-95fe-c966eaf93017 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:51:14.414131 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2059753753',display_name='tempest-TestMinimumBasicScenario-server-2059753753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testminimumbasicscenario-server-2059753753',id=68,image_ref='c0fc0bc8-8c65-4a6e-959b-a6b2ed62d0be',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFE0tBN9GzG6SxVu8Fu506tLSbobMhIXU3ZQscVC7ev5IfJaRf/LHt8reXVUYlxk2Su0V7Y12RRo7FQPS6hBP6bZ7wcxU9dA0kRn68Eo/qjAivZcHXpAp82KVoOZUKgmpg==',key_name='tempest-TestMinimumBasicScenario-1194764858',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:49:52Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99f67462305b466bac5791264c17cf14',ramdisk_id='',reservation_id='r-gsi3zt8l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c0fc0bc8-8c65-4a6e-959b-a6b2ed62d0be',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-545024582',owner_user_name='tempest-TestMinimumBasicScenario-545024582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:50:30Z,user_data=None,user_id='5b0cd08b7f014743a849982c90b5bd7a',uuid=a5adaab6-42dd-473d-95fe-c966eaf93017,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "address": "fa:16:3e:de:92:b6", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef81a86f-9a", "ovs_interfaceid": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:51:14.414131 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Converting VIF {"id": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "address": "fa:16:3e:de:92:b6", "network": {"id": "08400d14-ac42-4046-ae13-082939c8e0e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-871997899-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99f67462305b466bac5791264c17cf14", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef81a86f-9a", "ovs_interfaceid": "ef81a86f-9ae0-4139-829c-31d487be0a6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:51:14.414713 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:92:b6,bridge_name='br-int',has_traffic_filtering=True,id=ef81a86f-9ae0-4139-829c-31d487be0a6f,network=Network(08400d14-ac42-4046-ae13-082939c8e0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef81a86f-9a') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:51:14.414920 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:92:b6,bridge_name='br-int',has_traffic_filtering=True,id=ef81a86f-9ae0-4139-829c-31d487be0a6f,network=Network(08400d14-ac42-4046-ae13-082939c8e0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef81a86f-9a') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:51:14.417616 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:14.418837 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef81a86f-9a, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:51:14.418996 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:14.419908 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:51:14.420750 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:14.420965 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d76062f-a934-454b-9c3b-85a399b46570) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:51:14.421668 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:14.422186 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:51:14.422583 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:14.426204 np0000001025 nova-compute[97981]: INFO os_vif [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:92:b6,bridge_name='br-int',has_traffic_filtering=True,id=ef81a86f-9ae0-4139-829c-31d487be0a6f,network=Network(08400d14-ac42-4046-ae13-082939c8e0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef81a86f-9a')
May 19 04:51:14.428463 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Deleting instance files /opt/stack/data/nova/instances/a5adaab6-42dd-473d-95fe-c966eaf93017_del
May 19 04:51:14.429114 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Deletion of /opt/stack/data/nova/instances/a5adaab6-42dd-473d-95fe-c966eaf93017_del complete
May 19 04:51:14.934882 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Took 1.47 seconds to destroy the instance on the hypervisor.
May 19 04:51:14.935407 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:51:14.935594 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:51:14.935693 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:51:14.935910 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:51:15.045223 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:51:15.264955 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-29a2b8a3-1ce7-4b58-9aa3-b62bf10c0a00 req-c462fd52-3617-4770-9f17-e92c7f12ea88 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Received event network-vif-deleted-ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:51:15.265124 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-29a2b8a3-1ce7-4b58-9aa3-b62bf10c0a00 req-c462fd52-3617-4770-9f17-e92c7f12ea88 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Neutron deleted interface ef81a86f-9ae0-4139-829c-31d487be0a6f; detaching it from the instance and deleting it from the info cache
May 19 04:51:15.265266 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-29a2b8a3-1ce7-4b58-9aa3-b62bf10c0a00 req-c462fd52-3617-4770-9f17-e92c7f12ea88 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:51:15.328083 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:51:15.328252 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:51:15.328362 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:51:15.328475 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] No VIF found with MAC fa:16:3e:6c:1d:a4, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:51:15.722903 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:51:15.732907 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7c2d3819-8b68-454a-a573-3201f9975e81 req-b208c78c-2e77-47e4-9a14-af12b7ff9ea5 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Received event network-vif-unplugged-ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:51:15.733086 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7c2d3819-8b68-454a-a573-3201f9975e81 req-b208c78c-2e77-47e4-9a14-af12b7ff9ea5 service nova] Acquiring lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:15.733785 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7c2d3819-8b68-454a-a573-3201f9975e81 req-b208c78c-2e77-47e4-9a14-af12b7ff9ea5 service nova] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:15.733934 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7c2d3819-8b68-454a-a573-3201f9975e81 req-b208c78c-2e77-47e4-9a14-af12b7ff9ea5 service nova] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:15.734104 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7c2d3819-8b68-454a-a573-3201f9975e81 req-b208c78c-2e77-47e4-9a14-af12b7ff9ea5 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] No waiting events found dispatching network-vif-unplugged-ef81a86f-9ae0-4139-829c-31d487be0a6f {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:51:15.734510 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7c2d3819-8b68-454a-a573-3201f9975e81 req-b208c78c-2e77-47e4-9a14-af12b7ff9ea5 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Received event network-vif-unplugged-ef81a86f-9ae0-4139-829c-31d487be0a6f for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:51:15.771423 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-29a2b8a3-1ce7-4b58-9aa3-b62bf10c0a00 req-c462fd52-3617-4770-9f17-e92c7f12ea88 service nova] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Detach interface failed, port_id=ef81a86f-9ae0-4139-829c-31d487be0a6f, reason: Instance a5adaab6-42dd-473d-95fe-c966eaf93017 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:51:16.224734 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Took 1.29 seconds to deallocate network for instance.
May 19 04:51:16.729496 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:16.729955 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:16.877564 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d357bee6-2dc4-46a0-83ca-c19c247b1c04 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "4658b92f-849d-4658-b3b1-44b1955800d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.454s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:16.949879 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:51:16.950079 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:51:17.318704 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "4658b92f-849d-4658-b3b1-44b1955800d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:17.318918 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "4658b92f-849d-4658-b3b1-44b1955800d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:17.454440 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:51:17.820947 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Detaching volume b7d16359-cbf5-46c1-bfbd-07ec347a6859
May 19 04:51:17.850358 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Attempting to driver detach volume b7d16359-cbf5-46c1-bfbd-07ec347a6859 from mountpoint /dev/vdb
May 19 04:51:17.853809 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Found disk vdb by alias ua-b7d16359-cbf5-46c1-bfbd-07ec347a6859 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:51:17.855029 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Found disk vdb by alias ua-b7d16359-cbf5-46c1-bfbd-07ec347a6859 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:51:17.855157 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Attempting to detach device vdb from instance 4658b92f-849d-4658-b3b1-44b1955800d1 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:51:17.855362 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:51:17.855362 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:51:17.855362 np0000001025 nova-compute[97981]:   <alias name="ua-b7d16359-cbf5-46c1-bfbd-07ec347a6859"/>
May 19 04:51:17.855362 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-4"/>
May 19 04:51:17.855362 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:51:17.855362 np0000001025 nova-compute[97981]:   <serial>b7d16359-cbf5-46c1-bfbd-07ec347a6859</serial>
May 19 04:51:17.855362 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:51:17.855362 np0000001025 nova-compute[97981]: </disk>
May 19 04:51:17.855362 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:51:17.861066 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Successfully detached device vdb from instance 4658b92f-849d-4658-b3b1-44b1955800d1 from the persistent domain config.
May 19 04:51:17.861199 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] (1/8): Attempting to detach device vdb with device alias ua-b7d16359-cbf5-46c1-bfbd-07ec347a6859 from instance 4658b92f-849d-4658-b3b1-44b1955800d1 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:51:17.861585 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:51:17.861585 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:51:17.861585 np0000001025 nova-compute[97981]:   <alias name="ua-b7d16359-cbf5-46c1-bfbd-07ec347a6859"/>
May 19 04:51:17.861585 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-4"/>
May 19 04:51:17.861585 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:51:17.861585 np0000001025 nova-compute[97981]:   <serial>b7d16359-cbf5-46c1-bfbd-07ec347a6859</serial>
May 19 04:51:17.861585 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:51:17.861585 np0000001025 nova-compute[97981]: </disk>
May 19 04:51:17.861585 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:51:17.963598 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.234s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:18.021730 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Deleted allocations for instance a5adaab6-42dd-473d-95fe-c966eaf93017
May 19 04:51:18.345375 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779166278.3446999, 4658b92f-849d-4658-b3b1-44b1955800d1 => ua-b7d16359-cbf5-46c1-bfbd-07ec347a6859> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:51:18.346419 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b7d16359-cbf5-46c1-bfbd-07ec347a6859 for instance 4658b92f-849d-4658-b3b1-44b1955800d1 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:51:18.348969 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Successfully detached device vdb from instance 4658b92f-849d-4658-b3b1-44b1955800d1 from the live domain config.
May 19 04:51:18.349885 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:51:18.350157 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859', 'iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7d16359-cbf5-46c1-bfbd-07ec347a6859', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:51:18.350284 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:51:18.350616 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:51:18.350856 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859', 'iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7d16359-cbf5-46c1-bfbd-07ec347a6859', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:51:18.350979 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:51:18.373781 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:18.373781 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:18.373781 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:18.373781 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:18.373781 np0000001025 nova-compute[97981]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859 (non-flash)
May 19 04:51:18.373781 np0000001025 nova-compute[97981]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859 (non-flash)
May 19 04:51:18.373781 np0000001025 nova-compute[97981]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4428602b-ff1d-4b87-99ec-770a8c90daa3 (non-flash)
May 19 04:51:18.373781 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:51:18.373982 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:18.373982 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:18.373982 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:18.373982 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:18.373982 np0000001025 nova-compute[97981]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859 (non-flash)
May 19 04:51:18.373982 np0000001025 nova-compute[97981]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859 (non-flash)
May 19 04:51:18.373982 np0000001025 nova-compute[97981]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4428602b-ff1d-4b87-99ec-770a8c90daa3 (non-flash)
May 19 04:51:18.373982 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:51:18.374131 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', '156'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4428602b-ff1d-4b87-99ec-770a8c90daa3', '171')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:51:18.374131 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859', '169')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:51:18.374953 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859', '170')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:51:18.375773 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185041f600>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859'): ({'sdg'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:51:18.375942 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Removing multipathed devices sdf, sdg {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:51:18.376196 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Flush multipath device 330000000dbf42f1d {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:51:18.410624 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:51:18.461636 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:51:18.515512 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:51:18.515612 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:51:18.516497 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:51:18.527127 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:51:18.527335 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:51:18.538263 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:18.563803 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 169, target: iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859, portal: 192.168.40.100,3260]
May 19 04:51:18.563803 np0000001025 nova-compute[97981]: Logout of [sid: 169, target: iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859, portal: 192.168.40.100,3260] successful.
May 19 04:51:18.563803 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:18.581338 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:18.593069 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:18.628844 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 170, target: iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859, portal: 192.168.50.100,3260]
May 19 04:51:18.628844 np0000001025 nova-compute[97981]: Logout of [sid: 170, target: iqn.2023-03.storpool.com:os--volume-b7d16359-cbf5-46c1-bfbd-07ec347a6859, portal: 192.168.50.100,3260] successful.
May 19 04:51:18.628844 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:18.646040 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:18.646040 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:51:18.646040 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] <== disconnect_volume: return (293ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:51:18.646040 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:51:18.693634 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:19.030696 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c42ee39-68df-46f5-b894-379e678901e0 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Lock "a5adaab6-42dd-473d-95fe-c966eaf93017" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.067s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:19.180574 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lazy-loading 'flavor' on Instance uuid 4658b92f-849d-4658-b3b1-44b1955800d1 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:51:19.422960 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:20.186335 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ac64220b-18c2-4cf7-a5dc-92c5e926bccc tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "4658b92f-849d-4658-b3b1-44b1955800d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.867s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:20.644468 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "4658b92f-849d-4658-b3b1-44b1955800d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:20.645240 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "4658b92f-849d-4658-b3b1-44b1955800d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:20.645240 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "4658b92f-849d-4658-b3b1-44b1955800d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:20.645240 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "4658b92f-849d-4658-b3b1-44b1955800d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:20.645240 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "4658b92f-849d-4658-b3b1-44b1955800d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:20.647618 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Terminating instance
May 19 04:51:20.656816 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:20.934043 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:21.150318 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:51:21.164722 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:21.166747 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:21.180673 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:21.182376 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:21.207065 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:21.209095 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:21.313555 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8c986b4d-fae1-466e-a02e-0d913570b377 req-583b1df3-3361-4e60-af01-f28a2363ae0c service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Received event network-vif-unplugged-852e5752-e7de-44df-b335-8ea68b02e9dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:51:21.314826 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8c986b4d-fae1-466e-a02e-0d913570b377 req-583b1df3-3361-4e60-af01-f28a2363ae0c service nova] Acquiring lock "4658b92f-849d-4658-b3b1-44b1955800d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:21.314986 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8c986b4d-fae1-466e-a02e-0d913570b377 req-583b1df3-3361-4e60-af01-f28a2363ae0c service nova] Lock "4658b92f-849d-4658-b3b1-44b1955800d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:21.315097 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8c986b4d-fae1-466e-a02e-0d913570b377 req-583b1df3-3361-4e60-af01-f28a2363ae0c service nova] Lock "4658b92f-849d-4658-b3b1-44b1955800d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:21.315247 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8c986b4d-fae1-466e-a02e-0d913570b377 req-583b1df3-3361-4e60-af01-f28a2363ae0c service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] No waiting events found dispatching network-vif-unplugged-852e5752-e7de-44df-b335-8ea68b02e9dd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:51:21.315512 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8c986b4d-fae1-466e-a02e-0d913570b377 req-583b1df3-3361-4e60-af01-f28a2363ae0c service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Received event network-vif-unplugged-852e5752-e7de-44df-b335-8ea68b02e9dd for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:51:21.467690 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999727851999978 future=<Future at 0x721850634260 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:51:21.469235 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Instance destroyed successfully.
May 19 04:51:21.469792 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lazy-loading 'resources' on Instance uuid 4658b92f-849d-4658-b3b1-44b1955800d1 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:51:21.972060 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-79449918',display_name='tempest-AttachVolumeNegativeTest-server-79449918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-attachvolumenegativetest-server-79449918',id=70,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHerjq0aWPj7LO42+PJqj2QlTgHwEL1aw3ofb61o4GIi8ldltHr9ECTMIIE/xPAVCb+Vh27JgGsMJ0Y6pHSjrhT2F2SWLTK6lneEZZWBTtPIEx/Ni7YLsqbVOCIMK3TWA==',key_name='tempest-keypair-411497837',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:50:38Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e16e702e1284e7fbba4184913a43de7',ramdisk_id='',reservation_id='r-xl2jmzrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-198121636',owner_user_name='tempest-AttachVolumeNegativeTest-198121636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:50:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fd3d5c8cf5c41589ceb1e2a5a9813c9',uuid=4658b92f-849d-4658-b3b1-44b1955800d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "852e5752-e7de-44df-b335-8ea68b02e9dd", "address": "fa:16:3e:6c:1d:a4", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852e5752-e7", "ovs_interfaceid": "852e5752-e7de-44df-b335-8ea68b02e9dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:51:21.972287 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converting VIF {"id": "852e5752-e7de-44df-b335-8ea68b02e9dd", "address": "fa:16:3e:6c:1d:a4", "network": {"id": "0c9429e2-672f-415e-90e4-ff9821b18c62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1023743089-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e16e702e1284e7fbba4184913a43de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852e5752-e7", "ovs_interfaceid": "852e5752-e7de-44df-b335-8ea68b02e9dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:51:21.972617 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:1d:a4,bridge_name='br-int',has_traffic_filtering=True,id=852e5752-e7de-44df-b335-8ea68b02e9dd,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852e5752-e7') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:51:21.972794 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:1d:a4,bridge_name='br-int',has_traffic_filtering=True,id=852e5752-e7de-44df-b335-8ea68b02e9dd,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852e5752-e7') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:51:21.973567 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:21.973738 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap852e5752-e7, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:51:21.975859 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:51:21.976227 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:21.976337 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8873ea0e-deca-4330-86ef-afc5ab014803) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:51:21.977842 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:51:21.979074 np0000001025 nova-compute[97981]: INFO os_vif [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:1d:a4,bridge_name='br-int',has_traffic_filtering=True,id=852e5752-e7de-44df-b335-8ea68b02e9dd,network=Network(0c9429e2-672f-415e-90e4-ff9821b18c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852e5752-e7')
May 19 04:51:21.979336 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Deleting instance files /opt/stack/data/nova/instances/4658b92f-849d-4658-b3b1-44b1955800d1_del
May 19 04:51:21.980042 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Deletion of /opt/stack/data/nova/instances/4658b92f-849d-4658-b3b1-44b1955800d1_del complete
May 19 04:51:22.485789 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Took 1.34 seconds to destroy the instance on the hypervisor.
May 19 04:51:22.486346 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:51:22.486711 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:51:22.486794 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:51:22.486999 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:51:22.574958 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:51:22.992203 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-04fac6fb-1f5a-4143-a199-1ba63b293c98 req-c7639726-b2d5-4172-a3e2-29876ccb8df3 service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Received event network-vif-deleted-852e5752-e7de-44df-b335-8ea68b02e9dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:51:22.993054 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-04fac6fb-1f5a-4143-a199-1ba63b293c98 req-c7639726-b2d5-4172-a3e2-29876ccb8df3 service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Neutron deleted interface 852e5752-e7de-44df-b335-8ea68b02e9dd; detaching it from the instance and deleting it from the info cache
May 19 04:51:22.993210 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-04fac6fb-1f5a-4143-a199-1ba63b293c98 req-c7639726-b2d5-4172-a3e2-29876ccb8df3 service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:51:23.100918 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:23.367061 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4749d57b-3bb6-4214-9f45-cb387141e9b1 req-16b8850e-f0a1-4756-b42f-a5f3e0f64b9e service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Received event network-vif-unplugged-852e5752-e7de-44df-b335-8ea68b02e9dd {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:51:23.368049 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4749d57b-3bb6-4214-9f45-cb387141e9b1 req-16b8850e-f0a1-4756-b42f-a5f3e0f64b9e service nova] Acquiring lock "4658b92f-849d-4658-b3b1-44b1955800d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:23.368410 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4749d57b-3bb6-4214-9f45-cb387141e9b1 req-16b8850e-f0a1-4756-b42f-a5f3e0f64b9e service nova] Lock "4658b92f-849d-4658-b3b1-44b1955800d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:23.368524 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4749d57b-3bb6-4214-9f45-cb387141e9b1 req-16b8850e-f0a1-4756-b42f-a5f3e0f64b9e service nova] Lock "4658b92f-849d-4658-b3b1-44b1955800d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:23.368702 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4749d57b-3bb6-4214-9f45-cb387141e9b1 req-16b8850e-f0a1-4756-b42f-a5f3e0f64b9e service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] No waiting events found dispatching network-vif-unplugged-852e5752-e7de-44df-b335-8ea68b02e9dd {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:51:23.368839 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4749d57b-3bb6-4214-9f45-cb387141e9b1 req-16b8850e-f0a1-4756-b42f-a5f3e0f64b9e service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Received event network-vif-unplugged-852e5752-e7de-44df-b335-8ea68b02e9dd for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:51:23.429133 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:51:23.496411 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-04fac6fb-1f5a-4143-a199-1ba63b293c98 req-c7639726-b2d5-4172-a3e2-29876ccb8df3 service nova] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Detach interface failed, port_id=852e5752-e7de-44df-b335-8ea68b02e9dd, reason: Instance 4658b92f-849d-4658-b3b1-44b1955800d1 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:51:23.694695 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:23.931139 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Took 1.44 seconds to deallocate network for instance.
May 19 04:51:24.436157 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:24.436302 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:24.598568 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:51:24.598891 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:51:25.101218 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:51:25.608693 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.172s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:25.676615 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Deleted allocations for instance 4658b92f-849d-4658-b3b1-44b1955800d1
May 19 04:51:26.433633 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:26.683872 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e535a3d6-aaaf-4cce-ab54-1f9a3652e2d5 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Lock "4658b92f-849d-4658-b3b1-44b1955800d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.039s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:26.977555 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:27.615937 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:51:27.616083 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Cleaning up deleted instances with incomplete migration  {{(pid=97981) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 19 04:51:28.119055 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 10.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:51:28.391510 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:28.703157 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:28.909439 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0005128419998072786 future=<Future at 0x7218342c8d70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:51:28.909510 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:51:28.909604 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=7.557787243999883 future=<Future at 0x721850634260 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:51:28.909666 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=7.55771817599998 future=<Future at 0x721850634260 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:51:28.910101 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Emitting event <LifecycleEvent: 1779166273.9088283, a5adaab6-42dd-473d-95fe-c966eaf93017 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:51:28.910296 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] VM Stopped (Lifecycle Event)
May 19 04:51:29.413075 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: a5adaab6-42dd-473d-95fe-c966eaf93017] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:51:30.875612 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:31.980085 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:32.404340 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:33.069568 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:33.704144 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:35.859090 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "9da3fdac-deca-4ab9-9df5-8342144acc13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:35.859476 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:36.361655 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:51:36.467728 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.000311234000037075 future=<Future at 0x721850634260 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:51:36.467836 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:51:36.468158 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] Emitting event <LifecycleEvent: 1779166281.4673336, 4658b92f-849d-4658-b3b1-44b1955800d1 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:51:36.468282 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] VM Stopped (Lifecycle Event)
May 19 04:51:36.906089 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:36.906458 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:36.909224 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:51:36.909348 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Claim successful on node np0000001025
May 19 04:51:36.970624 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-439b3fe2-72b8-434f-9ed8-19bfa6ab90b7 tempest-AttachVolumeNegativeTest-198121636 tempest-AttachVolumeNegativeTest-198121636-project-member] [instance: 4658b92f-849d-4658-b3b1-44b1955800d1] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:51:36.982498 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:38.076622 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:51:38.076954 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:51:38.117578 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:51:38.117871 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:51:38.578861 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:51:38.610459 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:51:38.610799 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:51:38.705200 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:39.084678 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.178s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:39.085196 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:51:39.591792 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:51:39.591957 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:51:39.592351 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:51:39.592504 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:51:39.615400 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:51:39.615772 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:51:39.654977 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8895143392c74e3a888bfc84ef323373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a69d8ed0ff94aa7aeeba4bb7186c857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:51:40.095124 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:51:40.195680 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Successfully created port: 4075449d-8606-42aa-82d0-371efdbcca11 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:51:40.517599 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:40.598247 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:51:40.614780 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:51:40.615088 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:51:40.654298 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Successfully updated port: 4075449d-8606-42aa-82d0-371efdbcca11 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:51:40.702369 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f51c64b4-5f26-4cc0-99ad-cafefcd98da0 req-a9b3412f-d363-4cca-a132-9597603039b4 service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Received event network-changed-4075449d-8606-42aa-82d0-371efdbcca11 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:51:40.702524 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f51c64b4-5f26-4cc0-99ad-cafefcd98da0 req-a9b3412f-d363-4cca-a132-9597603039b4 service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Refreshing instance network info cache due to event network-changed-4075449d-8606-42aa-82d0-371efdbcca11. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:51:40.702677 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f51c64b4-5f26-4cc0-99ad-cafefcd98da0 req-a9b3412f-d363-4cca-a132-9597603039b4 service nova] Acquiring lock "refresh_cache-9da3fdac-deca-4ab9-9df5-8342144acc13" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:51:40.702761 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f51c64b4-5f26-4cc0-99ad-cafefcd98da0 req-a9b3412f-d363-4cca-a132-9597603039b4 service nova] Acquired lock "refresh_cache-9da3fdac-deca-4ab9-9df5-8342144acc13" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:51:40.702865 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-f51c64b4-5f26-4cc0-99ad-cafefcd98da0 req-a9b3412f-d363-4cca-a132-9597603039b4 service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Refreshing network info cache for port 4075449d-8606-42aa-82d0-371efdbcca11 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:51:41.156074 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "refresh_cache-9da3fdac-deca-4ab9-9df5-8342144acc13" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:51:41.205373 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-f51c64b4-5f26-4cc0-99ad-cafefcd98da0 req-a9b3412f-d363-4cca-a132-9597603039b4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:51:41.287816 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-f51c64b4-5f26-4cc0-99ad-cafefcd98da0 req-a9b3412f-d363-4cca-a132-9597603039b4 service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:51:41.462848 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-f51c64b4-5f26-4cc0-99ad-cafefcd98da0 req-a9b3412f-d363-4cca-a132-9597603039b4 service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:51:41.606344 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:51:41.607490 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:51:41.607778 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Creating image(s)
May 19 04:51:41.608354 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "/opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:41.608617 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "/opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:41.609197 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "/opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:41.609700 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:51:41.612470 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:51:41.613522 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:51:41.626231 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:51:41.626700 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.99 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:51:41.700543 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.087s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:51:41.701160 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:41.701666 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:41.702198 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:51:41.705950 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:51:41.706557 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:51:41.803600 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.097s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:51:41.803997 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:51:41.855900 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/disk 1073741824" returned: 0 in 0.052s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:51:41.856375 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.155s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:41.856707 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:51:41.942445 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.085s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:51:41.942965 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:51:41.943358 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:51:41.966862 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f51c64b4-5f26-4cc0-99ad-cafefcd98da0 req-a9b3412f-d363-4cca-a132-9597603039b4 service nova] Releasing lock "refresh_cache-9da3fdac-deca-4ab9-9df5-8342144acc13" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:51:41.968205 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquired lock "refresh_cache-9da3fdac-deca-4ab9-9df5-8342144acc13" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:51:41.968836 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:51:41.984470 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:42.006669 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:42.039746 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:51:42.040191 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Cannot resize image /opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:51:42.040550 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:51:42.040757 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Ensure instance console log exists: /opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:51:42.041015 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:42.041281 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:42.041453 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:42.530331 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:51:42.671826 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:51:42.806490 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Updating instance_info_cache with network_info: [{"id": "4075449d-8606-42aa-82d0-371efdbcca11", "address": "fa:16:3e:dd:ea:eb", "network": {"id": "cde3508d-bb21-4be7-8e14-fc9f2e50f75c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-53532512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a69d8ed0ff94aa7aeeba4bb7186c857", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4075449d-86", "ovs_interfaceid": "4075449d-8606-42aa-82d0-371efdbcca11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:51:43.308160 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Releasing lock "refresh_cache-9da3fdac-deca-4ab9-9df5-8342144acc13" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:51:43.308460 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Instance network_info: |[{"id": "4075449d-8606-42aa-82d0-371efdbcca11", "address": "fa:16:3e:dd:ea:eb", "network": {"id": "cde3508d-bb21-4be7-8e14-fc9f2e50f75c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-53532512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a69d8ed0ff94aa7aeeba4bb7186c857", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4075449d-86", "ovs_interfaceid": "4075449d-8606-42aa-82d0-371efdbcca11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:51:43.310208 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Start _get_guest_xml network_info=[{"id": "4075449d-8606-42aa-82d0-371efdbcca11", "address": "fa:16:3e:dd:ea:eb", "network": {"id": "cde3508d-bb21-4be7-8e14-fc9f2e50f75c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-53532512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a69d8ed0ff94aa7aeeba4bb7186c857", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4075449d-86", "ovs_interfaceid": "4075449d-8606-42aa-82d0-371efdbcca11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:51:43.314162 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:51:43.315475 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachmentScenario-server-1814397367', uuid='9da3fdac-deca-4ab9-9df5-8342144acc13'), owner=OwnerMeta(userid='8895143392c74e3a888bfc84ef323373', username='tempest-TestServerVolumeAttachmentScenario-1085645296-project-member', projectid='8a69d8ed0ff94aa7aeeba4bb7186c857', projectname='tempest-TestServerVolumeAttachmentScenario-1085645296'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4075449d-8606-42aa-82d0-371efdbcca11", "address": "fa:16:3e:dd:ea:eb", "network": {"id": "cde3508d-bb21-4be7-8e14-fc9f2e50f75c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-53532512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a69d8ed0ff94aa7aeeba4bb7186c857", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4075449d-86", "ovs_interfaceid": "4075449d-8606-42aa-82d0-371efdbcca11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166303.315051) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:51:43.316532 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:51:43.316838 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:51:43.317756 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:51:43.317939 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:51:43.319209 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:51:43.319669 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:51:43.319878 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:51:43.320031 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:51:43.320250 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:51:43.320395 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:51:43.320562 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:51:43.320917 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:51:43.321085 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:51:43.321286 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:51:43.321458 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:51:43.321643 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:51:43.334290 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:51:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1814397367',display_name='tempest-TestServerVolumeAttachmentScenario-server-1814397367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testservervolumeattachmentscenario-server-1814397367',id=72,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzcAmkx43zYA6ye/0QCPY97Hw1TmmOl5CXA25NUWf2XzwrTp8kJXb9TGQHWNOyZw4rHb3dzkX+j2ue2VEPkPu++gZOzwiLYha0DNj9oSm6hlwNnUUMtF+Bq2wqHrbbC6w==',key_name='tempest-keypair-1204702030',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a69d8ed0ff94aa7aeeba4bb7186c857',ramdisk_id='',reservation_id='r-2loj8z5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1085645296',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1085645296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:51:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8895143392c74e3a888bfc84ef323373',uuid=9da3fdac-deca-4ab9-9df5-8342144acc13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4075449d-8606-42aa-82d0-371efdbcca11", "address": "fa:16:3e:dd:ea:eb", "network": {"id": "cde3508d-bb21-4be7-8e14-fc9f2e50f75c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-53532512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a69d8ed0ff94aa7aeeba4bb7186c857", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4075449d-86", "ovs_interfaceid": "4075449d-8606-42aa-82d0-371efdbcca11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:51:43.334540 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Converting VIF {"id": "4075449d-8606-42aa-82d0-371efdbcca11", "address": "fa:16:3e:dd:ea:eb", "network": {"id": "cde3508d-bb21-4be7-8e14-fc9f2e50f75c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-53532512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a69d8ed0ff94aa7aeeba4bb7186c857", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4075449d-86", "ovs_interfaceid": "4075449d-8606-42aa-82d0-371efdbcca11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:51:43.334965 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ea:eb,bridge_name='br-int',has_traffic_filtering=True,id=4075449d-8606-42aa-82d0-371efdbcca11,network=Network(cde3508d-bb21-4be7-8e14-fc9f2e50f75c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4075449d-86') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:51:43.335508 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lazy-loading 'pci_devices' on Instance uuid 9da3fdac-deca-4ab9-9df5-8342144acc13 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:51:43.707920 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:43.838542 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] End _get_guest_xml xml=<domain type="qemu">
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:   <uuid>9da3fdac-deca-4ab9-9df5-8342144acc13</uuid>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:   <name>instance-00000048</name>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1814397367</nova:name>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:51:43</nova:creationTime>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:         <nova:user uuid="8895143392c74e3a888bfc84ef323373">tempest-TestServerVolumeAttachmentScenario-1085645296-project-member</nova:user>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:         <nova:project uuid="8a69d8ed0ff94aa7aeeba4bb7186c857">tempest-TestServerVolumeAttachmentScenario-1085645296</nova:project>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:         <nova:port uuid="4075449d-8606-42aa-82d0-371efdbcca11">
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     <system>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <entry name="serial">9da3fdac-deca-4ab9-9df5-8342144acc13</entry>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <entry name="uuid">9da3fdac-deca-4ab9-9df5-8342144acc13</entry>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     </system>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:   <os>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:   </os>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:   <features>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:   </features>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:   <devices>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/disk"/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     </disk>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/disk.config"/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     </disk>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:dd:ea:eb"/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <target dev="tap4075449d-86"/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     </interface>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/console.log" append="off"/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     </serial>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     <video>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     </video>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     </rng>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:   </devices>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]: </domain>
May 19 04:51:43.838542 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:51:43.841690 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Preparing to wait for external event network-vif-plugged-4075449d-8606-42aa-82d0-371efdbcca11 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:51:43.841690 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "9da3fdac-deca-4ab9-9df5-8342144acc13-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:43.841690 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:43.841690 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:43.841690 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:51:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1814397367',display_name='tempest-TestServerVolumeAttachmentScenario-server-1814397367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testservervolumeattachmentscenario-server-1814397367',id=72,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzcAmkx43zYA6ye/0QCPY97Hw1TmmOl5CXA25NUWf2XzwrTp8kJXb9TGQHWNOyZw4rHb3dzkX+j2ue2VEPkPu++gZOzwiLYha0DNj9oSm6hlwNnUUMtF+Bq2wqHrbbC6w==',key_name='tempest-keypair-1204702030',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a69d8ed0ff94aa7aeeba4bb7186c857',ramdisk_id='',reservation_id='r-2loj8z5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1085645296',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1085645296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:51:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8895143392c74e3a888bfc84ef323373',uuid=9da3fdac-deca-4ab9-9df5-8342144acc13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4075449d-8606-42aa-82d0-371efdbcca11", "address": "fa:16:3e:dd:ea:eb", "network": {"id": "cde3508d-bb21-4be7-8e14-fc9f2e50f75c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-53532512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a69d8ed0ff94aa7aeeba4bb7186c857", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4075449d-86", "ovs_interfaceid": "4075449d-8606-42aa-82d0-371efdbcca11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:51:43.841690 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Converting VIF {"id": "4075449d-8606-42aa-82d0-371efdbcca11", "address": "fa:16:3e:dd:ea:eb", "network": {"id": "cde3508d-bb21-4be7-8e14-fc9f2e50f75c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-53532512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a69d8ed0ff94aa7aeeba4bb7186c857", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4075449d-86", "ovs_interfaceid": "4075449d-8606-42aa-82d0-371efdbcca11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:51:43.841690 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ea:eb,bridge_name='br-int',has_traffic_filtering=True,id=4075449d-8606-42aa-82d0-371efdbcca11,network=Network(cde3508d-bb21-4be7-8e14-fc9f2e50f75c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4075449d-86') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:51:43.841690 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ea:eb,bridge_name='br-int',has_traffic_filtering=True,id=4075449d-8606-42aa-82d0-371efdbcca11,network=Network(cde3508d-bb21-4be7-8e14-fc9f2e50f75c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4075449d-86') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:51:43.841690 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:43.841690 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:51:43.841690 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:51:43.842280 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:43.842416 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f886d4e-7c6c-52f3-a45f-b05cef293dd6', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:51:43.843226 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:43.843861 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:51:43.844449 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:43.846213 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:43.846340 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4075449d-86, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:51:43.846643 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4075449d-86, col_values=(('qos', UUID('21c5cd65-d5dd-4fcb-83d6-aeee6be05679')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:51:43.846796 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4075449d-86, col_values=(('external_ids', {'iface-id': '4075449d-8606-42aa-82d0-371efdbcca11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:ea:eb', 'vm-uuid': '9da3fdac-deca-4ab9-9df5-8342144acc13'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:51:43.847782 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:43.850100 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:51:43.852515 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:43.853312 np0000001025 nova-compute[97981]: INFO os_vif [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ea:eb,bridge_name='br-int',has_traffic_filtering=True,id=4075449d-8606-42aa-82d0-371efdbcca11,network=Network(cde3508d-bb21-4be7-8e14-fc9f2e50f75c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4075449d-86')
May 19 04:51:44.615507 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:51:44.764211 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "656a7921-42b1-45cd-802f-488693ff5268" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:44.764605 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "656a7921-42b1-45cd-802f-488693ff5268" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:45.117286 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:51:45.265845 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:51:45.367327 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:51:45.367417 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:51:45.367534 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] No VIF found with MAC fa:16:3e:dd:ea:eb, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:51:45.367896 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Using config drive
May 19 04:51:45.810364 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:45.810671 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:45.813958 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:51:45.814121 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Claim successful on node np0000001025
May 19 04:51:45.872594 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:51:45.979302 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Creating config drive at /opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/disk.config
May 19 04:51:45.983262 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf9tv73s6 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:51:46.041814 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf9tv73s6" returned: 0 in 0.058s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:51:46.117054 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:51:46.117390 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:51:46.405060 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:46.425187 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:46.426129 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:46.524151 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:46.577852 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-99aff020-e9aa-4e62-815f-c871455a0c58 req-20475767-a0c1-4d7a-8975-7d182204b3a8 service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Received event network-vif-plugged-4075449d-8606-42aa-82d0-371efdbcca11 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:51:46.578386 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-99aff020-e9aa-4e62-815f-c871455a0c58 req-20475767-a0c1-4d7a-8975-7d182204b3a8 service nova] Acquiring lock "9da3fdac-deca-4ab9-9df5-8342144acc13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:46.578589 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-99aff020-e9aa-4e62-815f-c871455a0c58 req-20475767-a0c1-4d7a-8975-7d182204b3a8 service nova] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:46.578717 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-99aff020-e9aa-4e62-815f-c871455a0c58 req-20475767-a0c1-4d7a-8975-7d182204b3a8 service nova] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:46.578827 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-99aff020-e9aa-4e62-815f-c871455a0c58 req-20475767-a0c1-4d7a-8975-7d182204b3a8 service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Processing event network-vif-plugged-4075449d-8606-42aa-82d0-371efdbcca11 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:51:46.615178 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:51:46.615334 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Cleaning up deleted instances {{(pid=97981) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 19 04:51:46.690050 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:46.691669 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:46.694140 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:46.714053 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:47.114252 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166307.1138604, 9da3fdac-deca-4ab9-9df5-8342144acc13 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:51:47.114832 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:51:47.115118 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] VM Started (Lifecycle Event)
May 19 04:51:47.117521 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:51:47.118728 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] There are 0 instances to clean {{(pid=97981) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 19 04:51:47.118978 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:51:47.119690 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:51:47.120058 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:51:47.122594 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Instance spawned successfully.
May 19 04:51:47.122949 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:51:47.618413 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:51:47.621185 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:51:47.623593 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:51:47.639410 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:51:47.639597 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:51:47.639954 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:51:47.640251 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:51:47.641265 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:51:47.643143 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:51:48.132948 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.322s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:48.133291 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:51:48.135221 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:51:48.135564 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166308.1354136, 9da3fdac-deca-4ab9-9df5-8342144acc13 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:51:48.136392 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] VM Paused (Lifecycle Event)
May 19 04:51:48.147531 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Took 6.54 seconds to spawn the instance on the hypervisor.
May 19 04:51:48.147600 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:51:48.637928 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:51:48.638079 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:51:48.638480 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:51:48.638888 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:51:48.640627 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:51:48.648404 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8090a604-f239-4ade-8fd1-451b42c37c47 req-18910ff6-e13c-42b8-9158-9eb0774cc4cd service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Received event network-vif-plugged-4075449d-8606-42aa-82d0-371efdbcca11 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:51:48.648477 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8090a604-f239-4ade-8fd1-451b42c37c47 req-18910ff6-e13c-42b8-9158-9eb0774cc4cd service nova] Acquiring lock "9da3fdac-deca-4ab9-9df5-8342144acc13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:48.651000 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8090a604-f239-4ade-8fd1-451b42c37c47 req-18910ff6-e13c-42b8-9158-9eb0774cc4cd service nova] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:48.651000 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8090a604-f239-4ade-8fd1-451b42c37c47 req-18910ff6-e13c-42b8-9158-9eb0774cc4cd service nova] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:48.651000 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8090a604-f239-4ade-8fd1-451b42c37c47 req-18910ff6-e13c-42b8-9158-9eb0774cc4cd service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] No waiting events found dispatching network-vif-plugged-4075449d-8606-42aa-82d0-371efdbcca11 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:51:48.651000 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-8090a604-f239-4ade-8fd1-451b42c37c47 req-18910ff6-e13c-42b8-9158-9eb0774cc4cd service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Received unexpected event network-vif-plugged-4075449d-8606-42aa-82d0-371efdbcca11 for instance with vm_state active and task_state None.
May 19 04:51:48.656295 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166308.6551306, 9da3fdac-deca-4ab9-9df5-8342144acc13 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:51:48.656295 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] VM Resumed (Lifecycle Event)
May 19 04:51:48.656681 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Took 11.79 seconds to build instance.
May 19 04:51:48.718134 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eafa3940f19346c8b574aa03335a0528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16b1deed8084634b3a8120ef6795f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:51:48.719315 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:48.848812 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:49.119130 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:51:49.119130 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:51:49.119574 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:51:49.150302 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:51:49.158804 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:51:49.159835 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e36fba69-b89d-464b-9a94-904e7244262f tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.300s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:49.165945 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:51:49.168540 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Successfully created port: ef570f36-69a8-403c-90b4-26185bba8130 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:51:49.611060 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:51:49.611487 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:51:49.654844 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:51:49.742554 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Successfully updated port: ef570f36-69a8-403c-90b4-26185bba8130 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:51:49.915971 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3487b789-d4d5-44dd-9ec7-ab9b24778281 req-7bbda2e1-6668-49ae-846d-11ae4735df4d service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Received event network-changed-4075449d-8606-42aa-82d0-371efdbcca11 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:51:49.916148 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3487b789-d4d5-44dd-9ec7-ab9b24778281 req-7bbda2e1-6668-49ae-846d-11ae4735df4d service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Refreshing instance network info cache due to event network-changed-4075449d-8606-42aa-82d0-371efdbcca11. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:51:49.916621 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3487b789-d4d5-44dd-9ec7-ab9b24778281 req-7bbda2e1-6668-49ae-846d-11ae4735df4d service nova] Acquiring lock "refresh_cache-9da3fdac-deca-4ab9-9df5-8342144acc13" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:51:49.916621 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3487b789-d4d5-44dd-9ec7-ab9b24778281 req-7bbda2e1-6668-49ae-846d-11ae4735df4d service nova] Acquired lock "refresh_cache-9da3fdac-deca-4ab9-9df5-8342144acc13" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:51:49.916621 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3487b789-d4d5-44dd-9ec7-ab9b24778281 req-7bbda2e1-6668-49ae-846d-11ae4735df4d service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Refreshing network info cache for port 4075449d-8606-42aa-82d0-371efdbcca11 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:51:50.160347 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Booting with volume 650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 at /dev/vda
May 19 04:51:50.206734 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:51:50.216918 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:51:50.237123 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:51:50.250362 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "refresh_cache-656a7921-42b1-45cd-802f-488693ff5268" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:51:50.250781 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquired lock "refresh_cache-656a7921-42b1-45cd-802f-488693ff5268" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:51:50.251224 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:51:50.289002 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:51:50.289679 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:51:50.297839 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:51:50.298793 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fec1:94ac', 'fe80::8c0d:8ff:fec2:525c', 'fe80::fc16:3eff:fe3f:eef9', 'fe80::fc16:3eff:fedd:eaeb', 'fe80::9403:78ff:fec9:7b94'] 
May 19 04:51:50.298896 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:51:50.298980 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:51:50.299236 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:51:50.299418 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Updating existing volume attachment record: df086a4e-4473-4b8f-beaf-78013742c7dd {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:51:50.421051 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-3487b789-d4d5-44dd-9ec7-ab9b24778281 req-7bbda2e1-6668-49ae-846d-11ae4735df4d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:51:50.615250 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:51:50.715463 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d759e4fe-a75f-42c8-a29c-de407cd0d82e req-501ee6c6-8930-4e56-90fb-50190f1c7352 service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Received event network-changed-ef570f36-69a8-403c-90b4-26185bba8130 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:51:50.715676 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d759e4fe-a75f-42c8-a29c-de407cd0d82e req-501ee6c6-8930-4e56-90fb-50190f1c7352 service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Refreshing instance network info cache due to event network-changed-ef570f36-69a8-403c-90b4-26185bba8130. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:51:50.716124 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d759e4fe-a75f-42c8-a29c-de407cd0d82e req-501ee6c6-8930-4e56-90fb-50190f1c7352 service nova] Acquiring lock "refresh_cache-656a7921-42b1-45cd-802f-488693ff5268" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:51:50.743608 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-3487b789-d4d5-44dd-9ec7-ab9b24778281 req-7bbda2e1-6668-49ae-846d-11ae4735df4d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:51:50.839699 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:51:50.886426 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:51:50.897126 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3487b789-d4d5-44dd-9ec7-ab9b24778281 req-7bbda2e1-6668-49ae-846d-11ae4735df4d service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Updated VIF entry in instance network info cache for port 4075449d-8606-42aa-82d0-371efdbcca11. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:51:50.897543 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3487b789-d4d5-44dd-9ec7-ab9b24778281 req-7bbda2e1-6668-49ae-846d-11ae4735df4d service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Updating instance_info_cache with network_info: [{"id": "4075449d-8606-42aa-82d0-371efdbcca11", "address": "fa:16:3e:dd:ea:eb", "network": {"id": "cde3508d-bb21-4be7-8e14-fc9f2e50f75c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-53532512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a69d8ed0ff94aa7aeeba4bb7186c857", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4075449d-86", "ovs_interfaceid": "4075449d-8606-42aa-82d0-371efdbcca11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:51:50.994743 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:51:51.120497 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:51.120679 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:51.120830 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:51.120955 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:51:51.155229 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Updating instance_info_cache with network_info: [{"id": "ef570f36-69a8-403c-90b4-26185bba8130", "address": "fa:16:3e:27:50:ef", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef570f36-69", "ovs_interfaceid": "ef570f36-69a8-403c-90b4-26185bba8130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:51:51.400217 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3487b789-d4d5-44dd-9ec7-ab9b24778281 req-7bbda2e1-6668-49ae-846d-11ae4735df4d service nova] Releasing lock "refresh_cache-9da3fdac-deca-4ab9-9df5-8342144acc13" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:51:51.657001 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Releasing lock "refresh_cache-656a7921-42b1-45cd-802f-488693ff5268" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:51:51.657309 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Instance network_info: |[{"id": "ef570f36-69a8-403c-90b4-26185bba8130", "address": "fa:16:3e:27:50:ef", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef570f36-69", "ovs_interfaceid": "ef570f36-69a8-403c-90b4-26185bba8130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:51:51.657587 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d759e4fe-a75f-42c8-a29c-de407cd0d82e req-501ee6c6-8930-4e56-90fb-50190f1c7352 service nova] Acquired lock "refresh_cache-656a7921-42b1-45cd-802f-488693ff5268" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:51:51.657721 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d759e4fe-a75f-42c8-a29c-de407cd0d82e req-501ee6c6-8930-4e56-90fb-50190f1c7352 service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Refreshing network info cache for port ef570f36-69a8-403c-90b4-26185bba8130 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:51:52.149833 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:51:52.152448 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:51:52.166567 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-d759e4fe-a75f-42c8-a29c-de407cd0d82e req-501ee6c6-8930-4e56-90fb-50190f1c7352 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:51:52.257478 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:51:52.257917 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:51:52.350987 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:51:52.355426 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:51:52.356851 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:51:52.357866 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:51:52.396912 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:51:52.398339 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:51:52.398589 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Creating image(s)
May 19 04:51:52.398868 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:51:52.399002 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Ensure instance console log exists: /opt/stack/data/nova/instances/656a7921-42b1-45cd-802f-488693ff5268/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:51:52.399401 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:52.399661 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:52.399820 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:52.400488 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Start _get_guest_xml network_info=[{"id": "ef570f36-69a8-403c-90b4-26185bba8130", "address": "fa:16:3e:27:50:ef", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef570f36-69", "ovs_interfaceid": "ef570f36-69a8-403c-90b4-26185bba8130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'df086a4e-4473-4b8f-beaf-78013742c7dd', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', 'iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '656a7921-42b1-45cd-802f-488693ff5268', 'attached_at': '', 'detached_at': '', 'volume_id': '650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', 'serial': '650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:51:52.401336 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:51:52.401895 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=13271MB free_disk=72.81046295166016GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:51:52.402045 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:52.402267 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:52.411279 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:51:52.413006 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-945352473', uuid='656a7921-42b1-45cd-802f-488693ff5268'), owner=OwnerMeta(userid='eafa3940f19346c8b574aa03335a0528', username='tempest-TestVolumeBootPatternV346-1959285151-project-member', projectid='d16b1deed8084634b3a8120ef6795f34', projectname='tempest-TestVolumeBootPatternV346-1959285151'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ef570f36-69a8-403c-90b4-26185bba8130", "address": "fa:16:3e:27:50:ef", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef570f36-69", "ovs_interfaceid": "ef570f36-69a8-403c-90b4-26185bba8130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166312.412616) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:51:52.417619 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:51:52.420366 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:51:52.422237 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:51:52.422619 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:51:52.423542 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:51:52.423840 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:51:52.423993 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:51:52.424095 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:51:52.425270 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:51:52.425393 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:51:52.425504 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:51:52.425661 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:51:52.425758 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:51:52.425883 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:51:52.425985 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:51:52.426128 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:51:52.444058 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:51:52.444420 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', 'iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:51:52.444601 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:51:52.445046 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:51:52.445258 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', 'iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:51:52.456375 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:51:52.457025 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:51:52.457430 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:51:52.457615 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:51:52.458537 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:51:52.458787 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:51:52.468799 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:51:52.468799 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:52.476129 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:51:52.476129 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:52.483573 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3] added
May 19 04:51:52.483573 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:51:52.483573 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:51:52.483573 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:51:52.483573 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:51:52.483573 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:51:52.483573 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:52.483736 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:51:52.483933 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0263(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:51:52.484071 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:51:52.487589 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-d759e4fe-a75f-42c8-a29c-de407cd0d82e req-501ee6c6-8930-4e56-90fb-50190f1c7352 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:51:52.489353 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3] added
May 19 04:51:52.489353 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:51:52.489353 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:51:52.489353 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:51:52.489353 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:51:52.489353 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:51:52.489353 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:52.489527 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:51:52.489728 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0309(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:51:52.489924 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:51:52.607348 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d759e4fe-a75f-42c8-a29c-de407cd0d82e req-501ee6c6-8930-4e56-90fb-50190f1c7352 service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Updated VIF entry in instance network info cache for port ef570f36-69a8-403c-90b4-26185bba8130. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:51:52.607640 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d759e4fe-a75f-42c8-a29c-de407cd0d82e req-501ee6c6-8930-4e56-90fb-50190f1c7352 service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Updating instance_info_cache with network_info: [{"id": "ef570f36-69a8-403c-90b4-26185bba8130", "address": "fa:16:3e:27:50:ef", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef570f36-69", "ovs_interfaceid": "ef570f36-69a8-403c-90b4-26185bba8130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:51:53.110245 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d759e4fe-a75f-42c8-a29c-de407cd0d82e req-501ee6c6-8930-4e56-90fb-50190f1c7352 service nova] Releasing lock "refresh_cache-656a7921-42b1-45cd-802f-488693ff5268" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:51:53.473455 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 9c2a46cb-f9b2-4c34-a041-2bda0bc64051 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:51:53.473861 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:51:53.473861 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 9da3fdac-deca-4ab9-9df5-8342144acc13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:51:53.473861 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 656a7921-42b1-45cd-802f-488693ff5268 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:51:53.473957 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:51:53.474059 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:51:52 up 42 min,  2 users,  load average: 2.84, 4.01, 3.88\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '4', 'num_proj_d16b1deed8084634b3a8120ef6795f34': '3', 'io_workload': '1', 'num_proj_8a69d8ed0ff94aa7aeeba4bb7186c857': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:51:53.484616 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:51:53.491486 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:51:53.498674 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:51:53.498674 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:51:53.506180 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:51:53.506180 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:53.513305 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:53.520331 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:53.530361 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:53.530361 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:53.530361 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:53.530361 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:53.530361 np0000001025 nova-compute[97981]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-461917cf-fdef-4f16-b983-16a4c30eb57b (non-flash)
May 19 04:51:53.530361 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:51:53.530637 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:53.530637 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:53.530637 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:53.530637 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:53.530637 np0000001025 nova-compute[97981]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-461917cf-fdef-4f16-b983-16a4c30eb57b (non-flash)
May 19 04:51:53.530637 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:51:53.537722 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:53.537722 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:53.537722 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:53.537722 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:53.537722 np0000001025 nova-compute[97981]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-461917cf-fdef-4f16-b983-16a4c30eb57b (non-flash)
May 19 04:51:53.537722 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:51:53.537931 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:53.537931 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:53.537931 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:53.537931 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:53.537931 np0000001025 nova-compute[97981]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-461917cf-fdef-4f16-b983-16a4c30eb57b (non-flash)
May 19 04:51:53.537931 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:51:53.565681 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3, portal: 192.168.40.100,3260]
May 19 04:51:53.565681 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3, portal: 192.168.40.100,3260] successful.
May 19 04:51:53.565681 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:53.576305 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3, portal: 192.168.50.100,3260]
May 19 04:51:53.576305 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3, portal: 192.168.50.100,3260] successful.
May 19 04:51:53.576305 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:53.576804 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:53.593504 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:53.593504 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:53.593504 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:53.593504 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:53.593504 np0000001025 nova-compute[97981]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-461917cf-fdef-4f16-b983-16a4c30eb57b (non-flash)
May 19 04:51:53.593504 np0000001025 nova-compute[97981]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:51:53.593504 np0000001025 nova-compute[97981]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:51:53.593504 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:51:53.596480 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:51:53.596767 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:53.596767 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:53.596767 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:53.596767 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:53.596767 np0000001025 nova-compute[97981]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-461917cf-fdef-4f16-b983-16a4c30eb57b (non-flash)
May 19 04:51:53.596767 np0000001025 nova-compute[97981]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:51:53.596767 np0000001025 nova-compute[97981]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:51:53.596767 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:51:53.597282 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:51:53.597430 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:51:53.598561 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] HCTL ('12', '-', '-', 0) found on session 173 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:51:53.598711 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:51:53.612589 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:53.612589 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:53.612589 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:53.612589 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:53.612589 np0000001025 nova-compute[97981]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-461917cf-fdef-4f16-b983-16a4c30eb57b (non-flash)
May 19 04:51:53.612589 np0000001025 nova-compute[97981]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:51:53.612589 np0000001025 nova-compute[97981]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:51:53.612589 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:51:53.613342 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:53.613342 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:51:53.613342 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:53.613342 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:51:53.613342 np0000001025 nova-compute[97981]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-461917cf-fdef-4f16-b983-16a4c30eb57b (non-flash)
May 19 04:51:53.613342 np0000001025 nova-compute[97981]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:51:53.613342 np0000001025 nova-compute[97981]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:51:53.613342 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:51:53.613342 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:51:53.613342 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:51:53.618944 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] HCTL ('13', '-', '-', 0) found on session 174 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:51:53.618944 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:51:53.622885 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Searching for a device in session 173 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:51:53.623041 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:51:53.641378 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Searching for a device in session 174 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:51:53.641378 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:51:53.724951 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:53.768631 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:51:53.769032 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:51:53.850356 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:54.273971 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:51:54.458694 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:51:54.786541 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:51:54.786940 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.384s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:54.787357 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 35.74 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:51:55.478932 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Found WWN 33000000031b74855 for multipath device dm-4 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:51:55.479205 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:51:55.479361 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '33000000031b74855', 'path': '/dev/dm-4', 'multipath_id': '33000000031b74855'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:51:55.479503 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000031b74855', 'path': '/dev/dm-4', 'multipath_id': '33000000031b74855'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:51:55.990332 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:51:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-945352473',display_name='tempest-TestVolumeBootPatternV346-server-945352473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpatternv346-server-945352473',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0cVkfSwoBK0iFb1CfOuKg/03uIXPNp7OhPp5BMpeoyzmx0+WvtZU2ssEoYoJd14aO19CtKvzEMoQt1UdFexlay4quzGsjzT6RuAZ3yy6j4rp6x2cUMdDDnAWV82dpO4A==',key_name='tempest-keypair-652142093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d16b1deed8084634b3a8120ef6795f34',ramdisk_id='',reservation_id='r-mn2u9p3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1959285151',owner_user_name='tempest-TestVolumeBootPatternV346-1959285151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:51:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eafa3940f19346c8b574aa03335a0528',uuid=656a7921-42b1-45cd-802f-488693ff5268,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef570f36-69a8-403c-90b4-26185bba8130", "address": "fa:16:3e:27:50:ef", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef570f36-69", "ovs_interfaceid": "ef570f36-69a8-403c-90b4-26185bba8130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:51:55.990874 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Converting VIF {"id": "ef570f36-69a8-403c-90b4-26185bba8130", "address": "fa:16:3e:27:50:ef", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef570f36-69", "ovs_interfaceid": "ef570f36-69a8-403c-90b4-26185bba8130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:51:55.991418 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:50:ef,bridge_name='br-int',has_traffic_filtering=True,id=ef570f36-69a8-403c-90b4-26185bba8130,network=Network(2bd74629-3dde-4be7-94c2-1550e25e2dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef570f36-69') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:51:55.992327 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lazy-loading 'pci_devices' on Instance uuid 656a7921-42b1-45cd-802f-488693ff5268 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:51:56.496461 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] End _get_guest_xml xml=<domain type="qemu">
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:   <uuid>656a7921-42b1-45cd-802f-488693ff5268</uuid>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:   <name>instance-00000049</name>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestVolumeBootPatternV346-server-945352473</nova:name>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:51:52</nova:creationTime>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:         <nova:user uuid="eafa3940f19346c8b574aa03335a0528">tempest-TestVolumeBootPatternV346-1959285151-project-member</nova:user>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:         <nova:project uuid="d16b1deed8084634b3a8120ef6795f34">tempest-TestVolumeBootPatternV346-1959285151</nova:project>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:         <nova:port uuid="ef570f36-69a8-403c-90b4-26185bba8130">
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     <system>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <entry name="serial">656a7921-42b1-45cd-802f-488693ff5268</entry>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <entry name="uuid">656a7921-42b1-45cd-802f-488693ff5268</entry>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     </system>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:   <os>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:   </os>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:   <features>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:   </features>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:   <devices>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/656a7921-42b1-45cd-802f-488693ff5268/disk.config"/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     </disk>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <alias name="ua-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3"/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-4"/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <serial>650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3</serial>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     </disk>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:27:50:ef"/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <target dev="tapef570f36-69"/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     </interface>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/656a7921-42b1-45cd-802f-488693ff5268/console.log" append="off"/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     </serial>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     <video>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     </video>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     </rng>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:   </devices>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]: </domain>
May 19 04:51:56.496461 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:51:56.498548 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Preparing to wait for external event network-vif-plugged-ef570f36-69a8-403c-90b4-26185bba8130 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:51:56.498548 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "656a7921-42b1-45cd-802f-488693ff5268-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:56.498548 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "656a7921-42b1-45cd-802f-488693ff5268-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:56.498548 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "656a7921-42b1-45cd-802f-488693ff5268-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:56.498548 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:51:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-945352473',display_name='tempest-TestVolumeBootPatternV346-server-945352473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpatternv346-server-945352473',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0cVkfSwoBK0iFb1CfOuKg/03uIXPNp7OhPp5BMpeoyzmx0+WvtZU2ssEoYoJd14aO19CtKvzEMoQt1UdFexlay4quzGsjzT6RuAZ3yy6j4rp6x2cUMdDDnAWV82dpO4A==',key_name='tempest-keypair-652142093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d16b1deed8084634b3a8120ef6795f34',ramdisk_id='',reservation_id='r-mn2u9p3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1959285151',owner_user_name='tempest-TestVolumeBootPatternV346-1959285151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:51:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eafa3940f19346c8b574aa03335a0528',uuid=656a7921-42b1-45cd-802f-488693ff5268,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef570f36-69a8-403c-90b4-26185bba8130", "address": "fa:16:3e:27:50:ef", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef570f36-69", "ovs_interfaceid": "ef570f36-69a8-403c-90b4-26185bba8130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:51:56.498548 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Converting VIF {"id": "ef570f36-69a8-403c-90b4-26185bba8130", "address": "fa:16:3e:27:50:ef", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef570f36-69", "ovs_interfaceid": "ef570f36-69a8-403c-90b4-26185bba8130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:51:56.499194 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:50:ef,bridge_name='br-int',has_traffic_filtering=True,id=ef570f36-69a8-403c-90b4-26185bba8130,network=Network(2bd74629-3dde-4be7-94c2-1550e25e2dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef570f36-69') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:51:56.499503 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:50:ef,bridge_name='br-int',has_traffic_filtering=True,id=ef570f36-69a8-403c-90b4-26185bba8130,network=Network(2bd74629-3dde-4be7-94c2-1550e25e2dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef570f36-69') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:51:56.503122 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:56.503122 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:51:56.503122 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:51:56.503122 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:56.503122 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0677e380-ca6a-505e-9a24-855e2f16c173', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:51:56.504593 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:56.506556 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:51:56.511183 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:56.511344 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef570f36-69, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:51:56.511680 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef570f36-69, col_values=(('qos', UUID('dcdfdcfa-803e-4d45-b423-6724e022acf6')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:51:56.511892 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef570f36-69, col_values=(('external_ids', {'iface-id': 'ef570f36-69a8-403c-90b4-26185bba8130', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:50:ef', 'vm-uuid': '656a7921-42b1-45cd-802f-488693ff5268'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:51:56.514963 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:51:56.518912 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:56.519787 np0000001025 nova-compute[97981]: INFO os_vif [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:50:ef,bridge_name='br-int',has_traffic_filtering=True,id=ef570f36-69a8-403c-90b4-26185bba8130,network=Network(2bd74629-3dde-4be7-94c2-1550e25e2dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef570f36-69')
May 19 04:51:58.047971 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:51:58.048527 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:51:58.048527 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] No VIF found with MAC fa:16:3e:27:50:ef, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:51:58.048657 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Using config drive
May 19 04:51:58.129229 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:58.554673 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:51:58.726289 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:58.761274 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Creating config drive at /opt/stack/data/nova/instances/656a7921-42b1-45cd-802f-488693ff5268/disk.config
May 19 04:51:58.766605 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/656a7921-42b1-45cd-802f-488693ff5268/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn1sb__y0 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:51:58.826789 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/656a7921-42b1-45cd-802f-488693ff5268/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn1sb__y0" returned: 0 in 0.060s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:51:59.262856 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:59.285696 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:59.390757 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:59.422883 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:51:59.463703 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-68bafb09-254d-4152-8085-1ceb0868eac8 req-3de3b73b-2c79-4c3d-b408-99eedd03f269 service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Received event network-vif-plugged-ef570f36-69a8-403c-90b4-26185bba8130 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:51:59.464012 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-68bafb09-254d-4152-8085-1ceb0868eac8 req-3de3b73b-2c79-4c3d-b408-99eedd03f269 service nova] Acquiring lock "656a7921-42b1-45cd-802f-488693ff5268-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:51:59.464276 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-68bafb09-254d-4152-8085-1ceb0868eac8 req-3de3b73b-2c79-4c3d-b408-99eedd03f269 service nova] Lock "656a7921-42b1-45cd-802f-488693ff5268-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:51:59.464496 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-68bafb09-254d-4152-8085-1ceb0868eac8 req-3de3b73b-2c79-4c3d-b408-99eedd03f269 service nova] Lock "656a7921-42b1-45cd-802f-488693ff5268-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:51:59.464626 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-68bafb09-254d-4152-8085-1ceb0868eac8 req-3de3b73b-2c79-4c3d-b408-99eedd03f269 service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Processing event network-vif-plugged-ef570f36-69a8-403c-90b4-26185bba8130 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:51:59.960508 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:00.042650 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:52:00.043133 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166320.0427587, 656a7921-42b1-45cd-802f-488693ff5268 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:52:00.043301 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 656a7921-42b1-45cd-802f-488693ff5268] VM Started (Lifecycle Event)
May 19 04:52:00.045963 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:52:00.048258 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Instance spawned successfully.
May 19 04:52:00.048550 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:52:00.546538 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:52:00.548609 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:52:00.554351 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:52:00.554538 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:52:00.554857 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:52:00.555100 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:52:00.555419 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:52:00.555709 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:52:01.052621 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 656a7921-42b1-45cd-802f-488693ff5268] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:52:01.052829 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166321.0526762, 656a7921-42b1-45cd-802f-488693ff5268 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:52:01.052929 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 656a7921-42b1-45cd-802f-488693ff5268] VM Paused (Lifecycle Event)
May 19 04:52:01.062319 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Took 8.66 seconds to spawn the instance on the hypervisor.
May 19 04:52:01.062574 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:52:01.521001 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:01.523279 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-97d2f9c2-05bf-415e-8605-df3b6403d9f3 req-c79b2fb1-739f-41c8-844c-2f6260d45b56 service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Received event network-vif-plugged-ef570f36-69a8-403c-90b4-26185bba8130 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:52:01.523535 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-97d2f9c2-05bf-415e-8605-df3b6403d9f3 req-c79b2fb1-739f-41c8-844c-2f6260d45b56 service nova] Acquiring lock "656a7921-42b1-45cd-802f-488693ff5268-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:01.523723 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-97d2f9c2-05bf-415e-8605-df3b6403d9f3 req-c79b2fb1-739f-41c8-844c-2f6260d45b56 service nova] Lock "656a7921-42b1-45cd-802f-488693ff5268-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:01.523881 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-97d2f9c2-05bf-415e-8605-df3b6403d9f3 req-c79b2fb1-739f-41c8-844c-2f6260d45b56 service nova] Lock "656a7921-42b1-45cd-802f-488693ff5268-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:01.526863 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-97d2f9c2-05bf-415e-8605-df3b6403d9f3 req-c79b2fb1-739f-41c8-844c-2f6260d45b56 service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] No waiting events found dispatching network-vif-plugged-ef570f36-69a8-403c-90b4-26185bba8130 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:52:01.527024 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-97d2f9c2-05bf-415e-8605-df3b6403d9f3 req-c79b2fb1-739f-41c8-844c-2f6260d45b56 service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Received unexpected event network-vif-plugged-ef570f36-69a8-403c-90b4-26185bba8130 for instance with vm_state active and task_state None.
May 19 04:52:01.557538 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:52:01.559651 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166321.5593963, 656a7921-42b1-45cd-802f-488693ff5268 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:52:01.559773 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 656a7921-42b1-45cd-802f-488693ff5268] VM Resumed (Lifecycle Event)
May 19 04:52:01.572394 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Took 15.80 seconds to build instance.
May 19 04:52:02.062136 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:52:02.063659 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:52:02.073899 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7940eb93-5ef6-4dc2-bed1-b11fe32d2dae tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "656a7921-42b1-45cd-802f-488693ff5268" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.309s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:02.494948 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:03.581132 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ba89eb51-c420-4620-9285-2660cc49d9a5 req-2393f6a6-2a78-491f-933a-5ca9435efb28 service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Received event network-changed-ef570f36-69a8-403c-90b4-26185bba8130 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:52:03.581474 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ba89eb51-c420-4620-9285-2660cc49d9a5 req-2393f6a6-2a78-491f-933a-5ca9435efb28 service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Refreshing instance network info cache due to event network-changed-ef570f36-69a8-403c-90b4-26185bba8130. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:52:03.581732 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ba89eb51-c420-4620-9285-2660cc49d9a5 req-2393f6a6-2a78-491f-933a-5ca9435efb28 service nova] Acquiring lock "refresh_cache-656a7921-42b1-45cd-802f-488693ff5268" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:52:03.581878 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ba89eb51-c420-4620-9285-2660cc49d9a5 req-2393f6a6-2a78-491f-933a-5ca9435efb28 service nova] Acquired lock "refresh_cache-656a7921-42b1-45cd-802f-488693ff5268" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:52:03.582081 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-ba89eb51-c420-4620-9285-2660cc49d9a5 req-2393f6a6-2a78-491f-933a-5ca9435efb28 service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Refreshing network info cache for port ef570f36-69a8-403c-90b4-26185bba8130 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:52:03.740706 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:04.085835 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-ba89eb51-c420-4620-9285-2660cc49d9a5 req-2393f6a6-2a78-491f-933a-5ca9435efb28 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:52:04.123212 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:04.492485 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-ba89eb51-c420-4620-9285-2660cc49d9a5 req-2393f6a6-2a78-491f-933a-5ca9435efb28 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:52:04.618605 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-ba89eb51-c420-4620-9285-2660cc49d9a5 req-2393f6a6-2a78-491f-933a-5ca9435efb28 service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Updated VIF entry in instance network info cache for port ef570f36-69a8-403c-90b4-26185bba8130. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:52:04.619215 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-ba89eb51-c420-4620-9285-2660cc49d9a5 req-2393f6a6-2a78-491f-933a-5ca9435efb28 service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Updating instance_info_cache with network_info: [{"id": "ef570f36-69a8-403c-90b4-26185bba8130", "address": "fa:16:3e:27:50:ef", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef570f36-69", "ovs_interfaceid": "ef570f36-69a8-403c-90b4-26185bba8130", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:52:05.120989 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ba89eb51-c420-4620-9285-2660cc49d9a5 req-2393f6a6-2a78-491f-933a-5ca9435efb28 service nova] Releasing lock "refresh_cache-656a7921-42b1-45cd-802f-488693ff5268" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:52:05.568182 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Acquiring lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:05.568341 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:06.071197 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:52:06.522633 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:06.626651 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:06.626805 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:06.629505 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:52:06.629619 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Claim successful on node np0000001025
May 19 04:52:07.687685 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Refreshing inventories for resource provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 19 04:52:07.727610 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Updating ProviderTree inventory for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 19 04:52:07.727749 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Updating inventory in ProviderTree for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 19 04:52:07.768803 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Refreshing aggregate associations for resource provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6, aggregates: None {{(pid=97981) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 19 04:52:07.814862 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Refreshing trait associations for resource provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6, traits: COMPUTE_SOUND_MODEL_AC97,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ARCH_S390X,COMPUTE_SOUND_MODEL_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SOUND_MODEL_ICH9,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ARCH_MIPSEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_SOUND_MODEL_ICH6,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIF_MODEL_IGB,HW_ARCH_X86_64,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ARCH_X86_64,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ARCH_RISCV64,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_ARCH_AARCH64,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_STORAGE_VIRTIO_FS {{(pid=97981) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 19 04:52:08.060282 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:52:08.060525 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:52:08.563448 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:52:08.756849 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:09.072429 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.445s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:09.072917 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:52:09.578123 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:52:09.578256 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:52:09.578569 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:52:09.578784 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:52:09.647419 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c51bac20489488fa027fa2951469790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0948913050fb4be783da551a1602d62b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:52:10.022245 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Successfully created port: cfc8b51a-841c-466e-9cf9-a6f5f77149f7 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:52:10.084132 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:52:10.526119 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Successfully updated port: cfc8b51a-841c-466e-9cf9-a6f5f77149f7 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:52:10.585525 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:52:10.599201 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-03cc87bb-6ffd-4d9e-9b06-ab1866efaf73 req-2d16b44b-520a-4b47-bfbb-d670078631de service nova] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Received event network-changed-cfc8b51a-841c-466e-9cf9-a6f5f77149f7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:52:10.602436 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-03cc87bb-6ffd-4d9e-9b06-ab1866efaf73 req-2d16b44b-520a-4b47-bfbb-d670078631de service nova] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Refreshing instance network info cache due to event network-changed-cfc8b51a-841c-466e-9cf9-a6f5f77149f7. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:52:10.602436 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-03cc87bb-6ffd-4d9e-9b06-ab1866efaf73 req-2d16b44b-520a-4b47-bfbb-d670078631de service nova] Acquiring lock "refresh_cache-04ec9e0a-3657-46d6-9d38-9fdee11c7a12" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:52:10.602436 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-03cc87bb-6ffd-4d9e-9b06-ab1866efaf73 req-2d16b44b-520a-4b47-bfbb-d670078631de service nova] Acquired lock "refresh_cache-04ec9e0a-3657-46d6-9d38-9fdee11c7a12" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:52:10.602436 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-03cc87bb-6ffd-4d9e-9b06-ab1866efaf73 req-2d16b44b-520a-4b47-bfbb-d670078631de service nova] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Refreshing network info cache for port cfc8b51a-841c-466e-9cf9-a6f5f77149f7 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:52:10.692020 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b64700df-3032-4c94-912c-224a347a13cd req-61de3971-9f14-4ad0-943c-8cd84d9d4732 service nova] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Received event network-vif-unplugged-cfc8b51a-841c-466e-9cf9-a6f5f77149f7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:52:10.693014 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b64700df-3032-4c94-912c-224a347a13cd req-61de3971-9f14-4ad0-943c-8cd84d9d4732 service nova] Acquiring lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:10.693014 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b64700df-3032-4c94-912c-224a347a13cd req-61de3971-9f14-4ad0-943c-8cd84d9d4732 service nova] Lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:10.693014 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b64700df-3032-4c94-912c-224a347a13cd req-61de3971-9f14-4ad0-943c-8cd84d9d4732 service nova] Lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:10.693014 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b64700df-3032-4c94-912c-224a347a13cd req-61de3971-9f14-4ad0-943c-8cd84d9d4732 service nova] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] No waiting events found dispatching network-vif-unplugged-cfc8b51a-841c-466e-9cf9-a6f5f77149f7 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:52:10.693014 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-b64700df-3032-4c94-912c-224a347a13cd req-61de3971-9f14-4ad0-943c-8cd84d9d4732 service nova] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Received unexpected event network-vif-unplugged-cfc8b51a-841c-466e-9cf9-a6f5f77149f7 for instance with vm_state building and task_state block_device_mapping.
May 19 04:52:11.028499 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Acquiring lock "refresh_cache-04ec9e0a-3657-46d6-9d38-9fdee11c7a12" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:52:11.105336 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-03cc87bb-6ffd-4d9e-9b06-ab1866efaf73 req-2d16b44b-520a-4b47-bfbb-d670078631de service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:52:11.172601 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-03cc87bb-6ffd-4d9e-9b06-ab1866efaf73 req-2d16b44b-520a-4b47-bfbb-d670078631de service nova] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:52:11.324100 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-03cc87bb-6ffd-4d9e-9b06-ab1866efaf73 req-2d16b44b-520a-4b47-bfbb-d670078631de service nova] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:52:11.523737 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:11.597713 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:52:11.598651 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:52:11.598920 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Creating image(s)
May 19 04:52:11.599453 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Acquiring lock "/opt/stack/data/nova/instances/04ec9e0a-3657-46d6-9d38-9fdee11c7a12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:11.599668 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Lock "/opt/stack/data/nova/instances/04ec9e0a-3657-46d6-9d38-9fdee11c7a12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:11.600166 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Lock "/opt/stack/data/nova/instances/04ec9e0a-3657-46d6-9d38-9fdee11c7a12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:11.600631 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:52:11.603128 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:52:11.604228 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:52:11.691021 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.086s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:52:11.691546 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:11.692036 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:11.692562 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:52:11.695187 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:52:11.695559 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:52:11.782012 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.086s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:52:11.783431 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/04ec9e0a-3657-46d6-9d38-9fdee11c7a12/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:52:11.827373 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-03cc87bb-6ffd-4d9e-9b06-ab1866efaf73 req-2d16b44b-520a-4b47-bfbb-d670078631de service nova] Releasing lock "refresh_cache-04ec9e0a-3657-46d6-9d38-9fdee11c7a12" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:52:11.828279 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Acquired lock "refresh_cache-04ec9e0a-3657-46d6-9d38-9fdee11c7a12" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:52:11.828611 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:52:11.854853 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/04ec9e0a-3657-46d6-9d38-9fdee11c7a12/disk 1073741824" returned: 0 in 0.071s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:52:11.855377 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.163s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:11.855862 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:52:11.943823 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.088s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:52:11.944259 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04ec9e0a-3657-46d6-9d38-9fdee11c7a12/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:52:11.944526 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ec9e0a-3657-46d6-9d38-9fdee11c7a12/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:52:12.029124 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ec9e0a-3657-46d6-9d38-9fdee11c7a12/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:52:12.029578 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Cannot resize image /opt/stack/data/nova/instances/04ec9e0a-3657-46d6-9d38-9fdee11c7a12/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:52:12.029857 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:52:12.030145 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Ensure instance console log exists: /opt/stack/data/nova/instances/04ec9e0a-3657-46d6-9d38-9fdee11c7a12/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:52:12.030403 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:12.030626 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:12.030754 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:12.397812 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:52:12.546206 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:52:12.661401 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Updating instance_info_cache with network_info: [{"id": "cfc8b51a-841c-466e-9cf9-a6f5f77149f7", "address": "fa:16:3e:df:8f:96", "network": {"id": "4c1902cf-e4cf-466f-9c73-93c586aa1f00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909387874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0948913050fb4be783da551a1602d62b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc8b51a-84", "ovs_interfaceid": "cfc8b51a-841c-466e-9cf9-a6f5f77149f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:52:13.164187 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Releasing lock "refresh_cache-04ec9e0a-3657-46d6-9d38-9fdee11c7a12" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:52:13.164617 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Instance network_info: |[{"id": "cfc8b51a-841c-466e-9cf9-a6f5f77149f7", "address": "fa:16:3e:df:8f:96", "network": {"id": "4c1902cf-e4cf-466f-9c73-93c586aa1f00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909387874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0948913050fb4be783da551a1602d62b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc8b51a-84", "ovs_interfaceid": "cfc8b51a-841c-466e-9cf9-a6f5f77149f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:52:13.166441 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Start _get_guest_xml network_info=[{"id": "cfc8b51a-841c-466e-9cf9-a6f5f77149f7", "address": "fa:16:3e:df:8f:96", "network": {"id": "4c1902cf-e4cf-466f-9c73-93c586aa1f00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909387874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0948913050fb4be783da551a1602d62b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc8b51a-84", "ovs_interfaceid": "cfc8b51a-841c-466e-9cf9-a6f5f77149f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:52:13.170490 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:52:13.172158 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-1409098377', uuid='04ec9e0a-3657-46d6-9d38-9fdee11c7a12'), owner=OwnerMeta(userid='8c51bac20489488fa027fa2951469790', username='tempest-VolumesActionsTest-1309022212-project-member', projectid='0948913050fb4be783da551a1602d62b', projectname='tempest-VolumesActionsTest-1309022212'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cfc8b51a-841c-466e-9cf9-a6f5f77149f7", "address": "fa:16:3e:df:8f:96", "network": {"id": "4c1902cf-e4cf-466f-9c73-93c586aa1f00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909387874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0948913050fb4be783da551a1602d62b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc8b51a-84", "ovs_interfaceid": "cfc8b51a-841c-466e-9cf9-a6f5f77149f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166333.1716764) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:52:13.173213 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:52:13.173604 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:52:13.174586 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:52:13.174771 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:52:13.175901 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:52:13.176290 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:52:13.176459 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:52:13.176588 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:52:13.176749 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:52:13.176855 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:52:13.176978 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:52:13.177183 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:52:13.177313 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:52:13.177452 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:52:13.177596 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:52:13.177739 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:52:13.192855 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:52:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1409098377',display_name='tempest-VolumesActionsTest-instance-1409098377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesactionstest-instance-1409098377',id=74,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0948913050fb4be783da551a1602d62b',ramdisk_id='',reservation_id='r-j446skvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1309022212',owner_user_name='tempest-VolumesActionsTest-1309022212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:52:11Z,user_data=None,user_id='8c51bac20489488fa027fa2951469790',uuid=04ec9e0a-3657-46d6-9d38-9fdee11c7a12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfc8b51a-841c-466e-9cf9-a6f5f77149f7", "address": "fa:16:3e:df:8f:96", "network": {"id": "4c1902cf-e4cf-466f-9c73-93c586aa1f00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909387874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0948913050fb4be783da551a1602d62b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc8b51a-84", "ovs_interfaceid": "cfc8b51a-841c-466e-9cf9-a6f5f77149f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:52:13.193061 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Converting VIF {"id": "cfc8b51a-841c-466e-9cf9-a6f5f77149f7", "address": "fa:16:3e:df:8f:96", "network": {"id": "4c1902cf-e4cf-466f-9c73-93c586aa1f00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909387874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0948913050fb4be783da551a1602d62b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc8b51a-84", "ovs_interfaceid": "cfc8b51a-841c-466e-9cf9-a6f5f77149f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:52:13.193744 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:8f:96,bridge_name='br-int',has_traffic_filtering=True,id=cfc8b51a-841c-466e-9cf9-a6f5f77149f7,network=Network(4c1902cf-e4cf-466f-9c73-93c586aa1f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfc8b51a-84') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:52:13.194459 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Lazy-loading 'pci_devices' on Instance uuid 04ec9e0a-3657-46d6-9d38-9fdee11c7a12 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:52:13.697013 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] End _get_guest_xml xml=<domain type="qemu">
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:   <uuid>04ec9e0a-3657-46d6-9d38-9fdee11c7a12</uuid>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:   <name>instance-0000004a</name>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <nova:name>tempest-VolumesActionsTest-instance-1409098377</nova:name>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:52:13</nova:creationTime>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:         <nova:user uuid="8c51bac20489488fa027fa2951469790">tempest-VolumesActionsTest-1309022212-project-member</nova:user>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:         <nova:project uuid="0948913050fb4be783da551a1602d62b">tempest-VolumesActionsTest-1309022212</nova:project>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:         <nova:port uuid="cfc8b51a-841c-466e-9cf9-a6f5f77149f7">
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     <system>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <entry name="serial">04ec9e0a-3657-46d6-9d38-9fdee11c7a12</entry>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <entry name="uuid">04ec9e0a-3657-46d6-9d38-9fdee11c7a12</entry>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     </system>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:   <os>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:   </os>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:   <features>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:   </features>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:   <devices>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/04ec9e0a-3657-46d6-9d38-9fdee11c7a12/disk"/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     </disk>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/04ec9e0a-3657-46d6-9d38-9fdee11c7a12/disk.config"/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     </disk>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:df:8f:96"/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <target dev="tapcfc8b51a-84"/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     </interface>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/04ec9e0a-3657-46d6-9d38-9fdee11c7a12/console.log" append="off"/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     </serial>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     <video>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     </video>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     </rng>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:   </devices>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]: </domain>
May 19 04:52:13.697013 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:52:13.700238 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Preparing to wait for external event network-vif-plugged-cfc8b51a-841c-466e-9cf9-a6f5f77149f7 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:52:13.700238 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Acquiring lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:13.700238 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:13.700238 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:13.700238 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:52:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1409098377',display_name='tempest-VolumesActionsTest-instance-1409098377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesactionstest-instance-1409098377',id=74,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0948913050fb4be783da551a1602d62b',ramdisk_id='',reservation_id='r-j446skvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1309022212',owner_user_name='tempest-VolumesActionsTest-1309022212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:52:11Z,user_data=None,user_id='8c51bac20489488fa027fa2951469790',uuid=04ec9e0a-3657-46d6-9d38-9fdee11c7a12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfc8b51a-841c-466e-9cf9-a6f5f77149f7", "address": "fa:16:3e:df:8f:96", "network": {"id": "4c1902cf-e4cf-466f-9c73-93c586aa1f00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909387874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0948913050fb4be783da551a1602d62b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc8b51a-84", "ovs_interfaceid": "cfc8b51a-841c-466e-9cf9-a6f5f77149f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:52:13.700238 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Converting VIF {"id": "cfc8b51a-841c-466e-9cf9-a6f5f77149f7", "address": "fa:16:3e:df:8f:96", "network": {"id": "4c1902cf-e4cf-466f-9c73-93c586aa1f00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909387874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0948913050fb4be783da551a1602d62b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc8b51a-84", "ovs_interfaceid": "cfc8b51a-841c-466e-9cf9-a6f5f77149f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:52:13.700238 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:8f:96,bridge_name='br-int',has_traffic_filtering=True,id=cfc8b51a-841c-466e-9cf9-a6f5f77149f7,network=Network(4c1902cf-e4cf-466f-9c73-93c586aa1f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfc8b51a-84') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:52:13.700238 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:8f:96,bridge_name='br-int',has_traffic_filtering=True,id=cfc8b51a-841c-466e-9cf9-a6f5f77149f7,network=Network(4c1902cf-e4cf-466f-9c73-93c586aa1f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfc8b51a-84') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:52:13.700238 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:13.700588 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:52:13.700819 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:52:13.701519 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:13.701656 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afc5751a-21ae-5cb9-8fe9-1812a5e6a820', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:52:13.710018 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:13.710951 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:52:13.712728 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:13.712861 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfc8b51a-84, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:52:13.713175 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcfc8b51a-84, col_values=(('qos', UUID('8ddea9eb-cb3d-4950-9722-8614609448c4')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:52:13.713334 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcfc8b51a-84, col_values=(('external_ids', {'iface-id': 'cfc8b51a-841c-466e-9cf9-a6f5f77149f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:8f:96', 'vm-uuid': '04ec9e0a-3657-46d6-9d38-9fdee11c7a12'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:52:13.713988 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:13.714979 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:52:13.719163 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:13.719872 np0000001025 nova-compute[97981]: INFO os_vif [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:8f:96,bridge_name='br-int',has_traffic_filtering=True,id=cfc8b51a-841c-466e-9cf9-a6f5f77149f7,network=Network(4c1902cf-e4cf-466f-9c73-93c586aa1f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfc8b51a-84')
May 19 04:52:13.757735 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:15.233606 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:52:15.234001 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:52:15.234001 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] No VIF found with MAC fa:16:3e:df:8f:96, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:52:15.234354 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Using config drive
May 19 04:52:15.740798 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:52:15.853869 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Creating config drive at /opt/stack/data/nova/instances/04ec9e0a-3657-46d6-9d38-9fdee11c7a12/disk.config
May 19 04:52:15.857093 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/04ec9e0a-3657-46d6-9d38-9fdee11c7a12/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzsfnsorx {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:52:15.909548 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/04ec9e0a-3657-46d6-9d38-9fdee11c7a12/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzsfnsorx" returned: 0 in 0.052s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:52:16.314679 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:16.335857 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:16.403251 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:16.483269 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-67347348-6af2-468e-bda4-6422c0797ed5 req-a0957947-f30f-4a67-b4bc-6ff5540712cf service nova] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Received event network-vif-plugged-cfc8b51a-841c-466e-9cf9-a6f5f77149f7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:52:16.483505 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-67347348-6af2-468e-bda4-6422c0797ed5 req-a0957947-f30f-4a67-b4bc-6ff5540712cf service nova] Acquiring lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:16.483685 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-67347348-6af2-468e-bda4-6422c0797ed5 req-a0957947-f30f-4a67-b4bc-6ff5540712cf service nova] Lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:16.483843 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-67347348-6af2-468e-bda4-6422c0797ed5 req-a0957947-f30f-4a67-b4bc-6ff5540712cf service nova] Lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:16.484001 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-67347348-6af2-468e-bda4-6422c0797ed5 req-a0957947-f30f-4a67-b4bc-6ff5540712cf service nova] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Processing event network-vif-plugged-cfc8b51a-841c-466e-9cf9-a6f5f77149f7 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:52:16.600304 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:16.601650 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:16.604002 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:16.621924 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:16.990292 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166336.9899156, 04ec9e0a-3657-46d6-9d38-9fdee11c7a12 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:52:16.990441 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] VM Started (Lifecycle Event)
May 19 04:52:16.992625 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:52:16.994415 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:52:16.997549 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Instance spawned successfully.
May 19 04:52:16.998865 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:52:17.494523 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:52:17.496359 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:52:17.504272 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:52:17.506466 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:52:17.506466 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:52:17.506466 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:52:17.506466 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:52:17.506466 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:52:17.998963 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:52:17.999190 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166337.9990294, 04ec9e0a-3657-46d6-9d38-9fdee11c7a12 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:52:17.999288 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] VM Paused (Lifecycle Event)
May 19 04:52:18.010417 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Took 6.41 seconds to spawn the instance on the hypervisor.
May 19 04:52:18.011535 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:52:18.501286 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:52:18.503146 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166338.5029325, 04ec9e0a-3657-46d6-9d38-9fdee11c7a12 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:52:18.503263 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] VM Resumed (Lifecycle Event)
May 19 04:52:18.523020 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Took 11.95 seconds to build instance.
May 19 04:52:18.543130 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7ee4b8d4-5e9c-4153-a35a-1dded7cf6e1f req-6563dbc7-6d16-407c-b264-16856c6f1e1f service nova] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Received event network-vif-plugged-cfc8b51a-841c-466e-9cf9-a6f5f77149f7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:52:18.543285 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7ee4b8d4-5e9c-4153-a35a-1dded7cf6e1f req-6563dbc7-6d16-407c-b264-16856c6f1e1f service nova] Acquiring lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:18.543443 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7ee4b8d4-5e9c-4153-a35a-1dded7cf6e1f req-6563dbc7-6d16-407c-b264-16856c6f1e1f service nova] Lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:18.543591 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-7ee4b8d4-5e9c-4153-a35a-1dded7cf6e1f req-6563dbc7-6d16-407c-b264-16856c6f1e1f service nova] Lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:18.543758 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-7ee4b8d4-5e9c-4153-a35a-1dded7cf6e1f req-6563dbc7-6d16-407c-b264-16856c6f1e1f service nova] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] No waiting events found dispatching network-vif-plugged-cfc8b51a-841c-466e-9cf9-a6f5f77149f7 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:52:18.543878 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-7ee4b8d4-5e9c-4153-a35a-1dded7cf6e1f req-6563dbc7-6d16-407c-b264-16856c6f1e1f service nova] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Received unexpected event network-vif-plugged-cfc8b51a-841c-466e-9cf9-a6f5f77149f7 for instance with vm_state active and task_state None.
May 19 04:52:18.724095 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:18.760982 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:19.005376 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:52:19.007501 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:52:19.025074 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-36076832-c750-486e-b673-92f7486cd4c9 tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.457s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:23.735157 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:23.762098 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:24.413540 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Acquiring lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:24.413850 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:24.413935 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Acquiring lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:24.414117 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:24.414578 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:24.418471 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Terminating instance
May 19 04:52:24.925920 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:52:24.953465 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:24.955602 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:24.973271 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:24.991676 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:24.997775 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:25.096037 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8f598573-5778-43f2-8228-ce718799ead1 req-a4ce79d5-a5f5-4eb5-9c4b-5f847f8ae17f service nova] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Received event network-vif-unplugged-cfc8b51a-841c-466e-9cf9-a6f5f77149f7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:52:25.096037 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8f598573-5778-43f2-8228-ce718799ead1 req-a4ce79d5-a5f5-4eb5-9c4b-5f847f8ae17f service nova] Acquiring lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:25.096037 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8f598573-5778-43f2-8228-ce718799ead1 req-a4ce79d5-a5f5-4eb5-9c4b-5f847f8ae17f service nova] Lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:25.096037 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8f598573-5778-43f2-8228-ce718799ead1 req-a4ce79d5-a5f5-4eb5-9c4b-5f847f8ae17f service nova] Lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:25.096226 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8f598573-5778-43f2-8228-ce718799ead1 req-a4ce79d5-a5f5-4eb5-9c4b-5f847f8ae17f service nova] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] No waiting events found dispatching network-vif-unplugged-cfc8b51a-841c-466e-9cf9-a6f5f77149f7 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:52:25.096226 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8f598573-5778-43f2-8228-ce718799ead1 req-a4ce79d5-a5f5-4eb5-9c4b-5f847f8ae17f service nova] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Received event network-vif-unplugged-cfc8b51a-841c-466e-9cf9-a6f5f77149f7 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:52:25.154589 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:25.250527 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999681336000322 future=<Future at 0x721850384a10 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:52:25.250821 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.99930292099998 future=<Future at 0x721850384a10 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:52:25.251032 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999062153000068 future=<Future at 0x721850384a10 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:52:25.253098 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Instance destroyed successfully.
May 19 04:52:25.253617 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Lazy-loading 'resources' on Instance uuid 04ec9e0a-3657-46d6-9d38-9fdee11c7a12 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:52:25.755815 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:52:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1409098377',display_name='tempest-VolumesActionsTest-instance-1409098377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-volumesactionstest-instance-1409098377',id=74,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:52:18Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0948913050fb4be783da551a1602d62b',ramdisk_id='',reservation_id='r-j446skvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1309022212',owner_user_name='tempest-VolumesActionsTest-1309022212-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:52:18Z,user_data=None,user_id='8c51bac20489488fa027fa2951469790',uuid=04ec9e0a-3657-46d6-9d38-9fdee11c7a12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfc8b51a-841c-466e-9cf9-a6f5f77149f7", "address": "fa:16:3e:df:8f:96", "network": {"id": "4c1902cf-e4cf-466f-9c73-93c586aa1f00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909387874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0948913050fb4be783da551a1602d62b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc8b51a-84", "ovs_interfaceid": "cfc8b51a-841c-466e-9cf9-a6f5f77149f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:52:25.756034 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Converting VIF {"id": "cfc8b51a-841c-466e-9cf9-a6f5f77149f7", "address": "fa:16:3e:df:8f:96", "network": {"id": "4c1902cf-e4cf-466f-9c73-93c586aa1f00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1909387874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0948913050fb4be783da551a1602d62b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc8b51a-84", "ovs_interfaceid": "cfc8b51a-841c-466e-9cf9-a6f5f77149f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:52:25.756609 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:8f:96,bridge_name='br-int',has_traffic_filtering=True,id=cfc8b51a-841c-466e-9cf9-a6f5f77149f7,network=Network(4c1902cf-e4cf-466f-9c73-93c586aa1f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfc8b51a-84') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:52:25.756856 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:8f:96,bridge_name='br-int',has_traffic_filtering=True,id=cfc8b51a-841c-466e-9cf9-a6f5f77149f7,network=Network(4c1902cf-e4cf-466f-9c73-93c586aa1f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfc8b51a-84') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:52:25.758210 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:25.758470 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfc8b51a-84, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:52:25.759989 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:25.760313 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:52:25.760471 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:25.761209 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:25.761339 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ddea9eb-cb3d-4950-9722-8614609448c4) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:52:25.761965 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:25.762084 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:52:25.762555 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:25.764404 np0000001025 nova-compute[97981]: INFO os_vif [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:8f:96,bridge_name='br-int',has_traffic_filtering=True,id=cfc8b51a-841c-466e-9cf9-a6f5f77149f7,network=Network(4c1902cf-e4cf-466f-9c73-93c586aa1f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfc8b51a-84')
May 19 04:52:25.764685 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Deleting instance files /opt/stack/data/nova/instances/04ec9e0a-3657-46d6-9d38-9fdee11c7a12_del
May 19 04:52:25.765234 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Deletion of /opt/stack/data/nova/instances/04ec9e0a-3657-46d6-9d38-9fdee11c7a12_del complete
May 19 04:52:26.272341 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Took 1.35 seconds to destroy the instance on the hypervisor.
May 19 04:52:26.272958 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:52:26.273153 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:52:26.273255 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:52:26.273534 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:52:26.329379 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:52:26.507224 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "9da3fdac-deca-4ab9-9df5-8342144acc13" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:26.507714 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:27.016646 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lazy-loading 'flavor' on Instance uuid 9da3fdac-deca-4ab9-9df5-8342144acc13 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:52:27.045781 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:52:27.148209 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3deafc1d-5c48-44b1-a4f5-fb34fb418136 req-faeda9ab-158c-4c4b-800a-ac00c60e55f5 service nova] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Received event network-vif-unplugged-cfc8b51a-841c-466e-9cf9-a6f5f77149f7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:52:27.148312 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3deafc1d-5c48-44b1-a4f5-fb34fb418136 req-faeda9ab-158c-4c4b-800a-ac00c60e55f5 service nova] Acquiring lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:27.148531 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3deafc1d-5c48-44b1-a4f5-fb34fb418136 req-faeda9ab-158c-4c4b-800a-ac00c60e55f5 service nova] Lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:27.148577 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3deafc1d-5c48-44b1-a4f5-fb34fb418136 req-faeda9ab-158c-4c4b-800a-ac00c60e55f5 service nova] Lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:27.148701 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3deafc1d-5c48-44b1-a4f5-fb34fb418136 req-faeda9ab-158c-4c4b-800a-ac00c60e55f5 service nova] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] No waiting events found dispatching network-vif-unplugged-cfc8b51a-841c-466e-9cf9-a6f5f77149f7 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:52:27.148795 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3deafc1d-5c48-44b1-a4f5-fb34fb418136 req-faeda9ab-158c-4c4b-800a-ac00c60e55f5 service nova] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Received event network-vif-unplugged-cfc8b51a-841c-466e-9cf9-a6f5f77149f7 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:52:27.148885 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3deafc1d-5c48-44b1-a4f5-fb34fb418136 req-faeda9ab-158c-4c4b-800a-ac00c60e55f5 service nova] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Received event network-vif-deleted-cfc8b51a-841c-466e-9cf9-a6f5f77149f7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:52:27.548053 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Took 1.27 seconds to deallocate network for instance.
May 19 04:52:28.032605 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.524s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:28.053492 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:28.053756 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:28.321678 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:52:28.321885 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:52:28.774600 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:28.827200 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:52:29.129999 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "9da3fdac-deca-4ab9-9df5-8342144acc13" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:29.130156 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:29.130307 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Attaching volume 15140bf8-714f-4e47-9cd8-2c616b9be272 to /dev/vdb
May 19 04:52:29.163880 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:52:29.173807 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:52:29.194657 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:52:29.242282 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:52:29.242628 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:52:29.251256 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:52:29.252596 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fec1:94ac', 'fe80::8c0d:8ff:fec2:525c', 'fe80::fc16:3eff:fe3f:eef9', 'fe80::fc16:3eff:fedd:eaeb', 'fe80::9403:78ff:fec9:7b94', 'fe80::fc16:3eff:fe27:50ef'] 
May 19 04:52:29.252766 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:52:29.252899 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:52:29.253231 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:52:29.253553 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Updating existing volume attachment record: c5c013e7-6d59-49b6-9de5-3d7a41a4d779 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:52:29.333279 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.279s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:29.389150 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Deleted allocations for instance 04ec9e0a-3657-46d6-9d38-9fdee11c7a12
May 19 04:52:29.813080 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:52:29.813600 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272', 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15140bf8-714f-4e47-9cd8-2c616b9be272', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:52:29.813884 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:52:29.814427 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:52:29.814745 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272', 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15140bf8-714f-4e47-9cd8-2c616b9be272', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:52:29.826883 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:52:29.827489 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:52:29.827951 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:52:29.828189 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:52:29.828721 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:52:29.829011 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:52:29.838787 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:52:29.838787 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:29.843102 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:52:29.843102 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:29.850427 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272] added
May 19 04:52:29.850427 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:52:29.850427 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:52:29.850427 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:52:29.850427 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:52:29.850427 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:52:29.850427 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:29.850728 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:52:29.850780 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0226(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:52:29.852124 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:52:29.855321 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272] added
May 19 04:52:29.855321 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:52:29.855321 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:52:29.855321 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:52:29.855321 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:52:29.855321 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:52:29.855321 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:29.855525 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:52:29.855706 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0267(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:52:29.855840 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:52:30.396130 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-cfbe4a0f-9f01-4b1a-a971-e44cb5a89abe tempest-VolumesActionsTest-1309022212 tempest-VolumesActionsTest-1309022212-project-member] Lock "04ec9e0a-3657-46d6-9d38-9fdee11c7a12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.982s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:30.527304 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._sync_power_states {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:52:30.762782 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:30.851299 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:52:30.856195 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:52:30.864533 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:52:30.864533 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:52:30.869867 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:52:30.869867 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:30.875971 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:30.882319 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:30.890636 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:30.890636 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:30.890636 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:30.890636 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:30.890636 np0000001025 nova-compute[97981]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:52:30.890636 np0000001025 nova-compute[97981]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:52:30.890636 np0000001025 nova-compute[97981]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:30.890636 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:52:30.890931 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:30.890931 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:30.890931 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:30.890931 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:30.890931 np0000001025 nova-compute[97981]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:52:30.890931 np0000001025 nova-compute[97981]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:52:30.890931 np0000001025 nova-compute[97981]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:30.890931 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:52:30.900371 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:30.900371 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:30.900371 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:30.900371 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:30.900371 np0000001025 nova-compute[97981]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:52:30.900371 np0000001025 nova-compute[97981]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:52:30.900371 np0000001025 nova-compute[97981]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:30.900371 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:52:30.900622 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:30.900622 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:30.900622 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:30.900622 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:30.900622 np0000001025 nova-compute[97981]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:52:30.900622 np0000001025 nova-compute[97981]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:52:30.900622 np0000001025 nova-compute[97981]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:30.900622 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:52:30.936166 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272, portal: 192.168.40.100,3260]
May 19 04:52:30.936166 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272, portal: 192.168.40.100,3260] successful.
May 19 04:52:30.936166 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:30.945664 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272, portal: 192.168.50.100,3260]
May 19 04:52:30.945664 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272, portal: 192.168.50.100,3260] successful.
May 19 04:52:30.945664 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:30.954689 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:30.960616 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:30.972745 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:30.972745 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:30.972745 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:30.972745 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:30.972745 np0000001025 nova-compute[97981]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:52:30.972745 np0000001025 nova-compute[97981]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:52:30.972745 np0000001025 nova-compute[97981]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:30.972745 np0000001025 nova-compute[97981]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:30.972745 np0000001025 nova-compute[97981]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:30.972745 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:52:30.973177 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:30.973177 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:30.973177 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:30.973177 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:30.973177 np0000001025 nova-compute[97981]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:52:30.973177 np0000001025 nova-compute[97981]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:52:30.973177 np0000001025 nova-compute[97981]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:30.973177 np0000001025 nova-compute[97981]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:30.973177 np0000001025 nova-compute[97981]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:30.973177 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:52:30.973177 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:52:30.973536 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:52:30.974666 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] HCTL ('14', '-', '-', 0) found on session 177 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:52:30.974819 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:52:30.987481 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:30.987481 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:30.987481 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:30.987481 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:30.987481 np0000001025 nova-compute[97981]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:52:30.987481 np0000001025 nova-compute[97981]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:52:30.987481 np0000001025 nova-compute[97981]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:30.987481 np0000001025 nova-compute[97981]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:30.987481 np0000001025 nova-compute[97981]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:30.987481 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:52:30.987815 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:30.987815 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:30.987815 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:30.987815 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:30.987815 np0000001025 nova-compute[97981]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:52:30.987815 np0000001025 nova-compute[97981]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:52:30.987815 np0000001025 nova-compute[97981]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:30.987815 np0000001025 nova-compute[97981]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:30.987815 np0000001025 nova-compute[97981]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:30.987815 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:52:30.988363 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:52:30.988363 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:52:30.989727 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] HCTL ('15', '-', '-', 0) found on session 178 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:52:30.989727 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:52:30.996776 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Searching for a device in session 177 and hctl ['14', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:52:31.009885 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Searching for a device in session 178 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:52:31.009885 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '15140bf8-714f-4e47-9cd8-2c616b9be272', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:52:31.036043 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Triggering sync for uuid 9c2a46cb-f9b2-4c34-a041-2bda0bc64051 {{(pid=97981) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 19 04:52:31.036452 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Triggering sync for uuid 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9 {{(pid=97981) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 19 04:52:31.036657 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Triggering sync for uuid 9da3fdac-deca-4ab9-9df5-8342144acc13 {{(pid=97981) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 19 04:52:31.036875 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Triggering sync for uuid 656a7921-42b1-45cd-802f-488693ff5268 {{(pid=97981) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 19 04:52:31.039081 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.09 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:52:31.040408 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:31.040618 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:31.040864 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "9da3fdac-deca-4ab9-9df5-8342144acc13" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:31.041392 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:31.041566 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:31.041958 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "656a7921-42b1-45cd-802f-488693ff5268" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:31.042943 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "656a7921-42b1-45cd-802f-488693ff5268" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:31.549199 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.508s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:31.549786 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.508s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:31.554739 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "656a7921-42b1-45cd-802f-488693ff5268" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.512s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:31.996452 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Searching for a device in session 177 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:52:31.996935 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15140bf8-714f-4e47-9cd8-2c616b9be272', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:52:32.843065 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Found WWN 330000000a03edc0b for multipath device dm-9 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:52:32.843307 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:52:32.843443 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '330000000a03edc0b', 'path': '/dev/dm-9', 'multipath_id': '330000000a03edc0b'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:52:32.843578 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a03edc0b', 'path': '/dev/dm-9', 'multipath_id': '330000000a03edc0b'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:52:32.845893 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lazy-loading 'flavor' on Instance uuid 9da3fdac-deca-4ab9-9df5-8342144acc13 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:52:33.348487 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Attempting to attach volume 15140bf8-714f-4e47-9cd8-2c616b9be272 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:52:33.349892 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:52:33.349892 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:52:33.349892 np0000001025 nova-compute[97981]:   <alias name="ua-15140bf8-714f-4e47-9cd8-2c616b9be272"/>
May 19 04:52:33.349892 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-9"/>
May 19 04:52:33.349892 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:52:33.349892 np0000001025 nova-compute[97981]:   <serial>15140bf8-714f-4e47-9cd8-2c616b9be272</serial>
May 19 04:52:33.349892 np0000001025 nova-compute[97981]: </disk>
May 19 04:52:33.349892 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:52:33.796763 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:34.991313 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:52:34.991677 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:52:34.991677 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:52:34.991811 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] No VIF found with MAC fa:16:3e:dd:ea:eb, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:52:35.764634 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:36.536548 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-fa9ad698-7b45-463c-ba64-994a79208351 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.406s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:36.537481 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.497s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:37.041254 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.504s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:38.066161 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "9da3fdac-deca-4ab9-9df5-8342144acc13" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:38.066161 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:38.128298 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:52:38.128949 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.48 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:52:38.569154 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lazy-loading 'flavor' on Instance uuid 9da3fdac-deca-4ab9-9df5-8342144acc13 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:52:38.798506 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:39.575890 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:39.611298 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "656a7921-42b1-45cd-802f-488693ff5268" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:39.611298 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "656a7921-42b1-45cd-802f-488693ff5268" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:39.611298 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "656a7921-42b1-45cd-802f-488693ff5268-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:39.611508 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "656a7921-42b1-45cd-802f-488693ff5268-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:39.611508 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "656a7921-42b1-45cd-802f-488693ff5268-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:39.614843 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Terminating instance
May 19 04:52:40.118248 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:52:40.151361 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:40.154474 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:40.176431 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:40.250655 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00048067699981402257 future=<Future at 0x721850384a10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:52:40.251481 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Emitting event <LifecycleEvent: 1779166345.2500288, 04ec9e0a-3657-46d6-9d38-9fdee11c7a12 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:52:40.251801 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:52:40.251945 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] VM Stopped (Lifecycle Event)
May 19 04:52:40.275865 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:40.282768 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:40.304966 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-02e7f874-d8b6-4527-bca0-a776468ade57 req-88ac91e3-a8cd-4970-9025-93e4bc1a622a service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Received event network-vif-unplugged-ef570f36-69a8-403c-90b4-26185bba8130 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:52:40.305488 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-02e7f874-d8b6-4527-bca0-a776468ade57 req-88ac91e3-a8cd-4970-9025-93e4bc1a622a service nova] Acquiring lock "656a7921-42b1-45cd-802f-488693ff5268-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:40.305732 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-02e7f874-d8b6-4527-bca0-a776468ade57 req-88ac91e3-a8cd-4970-9025-93e4bc1a622a service nova] Lock "656a7921-42b1-45cd-802f-488693ff5268-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:40.305895 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-02e7f874-d8b6-4527-bca0-a776468ade57 req-88ac91e3-a8cd-4970-9025-93e4bc1a622a service nova] Lock "656a7921-42b1-45cd-802f-488693ff5268-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:40.306048 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-02e7f874-d8b6-4527-bca0-a776468ade57 req-88ac91e3-a8cd-4970-9025-93e4bc1a622a service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] No waiting events found dispatching network-vif-unplugged-ef570f36-69a8-403c-90b4-26185bba8130 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:52:40.306220 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-02e7f874-d8b6-4527-bca0-a776468ade57 req-88ac91e3-a8cd-4970-9025-93e4bc1a622a service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Received event network-vif-unplugged-ef570f36-69a8-403c-90b4-26185bba8130 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:52:40.452756 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999651451999853 future=<Future at 0x72183418c860 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:52:40.453054 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999417065000216 future=<Future at 0x72183418c860 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:52:40.453277 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999070108000069 future=<Future at 0x72183418c860 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:52:40.455428 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Instance destroyed successfully.
May 19 04:52:40.455945 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lazy-loading 'resources' on Instance uuid 656a7921-42b1-45cd-802f-488693ff5268 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:52:40.610930 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:52:40.611358 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:52:40.614695 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:52:40.615232 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:52:40.668898 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "9da3fdac-deca-4ab9-9df5-8342144acc13" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:40.668986 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:40.669157 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Attaching volume b63c409e-7f66-4b3b-b487-c1b7d23ed09f to /dev/vdc
May 19 04:52:40.703242 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:52:40.714712 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:52:40.741205 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:52:40.759872 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 04ec9e0a-3657-46d6-9d38-9fdee11c7a12] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:52:40.766387 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:40.791543 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:52:40.791791 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:52:40.799882 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:52:40.800828 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fec1:94ac', 'fe80::8c0d:8ff:fec2:525c', 'fe80::fc16:3eff:fe3f:eef9', 'fe80::fc16:3eff:fedd:eaeb', 'fe80::9403:78ff:fec9:7b94'] 
May 19 04:52:40.800961 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:52:40.801030 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:52:40.801245 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:52:40.801438 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Updating existing volume attachment record: cd0c997c-5304-46e7-ac3e-992f022a36b3 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:52:40.960635 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:51:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-945352473',display_name='tempest-TestVolumeBootPatternV346-server-945352473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpatternv346-server-945352473',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0cVkfSwoBK0iFb1CfOuKg/03uIXPNp7OhPp5BMpeoyzmx0+WvtZU2ssEoYoJd14aO19CtKvzEMoQt1UdFexlay4quzGsjzT6RuAZ3yy6j4rp6x2cUMdDDnAWV82dpO4A==',key_name='tempest-keypair-652142093',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:52:01Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d16b1deed8084634b3a8120ef6795f34',ramdisk_id='',reservation_id='r-mn2u9p3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1959285151',owner_user_name='tempest-TestVolumeBootPatternV346-1959285151-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:52:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eafa3940f19346c8b574aa03335a0528',uuid=656a7921-42b1-45cd-802f-488693ff5268,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef570f36-69a8-403c-90b4-26185bba8130", "address": "fa:16:3e:27:50:ef", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef570f36-69", "ovs_interfaceid": "ef570f36-69a8-403c-90b4-26185bba8130", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:52:40.960844 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Converting VIF {"id": "ef570f36-69a8-403c-90b4-26185bba8130", "address": "fa:16:3e:27:50:ef", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef570f36-69", "ovs_interfaceid": "ef570f36-69a8-403c-90b4-26185bba8130", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:52:40.961492 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:50:ef,bridge_name='br-int',has_traffic_filtering=True,id=ef570f36-69a8-403c-90b4-26185bba8130,network=Network(2bd74629-3dde-4be7-94c2-1550e25e2dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef570f36-69') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:52:40.961752 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:50:ef,bridge_name='br-int',has_traffic_filtering=True,id=ef570f36-69a8-403c-90b4-26185bba8130,network=Network(2bd74629-3dde-4be7-94c2-1550e25e2dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef570f36-69') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:52:40.964135 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:40.964135 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef570f36-69, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:52:40.966194 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:52:40.966630 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:40.966756 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dcdfdcfa-803e-4d45-b423-6724e022acf6) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:52:40.967998 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:52:40.969302 np0000001025 nova-compute[97981]: INFO os_vif [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:50:ef,bridge_name='br-int',has_traffic_filtering=True,id=ef570f36-69a8-403c-90b4-26185bba8130,network=Network(2bd74629-3dde-4be7-94c2-1550e25e2dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef570f36-69')
May 19 04:52:40.970603 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:52:40.970932 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', 'iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:52:40.971101 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:52:40.971508 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:52:40.971870 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', 'iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:52:40.972059 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:52:41.001075 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:41.001075 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:41.001075 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:41.001075 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:41.001075 np0000001025 nova-compute[97981]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:52:41.001075 np0000001025 nova-compute[97981]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:52:41.001075 np0000001025 nova-compute[97981]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:41.001075 np0000001025 nova-compute[97981]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:41.001075 np0000001025 nova-compute[97981]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:41.001075 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:52:41.001399 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:41.001399 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:41.001399 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:41.001399 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:41.001399 np0000001025 nova-compute[97981]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:52:41.001399 np0000001025 nova-compute[97981]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3 (non-flash)
May 19 04:52:41.001399 np0000001025 nova-compute[97981]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:41.001399 np0000001025 nova-compute[97981]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:41.001399 np0000001025 nova-compute[97981]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:41.001399 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:52:41.001399 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', '156'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', '173'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', '174'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272', '177'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89', '179')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:52:41.001688 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', '173')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:52:41.002317 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3', '174')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:52:41.003040 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185013b7e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3'): ({'sdh'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:52:41.003276 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Removing multipathed devices sdh, sdg {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:52:41.003495 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Flush multipath device 33000000031b74855 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:52:41.075604 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:52:41.123675 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:52:41.165335 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:52:41.165541 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:52:41.166658 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:52:41.179296 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:52:41.179519 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:52:41.190590 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:41.232499 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 173, target: iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3, portal: 192.168.40.100,3260]
May 19 04:52:41.232499 np0000001025 nova-compute[97981]: Logout of [sid: 173, target: iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3, portal: 192.168.40.100,3260] successful.
May 19 04:52:41.232499 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:41.264965 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:41.276530 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:41.309075 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 174, target: iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3, portal: 192.168.50.100,3260]
May 19 04:52:41.309075 np0000001025 nova-compute[97981]: Logout of [sid: 174, target: iqn.2023-03.storpool.com:os--volume-650d4b1b-5c14-4b3d-ba57-75c6e2aa9ed3, portal: 192.168.50.100,3260] successful.
May 19 04:52:41.309075 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:41.325604 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:41.325814 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:52:41.325919 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] <== disconnect_volume: return (355ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:52:41.326026 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:52:41.326341 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Deleting instance files /opt/stack/data/nova/instances/656a7921-42b1-45cd-802f-488693ff5268_del
May 19 04:52:41.326841 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Deletion of /opt/stack/data/nova/instances/656a7921-42b1-45cd-802f-488693ff5268_del complete
May 19 04:52:41.354099 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:52:41.354421 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f', 'iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b63c409e-7f66-4b3b-b487-c1b7d23ed09f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:52:41.354628 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:52:41.355015 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:52:41.355357 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f', 'iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b63c409e-7f66-4b3b-b487-c1b7d23ed09f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:52:41.369223 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:52:41.369906 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:52:41.370589 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:52:41.370589 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:52:41.370908 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:52:41.371087 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:52:41.383102 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:52:41.383102 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:41.395209 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f] added
May 19 04:52:41.395209 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:52:41.395209 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:52:41.395209 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:52:41.395209 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:52:41.395209 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:52:41.395209 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:41.395402 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:52:41.395535 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.025(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:52:41.395669 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:52:41.418632 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:52:41.418632 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:41.430738 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f] added
May 19 04:52:41.430738 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:52:41.430738 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:52:41.430738 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:52:41.430738 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:52:41.430738 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:52:41.430738 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:41.430940 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:52:41.431175 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0599(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:52:41.431246 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:52:41.615527 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:52:41.616350 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:52:41.616572 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:52:41.834181 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Took 1.72 seconds to destroy the instance on the hypervisor.
May 19 04:52:41.834824 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:52:41.835249 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:52:41.835441 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 656a7921-42b1-45cd-802f-488693ff5268] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:52:41.835886 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:52:41.893947 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:52:42.276252 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-467b194f-e83a-442c-bfa2-b2457fa7f9a5 req-0bf490ec-db8f-4a25-bd4c-ddf39034ec92 service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Received event network-vif-deleted-ef570f36-69a8-403c-90b4-26185bba8130 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:52:42.276409 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-467b194f-e83a-442c-bfa2-b2457fa7f9a5 req-0bf490ec-db8f-4a25-bd4c-ddf39034ec92 service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Neutron deleted interface ef570f36-69a8-403c-90b4-26185bba8130; detaching it from the instance and deleting it from the info cache
May 19 04:52:42.276614 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-467b194f-e83a-442c-bfa2-b2457fa7f9a5 req-0bf490ec-db8f-4a25-bd4c-ddf39034ec92 service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:52:42.354005 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8455c98b-30d7-4b1b-b572-a3bbddfb4ebb req-e155c7e3-d256-4168-84e8-4ed0532e2ee7 service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Received event network-vif-unplugged-ef570f36-69a8-403c-90b4-26185bba8130 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:52:42.354451 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8455c98b-30d7-4b1b-b572-a3bbddfb4ebb req-e155c7e3-d256-4168-84e8-4ed0532e2ee7 service nova] Acquiring lock "656a7921-42b1-45cd-802f-488693ff5268-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:42.354696 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8455c98b-30d7-4b1b-b572-a3bbddfb4ebb req-e155c7e3-d256-4168-84e8-4ed0532e2ee7 service nova] Lock "656a7921-42b1-45cd-802f-488693ff5268-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:42.354751 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8455c98b-30d7-4b1b-b572-a3bbddfb4ebb req-e155c7e3-d256-4168-84e8-4ed0532e2ee7 service nova] Lock "656a7921-42b1-45cd-802f-488693ff5268-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:42.354857 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8455c98b-30d7-4b1b-b572-a3bbddfb4ebb req-e155c7e3-d256-4168-84e8-4ed0532e2ee7 service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] No waiting events found dispatching network-vif-unplugged-ef570f36-69a8-403c-90b4-26185bba8130 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:52:42.355016 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8455c98b-30d7-4b1b-b572-a3bbddfb4ebb req-e155c7e3-d256-4168-84e8-4ed0532e2ee7 service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Received event network-vif-unplugged-ef570f36-69a8-403c-90b4-26185bba8130 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:52:42.396166 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:52:42.406074 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:52:42.406074 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:42.417580 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:42.431049 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:42.431049 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:42.431049 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:42.431049 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:42.431049 np0000001025 nova-compute[97981]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:42.431049 np0000001025 nova-compute[97981]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:42.431049 np0000001025 nova-compute[97981]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:42.431049 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:52:42.431338 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:42.431338 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:42.431338 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:42.431338 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:42.431338 np0000001025 nova-compute[97981]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:42.431338 np0000001025 nova-compute[97981]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:42.431338 np0000001025 nova-compute[97981]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:42.431338 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:52:42.431789 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:52:42.442313 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:52:42.442313 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:42.452270 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:42.473396 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f, portal: 192.168.40.100,3260]
May 19 04:52:42.473396 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f, portal: 192.168.40.100,3260] successful.
May 19 04:52:42.473396 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:42.474462 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:42.474462 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:42.474462 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:42.474462 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:42.474462 np0000001025 nova-compute[97981]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:42.474462 np0000001025 nova-compute[97981]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:42.474462 np0000001025 nova-compute[97981]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:42.474462 np0000001025 nova-compute[97981]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f (non-flash)
May 19 04:52:42.474462 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:52:42.474653 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:42.474653 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:42.474653 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:42.474653 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:42.474653 np0000001025 nova-compute[97981]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:42.474653 np0000001025 nova-compute[97981]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:42.474653 np0000001025 nova-compute[97981]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:42.474653 np0000001025 nova-compute[97981]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f (non-flash)
May 19 04:52:42.474653 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:52:42.484144 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:42.499812 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:42.499812 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:42.499812 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:42.499812 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:42.499812 np0000001025 nova-compute[97981]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:42.499812 np0000001025 nova-compute[97981]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:42.499812 np0000001025 nova-compute[97981]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:42.499812 np0000001025 nova-compute[97981]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f (non-flash)
May 19 04:52:42.499812 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:52:42.500047 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:42.500047 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:42.500047 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:42.500047 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:42.500047 np0000001025 nova-compute[97981]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:42.500047 np0000001025 nova-compute[97981]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:42.500047 np0000001025 nova-compute[97981]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:42.500047 np0000001025 nova-compute[97981]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f (non-flash)
May 19 04:52:42.500047 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:52:42.500831 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.130s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:52:42.500831 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:52:42.501500 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] HCTL ('12', '-', '-', 0) found on session 180 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:52:42.501776 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:52:42.512925 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Searching for a device in session 180 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:52:42.512925 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b63c409e-7f66-4b3b-b487-c1b7d23ed09f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:52:42.523212 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f, portal: 192.168.50.100,3260]
May 19 04:52:42.523212 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f, portal: 192.168.50.100,3260] successful.
May 19 04:52:42.523212 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:42.533392 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:42.548814 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:42.548814 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:42.548814 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:42.548814 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:42.548814 np0000001025 nova-compute[97981]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:42.548814 np0000001025 nova-compute[97981]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:42.548814 np0000001025 nova-compute[97981]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:42.548814 np0000001025 nova-compute[97981]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f (non-flash)
May 19 04:52:42.548814 np0000001025 nova-compute[97981]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f (non-flash)
May 19 04:52:42.548814 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:52:42.549095 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:42.549095 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:42.549095 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:42.549095 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:42.549095 np0000001025 nova-compute[97981]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:42.549095 np0000001025 nova-compute[97981]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:42.549095 np0000001025 nova-compute[97981]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:42.549095 np0000001025 nova-compute[97981]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f (non-flash)
May 19 04:52:42.549095 np0000001025 nova-compute[97981]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f (non-flash)
May 19 04:52:42.549095 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:52:42.549308 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:52:42.549308 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:52:42.550125 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] HCTL ('13', '-', '-', 0) found on session 181 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:52:42.550255 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:52:42.562068 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Searching for a device in session 181 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:52:42.562238 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b63c409e-7f66-4b3b-b487-c1b7d23ed09f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:52:42.733778 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:52:42.780456 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-467b194f-e83a-442c-bfa2-b2457fa7f9a5 req-0bf490ec-db8f-4a25-bd4c-ddf39034ec92 service nova] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Detach interface failed, port_id=ef570f36-69a8-403c-90b4-26185bba8130, reason: Instance 656a7921-42b1-45cd-802f-488693ff5268 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:52:43.235535 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Took 1.40 seconds to deallocate network for instance.
May 19 04:52:43.370499 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:52:43.777283 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Took 0.54 seconds to detach 1 volumes for instance.
May 19 04:52:43.800323 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:44.174799 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:44.282240 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:44.282405 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:44.384284 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Found WWN 33000000040527fbe for multipath device dm-4 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:52:44.384590 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:52:44.384776 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '33000000040527fbe', 'path': '/dev/dm-4', 'multipath_id': '33000000040527fbe'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:52:44.384937 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000040527fbe', 'path': '/dev/dm-4', 'multipath_id': '33000000040527fbe'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:52:44.387605 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lazy-loading 'flavor' on Instance uuid 9da3fdac-deca-4ab9-9df5-8342144acc13 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:52:44.490736 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:52:44.490964 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:52:44.890283 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Attempting to attach volume b63c409e-7f66-4b3b-b487-c1b7d23ed09f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:52:44.892872 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:52:44.892872 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:52:44.892872 np0000001025 nova-compute[97981]:   <alias name="ua-b63c409e-7f66-4b3b-b487-c1b7d23ed09f"/>
May 19 04:52:44.892872 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-4"/>
May 19 04:52:44.892872 np0000001025 nova-compute[97981]:   <target dev="vdc" bus="virtio"/>
May 19 04:52:44.892872 np0000001025 nova-compute[97981]:   <serial>b63c409e-7f66-4b3b-b487-c1b7d23ed09f</serial>
May 19 04:52:44.892872 np0000001025 nova-compute[97981]: </disk>
May 19 04:52:44.892872 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:52:44.993331 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:52:45.499664 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.217s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:45.548539 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Deleted allocations for instance 656a7921-42b1-45cd-802f-488693ff5268
May 19 04:52:45.614895 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:52:45.615211 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:52:45.967902 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:46.116403 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:46.529508 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:52:46.529672 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:52:46.529746 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:52:46.529806 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:52:46.529887 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] No VIF found with MAC fa:16:3e:dd:ea:eb, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:52:46.555793 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4a32ee3b-3c73-4c23-b188-6becd9f87a2f tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "656a7921-42b1-45cd-802f-488693ff5268" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.945s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:48.071408 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-ef178a98-d40d-4027-9b34-28668f65c89d tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.402s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:48.471066 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "9da3fdac-deca-4ab9-9df5-8342144acc13" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:48.471258 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:48.973417 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Detaching volume b63c409e-7f66-4b3b-b487-c1b7d23ed09f
May 19 04:52:49.008844 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Attempting to driver detach volume b63c409e-7f66-4b3b-b487-c1b7d23ed09f from mountpoint /dev/vdc
May 19 04:52:49.013645 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Found disk vdc by alias ua-b63c409e-7f66-4b3b-b487-c1b7d23ed09f {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:52:49.014913 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Found disk vdc by alias ua-b63c409e-7f66-4b3b-b487-c1b7d23ed09f {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:52:49.015215 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Attempting to detach device vdc from instance 9da3fdac-deca-4ab9-9df5-8342144acc13 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:52:49.015331 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:52:49.015331 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:52:49.015331 np0000001025 nova-compute[97981]:   <alias name="ua-b63c409e-7f66-4b3b-b487-c1b7d23ed09f"/>
May 19 04:52:49.015331 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-4"/>
May 19 04:52:49.015331 np0000001025 nova-compute[97981]:   <target dev="vdc" bus="virtio"/>
May 19 04:52:49.015331 np0000001025 nova-compute[97981]:   <serial>b63c409e-7f66-4b3b-b487-c1b7d23ed09f</serial>
May 19 04:52:49.015331 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 19 04:52:49.015331 np0000001025 nova-compute[97981]: </disk>
May 19 04:52:49.015331 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:52:49.022071 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Successfully detached device vdc from instance 9da3fdac-deca-4ab9-9df5-8342144acc13 from the persistent domain config.
May 19 04:52:49.022269 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] (1/8): Attempting to detach device vdc with device alias ua-b63c409e-7f66-4b3b-b487-c1b7d23ed09f from instance 9da3fdac-deca-4ab9-9df5-8342144acc13 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:52:49.022549 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:52:49.022549 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:52:49.022549 np0000001025 nova-compute[97981]:   <alias name="ua-b63c409e-7f66-4b3b-b487-c1b7d23ed09f"/>
May 19 04:52:49.022549 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-4"/>
May 19 04:52:49.022549 np0000001025 nova-compute[97981]:   <target dev="vdc" bus="virtio"/>
May 19 04:52:49.022549 np0000001025 nova-compute[97981]:   <serial>b63c409e-7f66-4b3b-b487-c1b7d23ed09f</serial>
May 19 04:52:49.022549 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 19 04:52:49.022549 np0000001025 nova-compute[97981]: </disk>
May 19 04:52:49.022549 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:52:49.476672 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779166369.476227, 9da3fdac-deca-4ab9-9df5-8342144acc13 => ua-b63c409e-7f66-4b3b-b487-c1b7d23ed09f> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:52:49.477582 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-b63c409e-7f66-4b3b-b487-c1b7d23ed09f for instance 9da3fdac-deca-4ab9-9df5-8342144acc13 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:52:49.479584 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Successfully detached device vdc from instance 9da3fdac-deca-4ab9-9df5-8342144acc13 from the live domain config.
May 19 04:52:49.480463 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:52:49.480754 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f', 'iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b63c409e-7f66-4b3b-b487-c1b7d23ed09f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:52:49.480891 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:52:49.481213 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:52:49.481492 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f', 'iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b63c409e-7f66-4b3b-b487-c1b7d23ed09f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:52:49.481656 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:52:49.505612 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:49.505612 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:49.505612 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:49.505612 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:49.505612 np0000001025 nova-compute[97981]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:49.505612 np0000001025 nova-compute[97981]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:49.505612 np0000001025 nova-compute[97981]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f (non-flash)
May 19 04:52:49.505612 np0000001025 nova-compute[97981]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f (non-flash)
May 19 04:52:49.505612 np0000001025 nova-compute[97981]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:49.505612 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:52:49.506096 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:49.506096 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:49.506096 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:49.506096 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:49.506096 np0000001025 nova-compute[97981]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:49.506096 np0000001025 nova-compute[97981]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:49.506096 np0000001025 nova-compute[97981]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f (non-flash)
May 19 04:52:49.506096 np0000001025 nova-compute[97981]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f (non-flash)
May 19 04:52:49.506096 np0000001025 nova-compute[97981]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:49.506096 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:52:49.506096 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', '156'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272', '177'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89', '182')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:52:49.506096 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f', '180')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:52:49.506745 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f', '181')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:52:49.507478 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721834354c20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f'): ({'sdh'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:52:49.507645 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Removing multipathed devices sdh, sdg {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:52:49.507835 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Flush multipath device 33000000040527fbe {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:52:49.542176 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:52:49.593392 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:52:49.654428 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:52:49.654610 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:52:49.655615 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:52:49.665743 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:52:49.665892 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:52:49.677130 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:49.710157 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 180, target: iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f, portal: 192.168.40.100,3260]
May 19 04:52:49.710157 np0000001025 nova-compute[97981]: Logout of [sid: 180, target: iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f, portal: 192.168.40.100,3260] successful.
May 19 04:52:49.710157 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:49.726836 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:49.736833 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:49.774400 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 181, target: iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f, portal: 192.168.50.100,3260]
May 19 04:52:49.774400 np0000001025 nova-compute[97981]: Logout of [sid: 181, target: iqn.2023-03.storpool.com:os--volume-b63c409e-7f66-4b3b-b487-c1b7d23ed09f, portal: 192.168.50.100,3260] successful.
May 19 04:52:49.774400 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:49.792459 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:49.792610 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:52:49.792709 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] <== disconnect_volume: return (312ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:52:49.792811 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:52:50.337887 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lazy-loading 'flavor' on Instance uuid 9da3fdac-deca-4ab9-9df5-8342144acc13 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:52:50.422135 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:50.422301 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:50.422453 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:50.422560 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:50.422687 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:50.424399 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Terminating instance
May 19 04:52:50.614959 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:52:50.615370 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:52:50.615370 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:52:50.927195 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:52:50.943499 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:50.945918 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:50.962140 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:50.969361 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:51.080907 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:51.090718 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:51.093872 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6866c4be-a791-494f-92b6-bed9cf4ff6f0 req-8ec53de8-9e06-4dc1-a69a-7671b709c68c service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Received event network-vif-unplugged-e51bde8b-7b23-4983-99fe-0d79818030e6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:52:51.093872 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6866c4be-a791-494f-92b6-bed9cf4ff6f0 req-8ec53de8-9e06-4dc1-a69a-7671b709c68c service nova] Acquiring lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:51.093872 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6866c4be-a791-494f-92b6-bed9cf4ff6f0 req-8ec53de8-9e06-4dc1-a69a-7671b709c68c service nova] Lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:51.093872 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6866c4be-a791-494f-92b6-bed9cf4ff6f0 req-8ec53de8-9e06-4dc1-a69a-7671b709c68c service nova] Lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:51.093872 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6866c4be-a791-494f-92b6-bed9cf4ff6f0 req-8ec53de8-9e06-4dc1-a69a-7671b709c68c service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] No waiting events found dispatching network-vif-unplugged-e51bde8b-7b23-4983-99fe-0d79818030e6 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:52:51.093872 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6866c4be-a791-494f-92b6-bed9cf4ff6f0 req-8ec53de8-9e06-4dc1-a69a-7671b709c68c service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Received event network-vif-unplugged-e51bde8b-7b23-4983-99fe-0d79818030e6 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:52:51.242181 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999119991000043 future=<Future at 0x721834336840 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:52:51.244435 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Instance destroyed successfully.
May 19 04:52:51.244960 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lazy-loading 'resources' on Instance uuid 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:52:51.345003 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-26422b5e-302c-4f88-84dd-2111057a77e1 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.874s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:51.749502 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1128698321',display_name='tempest-TestVolumeBootPatternV346-server-1128698321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpatternv346-server-1128698321',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWZuTUbMHlt187ST8Ic73xnIBFaXdGZsmJv5qPiYEJFbly0P3DaTlPQaG5CDzQjMd9D7wd92eBqosXxJm4toHoYgyVTndfShgteNVuOhgdzCHQQPowHL9Z/RevU7giw7Q==',key_name='tempest-keypair-668702618',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:51:01Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d16b1deed8084634b3a8120ef6795f34',ramdisk_id='',reservation_id='r-d59v1kl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1959285151',owner_user_name='tempest-TestVolumeBootPatternV346-1959285151-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:51:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eafa3940f19346c8b574aa03335a0528',uuid=4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e51bde8b-7b23-4983-99fe-0d79818030e6", "address": "fa:16:3e:3f:ee:f9", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape51bde8b-7b", "ovs_interfaceid": "e51bde8b-7b23-4983-99fe-0d79818030e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:52:51.750017 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Converting VIF {"id": "e51bde8b-7b23-4983-99fe-0d79818030e6", "address": "fa:16:3e:3f:ee:f9", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape51bde8b-7b", "ovs_interfaceid": "e51bde8b-7b23-4983-99fe-0d79818030e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:52:51.750401 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:ee:f9,bridge_name='br-int',has_traffic_filtering=True,id=e51bde8b-7b23-4983-99fe-0d79818030e6,network=Network(2bd74629-3dde-4be7-94c2-1550e25e2dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape51bde8b-7b') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:52:51.750401 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:ee:f9,bridge_name='br-int',has_traffic_filtering=True,id=e51bde8b-7b23-4983-99fe-0d79818030e6,network=Network(2bd74629-3dde-4be7-94c2-1550e25e2dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape51bde8b-7b') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:52:51.751283 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:51.751511 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape51bde8b-7b, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:52:51.752473 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:51.753302 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:51.753957 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:51.754140 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab1ad6a5-cf3d-4323-8ae3-310d4ff33135) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:52:51.754804 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:51.754967 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:52:51.755237 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:51.756948 np0000001025 nova-compute[97981]: INFO os_vif [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:ee:f9,bridge_name='br-int',has_traffic_filtering=True,id=e51bde8b-7b23-4983-99fe-0d79818030e6,network=Network(2bd74629-3dde-4be7-94c2-1550e25e2dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape51bde8b-7b')
May 19 04:52:51.758248 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:52:51.758496 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fabed110-e527-4cce-8fc7-7589a664e611', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:52:51.758622 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:52:51.822358 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "9da3fdac-deca-4ab9-9df5-8342144acc13" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:51.822559 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:52.212133 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.452s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:52:52.212133 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fabed110-e527-4cce-8fc7-7589a664e611', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:52:52.212133 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:52:52.242676 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:52.242676 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:52.242676 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:52.242676 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:52.242676 np0000001025 nova-compute[97981]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:52.242676 np0000001025 nova-compute[97981]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:52.242676 np0000001025 nova-compute[97981]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:52.242676 np0000001025 nova-compute[97981]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05e292d9-ee36-429f-9463-bb6e5d267076 (non-flash)
May 19 04:52:52.242676 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:52:52.243048 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:52.243048 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:52.243048 np0000001025 nova-compute[97981]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:52.243048 np0000001025 nova-compute[97981]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611 (non-flash)
May 19 04:52:52.243048 np0000001025 nova-compute[97981]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:52.243048 np0000001025 nova-compute[97981]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:52.243048 np0000001025 nova-compute[97981]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:52.243048 np0000001025 nova-compute[97981]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05e292d9-ee36-429f-9463-bb6e5d267076 (non-flash)
May 19 04:52:52.243048 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:52:52.243378 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', '156'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272', '177'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-05e292d9-ee36-429f-9463-bb6e5d267076', '183')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:52:52.243585 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', '165')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:52:52.244506 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611', '166')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:52:52.245538 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721850139800>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611'): ({'sdc'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:52:52.245829 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Removing multipathed devices sdc, sdb {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:52:52.246125 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Flush multipath device 330000000c6fb5b2c {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:52:52.295468 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:52:52.324892 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Detaching volume 15140bf8-714f-4e47-9cd8-2c616b9be272
May 19 04:52:52.341046 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:52:52.364191 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Attempting to driver detach volume 15140bf8-714f-4e47-9cd8-2c616b9be272 from mountpoint /dev/vdb
May 19 04:52:52.376176 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Found disk vdb by alias ua-15140bf8-714f-4e47-9cd8-2c616b9be272 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:52:52.377448 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Found disk vdb by alias ua-15140bf8-714f-4e47-9cd8-2c616b9be272 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:52:52.377610 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Attempting to detach device vdb from instance 9da3fdac-deca-4ab9-9df5-8342144acc13 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:52:52.377897 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:52:52.377897 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:52:52.377897 np0000001025 nova-compute[97981]:   <alias name="ua-15140bf8-714f-4e47-9cd8-2c616b9be272"/>
May 19 04:52:52.377897 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-9"/>
May 19 04:52:52.377897 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:52:52.377897 np0000001025 nova-compute[97981]:   <serial>15140bf8-714f-4e47-9cd8-2c616b9be272</serial>
May 19 04:52:52.377897 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:52:52.377897 np0000001025 nova-compute[97981]: </disk>
May 19 04:52:52.377897 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:52:52.385334 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Successfully detached device vdb from instance 9da3fdac-deca-4ab9-9df5-8342144acc13 from the persistent domain config.
May 19 04:52:52.385541 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] (1/8): Attempting to detach device vdb with device alias ua-15140bf8-714f-4e47-9cd8-2c616b9be272 from instance 9da3fdac-deca-4ab9-9df5-8342144acc13 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:52:52.385866 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:52:52.385866 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:52:52.385866 np0000001025 nova-compute[97981]:   <alias name="ua-15140bf8-714f-4e47-9cd8-2c616b9be272"/>
May 19 04:52:52.385866 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-9"/>
May 19 04:52:52.385866 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:52:52.385866 np0000001025 nova-compute[97981]:   <serial>15140bf8-714f-4e47-9cd8-2c616b9be272</serial>
May 19 04:52:52.385866 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:52:52.385866 np0000001025 nova-compute[97981]: </disk>
May 19 04:52:52.385866 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:52:52.388819 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:52:52.389012 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:52:52.390222 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:52:52.400974 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:52:52.401174 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:52:52.418561 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:52.469303 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 165, target: iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611, portal: 192.168.40.100,3260]
May 19 04:52:52.469303 np0000001025 nova-compute[97981]: Logout of [sid: 165, target: iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611, portal: 192.168.40.100,3260] successful.
May 19 04:52:52.469303 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:52.489626 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:52.531533 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:52.576628 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 166, target: iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611, portal: 192.168.50.100,3260]
May 19 04:52:52.576628 np0000001025 nova-compute[97981]: Logout of [sid: 166, target: iqn.2023-03.storpool.com:os--volume-fabed110-e527-4cce-8fc7-7589a664e611, portal: 192.168.50.100,3260] successful.
May 19 04:52:52.576628 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:52.594692 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:52.594843 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:52:52.594890 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] <== disconnect_volume: return (836ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:52:52.594970 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:52:52.595251 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Deleting instance files /opt/stack/data/nova/instances/4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9_del
May 19 04:52:52.595626 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Deletion of /opt/stack/data/nova/instances/4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9_del complete
May 19 04:52:52.614761 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:52:52.996123 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779166372.995798, 9da3fdac-deca-4ab9-9df5-8342144acc13 => ua-15140bf8-714f-4e47-9cd8-2c616b9be272> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:52:52.997414 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-15140bf8-714f-4e47-9cd8-2c616b9be272 for instance 9da3fdac-deca-4ab9-9df5-8342144acc13 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:52:52.999729 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Successfully detached device vdb from instance 9da3fdac-deca-4ab9-9df5-8342144acc13 from the live domain config.
May 19 04:52:53.000820 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:52:53.001116 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272', 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15140bf8-714f-4e47-9cd8-2c616b9be272', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:52:53.001222 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:52:53.001512 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:52:53.001795 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272', 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15140bf8-714f-4e47-9cd8-2c616b9be272', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:52:53.001953 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:52:53.025348 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:53.025348 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:53.025348 np0000001025 nova-compute[97981]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:53.025348 np0000001025 nova-compute[97981]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:53.025348 np0000001025 nova-compute[97981]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:53.025348 np0000001025 nova-compute[97981]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05e292d9-ee36-429f-9463-bb6e5d267076 (non-flash)
May 19 04:52:53.025348 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:52:53.025656 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:53.025656 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:52:53.025656 np0000001025 nova-compute[97981]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:53.025656 np0000001025 nova-compute[97981]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272 (non-flash)
May 19 04:52:53.025656 np0000001025 nova-compute[97981]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89 (non-flash)
May 19 04:52:53.025656 np0000001025 nova-compute[97981]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05e292d9-ee36-429f-9463-bb6e5d267076 (non-flash)
May 19 04:52:53.025656 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:52:53.025917 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', '156'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272', '177'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51f5c9ec-3b98-4fcd-853a-eb6b030c9f89', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-05e292d9-ee36-429f-9463-bb6e5d267076', '183')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:52:53.025917 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272', '177')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:52:53.026811 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272', '178')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:52:53.027538 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185041ea20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272'): ({'sdj'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:52:53.027715 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Removing multipathed devices sdj, sdi {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:52:53.027897 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Flush multipath device 330000000a03edc0b {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:52:53.055299 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:52:53.099583 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:52:53.101012 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Took 2.17 seconds to destroy the instance on the hypervisor.
May 19 04:52:53.101571 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:52:53.101903 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:52:53.102068 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:52:53.102375 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:52:53.125086 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:53.125264 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:53.126910 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:53.126910 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:52:53.140931 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Checking to see if SCSI volumes sdj, sdi have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:52:53.140931 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] SCSI volumes sdj, sdi have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:52:53.142190 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Checking to see if device paths {'sdj', 'sdi'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:52:53.156870 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Device paths {'sdj', 'sdi'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:52:53.157087 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:52:53.164796 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4ab42fed-1377-4b08-a63e-7c8155e91184 req-6b265098-f442-4a75-9cfb-5187e6fe3562 service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Received event network-vif-unplugged-e51bde8b-7b23-4983-99fe-0d79818030e6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:52:53.165295 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4ab42fed-1377-4b08-a63e-7c8155e91184 req-6b265098-f442-4a75-9cfb-5187e6fe3562 service nova] Acquiring lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:53.165433 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4ab42fed-1377-4b08-a63e-7c8155e91184 req-6b265098-f442-4a75-9cfb-5187e6fe3562 service nova] Lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:53.165582 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4ab42fed-1377-4b08-a63e-7c8155e91184 req-6b265098-f442-4a75-9cfb-5187e6fe3562 service nova] Lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:53.165722 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4ab42fed-1377-4b08-a63e-7c8155e91184 req-6b265098-f442-4a75-9cfb-5187e6fe3562 service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] No waiting events found dispatching network-vif-unplugged-e51bde8b-7b23-4983-99fe-0d79818030e6 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:52:53.165830 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4ab42fed-1377-4b08-a63e-7c8155e91184 req-6b265098-f442-4a75-9cfb-5187e6fe3562 service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Received event network-vif-unplugged-e51bde8b-7b23-4983-99fe-0d79818030e6 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:52:53.171844 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:53.174279 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:52:53.201248 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 177, target: iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272, portal: 192.168.40.100,3260]
May 19 04:52:53.201248 np0000001025 nova-compute[97981]: Logout of [sid: 177, target: iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272, portal: 192.168.40.100,3260] successful.
May 19 04:52:53.201248 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:53.218307 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:53.230221 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:53.268235 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 178, target: iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272, portal: 192.168.50.100,3260]
May 19 04:52:53.268235 np0000001025 nova-compute[97981]: Logout of [sid: 178, target: iqn.2023-03.storpool.com:os--volume-15140bf8-714f-4e47-9cd8-2c616b9be272, portal: 192.168.50.100,3260] successful.
May 19 04:52:53.268235 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:53.286702 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:52:53.286947 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:52:53.287152 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] <== disconnect_volume: return (285ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:52:53.287289 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:52:53.668248 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e7b49e35-b08b-4c5c-b122-906d19d36b56 req-608dbd5e-66c9-4f47-9106-7e780d37458d service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Received event network-vif-deleted-e51bde8b-7b23-4983-99fe-0d79818030e6 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:52:53.669138 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-e7b49e35-b08b-4c5c-b122-906d19d36b56 req-608dbd5e-66c9-4f47-9106-7e780d37458d service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Neutron deleted interface e51bde8b-7b23-4983-99fe-0d79818030e6; detaching it from the instance and deleting it from the info cache
May 19 04:52:53.669138 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-e7b49e35-b08b-4c5c-b122-906d19d36b56 req-608dbd5e-66c9-4f47-9106-7e780d37458d service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:52:53.835944 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lazy-loading 'flavor' on Instance uuid 9da3fdac-deca-4ab9-9df5-8342144acc13 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:52:54.088534 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:52:54.160764 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:52:54.181362 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-e7b49e35-b08b-4c5c-b122-906d19d36b56 req-608dbd5e-66c9-4f47-9106-7e780d37458d service nova] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Detach interface failed, port_id=e51bde8b-7b23-4983-99fe-0d79818030e6, reason: Instance 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:52:54.254193 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:52:54.254674 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:52:54.345596 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:52:54.350222 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:52:54.352016 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:52:54.353046 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:52:54.404454 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.051s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:52:54.404796 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=12966MB free_disk=72.75491714477539GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:52:54.404915 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:54.405168 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:54.593413 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Took 1.49 seconds to deallocate network for instance.
May 19 04:52:54.845047 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-d417e9a4-f53f-4f62-96ec-d315b2d96d68 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.022s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:55.106640 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "9da3fdac-deca-4ab9-9df5-8342144acc13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:55.107201 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:55.107201 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "9da3fdac-deca-4ab9-9df5-8342144acc13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:55.107201 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:55.107431 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:55.112135 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Terminating instance
May 19 04:52:55.149372 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Took 0.56 seconds to detach 1 volumes for instance.
May 19 04:52:55.452786 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0004116449999855831 future=<Future at 0x72183418c860 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:52:55.453342 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Emitting event <LifecycleEvent: 1779166360.4522696, 656a7921-42b1-45cd-802f-488693ff5268 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:52:55.453508 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] VM Stopped (Lifecycle Event)
May 19 04:52:55.454579 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:52:55.454939 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=10.786411472000054 future=<Future at 0x721834336840 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:52:55.454939 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=10.786304664 future=<Future at 0x721834336840 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:52:55.467008 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 9c2a46cb-f9b2-4c34-a041-2bda0bc64051 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:52:55.467140 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:52:55.467270 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 9da3fdac-deca-4ab9-9df5-8342144acc13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:52:55.467425 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:52:55.467563 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:52:54 up 43 min,  2 users,  load average: 2.67, 3.81, 3.82\n', 'num_instances': '3', 'num_vm_active': '3', 'num_task_None': '2', 'num_os_type_None': '3', 'num_proj_d16b1deed8084634b3a8120ef6795f34': '2', 'io_workload': '0', 'num_task_deleting': '1', 'num_proj_8a69d8ed0ff94aa7aeeba4bb7186c857': '1'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:52:55.617871 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:52:55.634837 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:55.636640 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:55.641652 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:52:55.641914 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:52:55.655421 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:55.655679 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:55.676067 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:55.794723 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2a15537b-2592-4788-badc-8b3a5acc2277 req-cc5e0de1-d3a7-4a9d-9b14-1593b1cd9fa1 service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Received event network-vif-unplugged-4075449d-8606-42aa-82d0-371efdbcca11 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:52:55.795018 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2a15537b-2592-4788-badc-8b3a5acc2277 req-cc5e0de1-d3a7-4a9d-9b14-1593b1cd9fa1 service nova] Acquiring lock "9da3fdac-deca-4ab9-9df5-8342144acc13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:55.795513 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2a15537b-2592-4788-badc-8b3a5acc2277 req-cc5e0de1-d3a7-4a9d-9b14-1593b1cd9fa1 service nova] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:55.795513 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-2a15537b-2592-4788-badc-8b3a5acc2277 req-cc5e0de1-d3a7-4a9d-9b14-1593b1cd9fa1 service nova] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:55.795513 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2a15537b-2592-4788-badc-8b3a5acc2277 req-cc5e0de1-d3a7-4a9d-9b14-1593b1cd9fa1 service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] No waiting events found dispatching network-vif-unplugged-4075449d-8606-42aa-82d0-371efdbcca11 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:52:55.795513 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-2a15537b-2592-4788-badc-8b3a5acc2277 req-cc5e0de1-d3a7-4a9d-9b14-1593b1cd9fa1 service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Received event network-vif-unplugged-4075449d-8606-42aa-82d0-371efdbcca11 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:52:55.908356 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:55.916230 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:55.932840 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999660818999928 future=<Future at 0x721834382600 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:52:55.937732 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Instance destroyed successfully.
May 19 04:52:55.938272 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lazy-loading 'resources' on Instance uuid 9da3fdac-deca-4ab9-9df5-8342144acc13 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:52:55.956341 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 656a7921-42b1-45cd-802f-488693ff5268] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:52:56.148445 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:52:56.440780 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:51:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1814397367',display_name='tempest-TestServerVolumeAttachmentScenario-server-1814397367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testservervolumeattachmentscenario-server-1814397367',id=72,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzcAmkx43zYA6ye/0QCPY97Hw1TmmOl5CXA25NUWf2XzwrTp8kJXb9TGQHWNOyZw4rHb3dzkX+j2ue2VEPkPu++gZOzwiLYha0DNj9oSm6hlwNnUUMtF+Bq2wqHrbbC6w==',key_name='tempest-keypair-1204702030',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:51:48Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a69d8ed0ff94aa7aeeba4bb7186c857',ramdisk_id='',reservation_id='r-2loj8z5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1085645296',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1085645296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:51:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8895143392c74e3a888bfc84ef323373',uuid=9da3fdac-deca-4ab9-9df5-8342144acc13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4075449d-8606-42aa-82d0-371efdbcca11", "address": "fa:16:3e:dd:ea:eb", "network": {"id": "cde3508d-bb21-4be7-8e14-fc9f2e50f75c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-53532512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a69d8ed0ff94aa7aeeba4bb7186c857", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4075449d-86", "ovs_interfaceid": "4075449d-8606-42aa-82d0-371efdbcca11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:52:56.441026 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Converting VIF {"id": "4075449d-8606-42aa-82d0-371efdbcca11", "address": "fa:16:3e:dd:ea:eb", "network": {"id": "cde3508d-bb21-4be7-8e14-fc9f2e50f75c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-53532512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a69d8ed0ff94aa7aeeba4bb7186c857", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4075449d-86", "ovs_interfaceid": "4075449d-8606-42aa-82d0-371efdbcca11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:52:56.441585 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:ea:eb,bridge_name='br-int',has_traffic_filtering=True,id=4075449d-8606-42aa-82d0-371efdbcca11,network=Network(cde3508d-bb21-4be7-8e14-fc9f2e50f75c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4075449d-86') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:52:56.441803 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:ea:eb,bridge_name='br-int',has_traffic_filtering=True,id=4075449d-8606-42aa-82d0-371efdbcca11,network=Network(cde3508d-bb21-4be7-8e14-fc9f2e50f75c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4075449d-86') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:52:56.443126 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:56.443391 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4075449d-86, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:52:56.444346 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:56.445085 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:52:56.445705 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:56.446944 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:56.447144 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21c5cd65-d5dd-4fcb-83d6-aeee6be05679) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:52:56.447618 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:56.448237 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:52:56.448381 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:52:56.450317 np0000001025 nova-compute[97981]: INFO os_vif [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:ea:eb,bridge_name='br-int',has_traffic_filtering=True,id=4075449d-8606-42aa-82d0-371efdbcca11,network=Network(cde3508d-bb21-4be7-8e14-fc9f2e50f75c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4075449d-86')
May 19 04:52:56.450659 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Deleting instance files /opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13_del
May 19 04:52:56.451503 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Deletion of /opt/stack/data/nova/instances/9da3fdac-deca-4ab9-9df5-8342144acc13_del complete
May 19 04:52:56.663173 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:52:56.663333 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.258s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:56.663710 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.008s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:56.664046 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:52:56.820030 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:52:56.820307 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:52:56.958154 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Took 1.34 seconds to destroy the instance on the hypervisor.
May 19 04:52:56.958909 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:52:56.959162 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:52:56.959308 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:52:56.959616 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:52:57.037046 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:52:57.324551 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:52:57.833907 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.170s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:57.859012 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8a830c86-1e9b-411f-b0b1-5d648972ca82 req-a2b30440-a27b-4014-93cf-48c8877a331d service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Received event network-vif-unplugged-4075449d-8606-42aa-82d0-371efdbcca11 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:52:57.859413 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8a830c86-1e9b-411f-b0b1-5d648972ca82 req-a2b30440-a27b-4014-93cf-48c8877a331d service nova] Acquiring lock "9da3fdac-deca-4ab9-9df5-8342144acc13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:57.859647 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8a830c86-1e9b-411f-b0b1-5d648972ca82 req-a2b30440-a27b-4014-93cf-48c8877a331d service nova] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:57.859804 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8a830c86-1e9b-411f-b0b1-5d648972ca82 req-a2b30440-a27b-4014-93cf-48c8877a331d service nova] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:57.859986 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8a830c86-1e9b-411f-b0b1-5d648972ca82 req-a2b30440-a27b-4014-93cf-48c8877a331d service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] No waiting events found dispatching network-vif-unplugged-4075449d-8606-42aa-82d0-371efdbcca11 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:52:57.860186 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8a830c86-1e9b-411f-b0b1-5d648972ca82 req-a2b30440-a27b-4014-93cf-48c8877a331d service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Received event network-vif-unplugged-4075449d-8606-42aa-82d0-371efdbcca11 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:52:57.860328 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8a830c86-1e9b-411f-b0b1-5d648972ca82 req-a2b30440-a27b-4014-93cf-48c8877a331d service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Received event network-vif-deleted-4075449d-8606-42aa-82d0-371efdbcca11 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:52:57.860519 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-8a830c86-1e9b-411f-b0b1-5d648972ca82 req-a2b30440-a27b-4014-93cf-48c8877a331d service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Neutron deleted interface 4075449d-8606-42aa-82d0-371efdbcca11; detaching it from the instance and deleting it from the info cache
May 19 04:52:57.860707 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-8a830c86-1e9b-411f-b0b1-5d648972ca82 req-a2b30440-a27b-4014-93cf-48c8877a331d service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:52:57.885241 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Deleted allocations for instance 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9
May 19 04:52:57.949616 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:52:58.364978 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8a830c86-1e9b-411f-b0b1-5d648972ca82 req-a2b30440-a27b-4014-93cf-48c8877a331d service nova] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Detach interface failed, port_id=4075449d-8606-42aa-82d0-371efdbcca11, reason: Instance 9da3fdac-deca-4ab9-9df5-8342144acc13 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:52:58.459423 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Took 1.50 seconds to deallocate network for instance.
May 19 04:52:58.896650 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5975a767-e488-4783-bf63-b6600af8c090 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.474s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:52:58.964294 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:52:58.964458 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:52:59.099286 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:52:59.099470 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:52:59.601829 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:53:00.108890 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.144s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:53:00.150712 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Deleted allocations for instance 9da3fdac-deca-4ab9-9df5-8342144acc13
May 19 04:53:01.158659 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9d64a0a9-3a1b-4ab5-a7ea-c55465e82e81 tempest-TestServerVolumeAttachmentScenario-1085645296 tempest-TestServerVolumeAttachmentScenario-1085645296-project-member] Lock "9da3fdac-deca-4ab9-9df5-8342144acc13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.052s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:53:01.448242 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:02.701004 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:53:02.701321 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:53:02.701403 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:53:02.701559 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:53:02.701701 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:53:02.703724 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Terminating instance
May 19 04:53:03.206661 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:53:03.221919 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:03.223741 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:03.241025 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:03.247075 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:03.262381 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:03.269970 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:03.371301 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-20f012b7-7741-45f0-9736-25836680eaf8 req-78f7efc0-5fc5-4e5c-a70c-33ecac37c9fb service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Received event network-vif-unplugged-692f80db-61ab-40d0-8f40-0e6bf8a2cdf5 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:53:03.371741 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-20f012b7-7741-45f0-9736-25836680eaf8 req-78f7efc0-5fc5-4e5c-a70c-33ecac37c9fb service nova] Acquiring lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:53:03.371931 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-20f012b7-7741-45f0-9736-25836680eaf8 req-78f7efc0-5fc5-4e5c-a70c-33ecac37c9fb service nova] Lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:53:03.372075 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-20f012b7-7741-45f0-9736-25836680eaf8 req-78f7efc0-5fc5-4e5c-a70c-33ecac37c9fb service nova] Lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:53:03.372249 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-20f012b7-7741-45f0-9736-25836680eaf8 req-78f7efc0-5fc5-4e5c-a70c-33ecac37c9fb service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] No waiting events found dispatching network-vif-unplugged-692f80db-61ab-40d0-8f40-0e6bf8a2cdf5 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:53:03.372388 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-20f012b7-7741-45f0-9736-25836680eaf8 req-78f7efc0-5fc5-4e5c-a70c-33ecac37c9fb service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Received event network-vif-unplugged-692f80db-61ab-40d0-8f40-0e6bf8a2cdf5 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:53:03.521818 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999628188000315 future=<Future at 0x7218501671a0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:53:03.523956 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Instance destroyed successfully.
May 19 04:53:03.524468 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lazy-loading 'resources' on Instance uuid 9c2a46cb-f9b2-4c34-a041-2bda0bc64051 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:53:04.026990 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:49:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1200456181',display_name='tempest-TestVolumeBootPatternV346-server-1200456181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testvolumebootpatternv346-server-1200456181',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYZqiv3dqislx5kGihScnnnlvE9m1bfjtN8S86vxi3TzHNUoRNlM9NWwD3SJ3yNbf83hAmFkM0jNfDoM2jKDTbGOHIvlJqKEJ94hJRj5FSbH/P7IaTzsOU0+2RaWRW8Kg==',key_name='tempest-keypair-1600845828',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:50:01Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d16b1deed8084634b3a8120ef6795f34',ramdisk_id='',reservation_id='r-1nxk54v4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1959285151',owner_user_name='tempest-TestVolumeBootPatternV346-1959285151-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:50:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eafa3940f19346c8b574aa03335a0528',uuid=9c2a46cb-f9b2-4c34-a041-2bda0bc64051,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "692f80db-61ab-40d0-8f40-0e6bf8a2cdf5", "address": "fa:16:3e:c1:94:ac", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap692f80db-61", "ovs_interfaceid": "692f80db-61ab-40d0-8f40-0e6bf8a2cdf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:53:04.027409 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Converting VIF {"id": "692f80db-61ab-40d0-8f40-0e6bf8a2cdf5", "address": "fa:16:3e:c1:94:ac", "network": {"id": "2bd74629-3dde-4be7-94c2-1550e25e2dcf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1870728789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d16b1deed8084634b3a8120ef6795f34", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap692f80db-61", "ovs_interfaceid": "692f80db-61ab-40d0-8f40-0e6bf8a2cdf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:53:04.027631 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:94:ac,bridge_name='br-int',has_traffic_filtering=True,id=692f80db-61ab-40d0-8f40-0e6bf8a2cdf5,network=Network(2bd74629-3dde-4be7-94c2-1550e25e2dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap692f80db-61') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:53:04.027834 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:94:ac,bridge_name='br-int',has_traffic_filtering=True,id=692f80db-61ab-40d0-8f40-0e6bf8a2cdf5,network=Network(2bd74629-3dde-4be7-94c2-1550e25e2dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap692f80db-61') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:53:04.028715 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:04.028937 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap692f80db-61, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:53:04.030150 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:04.030548 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:53:04.031136 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:04.031642 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:04.031761 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1bd95d1a-a9b0-4bde-a26b-9e11983f482a) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:53:04.032155 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:04.032539 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:53:04.033097 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:04.034789 np0000001025 nova-compute[97981]: INFO os_vif [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:94:ac,bridge_name='br-int',has_traffic_filtering=True,id=692f80db-61ab-40d0-8f40-0e6bf8a2cdf5,network=Network(2bd74629-3dde-4be7-94c2-1550e25e2dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap692f80db-61')
May 19 04:53:04.036253 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:53:04.036523 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba8032c3-139a-415e-a854-4c627e2b5553', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:53:04.036650 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:53:04.036979 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:53:04.037250 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba8032c3-139a-415e-a854-4c627e2b5553', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:53:04.037380 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:53:04.060666 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:53:04.060666 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:53:04.060666 np0000001025 nova-compute[97981]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05e292d9-ee36-429f-9463-bb6e5d267076 (non-flash)
May 19 04:53:04.060666 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:53:04.060907 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsi session list stdout=tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:53:04.060907 np0000001025 nova-compute[97981]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553 (non-flash)
May 19 04:53:04.060907 np0000001025 nova-compute[97981]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05e292d9-ee36-429f-9463-bb6e5d267076 (non-flash)
May 19 04:53:04.060907 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:53:04.060907 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', '156'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-05e292d9-ee36-429f-9463-bb6e5d267076', '183')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:53:04.061131 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', '156')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:53:04.062349 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553', '157')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:53:04.062843 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721850107600>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553'): ({'sde'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:53:04.063116 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Removing multipathed devices sde, sdd {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:53:04.063370 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Flush multipath device 330000000c8523fa1 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:53:04.110637 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:53:04.163762 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:53:04.200461 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:53:04.200658 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:53:04.202060 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:53:04.220319 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:53:04.220508 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:53:04.230619 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:53:04.257336 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 156, target: iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553, portal: 192.168.40.100,3260]
May 19 04:53:04.257336 np0000001025 nova-compute[97981]: Logout of [sid: 156, target: iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553, portal: 192.168.40.100,3260] successful.
May 19 04:53:04.257336 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:53:04.270763 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:53:04.281692 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:53:04.316400 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 157, target: iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553, portal: 192.168.50.100,3260]
May 19 04:53:04.316400 np0000001025 nova-compute[97981]: Logout of [sid: 157, target: iqn.2023-03.storpool.com:os--volume-ba8032c3-139a-415e-a854-4c627e2b5553, portal: 192.168.50.100,3260] successful.
May 19 04:53:04.316400 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:53:04.329796 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:53:04.329962 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:53:04.330078 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] <== disconnect_volume: return (293ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:53:04.330209 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:53:04.330446 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Deleting instance files /opt/stack/data/nova/instances/9c2a46cb-f9b2-4c34-a041-2bda0bc64051_del
May 19 04:53:04.330950 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Deletion of /opt/stack/data/nova/instances/9c2a46cb-f9b2-4c34-a041-2bda0bc64051_del complete
May 19 04:53:04.836163 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Took 1.63 seconds to destroy the instance on the hypervisor.
May 19 04:53:04.836768 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:53:04.837115 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:53:04.837238 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:53:04.837473 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:53:04.905762 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:53:05.424263 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8bb647da-0b9c-43ff-b956-119d3574ff33 req-62761bb0-8896-454d-b175-562ac0279f1e service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Received event network-vif-unplugged-692f80db-61ab-40d0-8f40-0e6bf8a2cdf5 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:53:05.424619 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8bb647da-0b9c-43ff-b956-119d3574ff33 req-62761bb0-8896-454d-b175-562ac0279f1e service nova] Acquiring lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:53:05.424785 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8bb647da-0b9c-43ff-b956-119d3574ff33 req-62761bb0-8896-454d-b175-562ac0279f1e service nova] Lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:53:05.424929 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8bb647da-0b9c-43ff-b956-119d3574ff33 req-62761bb0-8896-454d-b175-562ac0279f1e service nova] Lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:53:05.425425 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8bb647da-0b9c-43ff-b956-119d3574ff33 req-62761bb0-8896-454d-b175-562ac0279f1e service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] No waiting events found dispatching network-vif-unplugged-692f80db-61ab-40d0-8f40-0e6bf8a2cdf5 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:53:05.425602 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8bb647da-0b9c-43ff-b956-119d3574ff33 req-62761bb0-8896-454d-b175-562ac0279f1e service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Received event network-vif-unplugged-692f80db-61ab-40d0-8f40-0e6bf8a2cdf5 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:53:05.425723 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8bb647da-0b9c-43ff-b956-119d3574ff33 req-62761bb0-8896-454d-b175-562ac0279f1e service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Received event network-vif-deleted-692f80db-61ab-40d0-8f40-0e6bf8a2cdf5 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:53:05.425873 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-8bb647da-0b9c-43ff-b956-119d3574ff33 req-62761bb0-8896-454d-b175-562ac0279f1e service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Neutron deleted interface 692f80db-61ab-40d0-8f40-0e6bf8a2cdf5; detaching it from the instance and deleting it from the info cache
May 19 04:53:05.426014 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-8bb647da-0b9c-43ff-b956-119d3574ff33 req-62761bb0-8896-454d-b175-562ac0279f1e service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:53:05.524589 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:05.774316 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:53:05.929565 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8bb647da-0b9c-43ff-b956-119d3574ff33 req-62761bb0-8896-454d-b175-562ac0279f1e service nova] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Detach interface failed, port_id=692f80db-61ab-40d0-8f40-0e6bf8a2cdf5, reason: Instance 9c2a46cb-f9b2-4c34-a041-2bda0bc64051 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:53:06.241773 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00046125300013954984 future=<Future at 0x721834336840 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:53:06.242330 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Emitting event <LifecycleEvent: 1779166371.2411745, 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:53:06.242498 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:53:06.242806 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] VM Stopped (Lifecycle Event)
May 19 04:53:06.243773 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=4.688649793999957 future=<Future at 0x721834382600 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:53:06.244278 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=4.688525782999932 future=<Future at 0x721834382600 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:53:06.276348 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Took 1.44 seconds to deallocate network for instance.
May 19 04:53:06.745355 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: 4dd7d5d0-8f4e-4922-8969-d5bb95a2a9b9] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:53:06.832892 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Took 0.56 seconds to detach 1 volumes for instance.
May 19 04:53:07.149896 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:07.338392 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:53:07.338549 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:53:07.425998 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:53:07.426211 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:53:07.928787 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:53:08.438287 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.100s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:53:08.491352 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Deleted allocations for instance 9c2a46cb-f9b2-4c34-a041-2bda0bc64051
May 19 04:53:09.033484 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:09.502156 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c736442a-f2ac-4bcf-9a95-e27d886f8584 tempest-TestVolumeBootPatternV346-1959285151 tempest-TestVolumeBootPatternV346-1959285151-project-member] Lock "9c2a46cb-f9b2-4c34-a041-2bda0bc64051" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.801s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:53:10.932865 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00040578299967819476 future=<Future at 0x721834382600 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:53:10.933313 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] Emitting event <LifecycleEvent: 1779166375.932333, 9da3fdac-deca-4ab9-9df5-8342144acc13 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:53:10.933400 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:53:10.933605 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] VM Stopped (Lifecycle Event)
May 19 04:53:10.934455 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=7.586951737000163 future=<Future at 0x7218501671a0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:53:10.934574 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=7.586846441000034 future=<Future at 0x7218501671a0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:53:11.435936 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-862418d2-55f0-442c-8cb1-f600661cedde tempest-VolumesBackupsTest-1527553839 tempest-VolumesBackupsTest-1527553839-project-member] [instance: 9da3fdac-deca-4ab9-9df5-8342144acc13] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:53:12.606535 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:13.880432 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:14.035453 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:18.521847 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00038971599997239537 future=<Future at 0x7218501671a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:53:18.522355 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] Emitting event <LifecycleEvent: 1779166383.5213413, 9c2a46cb-f9b2-4c34-a041-2bda0bc64051 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:53:18.522721 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:53:18.522721 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] VM Stopped (Lifecycle Event)
May 19 04:53:19.027058 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-ce0491bf-c5a1-4108-a3fb-251cf02a6034 tempest-TestMinimumBasicScenario-545024582 tempest-TestMinimumBasicScenario-545024582-project-member] [instance: 9c2a46cb-f9b2-4c34-a041-2bda0bc64051] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:53:19.036251 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:24.037552 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:24.548974 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Acquiring lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:53:24.549172 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:53:25.051027 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:53:25.593680 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:53:25.593844 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:53:25.596795 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:53:25.596925 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Claim successful on node np0000001025
May 19 04:53:26.677038 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:53:26.677409 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:53:27.179465 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:53:27.685604 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.092s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:53:27.686013 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:53:28.192732 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:53:28.192925 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:53:28.193232 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:53:28.193475 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:53:28.275502 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9473acc85b64afcb7c316ae5151a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cd97461f104ee7a873b6956d8a80cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:53:28.656594 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Successfully created port: 7d18f593-23f0-4cc9-96f8-c63acba87f19 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:53:28.695655 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:53:29.038469 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:29.065313 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Successfully updated port: 7d18f593-23f0-4cc9-96f8-c63acba87f19 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:53:29.103985 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c56b46ed-bf47-4278-984a-8e0487c9cb2c req-8fb5a4fe-6429-4f26-9903-561862fb8051 service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Received event network-changed-7d18f593-23f0-4cc9-96f8-c63acba87f19 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:53:29.104137 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c56b46ed-bf47-4278-984a-8e0487c9cb2c req-8fb5a4fe-6429-4f26-9903-561862fb8051 service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Refreshing instance network info cache due to event network-changed-7d18f593-23f0-4cc9-96f8-c63acba87f19. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:53:29.104593 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c56b46ed-bf47-4278-984a-8e0487c9cb2c req-8fb5a4fe-6429-4f26-9903-561862fb8051 service nova] Acquiring lock "refresh_cache-c66dd5ba-b3b6-41ef-b492-06c23cb1af1b" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:53:29.104708 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c56b46ed-bf47-4278-984a-8e0487c9cb2c req-8fb5a4fe-6429-4f26-9903-561862fb8051 service nova] Acquired lock "refresh_cache-c66dd5ba-b3b6-41ef-b492-06c23cb1af1b" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:53:29.104817 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c56b46ed-bf47-4278-984a-8e0487c9cb2c req-8fb5a4fe-6429-4f26-9903-561862fb8051 service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Refreshing network info cache for port 7d18f593-23f0-4cc9-96f8-c63acba87f19 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:53:29.566335 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Acquiring lock "refresh_cache-c66dd5ba-b3b6-41ef-b492-06c23cb1af1b" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:53:29.606407 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-c56b46ed-bf47-4278-984a-8e0487c9cb2c req-8fb5a4fe-6429-4f26-9903-561862fb8051 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:53:29.658651 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c56b46ed-bf47-4278-984a-8e0487c9cb2c req-8fb5a4fe-6429-4f26-9903-561862fb8051 service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:53:29.700888 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:53:29.791791 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c56b46ed-bf47-4278-984a-8e0487c9cb2c req-8fb5a4fe-6429-4f26-9903-561862fb8051 service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:53:30.205423 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Booting with volume 83b29274-aa4d-454c-8c16-fcaeac0296ab at /dev/vdb
May 19 04:53:30.238792 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:53:30.248821 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:53:30.266262 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:53:30.295212 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c56b46ed-bf47-4278-984a-8e0487c9cb2c req-8fb5a4fe-6429-4f26-9903-561862fb8051 service nova] Releasing lock "refresh_cache-c66dd5ba-b3b6-41ef-b492-06c23cb1af1b" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:53:30.298673 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Acquired lock "refresh_cache-c66dd5ba-b3b6-41ef-b492-06c23cb1af1b" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:53:30.298673 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:53:30.307582 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:53:30.307836 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:53:30.315880 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:53:30.316669 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c'] 
May 19 04:53:30.316776 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:53:30.316875 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:53:30.317079 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] <== get_connector_properties: return (78ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:53:30.317273 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Updating existing volume attachment record: 3ee6a3a2-bc04-4881-9c7e-905774a1fe69 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:53:30.859270 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:53:30.999520 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:53:31.126435 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Updating instance_info_cache with network_info: [{"id": "7d18f593-23f0-4cc9-96f8-c63acba87f19", "address": "fa:16:3e:ca:35:dd", "network": {"id": "36c4136b-9558-4066-a95b-f05b21c95c36", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1315331825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96cd97461f104ee7a873b6956d8a80cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d18f593-23", "ovs_interfaceid": "7d18f593-23f0-4cc9-96f8-c63acba87f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:53:31.628215 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Releasing lock "refresh_cache-c66dd5ba-b3b6-41ef-b492-06c23cb1af1b" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:53:31.628603 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Instance network_info: |[{"id": "7d18f593-23f0-4cc9-96f8-c63acba87f19", "address": "fa:16:3e:ca:35:dd", "network": {"id": "36c4136b-9558-4066-a95b-f05b21c95c36", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1315331825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96cd97461f104ee7a873b6956d8a80cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d18f593-23", "ovs_interfaceid": "7d18f593-23f0-4cc9-96f8-c63acba87f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:53:32.401838 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:53:32.402887 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:53:32.403099 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Creating image(s)
May 19 04:53:32.403668 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Acquiring lock "/opt/stack/data/nova/instances/c66dd5ba-b3b6-41ef-b492-06c23cb1af1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:53:32.403973 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "/opt/stack/data/nova/instances/c66dd5ba-b3b6-41ef-b492-06c23cb1af1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:53:32.404431 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "/opt/stack/data/nova/instances/c66dd5ba-b3b6-41ef-b492-06c23cb1af1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:53:32.405558 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:53:32.408339 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:53:32.409294 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:53:32.496214 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.087s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:53:32.496761 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:53:32.497313 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:53:32.497791 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:53:32.500596 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:53:32.500735 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:53:32.593070 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.090s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:53:32.594440 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/c66dd5ba-b3b6-41ef-b492-06c23cb1af1b/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:53:32.666971 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/c66dd5ba-b3b6-41ef-b492-06c23cb1af1b/disk 1073741824" returned: 0 in 0.073s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:53:32.667392 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.170s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:53:32.667725 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:53:32.749224 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.081s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:53:32.749707 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c66dd5ba-b3b6-41ef-b492-06c23cb1af1b/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:53:32.749939 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c66dd5ba-b3b6-41ef-b492-06c23cb1af1b/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:53:32.836417 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c66dd5ba-b3b6-41ef-b492-06c23cb1af1b/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:53:32.836957 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Cannot resize image /opt/stack/data/nova/instances/c66dd5ba-b3b6-41ef-b492-06c23cb1af1b/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:53:32.837451 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:53:32.837682 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Ensure instance console log exists: /opt/stack/data/nova/instances/c66dd5ba-b3b6-41ef-b492-06c23cb1af1b/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:53:32.838010 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:53:32.838256 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:53:32.838391 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:53:32.840909 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Start _get_guest_xml network_info=[{"id": "7d18f593-23f0-4cc9-96f8-c63acba87f19", "address": "fa:16:3e:ca:35:dd", "network": {"id": "36c4136b-9558-4066-a95b-f05b21c95c36", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1315331825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96cd97461f104ee7a873b6956d8a80cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d18f593-23", "ovs_interfaceid": "7d18f593-23f0-4cc9-96f8-c63acba87f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': -1, 'attachment_id': '3ee6a3a2-bc04-4881-9c7e-905774a1fe69', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab', 'iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83b29274-aa4d-454c-8c16-fcaeac0296ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c66dd5ba-b3b6-41ef-b492-06c23cb1af1b', 'attached_at': '', 'detached_at': '', 'volume_id': '83b29274-aa4d-454c-8c16-fcaeac0296ab', 'serial': '83b29274-aa4d-454c-8c16-fcaeac0296ab'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:53:32.845064 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:53:32.846607 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-instance-315464317', uuid='c66dd5ba-b3b6-41ef-b492-06c23cb1af1b'), owner=OwnerMeta(userid='e9473acc85b64afcb7c316ae5151a076', username='tempest-VolumesBackupsTest-2141478944-project-member', projectid='96cd97461f104ee7a873b6956d8a80cf', projectname='tempest-VolumesBackupsTest-2141478944'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7d18f593-23f0-4cc9-96f8-c63acba87f19", "address": "fa:16:3e:ca:35:dd", "network": {"id": "36c4136b-9558-4066-a95b-f05b21c95c36", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1315331825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96cd97461f104ee7a873b6956d8a80cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d18f593-23", "ovs_interfaceid": "7d18f593-23f0-4cc9-96f8-c63acba87f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166412.846118) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:53:32.847773 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:53:32.848085 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:53:32.849200 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:53:32.849355 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:53:32.850390 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:53:32.850724 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:53:32.850856 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:53:32.850940 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:53:32.851051 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:53:32.851155 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:53:32.851246 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:53:32.851423 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:53:32.851518 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:53:32.851634 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:53:32.851730 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:53:32.851868 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:53:32.861976 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:53:32.862305 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab', 'iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83b29274-aa4d-454c-8c16-fcaeac0296ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:53:32.862492 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:53:32.862895 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:53:32.863115 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab', 'iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83b29274-aa4d-454c-8c16-fcaeac0296ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:53:32.874995 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:53:32.875672 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:53:32.876134 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:53:32.876347 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:53:32.876716 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:53:32.876911 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:53:32.886450 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:53:32.886450 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:53:32.890723 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:53:32.890723 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:53:32.897546 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab] added
May 19 04:53:32.897546 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:53:32.897546 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:53:32.897546 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:53:32.897546 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:53:32.897546 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:53:32.897546 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:53:32.897738 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:53:32.897896 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0215(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:53:32.898032 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:53:32.903549 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab] added
May 19 04:53:32.903549 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:53:32.903549 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:53:32.903549 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:53:32.903549 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:53:32.903549 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:53:32.903549 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:53:32.903779 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:53:32.903826 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0269(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:53:32.903926 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:53:33.898434 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:53:33.904296 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:53:33.909290 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:53:33.909290 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:53:33.915447 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:53:33.915447 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:53:33.919198 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:53:33.925983 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:53:33.929736 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc89ec9d-3316-4726-8fb6-e024be68c257 (non-flash)
May 19 04:53:33.929736 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:53:33.929865 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsi session list stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc89ec9d-3316-4726-8fb6-e024be68c257 (non-flash)
May 19 04:53:33.929865 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:53:33.936518 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc89ec9d-3316-4726-8fb6-e024be68c257 (non-flash)
May 19 04:53:33.936518 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:53:33.936670 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsi session list stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc89ec9d-3316-4726-8fb6-e024be68c257 (non-flash)
May 19 04:53:33.936670 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:53:33.959309 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab, portal: 192.168.40.100,3260]
May 19 04:53:33.959309 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab, portal: 192.168.40.100,3260] successful.
May 19 04:53:33.959309 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:53:33.970100 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:53:33.981519 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc89ec9d-3316-4726-8fb6-e024be68c257 (non-flash)
May 19 04:53:33.981519 np0000001025 nova-compute[97981]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab (non-flash)
May 19 04:53:33.981519 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:53:33.981693 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsi session list stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc89ec9d-3316-4726-8fb6-e024be68c257 (non-flash)
May 19 04:53:33.981693 np0000001025 nova-compute[97981]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab (non-flash)
May 19 04:53:33.981693 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:53:33.981924 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.106s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:53:33.982040 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:53:33.982933 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] HCTL ('8', '-', '-', 0) found on session 188 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:53:33.983062 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:53:33.996076 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Searching for a device in session 188 and hctl ['8', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:53:34.039721 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:34.979151 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab, portal: 192.168.50.100,3260]
May 19 04:53:34.979151 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab, portal: 192.168.50.100,3260] successful.
May 19 04:53:34.979151 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:53:34.989000 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:53:34.995853 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Searching for a device in session 188 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:53:34.996076 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83b29274-aa4d-454c-8c16-fcaeac0296ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:53:35.000785 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc89ec9d-3316-4726-8fb6-e024be68c257 (non-flash)
May 19 04:53:35.000785 np0000001025 nova-compute[97981]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab (non-flash)
May 19 04:53:35.000785 np0000001025 nova-compute[97981]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab (non-flash)
May 19 04:53:35.000785 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:53:35.000916 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsi session list stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc89ec9d-3316-4726-8fb6-e024be68c257 (non-flash)
May 19 04:53:35.000916 np0000001025 nova-compute[97981]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab (non-flash)
May 19 04:53:35.000916 np0000001025 nova-compute[97981]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab (non-flash)
May 19 04:53:35.000916 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:53:35.001189 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.125s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:53:35.001314 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:53:35.001899 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] HCTL ('9', '-', '-', 0) found on session 189 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:53:35.001997 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:53:35.014497 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Searching for a device in session 189 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:53:35.014497 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '83b29274-aa4d-454c-8c16-fcaeac0296ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:53:35.876988 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:53:36.891880 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Found WWN 330000000ee221b48 for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:53:36.892303 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.029s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:53:36.892461 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] <== connect_volume: return (4029ms) {'type': 'block', 'scsi_wwn': '330000000ee221b48', 'path': '/dev/dm-0', 'multipath_id': '330000000ee221b48'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:53:36.892642 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ee221b48', 'path': '/dev/dm-0', 'multipath_id': '330000000ee221b48'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:53:37.399197 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:53:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-315464317',display_name='tempest-instance-315464317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-instance-315464317',id=75,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzaoY+jcQoXnm7PLzhpuBNYyCi2AylkWLjCrx96OdkPjrUB5sV6jNRuI4rN8jTR3FMd3HeCQ/jNTcWyfl0bIHEHI8oDWTfPHDLbRonX76dbTXQqfFgZtpxeUlhOr2Bt1A==',key_name='tempest-keypair-171742523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96cd97461f104ee7a873b6956d8a80cf',ramdisk_id='',reservation_id='r-hobem1xd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-2141478944',owner_user_name='tempest-VolumesBackupsTest-2141478944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:53:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9473acc85b64afcb7c316ae5151a076',uuid=c66dd5ba-b3b6-41ef-b492-06c23cb1af1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d18f593-23f0-4cc9-96f8-c63acba87f19", "address": "fa:16:3e:ca:35:dd", "network": {"id": "36c4136b-9558-4066-a95b-f05b21c95c36", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1315331825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96cd97461f104ee7a873b6956d8a80cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d18f593-23", "ovs_interfaceid": "7d18f593-23f0-4cc9-96f8-c63acba87f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:53:37.399455 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Converting VIF {"id": "7d18f593-23f0-4cc9-96f8-c63acba87f19", "address": "fa:16:3e:ca:35:dd", "network": {"id": "36c4136b-9558-4066-a95b-f05b21c95c36", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1315331825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96cd97461f104ee7a873b6956d8a80cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d18f593-23", "ovs_interfaceid": "7d18f593-23f0-4cc9-96f8-c63acba87f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:53:37.399946 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:35:dd,bridge_name='br-int',has_traffic_filtering=True,id=7d18f593-23f0-4cc9-96f8-c63acba87f19,network=Network(36c4136b-9558-4066-a95b-f05b21c95c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d18f593-23') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:53:37.400489 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lazy-loading 'pci_devices' on Instance uuid c66dd5ba-b3b6-41ef-b492-06c23cb1af1b {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:53:37.903431 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] End _get_guest_xml xml=<domain type="qemu">
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:   <uuid>c66dd5ba-b3b6-41ef-b492-06c23cb1af1b</uuid>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:   <name>instance-0000004b</name>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <nova:name>tempest-instance-315464317</nova:name>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:53:32</nova:creationTime>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:         <nova:user uuid="e9473acc85b64afcb7c316ae5151a076">tempest-VolumesBackupsTest-2141478944-project-member</nova:user>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:         <nova:project uuid="96cd97461f104ee7a873b6956d8a80cf">tempest-VolumesBackupsTest-2141478944</nova:project>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:         <nova:port uuid="7d18f593-23f0-4cc9-96f8-c63acba87f19">
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     <system>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <entry name="serial">c66dd5ba-b3b6-41ef-b492-06c23cb1af1b</entry>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <entry name="uuid">c66dd5ba-b3b6-41ef-b492-06c23cb1af1b</entry>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     </system>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:   <os>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:   </os>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:   <features>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:   </features>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:   <devices>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/c66dd5ba-b3b6-41ef-b492-06c23cb1af1b/disk"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     </disk>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/c66dd5ba-b3b6-41ef-b492-06c23cb1af1b/disk.config"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     </disk>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <alias name="ua-83b29274-aa4d-454c-8c16-fcaeac0296ab"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-0"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <target dev="vdb" bus="virtio"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <serial>83b29274-aa4d-454c-8c16-fcaeac0296ab</serial>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     </disk>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:ca:35:dd"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <target dev="tap7d18f593-23"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     </interface>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/c66dd5ba-b3b6-41ef-b492-06c23cb1af1b/console.log" append="off"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     </serial>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     <video>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     </video>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     </rng>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:   </devices>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]: </domain>
May 19 04:53:37.903431 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:53:37.905798 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Preparing to wait for external event network-vif-plugged-7d18f593-23f0-4cc9-96f8-c63acba87f19 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:53:37.905798 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Acquiring lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:53:37.905798 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:53:37.905798 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:53:37.905798 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:53:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-315464317',display_name='tempest-instance-315464317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-instance-315464317',id=75,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzaoY+jcQoXnm7PLzhpuBNYyCi2AylkWLjCrx96OdkPjrUB5sV6jNRuI4rN8jTR3FMd3HeCQ/jNTcWyfl0bIHEHI8oDWTfPHDLbRonX76dbTXQqfFgZtpxeUlhOr2Bt1A==',key_name='tempest-keypair-171742523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96cd97461f104ee7a873b6956d8a80cf',ramdisk_id='',reservation_id='r-hobem1xd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-2141478944',owner_user_name='tempest-VolumesBackupsTest-2141478944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:53:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9473acc85b64afcb7c316ae5151a076',uuid=c66dd5ba-b3b6-41ef-b492-06c23cb1af1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d18f593-23f0-4cc9-96f8-c63acba87f19", "address": "fa:16:3e:ca:35:dd", "network": {"id": "36c4136b-9558-4066-a95b-f05b21c95c36", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1315331825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96cd97461f104ee7a873b6956d8a80cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d18f593-23", "ovs_interfaceid": "7d18f593-23f0-4cc9-96f8-c63acba87f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:53:37.905798 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Converting VIF {"id": "7d18f593-23f0-4cc9-96f8-c63acba87f19", "address": "fa:16:3e:ca:35:dd", "network": {"id": "36c4136b-9558-4066-a95b-f05b21c95c36", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1315331825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96cd97461f104ee7a873b6956d8a80cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d18f593-23", "ovs_interfaceid": "7d18f593-23f0-4cc9-96f8-c63acba87f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:53:37.905798 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:35:dd,bridge_name='br-int',has_traffic_filtering=True,id=7d18f593-23f0-4cc9-96f8-c63acba87f19,network=Network(36c4136b-9558-4066-a95b-f05b21c95c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d18f593-23') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:53:37.905798 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:35:dd,bridge_name='br-int',has_traffic_filtering=True,id=7d18f593-23f0-4cc9-96f8-c63acba87f19,network=Network(36c4136b-9558-4066-a95b-f05b21c95c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d18f593-23') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:53:37.905798 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:37.906086 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:53:37.906319 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:53:37.906900 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:37.907035 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '42115e4e-9b3f-57de-a6d3-c304f7704688', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:53:37.907754 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:37.908370 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:53:37.908493 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:37.910234 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:37.910358 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d18f593-23, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:53:37.910669 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d18f593-23, col_values=(('qos', UUID('2fc2b98e-3051-43ed-b2b0-5af7b4582c65')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:53:37.910811 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d18f593-23, col_values=(('external_ids', {'iface-id': '7d18f593-23f0-4cc9-96f8-c63acba87f19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:35:dd', 'vm-uuid': 'c66dd5ba-b3b6-41ef-b492-06c23cb1af1b'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:53:37.911428 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:37.912406 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:53:37.916800 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:37.917449 np0000001025 nova-compute[97981]: INFO os_vif [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:35:dd,bridge_name='br-int',has_traffic_filtering=True,id=7d18f593-23f0-4cc9-96f8-c63acba87f19,network=Network(36c4136b-9558-4066-a95b-f05b21c95c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d18f593-23')
May 19 04:53:39.433902 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:53:39.434450 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:53:39.434450 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:53:39.434450 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] No VIF found with MAC fa:16:3e:ca:35:dd, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:53:39.434833 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Using config drive
May 19 04:53:39.939896 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:53:40.079714 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Creating config drive at /opt/stack/data/nova/instances/c66dd5ba-b3b6-41ef-b492-06c23cb1af1b/disk.config
May 19 04:53:40.083649 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c66dd5ba-b3b6-41ef-b492-06c23cb1af1b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuo730dyn {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:53:40.151832 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c66dd5ba-b3b6-41ef-b492-06c23cb1af1b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuo730dyn" returned: 0 in 0.068s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:53:40.557870 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:40.579014 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:40.580923 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:40.676767 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:40.680319 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:40.744395 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5dd24af4-93b7-45bb-a997-f9f6c5b6f059 req-5f1ad31d-4ab0-4a1d-aa74-1e0655df608b service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Received event network-vif-plugged-7d18f593-23f0-4cc9-96f8-c63acba87f19 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:53:40.744635 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5dd24af4-93b7-45bb-a997-f9f6c5b6f059 req-5f1ad31d-4ab0-4a1d-aa74-1e0655df608b service nova] Acquiring lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:53:40.744842 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5dd24af4-93b7-45bb-a997-f9f6c5b6f059 req-5f1ad31d-4ab0-4a1d-aa74-1e0655df608b service nova] Lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:53:40.744994 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5dd24af4-93b7-45bb-a997-f9f6c5b6f059 req-5f1ad31d-4ab0-4a1d-aa74-1e0655df608b service nova] Lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:53:40.746038 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5dd24af4-93b7-45bb-a997-f9f6c5b6f059 req-5f1ad31d-4ab0-4a1d-aa74-1e0655df608b service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Processing event network-vif-plugged-7d18f593-23f0-4cc9-96f8-c63acba87f19 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:53:40.853396 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:40.854966 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:40.857464 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:40.879819 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:40.880661 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:41.292132 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:53:41.292484 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166421.2921906, c66dd5ba-b3b6-41ef-b492-06c23cb1af1b => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:53:41.292615 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] VM Started (Lifecycle Event)
May 19 04:53:41.295055 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:53:41.298279 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Instance spawned successfully.
May 19 04:53:41.298638 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:53:41.795424 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:53:41.797476 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:53:41.806782 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:53:41.806892 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:53:41.807215 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:53:41.807443 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:53:41.807697 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:53:41.807950 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:53:42.304303 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:53:42.304557 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166422.3043735, c66dd5ba-b3b6-41ef-b492-06c23cb1af1b => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:53:42.304700 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] VM Paused (Lifecycle Event)
May 19 04:53:42.314172 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Took 9.91 seconds to spawn the instance on the hypervisor.
May 19 04:53:42.314342 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:53:42.800208 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6d81de55-56f9-480d-865f-b8ae8ef81915 req-0a662fa8-a6f4-4e8c-8775-0a3c386ff4bc service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Received event network-vif-plugged-7d18f593-23f0-4cc9-96f8-c63acba87f19 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:53:42.800659 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6d81de55-56f9-480d-865f-b8ae8ef81915 req-0a662fa8-a6f4-4e8c-8775-0a3c386ff4bc service nova] Acquiring lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:53:42.800867 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6d81de55-56f9-480d-865f-b8ae8ef81915 req-0a662fa8-a6f4-4e8c-8775-0a3c386ff4bc service nova] Lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:53:42.801030 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-6d81de55-56f9-480d-865f-b8ae8ef81915 req-0a662fa8-a6f4-4e8c-8775-0a3c386ff4bc service nova] Lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:53:42.801204 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6d81de55-56f9-480d-865f-b8ae8ef81915 req-0a662fa8-a6f4-4e8c-8775-0a3c386ff4bc service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] No waiting events found dispatching network-vif-plugged-7d18f593-23f0-4cc9-96f8-c63acba87f19 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:53:42.801375 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-6d81de55-56f9-480d-865f-b8ae8ef81915 req-0a662fa8-a6f4-4e8c-8775-0a3c386ff4bc service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Received unexpected event network-vif-plugged-7d18f593-23f0-4cc9-96f8-c63acba87f19 for instance with vm_state active and task_state None.
May 19 04:53:42.809495 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:53:42.811388 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166422.811188, c66dd5ba-b3b6-41ef-b492-06c23cb1af1b => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:53:42.811538 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] VM Resumed (Lifecycle Event)
May 19 04:53:42.824879 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Took 17.27 seconds to build instance.
May 19 04:53:42.914256 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:43.314671 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:53:43.317016 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:53:43.329393 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-964991fd-15de-4354-b344-f69cf9338e36 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.780s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:53:43.350564 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3297d282-cd5c-4db3-a284-d3c3aa9374a0 req-8190a6a4-c6a9-45a7-ac13-9068a6be0c37 service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Received event network-changed-7d18f593-23f0-4cc9-96f8-c63acba87f19 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:53:43.351013 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3297d282-cd5c-4db3-a284-d3c3aa9374a0 req-8190a6a4-c6a9-45a7-ac13-9068a6be0c37 service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Refreshing instance network info cache due to event network-changed-7d18f593-23f0-4cc9-96f8-c63acba87f19. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:53:43.351696 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3297d282-cd5c-4db3-a284-d3c3aa9374a0 req-8190a6a4-c6a9-45a7-ac13-9068a6be0c37 service nova] Acquiring lock "refresh_cache-c66dd5ba-b3b6-41ef-b492-06c23cb1af1b" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:53:43.351982 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3297d282-cd5c-4db3-a284-d3c3aa9374a0 req-8190a6a4-c6a9-45a7-ac13-9068a6be0c37 service nova] Acquired lock "refresh_cache-c66dd5ba-b3b6-41ef-b492-06c23cb1af1b" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:53:43.352213 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3297d282-cd5c-4db3-a284-d3c3aa9374a0 req-8190a6a4-c6a9-45a7-ac13-9068a6be0c37 service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Refreshing network info cache for port 7d18f593-23f0-4cc9-96f8-c63acba87f19 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:53:43.664331 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:53:43.664625 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:53:43.664869 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:53:43.665084 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:53:43.665306 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:53:43.665623 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.95 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:53:43.854697 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-3297d282-cd5c-4db3-a284-d3c3aa9374a0 req-8190a6a4-c6a9-45a7-ac13-9068a6be0c37 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:53:43.890692 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:44.148816 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-3297d282-cd5c-4db3-a284-d3c3aa9374a0 req-8190a6a4-c6a9-45a7-ac13-9068a6be0c37 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:53:44.302748 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3297d282-cd5c-4db3-a284-d3c3aa9374a0 req-8190a6a4-c6a9-45a7-ac13-9068a6be0c37 service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Updated VIF entry in instance network info cache for port 7d18f593-23f0-4cc9-96f8-c63acba87f19. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:53:44.304135 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3297d282-cd5c-4db3-a284-d3c3aa9374a0 req-8190a6a4-c6a9-45a7-ac13-9068a6be0c37 service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Updating instance_info_cache with network_info: [{"id": "7d18f593-23f0-4cc9-96f8-c63acba87f19", "address": "fa:16:3e:ca:35:dd", "network": {"id": "36c4136b-9558-4066-a95b-f05b21c95c36", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1315331825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96cd97461f104ee7a873b6956d8a80cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d18f593-23", "ovs_interfaceid": "7d18f593-23f0-4cc9-96f8-c63acba87f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:53:44.805875 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3297d282-cd5c-4db3-a284-d3c3aa9374a0 req-8190a6a4-c6a9-45a7-ac13-9068a6be0c37 service nova] Releasing lock "refresh_cache-c66dd5ba-b3b6-41ef-b492-06c23cb1af1b" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:53:46.615225 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:53:46.615874 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.99 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:53:47.917349 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:48.556838 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:48.892391 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:50.888944 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:53:51.610917 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:53:51.611166 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:53:51.614600 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:53:51.614690 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:53:51.614872 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:53:51.742784 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:52.919827 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:53.614868 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:53:53.857665 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:53.893552 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:54.119566 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:53:54.120021 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:53:54.120021 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:53:54.120163 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:53:55.139165 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c66dd5ba-b3b6-41ef-b492-06c23cb1af1b/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:53:55.242353 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c66dd5ba-b3b6-41ef-b492-06c23cb1af1b/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:53:55.242926 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c66dd5ba-b3b6-41ef-b492-06c23cb1af1b/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:53:55.341661 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c66dd5ba-b3b6-41ef-b492-06c23cb1af1b/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:53:55.342144 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:53:55.349313 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:53:55.350822 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:53:55.413943 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.062s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:53:55.414085 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=13849MB free_disk=72.76581573486328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:53:55.414343 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:53:55.414675 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:53:56.199672 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:56.485654 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance c66dd5ba-b3b6-41ef-b492-06c23cb1af1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:53:56.485873 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:53:56.486140 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:53:55 up 44 min,  2 users,  load average: 2.69, 3.64, 3.76\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_96cd97461f104ee7a873b6956d8a80cf': '1', 'io_workload': '0'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:53:56.612663 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:53:56.612913 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:53:57.119452 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:53:57.627890 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:53:57.628442 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.213s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:53:57.628442 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:53:57.691862 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:57.924074 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:53:58.894843 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:00.110534 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Acquiring lock "1452acf7-5040-4e13-94e3-bee1d64e8300" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:54:00.110946 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "1452acf7-5040-4e13-94e3-bee1d64e8300" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:54:00.612373 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:54:01.172249 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:54:01.172571 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:54:01.176251 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:54:01.176251 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Claim successful on node np0000001025
May 19 04:54:02.329380 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:54:02.329733 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:54:02.833196 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:54:02.927224 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:03.342782 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.170s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:54:03.343283 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:54:03.849822 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:54:03.850808 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:54:03.850808 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:54:03.850990 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:54:03.896787 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:03.924077 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff2b4bbecced4a1aa48b16cd62b01862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3d68b9e282446795456d9046c176d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:54:04.273361 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Successfully created port: a9660560-0a2e-42ab-a88a-3097da0747d7 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:54:04.353428 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:54:04.688175 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Successfully updated port: a9660560-0a2e-42ab-a88a-3097da0747d7 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:54:04.734948 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8bf7dfb3-f5a9-4408-88f3-a1b49381beef req-c88c9fd8-0445-46c9-b655-cd19c3e5273d service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Received event network-changed-a9660560-0a2e-42ab-a88a-3097da0747d7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:54:04.735336 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8bf7dfb3-f5a9-4408-88f3-a1b49381beef req-c88c9fd8-0445-46c9-b655-cd19c3e5273d service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Refreshing instance network info cache due to event network-changed-a9660560-0a2e-42ab-a88a-3097da0747d7. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:54:04.735534 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8bf7dfb3-f5a9-4408-88f3-a1b49381beef req-c88c9fd8-0445-46c9-b655-cd19c3e5273d service nova] Acquiring lock "refresh_cache-1452acf7-5040-4e13-94e3-bee1d64e8300" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:54:04.735695 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8bf7dfb3-f5a9-4408-88f3-a1b49381beef req-c88c9fd8-0445-46c9-b655-cd19c3e5273d service nova] Acquired lock "refresh_cache-1452acf7-5040-4e13-94e3-bee1d64e8300" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:54:04.735843 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-8bf7dfb3-f5a9-4408-88f3-a1b49381beef req-c88c9fd8-0445-46c9-b655-cd19c3e5273d service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Refreshing network info cache for port a9660560-0a2e-42ab-a88a-3097da0747d7 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:54:04.857618 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:54:05.190080 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Acquiring lock "refresh_cache-1452acf7-5040-4e13-94e3-bee1d64e8300" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:54:05.237446 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-8bf7dfb3-f5a9-4408-88f3-a1b49381beef req-c88c9fd8-0445-46c9-b655-cd19c3e5273d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:54:05.300348 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-8bf7dfb3-f5a9-4408-88f3-a1b49381beef req-c88c9fd8-0445-46c9-b655-cd19c3e5273d service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:54:05.424089 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-8bf7dfb3-f5a9-4408-88f3-a1b49381beef req-c88c9fd8-0445-46c9-b655-cd19c3e5273d service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:54:05.868911 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:54:05.869817 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:54:05.870080 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Creating image(s)
May 19 04:54:05.870550 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Acquiring lock "/opt/stack/data/nova/instances/1452acf7-5040-4e13-94e3-bee1d64e8300/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:54:05.870707 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "/opt/stack/data/nova/instances/1452acf7-5040-4e13-94e3-bee1d64e8300/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:54:05.871186 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "/opt/stack/data/nova/instances/1452acf7-5040-4e13-94e3-bee1d64e8300/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:54:05.871633 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:54:05.873896 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:54:05.874840 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:54:05.928524 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8bf7dfb3-f5a9-4408-88f3-a1b49381beef req-c88c9fd8-0445-46c9-b655-cd19c3e5273d service nova] Releasing lock "refresh_cache-1452acf7-5040-4e13-94e3-bee1d64e8300" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:54:05.929806 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Acquired lock "refresh_cache-1452acf7-5040-4e13-94e3-bee1d64e8300" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:54:05.930236 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:54:05.969315 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:54:05.969771 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:54:05.970272 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:54:05.970782 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:54:05.973902 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:54:05.974241 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:54:06.065360 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.091s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:54:06.065695 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/1452acf7-5040-4e13-94e3-bee1d64e8300/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:54:06.127571 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/1452acf7-5040-4e13-94e3-bee1d64e8300/disk 1073741824" returned: 0 in 0.061s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:54:06.128074 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.158s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:54:06.128472 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:54:06.218844 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.090s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:54:06.219321 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1452acf7-5040-4e13-94e3-bee1d64e8300/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:54:06.219586 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1452acf7-5040-4e13-94e3-bee1d64e8300/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:54:06.326684 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1452acf7-5040-4e13-94e3-bee1d64e8300/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:54:06.327080 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Cannot resize image /opt/stack/data/nova/instances/1452acf7-5040-4e13-94e3-bee1d64e8300/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:54:06.327537 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:54:06.327798 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Ensure instance console log exists: /opt/stack/data/nova/instances/1452acf7-5040-4e13-94e3-bee1d64e8300/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:54:06.328056 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:54:06.328371 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:54:06.328574 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:54:06.510755 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:54:06.692125 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:54:06.813392 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Updating instance_info_cache with network_info: [{"id": "a9660560-0a2e-42ab-a88a-3097da0747d7", "address": "fa:16:3e:3f:59:3c", "network": {"id": "71f812ef-a2b2-4e6b-8f86-de17a7bf565a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-401556595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1e3d68b9e282446795456d9046c176d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9660560-0a", "ovs_interfaceid": "a9660560-0a2e-42ab-a88a-3097da0747d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:54:07.315828 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Releasing lock "refresh_cache-1452acf7-5040-4e13-94e3-bee1d64e8300" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:54:07.316223 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Instance network_info: |[{"id": "a9660560-0a2e-42ab-a88a-3097da0747d7", "address": "fa:16:3e:3f:59:3c", "network": {"id": "71f812ef-a2b2-4e6b-8f86-de17a7bf565a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-401556595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1e3d68b9e282446795456d9046c176d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9660560-0a", "ovs_interfaceid": "a9660560-0a2e-42ab-a88a-3097da0747d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:54:07.318520 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Start _get_guest_xml network_info=[{"id": "a9660560-0a2e-42ab-a88a-3097da0747d7", "address": "fa:16:3e:3f:59:3c", "network": {"id": "71f812ef-a2b2-4e6b-8f86-de17a7bf565a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-401556595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1e3d68b9e282446795456d9046c176d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9660560-0a", "ovs_interfaceid": "a9660560-0a2e-42ab-a88a-3097da0747d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:54:07.324232 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:54:07.325991 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1001460892', uuid='1452acf7-5040-4e13-94e3-bee1d64e8300'), owner=OwnerMeta(userid='ff2b4bbecced4a1aa48b16cd62b01862', username='tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member', projectid='1e3d68b9e282446795456d9046c176d2', projectname='tempest-TestServerVolumeAttachScenarioOldVersion-1756195513'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a9660560-0a2e-42ab-a88a-3097da0747d7", "address": "fa:16:3e:3f:59:3c", "network": {"id": "71f812ef-a2b2-4e6b-8f86-de17a7bf565a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-401556595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1e3d68b9e282446795456d9046c176d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9660560-0a", "ovs_interfaceid": "a9660560-0a2e-42ab-a88a-3097da0747d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166447.325508) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:54:07.327683 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:54:07.328081 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:54:07.329341 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:54:07.329668 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:54:07.331027 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:54:07.331495 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:54:07.331733 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:54:07.331908 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:54:07.332119 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:54:07.332297 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:54:07.332598 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:54:07.332811 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:54:07.332952 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:54:07.333095 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:54:07.333248 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:54:07.333400 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:54:07.349452 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1001460892',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1001460892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testservervolumeattachscenariooldversion-server-1001460',id=76,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZLLtx81/4Gma6w5p6UkXlRWUT1czKTgkslbILD7zciVL1M7jJ6MVmxMXYConi4w/qNGttE0XtAK6//vKUx/OA7SZfVUllhITB9FRfNL3XyJGlzgvj8rKTzij6wJhOCJQ==',key_name='tempest-keypair-1570470930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e3d68b9e282446795456d9046c176d2',ramdisk_id='',reservation_id='r-m0ucxeyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1756195513',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:54:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff2b4bbecced4a1aa48b16cd62b01862',uuid=1452acf7-5040-4e13-94e3-bee1d64e8300,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9660560-0a2e-42ab-a88a-3097da0747d7", "address": "fa:16:3e:3f:59:3c", "network": {"id": "71f812ef-a2b2-4e6b-8f86-de17a7bf565a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-401556595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1e3d68b9e282446795456d9046c176d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9660560-0a", "ovs_interfaceid": "a9660560-0a2e-42ab-a88a-3097da0747d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:54:07.349729 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Converting VIF {"id": "a9660560-0a2e-42ab-a88a-3097da0747d7", "address": "fa:16:3e:3f:59:3c", "network": {"id": "71f812ef-a2b2-4e6b-8f86-de17a7bf565a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-401556595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1e3d68b9e282446795456d9046c176d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9660560-0a", "ovs_interfaceid": "a9660560-0a2e-42ab-a88a-3097da0747d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:54:07.350716 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:59:3c,bridge_name='br-int',has_traffic_filtering=True,id=a9660560-0a2e-42ab-a88a-3097da0747d7,network=Network(71f812ef-a2b2-4e6b-8f86-de17a7bf565a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9660560-0a') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:54:07.351395 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lazy-loading 'pci_devices' on Instance uuid 1452acf7-5040-4e13-94e3-bee1d64e8300 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:54:07.854407 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] End _get_guest_xml xml=<domain type="qemu">
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:   <uuid>1452acf7-5040-4e13-94e3-bee1d64e8300</uuid>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:   <name>instance-0000004c</name>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1001460892</nova:name>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:54:07</nova:creationTime>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:         <nova:user uuid="ff2b4bbecced4a1aa48b16cd62b01862">tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member</nova:user>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:         <nova:project uuid="1e3d68b9e282446795456d9046c176d2">tempest-TestServerVolumeAttachScenarioOldVersion-1756195513</nova:project>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:         <nova:port uuid="a9660560-0a2e-42ab-a88a-3097da0747d7">
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     <system>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <entry name="serial">1452acf7-5040-4e13-94e3-bee1d64e8300</entry>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <entry name="uuid">1452acf7-5040-4e13-94e3-bee1d64e8300</entry>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     </system>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:   <os>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:   </os>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:   <features>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:   </features>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:   <devices>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/1452acf7-5040-4e13-94e3-bee1d64e8300/disk"/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     </disk>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/1452acf7-5040-4e13-94e3-bee1d64e8300/disk.config"/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     </disk>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:3f:59:3c"/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <target dev="tapa9660560-0a"/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     </interface>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/1452acf7-5040-4e13-94e3-bee1d64e8300/console.log" append="off"/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     </serial>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     <video>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     </video>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     </rng>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:   </devices>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]: </domain>
May 19 04:54:07.854407 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:54:07.856684 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Preparing to wait for external event network-vif-plugged-a9660560-0a2e-42ab-a88a-3097da0747d7 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:54:07.856684 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Acquiring lock "1452acf7-5040-4e13-94e3-bee1d64e8300-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:54:07.856684 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "1452acf7-5040-4e13-94e3-bee1d64e8300-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:54:07.856684 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "1452acf7-5040-4e13-94e3-bee1d64e8300-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:54:07.856684 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1001460892',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1001460892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testservervolumeattachscenariooldversion-server-1001460',id=76,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZLLtx81/4Gma6w5p6UkXlRWUT1czKTgkslbILD7zciVL1M7jJ6MVmxMXYConi4w/qNGttE0XtAK6//vKUx/OA7SZfVUllhITB9FRfNL3XyJGlzgvj8rKTzij6wJhOCJQ==',key_name='tempest-keypair-1570470930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e3d68b9e282446795456d9046c176d2',ramdisk_id='',reservation_id='r-m0ucxeyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1756195513',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:54:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff2b4bbecced4a1aa48b16cd62b01862',uuid=1452acf7-5040-4e13-94e3-bee1d64e8300,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9660560-0a2e-42ab-a88a-3097da0747d7", "address": "fa:16:3e:3f:59:3c", "network": {"id": "71f812ef-a2b2-4e6b-8f86-de17a7bf565a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-401556595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1e3d68b9e282446795456d9046c176d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9660560-0a", "ovs_interfaceid": "a9660560-0a2e-42ab-a88a-3097da0747d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:54:07.856684 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Converting VIF {"id": "a9660560-0a2e-42ab-a88a-3097da0747d7", "address": "fa:16:3e:3f:59:3c", "network": {"id": "71f812ef-a2b2-4e6b-8f86-de17a7bf565a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-401556595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1e3d68b9e282446795456d9046c176d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9660560-0a", "ovs_interfaceid": "a9660560-0a2e-42ab-a88a-3097da0747d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:54:07.857389 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:59:3c,bridge_name='br-int',has_traffic_filtering=True,id=a9660560-0a2e-42ab-a88a-3097da0747d7,network=Network(71f812ef-a2b2-4e6b-8f86-de17a7bf565a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9660560-0a') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:54:07.857698 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:59:3c,bridge_name='br-int',has_traffic_filtering=True,id=a9660560-0a2e-42ab-a88a-3097da0747d7,network=Network(71f812ef-a2b2-4e6b-8f86-de17a7bf565a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9660560-0a') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:54:07.858357 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:07.858819 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:54:07.859221 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:54:07.859969 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:07.860200 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09b08865-401b-576d-ac8e-617814a9c42e', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:54:07.861480 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:07.862388 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:54:07.862388 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:07.864717 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:07.864912 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9660560-0a, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:54:07.865256 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa9660560-0a, col_values=(('qos', UUID('26f7191e-41a1-4919-9e3a-9c11701d5e63')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:54:07.865409 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa9660560-0a, col_values=(('external_ids', {'iface-id': 'a9660560-0a2e-42ab-a88a-3097da0747d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:59:3c', 'vm-uuid': '1452acf7-5040-4e13-94e3-bee1d64e8300'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:54:07.866627 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:07.867616 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:54:07.871814 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:07.872749 np0000001025 nova-compute[97981]: INFO os_vif [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:59:3c,bridge_name='br-int',has_traffic_filtering=True,id=a9660560-0a2e-42ab-a88a-3097da0747d7,network=Network(71f812ef-a2b2-4e6b-8f86-de17a7bf565a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9660560-0a')
May 19 04:54:08.898294 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:09.391972 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:54:09.391972 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:54:09.391972 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] No VIF found with MAC fa:16:3e:3f:59:3c, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:54:09.391972 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Using config drive
May 19 04:54:09.895913 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:54:10.028846 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Creating config drive at /opt/stack/data/nova/instances/1452acf7-5040-4e13-94e3-bee1d64e8300/disk.config
May 19 04:54:10.032598 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1452acf7-5040-4e13-94e3-bee1d64e8300/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoq9itn7k {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:54:10.090391 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1452acf7-5040-4e13-94e3-bee1d64e8300/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoq9itn7k" returned: 0 in 0.057s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:54:10.493988 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:10.519814 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:10.619946 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:10.670175 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9905fbef-93f1-4c0f-b90e-a1fc28d748fe req-b0313d65-182e-42e0-ad8a-ff16d3695b37 service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Received event network-vif-plugged-a9660560-0a2e-42ab-a88a-3097da0747d7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:54:10.672223 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9905fbef-93f1-4c0f-b90e-a1fc28d748fe req-b0313d65-182e-42e0-ad8a-ff16d3695b37 service nova] Acquiring lock "1452acf7-5040-4e13-94e3-bee1d64e8300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:54:10.673436 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9905fbef-93f1-4c0f-b90e-a1fc28d748fe req-b0313d65-182e-42e0-ad8a-ff16d3695b37 service nova] Lock "1452acf7-5040-4e13-94e3-bee1d64e8300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:54:10.673436 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9905fbef-93f1-4c0f-b90e-a1fc28d748fe req-b0313d65-182e-42e0-ad8a-ff16d3695b37 service nova] Lock "1452acf7-5040-4e13-94e3-bee1d64e8300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:54:10.673436 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9905fbef-93f1-4c0f-b90e-a1fc28d748fe req-b0313d65-182e-42e0-ad8a-ff16d3695b37 service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Processing event network-vif-plugged-a9660560-0a2e-42ab-a88a-3097da0747d7 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:54:10.827274 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:10.827274 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:10.835375 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:10.855253 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:11.224219 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166451.2238398, 1452acf7-5040-4e13-94e3-bee1d64e8300 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:54:11.224701 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] VM Started (Lifecycle Event)
May 19 04:54:11.227173 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:54:11.229556 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:54:11.232408 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Instance spawned successfully.
May 19 04:54:11.232855 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:54:11.728131 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:54:11.730226 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:54:11.740297 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:54:11.740515 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:54:11.740905 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:54:11.741264 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:54:11.741661 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:54:11.742045 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:54:12.232277 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:54:12.232822 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166452.2323349, 1452acf7-5040-4e13-94e3-bee1d64e8300 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:54:12.232822 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] VM Paused (Lifecycle Event)
May 19 04:54:12.250363 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Took 6.38 seconds to spawn the instance on the hypervisor.
May 19 04:54:12.250515 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:54:12.725413 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f3735053-eb86-4a76-b02c-a1236a8ffaf8 req-835698a4-8c5d-43b8-a86a-a53ca5eb9817 service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Received event network-vif-plugged-a9660560-0a2e-42ab-a88a-3097da0747d7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:54:12.726047 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f3735053-eb86-4a76-b02c-a1236a8ffaf8 req-835698a4-8c5d-43b8-a86a-a53ca5eb9817 service nova] Acquiring lock "1452acf7-5040-4e13-94e3-bee1d64e8300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:54:12.726217 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f3735053-eb86-4a76-b02c-a1236a8ffaf8 req-835698a4-8c5d-43b8-a86a-a53ca5eb9817 service nova] Lock "1452acf7-5040-4e13-94e3-bee1d64e8300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:54:12.726267 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f3735053-eb86-4a76-b02c-a1236a8ffaf8 req-835698a4-8c5d-43b8-a86a-a53ca5eb9817 service nova] Lock "1452acf7-5040-4e13-94e3-bee1d64e8300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:54:12.726367 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f3735053-eb86-4a76-b02c-a1236a8ffaf8 req-835698a4-8c5d-43b8-a86a-a53ca5eb9817 service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] No waiting events found dispatching network-vif-plugged-a9660560-0a2e-42ab-a88a-3097da0747d7 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:54:12.726476 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-f3735053-eb86-4a76-b02c-a1236a8ffaf8 req-835698a4-8c5d-43b8-a86a-a53ca5eb9817 service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Received unexpected event network-vif-plugged-a9660560-0a2e-42ab-a88a-3097da0747d7 for instance with vm_state active and task_state None.
May 19 04:54:12.735816 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:54:12.737470 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166452.7370157, 1452acf7-5040-4e13-94e3-bee1d64e8300 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:54:12.737733 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] VM Resumed (Lifecycle Event)
May 19 04:54:12.758707 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Took 11.64 seconds to build instance.
May 19 04:54:12.867621 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:13.240655 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:54:13.244275 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:54:13.259984 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "1452acf7-5040-4e13-94e3-bee1d64e8300" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.149s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:54:13.899100 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:14.781492 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-89839704-ec66-47b9-b6bc-923f2ab6d8b8 req-108daacd-d0b8-4539-b113-356b3a711b1d service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Received event network-changed-a9660560-0a2e-42ab-a88a-3097da0747d7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:54:14.781880 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-89839704-ec66-47b9-b6bc-923f2ab6d8b8 req-108daacd-d0b8-4539-b113-356b3a711b1d service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Refreshing instance network info cache due to event network-changed-a9660560-0a2e-42ab-a88a-3097da0747d7. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:54:14.781880 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-89839704-ec66-47b9-b6bc-923f2ab6d8b8 req-108daacd-d0b8-4539-b113-356b3a711b1d service nova] Acquiring lock "refresh_cache-1452acf7-5040-4e13-94e3-bee1d64e8300" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:54:14.781880 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-89839704-ec66-47b9-b6bc-923f2ab6d8b8 req-108daacd-d0b8-4539-b113-356b3a711b1d service nova] Acquired lock "refresh_cache-1452acf7-5040-4e13-94e3-bee1d64e8300" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:54:14.782052 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-89839704-ec66-47b9-b6bc-923f2ab6d8b8 req-108daacd-d0b8-4539-b113-356b3a711b1d service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Refreshing network info cache for port a9660560-0a2e-42ab-a88a-3097da0747d7 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:54:15.285081 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-89839704-ec66-47b9-b6bc-923f2ab6d8b8 req-108daacd-d0b8-4539-b113-356b3a711b1d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:54:15.566439 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-89839704-ec66-47b9-b6bc-923f2ab6d8b8 req-108daacd-d0b8-4539-b113-356b3a711b1d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:54:15.676062 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-89839704-ec66-47b9-b6bc-923f2ab6d8b8 req-108daacd-d0b8-4539-b113-356b3a711b1d service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Updated VIF entry in instance network info cache for port a9660560-0a2e-42ab-a88a-3097da0747d7. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:54:15.676321 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-89839704-ec66-47b9-b6bc-923f2ab6d8b8 req-108daacd-d0b8-4539-b113-356b3a711b1d service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Updating instance_info_cache with network_info: [{"id": "a9660560-0a2e-42ab-a88a-3097da0747d7", "address": "fa:16:3e:3f:59:3c", "network": {"id": "71f812ef-a2b2-4e6b-8f86-de17a7bf565a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-401556595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1e3d68b9e282446795456d9046c176d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9660560-0a", "ovs_interfaceid": "a9660560-0a2e-42ab-a88a-3097da0747d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:54:16.178059 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-89839704-ec66-47b9-b6bc-923f2ab6d8b8 req-108daacd-d0b8-4539-b113-356b3a711b1d service nova] Releasing lock "refresh_cache-1452acf7-5040-4e13-94e3-bee1d64e8300" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:54:17.869889 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:18.900341 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:19.838480 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Acquiring lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:54:19.838680 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:54:19.838852 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Acquiring lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:54:19.838975 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:54:19.839070 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:54:19.841038 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Terminating instance
May 19 04:54:20.351122 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:54:20.365894 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:20.382542 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:20.391832 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:20.417910 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:20.515761 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ca6bbe5b-f761-457d-9602-53f86fd4b86d req-98b76137-e0fb-437c-b275-c464f4782916 service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Received event network-vif-unplugged-7d18f593-23f0-4cc9-96f8-c63acba87f19 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:54:20.515761 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ca6bbe5b-f761-457d-9602-53f86fd4b86d req-98b76137-e0fb-437c-b275-c464f4782916 service nova] Acquiring lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:54:20.515761 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ca6bbe5b-f761-457d-9602-53f86fd4b86d req-98b76137-e0fb-437c-b275-c464f4782916 service nova] Lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:54:20.515761 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-ca6bbe5b-f761-457d-9602-53f86fd4b86d req-98b76137-e0fb-437c-b275-c464f4782916 service nova] Lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:54:20.515761 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ca6bbe5b-f761-457d-9602-53f86fd4b86d req-98b76137-e0fb-437c-b275-c464f4782916 service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] No waiting events found dispatching network-vif-unplugged-7d18f593-23f0-4cc9-96f8-c63acba87f19 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:54:20.515761 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-ca6bbe5b-f761-457d-9602-53f86fd4b86d req-98b76137-e0fb-437c-b275-c464f4782916 service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Received event network-vif-unplugged-7d18f593-23f0-4cc9-96f8-c63acba87f19 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:54:20.643673 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:20.651698 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:20.685148 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999673733000236 future=<Future at 0x7218342ca210 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:54:20.685691 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999095416999808 future=<Future at 0x7218342ca210 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:54:20.685958 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.998797663999994 future=<Future at 0x7218342ca210 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:54:20.690784 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Instance destroyed successfully.
May 19 04:54:20.692028 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lazy-loading 'resources' on Instance uuid c66dd5ba-b3b6-41ef-b492-06c23cb1af1b {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:54:21.194498 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:53:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-instance-315464317',display_name='tempest-instance-315464317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-instance-315464317',id=75,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzaoY+jcQoXnm7PLzhpuBNYyCi2AylkWLjCrx96OdkPjrUB5sV6jNRuI4rN8jTR3FMd3HeCQ/jNTcWyfl0bIHEHI8oDWTfPHDLbRonX76dbTXQqfFgZtpxeUlhOr2Bt1A==',key_name='tempest-keypair-171742523',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:53:42Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96cd97461f104ee7a873b6956d8a80cf',ramdisk_id='',reservation_id='r-hobem1xd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-2141478944',owner_user_name='tempest-VolumesBackupsTest-2141478944-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:53:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9473acc85b64afcb7c316ae5151a076',uuid=c66dd5ba-b3b6-41ef-b492-06c23cb1af1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d18f593-23f0-4cc9-96f8-c63acba87f19", "address": "fa:16:3e:ca:35:dd", "network": {"id": "36c4136b-9558-4066-a95b-f05b21c95c36", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1315331825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96cd97461f104ee7a873b6956d8a80cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d18f593-23", "ovs_interfaceid": "7d18f593-23f0-4cc9-96f8-c63acba87f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:54:21.194756 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Converting VIF {"id": "7d18f593-23f0-4cc9-96f8-c63acba87f19", "address": "fa:16:3e:ca:35:dd", "network": {"id": "36c4136b-9558-4066-a95b-f05b21c95c36", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1315331825-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96cd97461f104ee7a873b6956d8a80cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d18f593-23", "ovs_interfaceid": "7d18f593-23f0-4cc9-96f8-c63acba87f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:54:21.195330 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:35:dd,bridge_name='br-int',has_traffic_filtering=True,id=7d18f593-23f0-4cc9-96f8-c63acba87f19,network=Network(36c4136b-9558-4066-a95b-f05b21c95c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d18f593-23') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:54:21.195568 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:35:dd,bridge_name='br-int',has_traffic_filtering=True,id=7d18f593-23f0-4cc9-96f8-c63acba87f19,network=Network(36c4136b-9558-4066-a95b-f05b21c95c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d18f593-23') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:54:21.198180 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:21.198180 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d18f593-23, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:54:21.198905 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:21.199878 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:54:21.200440 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:21.200595 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2fc2b98e-3051-43ed-b2b0-5af7b4582c65) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:54:21.203379 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:21.204003 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:54:21.205403 np0000001025 nova-compute[97981]: INFO os_vif [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:35:dd,bridge_name='br-int',has_traffic_filtering=True,id=7d18f593-23f0-4cc9-96f8-c63acba87f19,network=Network(36c4136b-9558-4066-a95b-f05b21c95c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d18f593-23')
May 19 04:54:21.206752 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:54:21.207038 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab', 'iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83b29274-aa4d-454c-8c16-fcaeac0296ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:54:21.207174 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:54:21.207645 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:54:21.207963 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab', 'iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83b29274-aa4d-454c-8c16-fcaeac0296ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:54:21.208168 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:54:21.231932 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab (non-flash)
May 19 04:54:21.231932 np0000001025 nova-compute[97981]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab (non-flash)
May 19 04:54:21.231932 np0000001025 nova-compute[97981]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e20a205-0d52-494e-a9d0-f4f44a423e92 (non-flash)
May 19 04:54:21.231932 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:54:21.232559 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab (non-flash)
May 19 04:54:21.232559 np0000001025 nova-compute[97981]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab (non-flash)
May 19 04:54:21.232559 np0000001025 nova-compute[97981]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e20a205-0d52-494e-a9d0-f4f44a423e92 (non-flash)
May 19 04:54:21.232559 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:54:21.232559 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab', '188'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e20a205-0d52-494e-a9d0-f4f44a423e92', '192')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:54:21.232559 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab', '188')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:54:21.233290 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab', '189')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:54:21.233918 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218500f5580>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab'): ({'sdd'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:54:21.234159 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Removing multipathed devices sdc, sdd {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:54:21.234422 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Flush multipath device 330000000ee221b48 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:54:21.306494 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:54:21.371622 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:54:21.410308 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Checking to see if SCSI volumes sdc, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:54:21.410441 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] SCSI volumes sdc, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:54:21.411270 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Checking to see if device paths {'sdc', 'sdd'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:54:21.422390 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Device paths {'sdc', 'sdd'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:54:21.422616 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:54:21.432896 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:54:21.467419 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 188, target: iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab, portal: 192.168.40.100,3260]
May 19 04:54:21.467419 np0000001025 nova-compute[97981]: Logout of [sid: 188, target: iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab, portal: 192.168.40.100,3260] successful.
May 19 04:54:21.467419 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:54:21.479737 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:54:21.489830 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:54:21.520123 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 189, target: iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab, portal: 192.168.50.100,3260]
May 19 04:54:21.520123 np0000001025 nova-compute[97981]: Logout of [sid: 189, target: iqn.2023-03.storpool.com:os--volume-83b29274-aa4d-454c-8c16-fcaeac0296ab, portal: 192.168.50.100,3260] successful.
May 19 04:54:21.520123 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:54:21.530974 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:54:21.531193 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:54:21.531329 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] <== disconnect_volume: return (323ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:54:21.531436 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:54:21.531690 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Deleting instance files /opt/stack/data/nova/instances/c66dd5ba-b3b6-41ef-b492-06c23cb1af1b_del
May 19 04:54:21.532271 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Deletion of /opt/stack/data/nova/instances/c66dd5ba-b3b6-41ef-b492-06c23cb1af1b_del complete
May 19 04:54:22.037358 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Took 1.69 seconds to destroy the instance on the hypervisor.
May 19 04:54:22.037918 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:54:22.038238 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:54:22.038370 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:54:22.038613 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:54:22.151818 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:54:22.604423 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8c57af8a-8cd0-444d-83a2-4cb3b5c439ee req-66183459-c108-4643-b765-bfa3eccc0e35 service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Received event network-vif-unplugged-7d18f593-23f0-4cc9-96f8-c63acba87f19 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:54:22.604726 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8c57af8a-8cd0-444d-83a2-4cb3b5c439ee req-66183459-c108-4643-b765-bfa3eccc0e35 service nova] Acquiring lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:54:22.604782 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8c57af8a-8cd0-444d-83a2-4cb3b5c439ee req-66183459-c108-4643-b765-bfa3eccc0e35 service nova] Lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:54:22.604938 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-8c57af8a-8cd0-444d-83a2-4cb3b5c439ee req-66183459-c108-4643-b765-bfa3eccc0e35 service nova] Lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:54:22.606577 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8c57af8a-8cd0-444d-83a2-4cb3b5c439ee req-66183459-c108-4643-b765-bfa3eccc0e35 service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] No waiting events found dispatching network-vif-unplugged-7d18f593-23f0-4cc9-96f8-c63acba87f19 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:54:22.606725 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-8c57af8a-8cd0-444d-83a2-4cb3b5c439ee req-66183459-c108-4643-b765-bfa3eccc0e35 service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Received event network-vif-unplugged-7d18f593-23f0-4cc9-96f8-c63acba87f19 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:54:22.621077 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3237c90b-5c28-4d96-bbb7-4e7bbf8685a9 req-9c16059d-70a9-4d6c-a337-b10563b0ebc3 service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Received event network-vif-deleted-7d18f593-23f0-4cc9-96f8-c63acba87f19 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:54:22.621218 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-3237c90b-5c28-4d96-bbb7-4e7bbf8685a9 req-9c16059d-70a9-4d6c-a337-b10563b0ebc3 service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Neutron deleted interface 7d18f593-23f0-4cc9-96f8-c63acba87f19; detaching it from the instance and deleting it from the info cache
May 19 04:54:22.621324 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3237c90b-5c28-4d96-bbb7-4e7bbf8685a9 req-9c16059d-70a9-4d6c-a337-b10563b0ebc3 service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:54:23.069755 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:54:23.124717 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3237c90b-5c28-4d96-bbb7-4e7bbf8685a9 req-9c16059d-70a9-4d6c-a337-b10563b0ebc3 service nova] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Detach interface failed, port_id=7d18f593-23f0-4cc9-96f8-c63acba87f19, reason: Instance c66dd5ba-b3b6-41ef-b492-06c23cb1af1b could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:54:23.571809 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Took 1.53 seconds to deallocate network for instance.
May 19 04:54:23.901168 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:24.123005 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Took 0.55 seconds to detach 1 volumes for instance.
May 19 04:54:24.628144 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:54:24.628300 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:54:24.777392 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:54:24.777568 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:54:25.279899 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:54:25.786791 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.158s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:54:25.829847 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Deleted allocations for instance c66dd5ba-b3b6-41ef-b492-06c23cb1af1b
May 19 04:54:26.204919 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:26.838308 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-3f1e80b6-eb27-483f-8617-4f8f42815ab8 tempest-VolumesBackupsTest-2141478944 tempest-VolumesBackupsTest-2141478944-project-member] Lock "c66dd5ba-b3b6-41ef-b492-06c23cb1af1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.999s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:54:28.903338 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:31.208141 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:33.907960 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:35.685426 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0005050800000390154 future=<Future at 0x7218342ca210 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:54:35.685909 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:54:35.688318 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Emitting event <LifecycleEvent: 1779166460.6846735, c66dd5ba-b3b6-41ef-b492-06c23cb1af1b => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:54:35.688318 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] VM Stopped (Lifecycle Event)
May 19 04:54:36.193038 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: c66dd5ba-b3b6-41ef-b492-06c23cb1af1b] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:54:36.210594 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:38.909304 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:41.225059 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:43.910810 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:45.628550 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:54:45.628956 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:54:45.628996 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:54:45.629215 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:54:45.629395 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:54:45.629644 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.98 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:54:46.235055 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:46.614956 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:54:46.615309 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:54:50.961282 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Acquiring lock "1452acf7-5040-4e13-94e3-bee1d64e8300" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:54:50.962168 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "1452acf7-5040-4e13-94e3-bee1d64e8300" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:54:51.236590 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:51.464482 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lazy-loading 'flavor' on Instance uuid 1452acf7-5040-4e13-94e3-bee1d64e8300 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:54:52.468871 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "1452acf7-5040-4e13-94e3-bee1d64e8300" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:54:53.529567 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Acquiring lock "1452acf7-5040-4e13-94e3-bee1d64e8300" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:54:53.530005 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "1452acf7-5040-4e13-94e3-bee1d64e8300" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:54:53.530005 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Attaching volume d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9 to /dev/vdb
May 19 04:54:53.563299 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:54:53.574950 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:54:53.598127 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:54:53.615876 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:54:53.616131 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:54:53.616518 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:54:53.639263 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:54:53.639512 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:54:53.647956 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:54:53.648786 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fe3f:593c', 'fe80::800c:19ff:fe3c:3842'] 
May 19 04:54:53.648883 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:54:53.648992 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:54:53.649234 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:54:53.649451 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Updating existing volume attachment record: 7ab04f5a-b83e-42c8-ab52-baf2fcaa8af0 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:54:53.919552 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:54.205184 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:54:54.205492 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9', 'iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd40a6fb6-e6d2-4efc-b21f-90fb4777d2c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:54:54.205636 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:54:54.206151 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:54:54.206325 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9', 'iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd40a6fb6-e6d2-4efc-b21f-90fb4777d2c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:54:54.217908 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:54:54.218464 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:54:54.218915 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:54:54.219244 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:54:54.219618 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:54:54.219817 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:54:54.231845 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:54:54.231845 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:54:54.236859 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:54:54.236859 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:54:54.245872 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9] added
May 19 04:54:54.245872 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:54:54.245872 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:54:54.245872 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:54:54.245872 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:54:54.245872 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:54:54.245872 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:54:54.247811 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:54:54.247811 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0281(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:54:54.248453 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9] added
May 19 04:54:54.248453 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:54:54.248453 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:54:54.248453 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:54:54.248453 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:54:54.248453 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:54:54.248453 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:54:54.249168 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:54:54.249168 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:54:54.249168 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0292(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:54:54.249462 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:54:54.614989 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:54:55.119816 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:54:55.120005 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:54:55.120124 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:54:55.120272 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:54:55.249338 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:54:55.249930 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:54:55.263179 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:54:55.263179 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:54:55.265153 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:54:55.265153 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:54:55.276261 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:54:55.281302 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:54:55.289970 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47e68b22-b7bd-4fee-9dd0-aa4f96eb0720 (non-flash)
May 19 04:54:55.289970 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:54:55.290249 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47e68b22-b7bd-4fee-9dd0-aa4f96eb0720 (non-flash)
May 19 04:54:55.290249 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:54:55.297130 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47e68b22-b7bd-4fee-9dd0-aa4f96eb0720 (non-flash)
May 19 04:54:55.297130 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:54:55.297310 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47e68b22-b7bd-4fee-9dd0-aa4f96eb0720 (non-flash)
May 19 04:54:55.297310 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:54:55.356409 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9, portal: 192.168.40.100,3260]
May 19 04:54:55.356409 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9, portal: 192.168.40.100,3260] successful.
May 19 04:54:55.356409 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:54:55.368170 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:54:55.386978 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47e68b22-b7bd-4fee-9dd0-aa4f96eb0720 (non-flash)
May 19 04:54:55.386978 np0000001025 nova-compute[97981]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9 (non-flash)
May 19 04:54:55.386978 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:54:55.387207 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47e68b22-b7bd-4fee-9dd0-aa4f96eb0720 (non-flash)
May 19 04:54:55.387207 np0000001025 nova-compute[97981]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9 (non-flash)
May 19 04:54:55.387207 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:54:55.387377 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:54:55.387596 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:54:55.388307 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] HCTL ('7', '-', '-', 0) found on session 197 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:54:55.388453 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:54:55.403009 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Searching for a device in session 197 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:54:55.403361 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd40a6fb6-e6d2-4efc-b21f-90fb4777d2c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:54:56.137590 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1452acf7-5040-4e13-94e3-bee1d64e8300/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:54:56.229271 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1452acf7-5040-4e13-94e3-bee1d64e8300/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:54:56.229805 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1452acf7-5040-4e13-94e3-bee1d64e8300/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:54:56.242678 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:56.321229 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1452acf7-5040-4e13-94e3-bee1d64e8300/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:54:56.325909 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:54:56.327231 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:54:56.348425 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9, portal: 192.168.50.100,3260]
May 19 04:54:56.348425 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9, portal: 192.168.50.100,3260] successful.
May 19 04:54:56.348425 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:54:56.372916 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:54:56.377683 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:54:56.378184 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=13514MB free_disk=72.72095489501953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:54:56.378184 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:54:56.378413 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:54:56.393422 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47e68b22-b7bd-4fee-9dd0-aa4f96eb0720 (non-flash)
May 19 04:54:56.393422 np0000001025 nova-compute[97981]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9 (non-flash)
May 19 04:54:56.393422 np0000001025 nova-compute[97981]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9 (non-flash)
May 19 04:54:56.393422 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:54:56.393641 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47e68b22-b7bd-4fee-9dd0-aa4f96eb0720 (non-flash)
May 19 04:54:56.393641 np0000001025 nova-compute[97981]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9 (non-flash)
May 19 04:54:56.393641 np0000001025 nova-compute[97981]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9 (non-flash)
May 19 04:54:56.393641 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:54:56.394303 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.174s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:54:56.394303 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:54:56.395242 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] HCTL ('9', '-', '-', 0) found on session 198 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:54:56.395242 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:54:56.414955 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Searching for a device in session 198 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:54:56.415737 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd40a6fb6-e6d2-4efc-b21f-90fb4777d2c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:54:56.958441 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:54:57.258621 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:54:57.435064 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 1452acf7-5040-4e13-94e3-bee1d64e8300 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:54:57.435309 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:54:57.435478 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:54:56 up 45 min,  2 users,  load average: 2.45, 3.40, 3.67\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_1e3d68b9e282446795456d9046c176d2': '1', 'io_workload': '0'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:54:57.554293 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:54:57.554572 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:54:58.057171 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:54:58.274820 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Found WWN SStorPool_iSCSI_DISK_1034578903445799219 for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:54:58.275301 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.069s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:54:58.275301 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] <== connect_volume: return (4069ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799219', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445799219'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:54:58.275478 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Attached iSCSI volume {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799219', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445799219'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:54:58.278348 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lazy-loading 'flavor' on Instance uuid 1452acf7-5040-4e13-94e3-bee1d64e8300 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:54:58.565237 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:54:58.565446 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.187s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:54:58.565792 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.99 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:54:58.781219 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Attempting to attach volume d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:54:58.782743 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:54:58.782743 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:54:58.782743 np0000001025 nova-compute[97981]:   <alias name="ua-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9"/>
May 19 04:54:58.782743 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:54:58.782743 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:54:58.782743 np0000001025 nova-compute[97981]:   <serial>d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9</serial>
May 19 04:54:58.782743 np0000001025 nova-compute[97981]: </disk>
May 19 04:54:58.782743 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:55:00.044411 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:00.430712 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:55:00.430832 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:55:00.430920 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:55:00.431022 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] No VIF found with MAC fa:16:3e:3f:59:3c, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:55:01.244451 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:01.764146 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:01.976943 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e8c6d44b-5882-4868-8a62-d9609919ad57 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "1452acf7-5040-4e13-94e3-bee1d64e8300" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.447s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:55:03.145976 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Acquiring lock "1452acf7-5040-4e13-94e3-bee1d64e8300" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:55:03.146517 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "1452acf7-5040-4e13-94e3-bee1d64e8300" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:55:03.648352 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Detaching volume d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9
May 19 04:55:03.680567 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Attempting to driver detach volume d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9 from mountpoint /dev/vdb
May 19 04:55:03.684481 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Found disk vdb by alias ua-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:55:03.685437 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Found disk vdb by alias ua-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:55:03.685563 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Attempting to detach device vdb from instance 1452acf7-5040-4e13-94e3-bee1d64e8300 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:55:03.685759 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:55:03.685759 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:55:03.685759 np0000001025 nova-compute[97981]:   <alias name="ua-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9"/>
May 19 04:55:03.685759 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:55:03.685759 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:55:03.685759 np0000001025 nova-compute[97981]:   <serial>d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9</serial>
May 19 04:55:03.685759 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:55:03.685759 np0000001025 nova-compute[97981]: </disk>
May 19 04:55:03.685759 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:55:03.691806 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Successfully detached device vdb from instance 1452acf7-5040-4e13-94e3-bee1d64e8300 from the persistent domain config.
May 19 04:55:03.691971 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] (1/8): Attempting to detach device vdb with device alias ua-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9 from instance 1452acf7-5040-4e13-94e3-bee1d64e8300 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:55:03.692275 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:55:03.692275 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:55:03.692275 np0000001025 nova-compute[97981]:   <alias name="ua-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9"/>
May 19 04:55:03.692275 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:55:03.692275 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:55:03.692275 np0000001025 nova-compute[97981]:   <serial>d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9</serial>
May 19 04:55:03.692275 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:55:03.692275 np0000001025 nova-compute[97981]: </disk>
May 19 04:55:03.692275 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:55:03.921948 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:04.048135 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:04.169157 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779166504.1688085, 1452acf7-5040-4e13-94e3-bee1d64e8300 => ua-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:55:04.169638 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9 for instance 1452acf7-5040-4e13-94e3-bee1d64e8300 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:55:04.171836 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Successfully detached device vdb from instance 1452acf7-5040-4e13-94e3-bee1d64e8300 from the live domain config.
May 19 04:55:04.172803 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:55:04.173198 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9', 'iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd40a6fb6-e6d2-4efc-b21f-90fb4777d2c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:55:04.173353 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:55:04.173788 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:55:04.174163 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9', 'iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd40a6fb6-e6d2-4efc-b21f-90fb4777d2c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:55:04.174349 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:55:04.195646 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9 (non-flash)
May 19 04:55:04.195646 np0000001025 nova-compute[97981]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9 (non-flash)
May 19 04:55:04.195646 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:55:04.195891 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9 (non-flash)
May 19 04:55:04.195891 np0000001025 nova-compute[97981]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9 (non-flash)
May 19 04:55:04.195891 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:55:04.195891 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9', '198')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:55:04.196098 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9', '197')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:55:04.197205 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9', '198')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:55:04.198030 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721834355d00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9'): ({'sdd'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:55:04.198305 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Removing multipathed devices sdd, sdb {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:55:04.198587 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Flush multipath device 3300000001acc595d {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:55:04.233612 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:55:04.309361 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:55:04.362505 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Checking to see if SCSI volumes sdd, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:55:04.362713 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] SCSI volumes sdd, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:55:04.363472 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Checking to see if device paths {'sdd', 'sdb'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:55:04.376126 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Device paths {'sdd', 'sdb'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:55:04.376362 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:55:04.386476 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:55:04.415077 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 197, target: iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9, portal: 192.168.40.100,3260]
May 19 04:55:04.415077 np0000001025 nova-compute[97981]: Logout of [sid: 197, target: iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9, portal: 192.168.40.100,3260] successful.
May 19 04:55:04.415077 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:55:04.426128 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:55:04.437277 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:55:04.465674 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 198, target: iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9, portal: 192.168.50.100,3260]
May 19 04:55:04.465674 np0000001025 nova-compute[97981]: Logout of [sid: 198, target: iqn.2023-03.storpool.com:os--volume-d40a6fb6-e6d2-4efc-b21f-90fb4777d2c9, portal: 192.168.50.100,3260] successful.
May 19 04:55:04.465674 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:55:04.476764 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:55:04.477001 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:55:04.477057 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] <== disconnect_volume: return (303ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:55:04.477344 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:55:05.019066 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lazy-loading 'flavor' on Instance uuid 1452acf7-5040-4e13-94e3-bee1d64e8300 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:55:05.381173 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:06.024425 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-96f199fd-b50e-413a-9234-580701f9c2b1 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "1452acf7-5040-4e13-94e3-bee1d64e8300" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.878s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:55:06.246103 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:07.483944 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Acquiring lock "1452acf7-5040-4e13-94e3-bee1d64e8300" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:55:07.484418 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "1452acf7-5040-4e13-94e3-bee1d64e8300" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:55:07.484418 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Acquiring lock "1452acf7-5040-4e13-94e3-bee1d64e8300-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:55:07.484418 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "1452acf7-5040-4e13-94e3-bee1d64e8300-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:55:07.484558 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "1452acf7-5040-4e13-94e3-bee1d64e8300-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:55:07.486848 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Terminating instance
May 19 04:55:07.972250 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:07.989815 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:55:08.008898 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:08.010685 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:08.023929 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:08.034170 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:08.050664 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:08.058386 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:08.263894 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0c5a395b-192f-454e-9ead-957a3d276df6 req-d48afeb1-84b6-4c44-9a21-bf1bfe276f5b service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Received event network-vif-unplugged-a9660560-0a2e-42ab-a88a-3097da0747d7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:55:08.264720 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0c5a395b-192f-454e-9ead-957a3d276df6 req-d48afeb1-84b6-4c44-9a21-bf1bfe276f5b service nova] Acquiring lock "1452acf7-5040-4e13-94e3-bee1d64e8300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:55:08.264720 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0c5a395b-192f-454e-9ead-957a3d276df6 req-d48afeb1-84b6-4c44-9a21-bf1bfe276f5b service nova] Lock "1452acf7-5040-4e13-94e3-bee1d64e8300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:55:08.264720 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-0c5a395b-192f-454e-9ead-957a3d276df6 req-d48afeb1-84b6-4c44-9a21-bf1bfe276f5b service nova] Lock "1452acf7-5040-4e13-94e3-bee1d64e8300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:55:08.264720 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0c5a395b-192f-454e-9ead-957a3d276df6 req-d48afeb1-84b6-4c44-9a21-bf1bfe276f5b service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] No waiting events found dispatching network-vif-unplugged-a9660560-0a2e-42ab-a88a-3097da0747d7 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:55:08.264860 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-0c5a395b-192f-454e-9ead-957a3d276df6 req-d48afeb1-84b6-4c44-9a21-bf1bfe276f5b service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Received event network-vif-unplugged-a9660560-0a2e-42ab-a88a-3097da0747d7 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:55:08.287572 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:08.295487 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:08.317810 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999734776999958 future=<Future at 0x7218500fa090 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:55:08.318159 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999478360000012 future=<Future at 0x7218500fa090 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:55:08.318159 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999369957999988 future=<Future at 0x7218500fa090 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:55:08.319592 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Instance destroyed successfully.
May 19 04:55:08.320164 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lazy-loading 'resources' on Instance uuid 1452acf7-5040-4e13-94e3-bee1d64e8300 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:55:08.822842 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1001460892',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1001460892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testservervolumeattachscenariooldversion-server-1001460',id=76,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZLLtx81/4Gma6w5p6UkXlRWUT1czKTgkslbILD7zciVL1M7jJ6MVmxMXYConi4w/qNGttE0XtAK6//vKUx/OA7SZfVUllhITB9FRfNL3XyJGlzgvj8rKTzij6wJhOCJQ==',key_name='tempest-keypair-1570470930',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:54:12Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e3d68b9e282446795456d9046c176d2',ramdisk_id='',reservation_id='r-m0ucxeyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1756195513',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:54:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff2b4bbecced4a1aa48b16cd62b01862',uuid=1452acf7-5040-4e13-94e3-bee1d64e8300,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9660560-0a2e-42ab-a88a-3097da0747d7", "address": "fa:16:3e:3f:59:3c", "network": {"id": "71f812ef-a2b2-4e6b-8f86-de17a7bf565a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-401556595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1e3d68b9e282446795456d9046c176d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9660560-0a", "ovs_interfaceid": "a9660560-0a2e-42ab-a88a-3097da0747d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:55:08.823393 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Converting VIF {"id": "a9660560-0a2e-42ab-a88a-3097da0747d7", "address": "fa:16:3e:3f:59:3c", "network": {"id": "71f812ef-a2b2-4e6b-8f86-de17a7bf565a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-401556595-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1e3d68b9e282446795456d9046c176d2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9660560-0a", "ovs_interfaceid": "a9660560-0a2e-42ab-a88a-3097da0747d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:55:08.823681 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:59:3c,bridge_name='br-int',has_traffic_filtering=True,id=a9660560-0a2e-42ab-a88a-3097da0747d7,network=Network(71f812ef-a2b2-4e6b-8f86-de17a7bf565a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9660560-0a') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:55:08.823922 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:59:3c,bridge_name='br-int',has_traffic_filtering=True,id=a9660560-0a2e-42ab-a88a-3097da0747d7,network=Network(71f812ef-a2b2-4e6b-8f86-de17a7bf565a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9660560-0a') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:55:08.825614 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:08.825822 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9660560-0a, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:55:08.826755 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:08.827582 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:55:08.827796 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:08.828373 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:08.828496 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=26f7191e-41a1-4919-9e3a-9c11701d5e63) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:55:08.828864 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:08.829291 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:55:08.829601 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:08.831284 np0000001025 nova-compute[97981]: INFO os_vif [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:59:3c,bridge_name='br-int',has_traffic_filtering=True,id=a9660560-0a2e-42ab-a88a-3097da0747d7,network=Network(71f812ef-a2b2-4e6b-8f86-de17a7bf565a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9660560-0a')
May 19 04:55:08.831578 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Deleting instance files /opt/stack/data/nova/instances/1452acf7-5040-4e13-94e3-bee1d64e8300_del
May 19 04:55:08.832336 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Deletion of /opt/stack/data/nova/instances/1452acf7-5040-4e13-94e3-bee1d64e8300_del complete
May 19 04:55:08.930223 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:09.337829 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Took 1.35 seconds to destroy the instance on the hypervisor.
May 19 04:55:09.338827 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:55:09.339058 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:55:09.339186 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:55:09.339420 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:55:09.423099 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:55:09.789765 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d4d20a19-41f1-464c-867f-47e2b54f6021 req-e5487401-3f0f-4478-8bad-6eae812c788a service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Received event network-vif-deleted-a9660560-0a2e-42ab-a88a-3097da0747d7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:55:09.789970 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-d4d20a19-41f1-464c-867f-47e2b54f6021 req-e5487401-3f0f-4478-8bad-6eae812c788a service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Neutron deleted interface a9660560-0a2e-42ab-a88a-3097da0747d7; detaching it from the instance and deleting it from the info cache
May 19 04:55:09.790283 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-d4d20a19-41f1-464c-867f-47e2b54f6021 req-e5487401-3f0f-4478-8bad-6eae812c788a service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:55:10.240540 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:55:10.293592 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d4d20a19-41f1-464c-867f-47e2b54f6021 req-e5487401-3f0f-4478-8bad-6eae812c788a service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Detach interface failed, port_id=a9660560-0a2e-42ab-a88a-3097da0747d7, reason: Instance 1452acf7-5040-4e13-94e3-bee1d64e8300 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:55:10.317328 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-140d1552-4f5c-400e-b5e3-4a4067d51e26 req-37426076-8385-4b73-9be7-bc38ad318d8e service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Received event network-vif-unplugged-a9660560-0a2e-42ab-a88a-3097da0747d7 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:55:10.317775 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-140d1552-4f5c-400e-b5e3-4a4067d51e26 req-37426076-8385-4b73-9be7-bc38ad318d8e service nova] Acquiring lock "1452acf7-5040-4e13-94e3-bee1d64e8300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:55:10.318008 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-140d1552-4f5c-400e-b5e3-4a4067d51e26 req-37426076-8385-4b73-9be7-bc38ad318d8e service nova] Lock "1452acf7-5040-4e13-94e3-bee1d64e8300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:55:10.318117 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-140d1552-4f5c-400e-b5e3-4a4067d51e26 req-37426076-8385-4b73-9be7-bc38ad318d8e service nova] Lock "1452acf7-5040-4e13-94e3-bee1d64e8300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:55:10.318289 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-140d1552-4f5c-400e-b5e3-4a4067d51e26 req-37426076-8385-4b73-9be7-bc38ad318d8e service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] No waiting events found dispatching network-vif-unplugged-a9660560-0a2e-42ab-a88a-3097da0747d7 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:55:10.318410 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-140d1552-4f5c-400e-b5e3-4a4067d51e26 req-37426076-8385-4b73-9be7-bc38ad318d8e service nova] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Received event network-vif-unplugged-a9660560-0a2e-42ab-a88a-3097da0747d7 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:55:10.742292 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Took 1.40 seconds to deallocate network for instance.
May 19 04:55:11.247047 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:55:11.247469 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:55:11.333939 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:55:11.334143 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:55:11.836359 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:55:12.343568 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.096s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:55:12.388997 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Deleted allocations for instance 1452acf7-5040-4e13-94e3-bee1d64e8300
May 19 04:55:13.396724 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-98c9e15a-c1d9-403b-ab5f-75050e54d442 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Lock "1452acf7-5040-4e13-94e3-bee1d64e8300" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.912s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:55:13.832202 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:13.931091 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:14.511647 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:15.917268 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:18.376147 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:55:18.376147 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:55:18.833666 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:18.879666 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:55:18.934488 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:19.424425 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:55:19.424764 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:55:19.428634 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:55:19.428789 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Claim successful on node np0000001025
May 19 04:55:19.484980 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:20.534172 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:55:20.534172 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:55:21.036552 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:55:21.542641 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.118s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:55:21.542929 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:55:21.666993 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:22.048385 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:55:22.048558 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:55:22.048810 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:55:22.049006 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:55:22.110244 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6720ecdbe3414d4eac1542d35d21d5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ff6589269d4d73acf3d5d205b75622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:55:22.551366 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:55:22.568544 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Successfully created port: 4c752ea3-d17a-43fd-884c-b431a879d355 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:55:23.054041 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:55:23.097539 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Successfully updated port: 4c752ea3-d17a-43fd-884c-b431a879d355 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:55:23.185452 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-447b6046-e677-4621-bceb-749102a9d0ff req-037810a8-c728-480a-8a80-8c691c94afcf service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Received event network-changed-4c752ea3-d17a-43fd-884c-b431a879d355 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:55:23.185891 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-447b6046-e677-4621-bceb-749102a9d0ff req-037810a8-c728-480a-8a80-8c691c94afcf service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Refreshing instance network info cache due to event network-changed-4c752ea3-d17a-43fd-884c-b431a879d355. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:55:23.187407 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-447b6046-e677-4621-bceb-749102a9d0ff req-037810a8-c728-480a-8a80-8c691c94afcf service nova] Acquiring lock "refresh_cache-1dc1a2a6-1666-417c-999b-fddeb8fb7589" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:55:23.187407 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-447b6046-e677-4621-bceb-749102a9d0ff req-037810a8-c728-480a-8a80-8c691c94afcf service nova] Acquired lock "refresh_cache-1dc1a2a6-1666-417c-999b-fddeb8fb7589" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:55:23.187407 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-447b6046-e677-4621-bceb-749102a9d0ff req-037810a8-c728-480a-8a80-8c691c94afcf service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Refreshing network info cache for port 4c752ea3-d17a-43fd-884c-b431a879d355 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:55:23.317920 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0003560129998732009 future=<Future at 0x7218500fa090 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:55:23.318290 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] Emitting event <LifecycleEvent: 1779166508.3174455, 1452acf7-5040-4e13-94e3-bee1d64e8300 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:55:23.318424 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:55:23.318542 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] VM Stopped (Lifecycle Event)
May 19 04:55:23.599449 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "refresh_cache-1dc1a2a6-1666-417c-999b-fddeb8fb7589" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:55:23.690424 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-447b6046-e677-4621-bceb-749102a9d0ff req-037810a8-c728-480a-8a80-8c691c94afcf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:55:23.757162 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-447b6046-e677-4621-bceb-749102a9d0ff req-037810a8-c728-480a-8a80-8c691c94afcf service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:55:23.820796 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-3e7cd1cf-6f96-451a-975d-1dfed883db93 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513 tempest-TestServerVolumeAttachScenarioOldVersion-1756195513-project-member] [instance: 1452acf7-5040-4e13-94e3-bee1d64e8300] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:55:23.834385 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:23.915303 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-447b6046-e677-4621-bceb-749102a9d0ff req-037810a8-c728-480a-8a80-8c691c94afcf service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:55:23.933258 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:24.061356 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:55:24.062457 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:55:24.062715 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Creating image(s)
May 19 04:55:24.063190 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "/opt/stack/data/nova/instances/1dc1a2a6-1666-417c-999b-fddeb8fb7589/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:55:24.063359 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "/opt/stack/data/nova/instances/1dc1a2a6-1666-417c-999b-fddeb8fb7589/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:55:24.063949 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "/opt/stack/data/nova/instances/1dc1a2a6-1666-417c-999b-fddeb8fb7589/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:55:24.064863 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:55:24.067953 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:55:24.069360 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:55:24.156816 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.087s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:55:24.157124 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:55:24.157580 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:55:24.157995 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:55:24.160501 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:55:24.160786 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:55:24.242849 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.082s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:55:24.243388 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/1dc1a2a6-1666-417c-999b-fddeb8fb7589/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:55:24.302565 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/1dc1a2a6-1666-417c-999b-fddeb8fb7589/disk 1073741824" returned: 0 in 0.059s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:55:24.303086 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.145s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:55:24.303544 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:55:24.392992 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.089s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:55:24.393405 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1dc1a2a6-1666-417c-999b-fddeb8fb7589/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:55:24.393676 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc1a2a6-1666-417c-999b-fddeb8fb7589/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:55:24.421216 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-447b6046-e677-4621-bceb-749102a9d0ff req-037810a8-c728-480a-8a80-8c691c94afcf service nova] Releasing lock "refresh_cache-1dc1a2a6-1666-417c-999b-fddeb8fb7589" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:55:24.422522 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquired lock "refresh_cache-1dc1a2a6-1666-417c-999b-fddeb8fb7589" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:55:24.423096 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:55:24.468961 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:24.488584 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc1a2a6-1666-417c-999b-fddeb8fb7589/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:55:24.488805 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Cannot resize image /opt/stack/data/nova/instances/1dc1a2a6-1666-417c-999b-fddeb8fb7589/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:55:24.489168 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:55:24.489413 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Ensure instance console log exists: /opt/stack/data/nova/instances/1dc1a2a6-1666-417c-999b-fddeb8fb7589/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:55:24.489704 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:55:24.489753 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:55:24.489904 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:55:25.020616 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:55:25.197854 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:55:25.339931 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Updating instance_info_cache with network_info: [{"id": "4c752ea3-d17a-43fd-884c-b431a879d355", "address": "fa:16:3e:c2:07:16", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c752ea3-d1", "ovs_interfaceid": "4c752ea3-d17a-43fd-884c-b431a879d355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:55:25.773444 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:25.841644 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Releasing lock "refresh_cache-1dc1a2a6-1666-417c-999b-fddeb8fb7589" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:55:25.841967 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Instance network_info: |[{"id": "4c752ea3-d17a-43fd-884c-b431a879d355", "address": "fa:16:3e:c2:07:16", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c752ea3-d1", "ovs_interfaceid": "4c752ea3-d17a-43fd-884c-b431a879d355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:55:25.843792 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Start _get_guest_xml network_info=[{"id": "4c752ea3-d17a-43fd-884c-b431a879d355", "address": "fa:16:3e:c2:07:16", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c752ea3-d1", "ovs_interfaceid": "4c752ea3-d17a-43fd-884c-b431a879d355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:55:25.847675 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:55:25.848906 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-375549394', uuid='1dc1a2a6-1666-417c-999b-fddeb8fb7589'), owner=OwnerMeta(userid='6720ecdbe3414d4eac1542d35d21d5ea', username='tempest-TestEncryptedCinderVolumes-282543688-project-member', projectid='36ff6589269d4d73acf3d5d205b75622', projectname='tempest-TestEncryptedCinderVolumes-282543688'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4c752ea3-d17a-43fd-884c-b431a879d355", "address": "fa:16:3e:c2:07:16", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c752ea3-d1", "ovs_interfaceid": "4c752ea3-d17a-43fd-884c-b431a879d355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166525.848544) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:55:25.849883 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:55:25.850205 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:55:25.851186 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:55:25.851361 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:55:25.852220 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:55:25.852520 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:55:25.852663 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:55:25.852763 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:55:25.852866 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:55:25.852943 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:55:25.853029 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:55:25.853198 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:55:25.853289 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:55:25.853389 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:55:25.853493 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:55:25.853602 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:55:25.863130 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:55:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-375549394',display_name='tempest-TestEncryptedCinderVolumes-server-375549394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testencryptedcindervolumes-server-375549394',id=77,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVofLCVEuPupiOK7uU1vdNDzzJC6TYJ3MrBpeKTHmYhjH68FayDsb6uxXCu0nDELneek0Hp1Xz2uKqAOsDETblgys7W5/fyog9bUeBZYE+0dqs1MXsJ+39D22o1BXFaxA==',key_name='tempest-keypair-892538175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36ff6589269d4d73acf3d5d205b75622',ramdisk_id='',reservation_id='r-khdw9h8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-282543688',owner_user_name='tempest-TestEncryptedCinderVolumes-282543688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:55:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6720ecdbe3414d4eac1542d35d21d5ea',uuid=1dc1a2a6-1666-417c-999b-fddeb8fb7589,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c752ea3-d17a-43fd-884c-b431a879d355", "address": "fa:16:3e:c2:07:16", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c752ea3-d1", "ovs_interfaceid": "4c752ea3-d17a-43fd-884c-b431a879d355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:55:25.863130 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Converting VIF {"id": "4c752ea3-d17a-43fd-884c-b431a879d355", "address": "fa:16:3e:c2:07:16", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c752ea3-d1", "ovs_interfaceid": "4c752ea3-d17a-43fd-884c-b431a879d355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:55:25.863576 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:07:16,bridge_name='br-int',has_traffic_filtering=True,id=4c752ea3-d17a-43fd-884c-b431a879d355,network=Network(9c642de3-79c6-4ed4-a828-c4eba2555eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c752ea3-d1') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:55:25.864082 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lazy-loading 'pci_devices' on Instance uuid 1dc1a2a6-1666-417c-999b-fddeb8fb7589 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:55:26.366930 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] End _get_guest_xml xml=<domain type="qemu">
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:   <uuid>1dc1a2a6-1666-417c-999b-fddeb8fb7589</uuid>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:   <name>instance-0000004d</name>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-375549394</nova:name>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:55:25</nova:creationTime>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:         <nova:user uuid="6720ecdbe3414d4eac1542d35d21d5ea">tempest-TestEncryptedCinderVolumes-282543688-project-member</nova:user>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:         <nova:project uuid="36ff6589269d4d73acf3d5d205b75622">tempest-TestEncryptedCinderVolumes-282543688</nova:project>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:         <nova:port uuid="4c752ea3-d17a-43fd-884c-b431a879d355">
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     <system>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <entry name="serial">1dc1a2a6-1666-417c-999b-fddeb8fb7589</entry>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <entry name="uuid">1dc1a2a6-1666-417c-999b-fddeb8fb7589</entry>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     </system>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:   <os>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:   </os>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:   <features>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:   </features>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:   <devices>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/1dc1a2a6-1666-417c-999b-fddeb8fb7589/disk"/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     </disk>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/1dc1a2a6-1666-417c-999b-fddeb8fb7589/disk.config"/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     </disk>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:c2:07:16"/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <target dev="tap4c752ea3-d1"/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     </interface>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/1dc1a2a6-1666-417c-999b-fddeb8fb7589/console.log" append="off"/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     </serial>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     <video>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     </video>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     </rng>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:   </devices>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]: </domain>
May 19 04:55:26.366930 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:55:26.370396 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Preparing to wait for external event network-vif-plugged-4c752ea3-d17a-43fd-884c-b431a879d355 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:55:26.370396 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:55:26.370396 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:55:26.370396 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:55:26.370396 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:55:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-375549394',display_name='tempest-TestEncryptedCinderVolumes-server-375549394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testencryptedcindervolumes-server-375549394',id=77,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVofLCVEuPupiOK7uU1vdNDzzJC6TYJ3MrBpeKTHmYhjH68FayDsb6uxXCu0nDELneek0Hp1Xz2uKqAOsDETblgys7W5/fyog9bUeBZYE+0dqs1MXsJ+39D22o1BXFaxA==',key_name='tempest-keypair-892538175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36ff6589269d4d73acf3d5d205b75622',ramdisk_id='',reservation_id='r-khdw9h8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-282543688',owner_user_name='tempest-TestEncryptedCinderVolumes-282543688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:55:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6720ecdbe3414d4eac1542d35d21d5ea',uuid=1dc1a2a6-1666-417c-999b-fddeb8fb7589,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c752ea3-d17a-43fd-884c-b431a879d355", "address": "fa:16:3e:c2:07:16", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c752ea3-d1", "ovs_interfaceid": "4c752ea3-d17a-43fd-884c-b431a879d355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:55:26.370396 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Converting VIF {"id": "4c752ea3-d17a-43fd-884c-b431a879d355", "address": "fa:16:3e:c2:07:16", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c752ea3-d1", "ovs_interfaceid": "4c752ea3-d17a-43fd-884c-b431a879d355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:55:26.370396 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:07:16,bridge_name='br-int',has_traffic_filtering=True,id=4c752ea3-d17a-43fd-884c-b431a879d355,network=Network(9c642de3-79c6-4ed4-a828-c4eba2555eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c752ea3-d1') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:55:26.370396 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:07:16,bridge_name='br-int',has_traffic_filtering=True,id=4c752ea3-d17a-43fd-884c-b431a879d355,network=Network(9c642de3-79c6-4ed4-a828-c4eba2555eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c752ea3-d1') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:55:26.370396 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:26.370396 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:55:26.371006 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:55:26.371190 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:26.371267 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7cb67eb4-c5db-5013-b663-99e3c0dedc02', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:55:26.372048 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:26.372999 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:55:26.373308 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:26.375011 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:26.375196 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c752ea3-d1, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:55:26.375580 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c752ea3-d1, col_values=(('qos', UUID('e42c42a6-d5e5-4fb6-b4cc-9e98e5ec9cfa')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:55:26.375782 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c752ea3-d1, col_values=(('external_ids', {'iface-id': '4c752ea3-d17a-43fd-884c-b431a879d355', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:07:16', 'vm-uuid': '1dc1a2a6-1666-417c-999b-fddeb8fb7589'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:55:26.376552 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:26.377924 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:55:26.381880 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:26.382952 np0000001025 nova-compute[97981]: INFO os_vif [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:07:16,bridge_name='br-int',has_traffic_filtering=True,id=4c752ea3-d17a-43fd-884c-b431a879d355,network=Network(9c642de3-79c6-4ed4-a828-c4eba2555eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c752ea3-d1')
May 19 04:55:27.897006 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:55:27.897516 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:55:27.897516 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] No VIF found with MAC fa:16:3e:c2:07:16, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:55:27.897750 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Using config drive
May 19 04:55:28.405596 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:55:28.508514 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Creating config drive at /opt/stack/data/nova/instances/1dc1a2a6-1666-417c-999b-fddeb8fb7589/disk.config
May 19 04:55:28.512268 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1dc1a2a6-1666-417c-999b-fddeb8fb7589/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp44ulgzix {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:55:28.564152 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1dc1a2a6-1666-417c-999b-fddeb8fb7589/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp44ulgzix" returned: 0 in 0.052s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:55:28.942452 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:28.968546 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:28.995186 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:29.082002 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:29.089031 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:29.155727 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b2cea2dc-3c3c-448a-b887-06a4bd5b35f3 req-896362d1-b5d5-4558-a3be-24f37e93a3ba service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Received event network-vif-plugged-4c752ea3-d17a-43fd-884c-b431a879d355 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:55:29.155985 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b2cea2dc-3c3c-448a-b887-06a4bd5b35f3 req-896362d1-b5d5-4558-a3be-24f37e93a3ba service nova] Acquiring lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:55:29.156197 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b2cea2dc-3c3c-448a-b887-06a4bd5b35f3 req-896362d1-b5d5-4558-a3be-24f37e93a3ba service nova] Lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:55:29.156353 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b2cea2dc-3c3c-448a-b887-06a4bd5b35f3 req-896362d1-b5d5-4558-a3be-24f37e93a3ba service nova] Lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:55:29.156494 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b2cea2dc-3c3c-448a-b887-06a4bd5b35f3 req-896362d1-b5d5-4558-a3be-24f37e93a3ba service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Processing event network-vif-plugged-4c752ea3-d17a-43fd-884c-b431a879d355 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:55:29.273593 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:29.274906 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:29.276416 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:29.296712 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:29.528666 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:55:29.528914 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:55:29.670824 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166529.6701922, 1dc1a2a6-1666-417c-999b-fddeb8fb7589 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:55:29.671687 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:55:29.672461 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] VM Started (Lifecycle Event)
May 19 04:55:29.673722 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:55:29.676739 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Instance spawned successfully.
May 19 04:55:29.677133 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:55:30.031252 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:55:30.175617 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:55:30.178431 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:55:30.183464 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:55:30.183568 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:55:30.183848 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:55:30.184363 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:55:30.184680 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:55:30.184971 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:55:30.577882 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:55:30.577882 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:55:30.580499 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:55:30.580727 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Claim successful on node np0000001025
May 19 04:55:30.680829 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:55:30.682274 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166530.681054, 1dc1a2a6-1666-417c-999b-fddeb8fb7589 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:55:30.682274 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] VM Paused (Lifecycle Event)
May 19 04:55:30.689384 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Took 6.63 seconds to spawn the instance on the hypervisor.
May 19 04:55:30.689637 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:55:31.187675 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:55:31.194318 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166531.193595, 1dc1a2a6-1666-417c-999b-fddeb8fb7589 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:55:31.194318 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] VM Resumed (Lifecycle Event)
May 19 04:55:31.198138 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Took 11.81 seconds to build instance.
May 19 04:55:31.214596 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-40002779-046a-4398-b965-221e93c9955f req-fb83e940-e5d1-4642-8cbb-584d49e11e6b service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Received event network-vif-plugged-4c752ea3-d17a-43fd-884c-b431a879d355 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:55:31.214979 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-40002779-046a-4398-b965-221e93c9955f req-fb83e940-e5d1-4642-8cbb-584d49e11e6b service nova] Acquiring lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:55:31.215366 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-40002779-046a-4398-b965-221e93c9955f req-fb83e940-e5d1-4642-8cbb-584d49e11e6b service nova] Lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:55:31.215501 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-40002779-046a-4398-b965-221e93c9955f req-fb83e940-e5d1-4642-8cbb-584d49e11e6b service nova] Lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:55:31.215611 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-40002779-046a-4398-b965-221e93c9955f req-fb83e940-e5d1-4642-8cbb-584d49e11e6b service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] No waiting events found dispatching network-vif-plugged-4c752ea3-d17a-43fd-884c-b431a879d355 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:55:31.215723 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-40002779-046a-4398-b965-221e93c9955f req-fb83e940-e5d1-4642-8cbb-584d49e11e6b service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Received unexpected event network-vif-plugged-4c752ea3-d17a-43fd-884c-b431a879d355 for instance with vm_state active and task_state None.
May 19 04:55:31.377663 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:31.700605 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-4083cf0d-1350-4518-b2d1-bf734e1bf0b3 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.324s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:55:31.703030 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:55:31.707013 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:55:31.719389 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:55:31.719739 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:55:32.222919 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:55:32.732922 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.155s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:55:32.736614 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:55:33.244324 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:55:33.246334 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:55:33.246731 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:55:33.247033 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:55:33.276222 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-eee2b97a-48e5-4e93-a3e8-09ebc73a0c42 req-c78ec8c4-31d3-42f3-8dd2-85d7bd03d279 service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Received event network-changed-4c752ea3-d17a-43fd-884c-b431a879d355 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:55:33.276312 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-eee2b97a-48e5-4e93-a3e8-09ebc73a0c42 req-c78ec8c4-31d3-42f3-8dd2-85d7bd03d279 service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Refreshing instance network info cache due to event network-changed-4c752ea3-d17a-43fd-884c-b431a879d355. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:55:33.276470 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-eee2b97a-48e5-4e93-a3e8-09ebc73a0c42 req-c78ec8c4-31d3-42f3-8dd2-85d7bd03d279 service nova] Acquiring lock "refresh_cache-1dc1a2a6-1666-417c-999b-fddeb8fb7589" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:55:33.276784 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-eee2b97a-48e5-4e93-a3e8-09ebc73a0c42 req-c78ec8c4-31d3-42f3-8dd2-85d7bd03d279 service nova] Acquired lock "refresh_cache-1dc1a2a6-1666-417c-999b-fddeb8fb7589" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:55:33.276891 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-eee2b97a-48e5-4e93-a3e8-09ebc73a0c42 req-c78ec8c4-31d3-42f3-8dd2-85d7bd03d279 service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Refreshing network info cache for port 4c752ea3-d17a-43fd-884c-b431a879d355 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:55:33.324443 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c02d167c3764ceaa0671926946d8920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4772a09cd1480f9d139120e1f42892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:55:33.749512 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:55:33.758174 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Successfully created port: b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:55:33.781837 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-eee2b97a-48e5-4e93-a3e8-09ebc73a0c42 req-c78ec8c4-31d3-42f3-8dd2-85d7bd03d279 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:55:33.942009 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:34.136193 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-eee2b97a-48e5-4e93-a3e8-09ebc73a0c42 req-c78ec8c4-31d3-42f3-8dd2-85d7bd03d279 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:55:34.248285 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Successfully updated port: b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:55:34.253259 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:55:34.279606 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-eee2b97a-48e5-4e93-a3e8-09ebc73a0c42 req-c78ec8c4-31d3-42f3-8dd2-85d7bd03d279 service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Updated VIF entry in instance network info cache for port 4c752ea3-d17a-43fd-884c-b431a879d355. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:55:34.279905 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-eee2b97a-48e5-4e93-a3e8-09ebc73a0c42 req-c78ec8c4-31d3-42f3-8dd2-85d7bd03d279 service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Updating instance_info_cache with network_info: [{"id": "4c752ea3-d17a-43fd-884c-b431a879d355", "address": "fa:16:3e:c2:07:16", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c752ea3-d1", "ovs_interfaceid": "4c752ea3-d17a-43fd-884c-b431a879d355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:55:34.308048 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a0a753c0-90be-4688-b574-c8a98cbe2080 req-7fe1dd15-f760-40e2-ba36-47c7092299f1 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Received event network-changed-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:55:34.310437 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-a0a753c0-90be-4688-b574-c8a98cbe2080 req-7fe1dd15-f760-40e2-ba36-47c7092299f1 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Refreshing instance network info cache due to event network-changed-b6e423ea-5da0-4bb9-8d49-e59d822f4e75. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:55:34.310834 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a0a753c0-90be-4688-b574-c8a98cbe2080 req-7fe1dd15-f760-40e2-ba36-47c7092299f1 service nova] Acquiring lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:55:34.310977 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a0a753c0-90be-4688-b574-c8a98cbe2080 req-7fe1dd15-f760-40e2-ba36-47c7092299f1 service nova] Acquired lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:55:34.312784 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a0a753c0-90be-4688-b574-c8a98cbe2080 req-7fe1dd15-f760-40e2-ba36-47c7092299f1 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Refreshing network info cache for port b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:55:34.750188 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:55:34.758319 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Booting with volume 38784990-34f2-4fa8-a574-265dcda0e395 at /dev/vda
May 19 04:55:34.781695 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-eee2b97a-48e5-4e93-a3e8-09ebc73a0c42 req-c78ec8c4-31d3-42f3-8dd2-85d7bd03d279 service nova] Releasing lock "refresh_cache-1dc1a2a6-1666-417c-999b-fddeb8fb7589" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:55:34.793273 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:55:34.802782 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:55:34.814956 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-a0a753c0-90be-4688-b574-c8a98cbe2080 req-7fe1dd15-f760-40e2-ba36-47c7092299f1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:55:34.822824 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:55:34.874421 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:55:34.874812 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:55:34.884159 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:55:34.888705 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fec2:716', 'fe80::1c6c:ff:fe04:9b0e'] 
May 19 04:55:34.888873 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:55:34.888975 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:55:34.889207 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:55:34.889420 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Updating existing volume attachment record: 80ca483c-5b17-4d72-b68a-1d5f10b6ab56 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:55:34.896521 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a0a753c0-90be-4688-b574-c8a98cbe2080 req-7fe1dd15-f760-40e2-ba36-47c7092299f1 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:55:35.041995 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-a0a753c0-90be-4688-b574-c8a98cbe2080 req-7fe1dd15-f760-40e2-ba36-47c7092299f1 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:55:35.544203 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-a0a753c0-90be-4688-b574-c8a98cbe2080 req-7fe1dd15-f760-40e2-ba36-47c7092299f1 service nova] Releasing lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:55:35.544706 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquired lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:55:35.544843 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:55:36.104499 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:55:36.256945 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:55:36.369494 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Updating instance_info_cache with network_info: [{"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": "br-int", "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:55:36.379129 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:36.871332 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Releasing lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:55:36.871741 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Instance network_info: |[{"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": "br-int", "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:55:37.003834 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:55:37.005027 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:55:37.005291 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Creating image(s)
May 19 04:55:37.005588 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:55:37.005740 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Ensure instance console log exists: /opt/stack/data/nova/instances/c1b2acdc-413f-4b94-a80d-cb2e5c966a2e/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:55:37.005988 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:55:37.006215 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:55:37.006337 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:55:37.006782 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Start _get_guest_xml network_info=[{"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": "br-int", "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '80ca483c-5b17-4d72-b68a-1d5f10b6ab56', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38784990-34f2-4fa8-a574-265dcda0e395', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c1b2acdc-413f-4b94-a80d-cb2e5c966a2e', 'attached_at': '', 'detached_at': '', 'volume_id': '38784990-34f2-4fa8-a574-265dcda0e395', 'serial': '38784990-34f2-4fa8-a574-265dcda0e395'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:55:37.010654 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:55:37.011778 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-1644755258', uuid='c1b2acdc-413f-4b94-a80d-cb2e5c966a2e'), owner=OwnerMeta(userid='1c02d167c3764ceaa0671926946d8920', username='tempest-TestShelveInstance-606043442-project-member', projectid='dc4772a09cd1480f9d139120e1f42892', projectname='tempest-TestShelveInstance-606043442'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": "br-int", "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166537.0114412) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:55:37.012799 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:55:37.013091 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:55:37.014071 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:55:37.014264 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:55:37.015143 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:55:37.015405 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:55:37.015570 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:55:37.015687 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:55:37.015800 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:55:37.015883 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:55:37.015970 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:55:37.016182 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:55:37.016294 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:55:37.016398 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:55:37.016521 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:55:37.016633 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:55:37.026732 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:55:37.027022 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38784990-34f2-4fa8-a574-265dcda0e395', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:55:37.027150 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:55:38.956236 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:39.281416 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.254s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:55:39.281625 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38784990-34f2-4fa8-a574-265dcda0e395', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:55:39.301908 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:55:39.302347 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:55:39.302769 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:55:39.302978 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:55:39.303321 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:55:39.303568 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:55:39.316556 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:55:39.316556 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:55:39.317022 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:55:39.317022 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:55:39.329246 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395] added
May 19 04:55:39.329246 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:55:39.329246 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:55:39.329246 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:55:39.329246 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:55:39.329246 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:55:39.329246 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:55:39.329502 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:55:39.329635 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.026(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:55:39.329816 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:55:39.331691 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395] added
May 19 04:55:39.331691 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:55:39.331691 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:55:39.331691 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:55:39.331691 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:55:39.331691 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:55:39.331691 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:55:39.331861 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:55:39.332007 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.029(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:55:39.332156 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:55:40.330723 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:55:40.332604 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:55:40.344177 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:55:40.344177 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:55:40.346998 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:55:40.346998 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:55:40.357508 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:55:40.362372 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:55:40.371656 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-799869df-5bcc-4ede-96f6-5af867765ace (non-flash)
May 19 04:55:40.371656 np0000001025 nova-compute[97981]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-799869df-5bcc-4ede-96f6-5af867765ace (non-flash)
May 19 04:55:40.371656 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:55:40.372078 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-799869df-5bcc-4ede-96f6-5af867765ace (non-flash)
May 19 04:55:40.372078 np0000001025 nova-compute[97981]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-799869df-5bcc-4ede-96f6-5af867765ace (non-flash)
May 19 04:55:40.372078 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:55:40.378288 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-799869df-5bcc-4ede-96f6-5af867765ace (non-flash)
May 19 04:55:40.378288 np0000001025 nova-compute[97981]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-799869df-5bcc-4ede-96f6-5af867765ace (non-flash)
May 19 04:55:40.378288 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:55:40.378482 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-799869df-5bcc-4ede-96f6-5af867765ace (non-flash)
May 19 04:55:40.378482 np0000001025 nova-compute[97981]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-799869df-5bcc-4ede-96f6-5af867765ace (non-flash)
May 19 04:55:40.378482 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:55:40.407358 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395, portal: 192.168.50.100,3260]
May 19 04:55:40.407358 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395, portal: 192.168.50.100,3260] successful.
May 19 04:55:40.407358 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:55:40.426696 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395, portal: 192.168.40.100,3260]
May 19 04:55:40.426696 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395, portal: 192.168.40.100,3260] successful.
May 19 04:55:40.426696 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:55:40.430242 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:55:40.438533 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:55:40.447270 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-799869df-5bcc-4ede-96f6-5af867765ace (non-flash)
May 19 04:55:40.447270 np0000001025 nova-compute[97981]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-799869df-5bcc-4ede-96f6-5af867765ace (non-flash)
May 19 04:55:40.447270 np0000001025 nova-compute[97981]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:55:40.447270 np0000001025 nova-compute[97981]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:55:40.447270 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:55:40.447270 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-799869df-5bcc-4ede-96f6-5af867765ace (non-flash)
May 19 04:55:40.447270 np0000001025 nova-compute[97981]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-799869df-5bcc-4ede-96f6-5af867765ace (non-flash)
May 19 04:55:40.447270 np0000001025 nova-compute[97981]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:55:40.447270 np0000001025 nova-compute[97981]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:55:40.447270 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:55:40.449001 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:55:40.449001 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:55:40.449001 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] HCTL ('9', '-', '-', 0) found on session 207 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:55:40.449001 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:55:40.455765 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-799869df-5bcc-4ede-96f6-5af867765ace (non-flash)
May 19 04:55:40.455765 np0000001025 nova-compute[97981]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-799869df-5bcc-4ede-96f6-5af867765ace (non-flash)
May 19 04:55:40.455765 np0000001025 nova-compute[97981]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:55:40.455765 np0000001025 nova-compute[97981]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:55:40.455765 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:55:40.455951 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-799869df-5bcc-4ede-96f6-5af867765ace (non-flash)
May 19 04:55:40.455951 np0000001025 nova-compute[97981]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-799869df-5bcc-4ede-96f6-5af867765ace (non-flash)
May 19 04:55:40.455951 np0000001025 nova-compute[97981]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:55:40.455951 np0000001025 nova-compute[97981]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:55:40.455951 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:55:40.456349 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:55:40.456349 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:55:40.456641 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] HCTL ('10', '-', '-', 0) found on session 208 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:55:40.456737 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:55:40.468991 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Searching for a device in session 207 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:55:40.471079 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '38784990-34f2-4fa8-a574-265dcda0e395', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:55:40.471079 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Searching for a device in session 208 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:55:40.471218 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38784990-34f2-4fa8-a574-265dcda0e395', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:55:41.303444 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:55:41.380670 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:42.317609 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Found WWN 330000000f52b2e61 for multipath device dm-1 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:55:42.317868 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:55:42.318157 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] <== connect_volume: return (5290ms) {'type': 'block', 'scsi_wwn': '330000000f52b2e61', 'path': '/dev/dm-1', 'multipath_id': '330000000f52b2e61'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:55:42.318157 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f52b2e61', 'path': '/dev/dm-1', 'multipath_id': '330000000f52b2e61'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:55:42.822957 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:55:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1644755258',display_name='tempest-TestShelveInstance-server-1644755258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testshelveinstance-server-1644755258',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+YqEICjz9MxMBHak0SAR0UnoboImu3BWh6kqDkFVDd9NL4fr5f8rx/kw8WF+Mxf7rmmEDOIxeCWXt9bBZq+1nbq28my0wgV1vjSrmXUi53sBa8iJQZmphNm//O1bm36g==',key_name='tempest-TestShelveInstance-1648700680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc4772a09cd1480f9d139120e1f42892',ramdisk_id='',reservation_id='r-e8s6y7hb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-606043442',owner_user_name='tempest-TestShelveInstance-606043442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:55:34Z,user_data=None,user_id='1c02d167c3764ceaa0671926946d8920',uuid=c1b2acdc-413f-4b94-a80d-cb2e5c966a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": "br-int", "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:55:42.823333 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Converting VIF {"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": "br-int", "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:55:42.823649 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2d:01,bridge_name='br-int',has_traffic_filtering=True,id=b6e423ea-5da0-4bb9-8d49-e59d822f4e75,network=Network(15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e423ea-5d') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:55:42.826162 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lazy-loading 'pci_devices' on Instance uuid c1b2acdc-413f-4b94-a80d-cb2e5c966a2e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:55:43.329810 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] End _get_guest_xml xml=<domain type="qemu">
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:   <uuid>c1b2acdc-413f-4b94-a80d-cb2e5c966a2e</uuid>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:   <name>instance-0000004e</name>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestShelveInstance-server-1644755258</nova:name>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:55:37</nova:creationTime>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:         <nova:user uuid="1c02d167c3764ceaa0671926946d8920">tempest-TestShelveInstance-606043442-project-member</nova:user>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:         <nova:project uuid="dc4772a09cd1480f9d139120e1f42892">tempest-TestShelveInstance-606043442</nova:project>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:         <nova:port uuid="b6e423ea-5da0-4bb9-8d49-e59d822f4e75">
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     <system>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <entry name="serial">c1b2acdc-413f-4b94-a80d-cb2e5c966a2e</entry>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <entry name="uuid">c1b2acdc-413f-4b94-a80d-cb2e5c966a2e</entry>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     </system>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:   <os>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:   </os>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:   <features>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:   </features>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:   <devices>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/c1b2acdc-413f-4b94-a80d-cb2e5c966a2e/disk.config"/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     </disk>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <alias name="ua-38784990-34f2-4fa8-a574-265dcda0e395"/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-1"/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <serial>38784990-34f2-4fa8-a574-265dcda0e395</serial>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     </disk>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:c0:2d:01"/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <target dev="tapb6e423ea-5d"/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     </interface>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/c1b2acdc-413f-4b94-a80d-cb2e5c966a2e/console.log" append="off"/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     </serial>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     <video>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     </video>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     </rng>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:   </devices>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]: </domain>
May 19 04:55:43.329810 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:55:43.332315 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Preparing to wait for external event network-vif-plugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:55:43.332315 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:55:43.332315 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:55:43.332315 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:55:43.332315 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:55:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1644755258',display_name='tempest-TestShelveInstance-server-1644755258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testshelveinstance-server-1644755258',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+YqEICjz9MxMBHak0SAR0UnoboImu3BWh6kqDkFVDd9NL4fr5f8rx/kw8WF+Mxf7rmmEDOIxeCWXt9bBZq+1nbq28my0wgV1vjSrmXUi53sBa8iJQZmphNm//O1bm36g==',key_name='tempest-TestShelveInstance-1648700680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc4772a09cd1480f9d139120e1f42892',ramdisk_id='',reservation_id='r-e8s6y7hb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-606043442',owner_user_name='tempest-TestShelveInstance-606043442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:55:34Z,user_data=None,user_id='1c02d167c3764ceaa0671926946d8920',uuid=c1b2acdc-413f-4b94-a80d-cb2e5c966a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": "br-int", "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:55:43.332315 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Converting VIF {"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": "br-int", "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:55:43.332315 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2d:01,bridge_name='br-int',has_traffic_filtering=True,id=b6e423ea-5da0-4bb9-8d49-e59d822f4e75,network=Network(15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e423ea-5d') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:55:43.332315 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2d:01,bridge_name='br-int',has_traffic_filtering=True,id=b6e423ea-5da0-4bb9-8d49-e59d822f4e75,network=Network(15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e423ea-5d') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:55:43.332315 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:43.332750 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:55:43.332750 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:55:43.333591 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:43.333591 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6675a0df-6c0f-503f-9000-8dc099c8e665', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:55:43.335233 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:55:43.335671 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:43.337723 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:43.337899 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6e423ea-5d, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:55:43.338229 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb6e423ea-5d, col_values=(('qos', UUID('54a44383-248d-41aa-ad6e-c2f07f22a05e')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:55:43.338423 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb6e423ea-5d, col_values=(('external_ids', {'iface-id': 'b6e423ea-5da0-4bb9-8d49-e59d822f4e75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:2d:01', 'vm-uuid': 'c1b2acdc-413f-4b94-a80d-cb2e5c966a2e'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:55:43.340455 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:55:43.344513 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:43.345440 np0000001025 nova-compute[97981]: INFO os_vif [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2d:01,bridge_name='br-int',has_traffic_filtering=True,id=b6e423ea-5da0-4bb9-8d49-e59d822f4e75,network=Network(15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e423ea-5d')
May 19 04:55:43.965233 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:44.859150 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:55:44.859150 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:55:44.859317 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] No VIF found with MAC fa:16:3e:c0:2d:01, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:55:44.859652 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Using config drive
May 19 04:55:45.364240 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:55:45.464736 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Creating config drive at /opt/stack/data/nova/instances/c1b2acdc-413f-4b94-a80d-cb2e5c966a2e/disk.config
May 19 04:55:45.467579 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c1b2acdc-413f-4b94-a80d-cb2e5c966a2e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjecnodhr {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:55:45.519494 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c1b2acdc-413f-4b94-a80d-cb2e5c966a2e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjecnodhr" returned: 0 in 0.052s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:55:45.875148 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:45.897431 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:45.898264 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:46.003684 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:46.041639 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1851c1fc-1a53-412e-9fd0-b0947c2bc3af req-84e38d8d-1c5d-4494-bd69-0560eaa0c132 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Received event network-vif-plugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:55:46.041887 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1851c1fc-1a53-412e-9fd0-b0947c2bc3af req-84e38d8d-1c5d-4494-bd69-0560eaa0c132 service nova] Acquiring lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:55:46.045011 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1851c1fc-1a53-412e-9fd0-b0947c2bc3af req-84e38d8d-1c5d-4494-bd69-0560eaa0c132 service nova] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:55:46.045227 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1851c1fc-1a53-412e-9fd0-b0947c2bc3af req-84e38d8d-1c5d-4494-bd69-0560eaa0c132 service nova] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:55:46.045396 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1851c1fc-1a53-412e-9fd0-b0947c2bc3af req-84e38d8d-1c5d-4494-bd69-0560eaa0c132 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Processing event network-vif-plugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:55:46.160424 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:46.161722 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:46.163286 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:46.181741 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:46.552074 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166546.5515828, c1b2acdc-413f-4b94-a80d-cb2e5c966a2e => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:55:46.552505 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] VM Started (Lifecycle Event)
May 19 04:55:46.553899 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:55:46.556015 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:55:46.558899 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Instance spawned successfully.
May 19 04:55:46.559196 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:55:46.560838 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:55:46.561069 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:55:46.561246 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:55:46.561429 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:55:46.561619 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:55:46.561865 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.05 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:55:46.614932 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:55:46.615252 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 8.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:55:47.055064 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:55:47.057015 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:55:47.064563 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:55:47.064699 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:55:47.064893 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:55:47.065068 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:55:47.065345 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:55:47.065570 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:55:47.559358 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:55:47.559742 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166547.5595434, c1b2acdc-413f-4b94-a80d-cb2e5c966a2e => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:55:47.559860 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] VM Paused (Lifecycle Event)
May 19 04:55:47.569901 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Took 10.57 seconds to spawn the instance on the hypervisor.
May 19 04:55:47.570203 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:55:48.061992 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:55:48.064798 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166548.0645509, c1b2acdc-413f-4b94-a80d-cb2e5c966a2e => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:55:48.064932 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] VM Resumed (Lifecycle Event)
May 19 04:55:48.080165 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Took 17.54 seconds to build instance.
May 19 04:55:48.097119 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5fee691b-941f-437d-9817-2a1467a36f07 req-a60dc6d5-2337-4c15-b0e6-d3897a572e8a service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Received event network-vif-plugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:55:48.097365 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5fee691b-941f-437d-9817-2a1467a36f07 req-a60dc6d5-2337-4c15-b0e6-d3897a572e8a service nova] Acquiring lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:55:48.097576 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5fee691b-941f-437d-9817-2a1467a36f07 req-a60dc6d5-2337-4c15-b0e6-d3897a572e8a service nova] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:55:48.097934 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5fee691b-941f-437d-9817-2a1467a36f07 req-a60dc6d5-2337-4c15-b0e6-d3897a572e8a service nova] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:55:48.098267 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5fee691b-941f-437d-9817-2a1467a36f07 req-a60dc6d5-2337-4c15-b0e6-d3897a572e8a service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] No waiting events found dispatching network-vif-plugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:55:48.098530 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-5fee691b-941f-437d-9817-2a1467a36f07 req-a60dc6d5-2337-4c15-b0e6-d3897a572e8a service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Received unexpected event network-vif-plugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 for instance with vm_state active and task_state None.
May 19 04:55:48.339532 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:48.567054 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:55:48.571133 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:55:48.581591 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-87c06ab9-061b-4639-9aff-11819b1cb963 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.053s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:55:48.981301 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:49.892819 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-860a6010-b479-492e-9be9-9d5e7381a810 req-6a70e40d-0901-4a2c-bed4-0224ff549f76 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Received event network-changed-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:55:49.893149 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-860a6010-b479-492e-9be9-9d5e7381a810 req-6a70e40d-0901-4a2c-bed4-0224ff549f76 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Refreshing instance network info cache due to event network-changed-b6e423ea-5da0-4bb9-8d49-e59d822f4e75. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:55:49.893225 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-860a6010-b479-492e-9be9-9d5e7381a810 req-6a70e40d-0901-4a2c-bed4-0224ff549f76 service nova] Acquiring lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:55:49.893324 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-860a6010-b479-492e-9be9-9d5e7381a810 req-6a70e40d-0901-4a2c-bed4-0224ff549f76 service nova] Acquired lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:55:49.893482 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-860a6010-b479-492e-9be9-9d5e7381a810 req-6a70e40d-0901-4a2c-bed4-0224ff549f76 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Refreshing network info cache for port b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:55:50.395480 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-860a6010-b479-492e-9be9-9d5e7381a810 req-6a70e40d-0901-4a2c-bed4-0224ff549f76 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:55:50.690664 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-860a6010-b479-492e-9be9-9d5e7381a810 req-6a70e40d-0901-4a2c-bed4-0224ff549f76 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:55:50.840961 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-860a6010-b479-492e-9be9-9d5e7381a810 req-6a70e40d-0901-4a2c-bed4-0224ff549f76 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Updated VIF entry in instance network info cache for port b6e423ea-5da0-4bb9-8d49-e59d822f4e75. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:55:50.841246 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-860a6010-b479-492e-9be9-9d5e7381a810 req-6a70e40d-0901-4a2c-bed4-0224ff549f76 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Updating instance_info_cache with network_info: [{"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": "br-int", "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:55:50.891212 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:55:51.342958 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-860a6010-b479-492e-9be9-9d5e7381a810 req-6a70e40d-0901-4a2c-bed4-0224ff549f76 service nova] Releasing lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:55:53.340698 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:53.992053 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:54.614941 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:55:54.615417 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:55:54.615417 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:55:56.610584 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:55:56.610999 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:55:56.614666 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:55:57.120280 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:55:57.120625 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:55:57.120874 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:55:57.121120 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:55:58.142195 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:55:58.143720 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc1a2a6-1666-417c-999b-fddeb8fb7589/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:55:58.232938 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc1a2a6-1666-417c-999b-fddeb8fb7589/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:55:58.233513 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc1a2a6-1666-417c-999b-fddeb8fb7589/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:55:58.324252 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc1a2a6-1666-417c-999b-fddeb8fb7589/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:55:58.328269 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:55:58.329631 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:55:58.341957 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:58.375229 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:55:58.375617 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=13684MB free_disk=72.68473815917969GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:55:58.375783 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:55:58.375985 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:55:58.993628 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:55:59.438638 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 1dc1a2a6-1666-417c-999b-fddeb8fb7589 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:55:59.439189 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance c1b2acdc-413f-4b94-a80d-cb2e5c966a2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:55:59.439189 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:55:59.439189 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:55:58 up 46 min,  2 users,  load average: 2.65, 3.31, 3.62\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '2', 'num_proj_36ff6589269d4d73acf3d5d205b75622': '1', 'io_workload': '0', 'num_proj_dc4772a09cd1480f9d139120e1f42892': '1'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:55:59.586147 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:55:59.586419 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:56:00.089074 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:56:00.596251 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:56:00.596688 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.220s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:56:00.596733 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 35.02 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:56:03.343765 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:04.015615 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:08.344332 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:08.481066 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:56:08.481513 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:56:08.985539 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lazy-loading 'flavor' on Instance uuid 1dc1a2a6-1666-417c-999b-fddeb8fb7589 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:56:09.027280 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:09.990291 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:56:11.044133 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:56:11.044133 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:56:11.044133 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Attaching volume d92cf7da-1d62-4a85-888f-f14cae592277 to /dev/vdb
May 19 04:56:11.076398 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:56:11.085992 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:56:11.106651 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:56:11.146955 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:56:11.147478 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:56:11.155382 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:56:11.156414 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fec2:716', 'fe80::1c6c:ff:fe04:9b0e', 'fe80::fc16:3eff:fec0:2d01', 'fe80::acfb:13ff:fed0:d3e1'] 
May 19 04:56:11.156677 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:56:11.156898 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:56:11.157226 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:56:11.157728 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Updating existing volume attachment record: 52a5806d-c663-48dd-9521-81bdc4829c96 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:56:11.720643 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277', 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd92cf7da-1d62-4a85-888f-f14cae592277', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1dc1a2a6-1666-417c-999b-fddeb8fb7589', 'attached_at': '', 'detached_at': '', 'volume_id': 'd92cf7da-1d62-4a85-888f-f14cae592277', 'serial': 'd92cf7da-1d62-4a85-888f-f14cae592277'} {{(pid=97981) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 19 04:56:11.723668 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:56:11.724121 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277', 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd92cf7da-1d62-4a85-888f-f14cae592277', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:56:11.725087 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:56:11.725087 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:56:11.725087 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277', 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd92cf7da-1d62-4a85-888f-f14cae592277', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:56:11.737218 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:56:11.737884 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:56:11.738384 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:56:11.738561 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:56:11.738868 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:56:11.739008 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:56:11.748890 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:56:11.748890 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:11.753313 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:56:11.753313 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:11.760841 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277] added
May 19 04:56:11.760841 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:56:11.760841 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:56:11.760841 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:56:11.760841 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:56:11.760841 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:56:11.760841 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:11.761074 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:56:11.761498 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0225(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:56:11.761498 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:56:11.763297 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277] added
May 19 04:56:11.763297 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:56:11.763297 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:56:11.763297 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:56:11.763297 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:56:11.763297 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:56:11.763297 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:11.763498 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:56:11.763733 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0246(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:56:11.763883 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:56:12.761853 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:56:12.764430 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:56:12.775925 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:56:12.775925 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:56:12.780917 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:56:12.780917 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:12.787927 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:12.795012 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:12.801634 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:12.801634 np0000001025 nova-compute[97981]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:12.801634 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:56:12.801858 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsi session list stdout=tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:12.801858 np0000001025 nova-compute[97981]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:12.801858 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:56:12.808568 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:12.808568 np0000001025 nova-compute[97981]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:12.808568 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:56:12.808699 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsi session list stdout=tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:12.808699 np0000001025 nova-compute[97981]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:12.808699 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:56:12.827710 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277, portal: 192.168.40.100,3260]
May 19 04:56:12.827710 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277, portal: 192.168.40.100,3260] successful.
May 19 04:56:12.827710 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:12.838046 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:12.843413 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277, portal: 192.168.50.100,3260]
May 19 04:56:12.843413 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277, portal: 192.168.50.100,3260] successful.
May 19 04:56:12.843413 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:12.850732 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:12.850732 np0000001025 nova-compute[97981]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:12.850732 np0000001025 nova-compute[97981]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277 (non-flash)
May 19 04:56:12.850732 np0000001025 nova-compute[97981]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277 (non-flash)
May 19 04:56:12.850732 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:56:12.850904 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsi session list stdout=tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:12.850904 np0000001025 nova-compute[97981]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:12.850904 np0000001025 nova-compute[97981]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277 (non-flash)
May 19 04:56:12.850904 np0000001025 nova-compute[97981]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277 (non-flash)
May 19 04:56:12.850904 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:56:12.851070 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.113s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:56:12.851196 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:56:12.851759 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] HCTL ('7', '-', '-', 0) found on session 209 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:56:12.851857 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:56:12.856352 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:12.864925 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Searching for a device in session 209 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:56:12.864925 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd92cf7da-1d62-4a85-888f-f14cae592277', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:56:12.869890 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:12.869890 np0000001025 nova-compute[97981]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:12.869890 np0000001025 nova-compute[97981]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277 (non-flash)
May 19 04:56:12.869890 np0000001025 nova-compute[97981]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277 (non-flash)
May 19 04:56:12.869890 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:56:12.870031 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsi session list stdout=tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:12.870031 np0000001025 nova-compute[97981]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:12.870031 np0000001025 nova-compute[97981]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277 (non-flash)
May 19 04:56:12.870031 np0000001025 nova-compute[97981]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277 (non-flash)
May 19 04:56:12.870031 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:56:12.870280 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.131s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:56:12.870395 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:56:12.870929 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] HCTL ('8', '-', '-', 0) found on session 210 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:56:12.871034 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:56:12.884270 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Searching for a device in session 210 and hctl ['8', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:56:13.345134 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:13.870129 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:56:13.870659 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:56:13.870659 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Shelve offloading
May 19 04:56:13.883322 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Searching for a device in session 210 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:56:13.883728 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd92cf7da-1d62-4a85-888f-f14cae592277', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:56:14.042309 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:14.754638 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Found WWN 3300000003dc92486 for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:56:14.754638 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:56:14.755349 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '3300000003dc92486', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000003dc92486'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:56:14.756258 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003dc92486', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000003dc92486'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:56:14.758040 np0000001025 nova-compute[97981]: WARNING stevedore.named [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 19 04:56:14.758417 np0000001025 nova-compute[97981]: WARNING castellan.key_manager [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:56:14.758704 np0000001025 nova-compute[97981]: WARNING nova.keymgr.conf_key_mgr [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:56:14.775971 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Secret XML: <secret ephemeral="no" private="no">
May 19 04:56:14.775971 np0000001025 nova-compute[97981]:   <usage type="volume">
May 19 04:56:14.775971 np0000001025 nova-compute[97981]:     <volume>d92cf7da-1d62-4a85-888f-f14cae592277</volume>
May 19 04:56:14.775971 np0000001025 nova-compute[97981]:   </usage>
May 19 04:56:14.775971 np0000001025 nova-compute[97981]: </secret>
May 19 04:56:14.775971 np0000001025 nova-compute[97981]:  {{(pid=97981) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 19 04:56:14.782498 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lazy-loading 'flavor' on Instance uuid 1dc1a2a6-1666-417c-999b-fddeb8fb7589 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:56:14.894155 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:14.896078 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:14.909999 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:14.912511 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:14.927312 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:14.933536 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:15.011765 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c548fc4d-f71c-4e3f-81f6-6093feecd0c7 req-c00fcbae-767d-4d62-ae79-5af9fc35350b service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Received event network-vif-unplugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:56:15.011940 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c548fc4d-f71c-4e3f-81f6-6093feecd0c7 req-c00fcbae-767d-4d62-ae79-5af9fc35350b service nova] Acquiring lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:56:15.012154 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c548fc4d-f71c-4e3f-81f6-6093feecd0c7 req-c00fcbae-767d-4d62-ae79-5af9fc35350b service nova] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:56:15.012314 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c548fc4d-f71c-4e3f-81f6-6093feecd0c7 req-c00fcbae-767d-4d62-ae79-5af9fc35350b service nova] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:56:15.012496 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c548fc4d-f71c-4e3f-81f6-6093feecd0c7 req-c00fcbae-767d-4d62-ae79-5af9fc35350b service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] No waiting events found dispatching network-vif-unplugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:56:15.012888 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-c548fc4d-f71c-4e3f-81f6-6093feecd0c7 req-c00fcbae-767d-4d62-ae79-5af9fc35350b service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Received unexpected event network-vif-unplugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 for instance with vm_state active and task_state shelving.
May 19 04:56:15.091344 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:15.183694 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:15.189252 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:15.212288 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999620234000304 future=<Future at 0x7218505c4bf0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:56:15.212794 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.99909372600041 future=<Future at 0x7218505c4bf0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:56:15.212946 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.99890920200005 future=<Future at 0x7218505c4bf0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:56:15.214324 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Instance destroyed successfully.
May 19 04:56:15.214733 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lazy-loading 'numa_topology' on Instance uuid c1b2acdc-413f-4b94-a80d-cb2e5c966a2e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:56:15.284287 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Attempting to attach volume d92cf7da-1d62-4a85-888f-f14cae592277 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:56:15.285496 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:56:15.285496 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:56:15.285496 np0000001025 nova-compute[97981]:   <alias name="ua-d92cf7da-1d62-4a85-888f-f14cae592277"/>
May 19 04:56:15.285496 np0000001025 nova-compute[97981]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 19 04:56:15.285496 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:56:15.285496 np0000001025 nova-compute[97981]:   <serial>d92cf7da-1d62-4a85-888f-f14cae592277</serial>
May 19 04:56:15.285496 np0000001025 nova-compute[97981]:   <encryption format="luks">
May 19 04:56:15.285496 np0000001025 nova-compute[97981]:     <secret type="passphrase" uuid="5badd73d-b53a-4262-8e60-16a9f7f90bb2"/>
May 19 04:56:15.285496 np0000001025 nova-compute[97981]:   </encryption>
May 19 04:56:15.285496 np0000001025 nova-compute[97981]: </disk>
May 19 04:56:15.285496 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:56:15.716704 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:56:15.719184 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:56:15.719383 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquired lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:56:15.719580 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:56:16.222005 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:56:16.480895 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:56:16.602780 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Updating instance_info_cache with network_info: [{"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": "br-int", "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:56:17.073086 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-268c500c-4e2e-4ec9-a1c4-c6591763b72a req-4945889c-c461-49ea-87e6-80524964c84f service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Received event network-vif-unplugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:56:17.073583 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-268c500c-4e2e-4ec9-a1c4-c6591763b72a req-4945889c-c461-49ea-87e6-80524964c84f service nova] Acquiring lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:56:17.073789 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-268c500c-4e2e-4ec9-a1c4-c6591763b72a req-4945889c-c461-49ea-87e6-80524964c84f service nova] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:56:17.073848 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-268c500c-4e2e-4ec9-a1c4-c6591763b72a req-4945889c-c461-49ea-87e6-80524964c84f service nova] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:56:17.073960 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-268c500c-4e2e-4ec9-a1c4-c6591763b72a req-4945889c-c461-49ea-87e6-80524964c84f service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] No waiting events found dispatching network-vif-unplugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:56:17.074095 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-268c500c-4e2e-4ec9-a1c4-c6591763b72a req-4945889c-c461-49ea-87e6-80524964c84f service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Received unexpected event network-vif-unplugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 for instance with vm_state active and task_state shelving.
May 19 04:56:17.104595 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Releasing lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:56:17.105164 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:56:17.105420 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:56:17.467457 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Instance destroyed successfully.
May 19 04:56:17.467828 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lazy-loading 'resources' on Instance uuid c1b2acdc-413f-4b94-a80d-cb2e5c966a2e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:56:17.883417 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:56:17.883555 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:56:17.883690 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:56:17.883822 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] No VIF found with MAC fa:16:3e:c2:07:16, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:56:17.969333 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Object Instance<c1b2acdc-413f-4b94-a80d-cb2e5c966a2e> lazy-loaded attributes: numa_topology,resources {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:56:17.970006 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:55:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1644755258',display_name='tempest-TestShelveInstance-server-1644755258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testshelveinstance-server-1644755258',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+YqEICjz9MxMBHak0SAR0UnoboImu3BWh6kqDkFVDd9NL4fr5f8rx/kw8WF+Mxf7rmmEDOIxeCWXt9bBZq+1nbq28my0wgV1vjSrmXUi53sBa8iJQZmphNm//O1bm36g==',key_name='tempest-TestShelveInstance-1648700680',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:55:47Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc4772a09cd1480f9d139120e1f42892',ramdisk_id='',reservation_id='r-e8s6y7hb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-606043442',owner_user_name='tempest-TestShelveInstance-606043442-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:55:48Z,user_data=None,user_id='1c02d167c3764ceaa0671926946d8920',uuid=c1b2acdc-413f-4b94-a80d-cb2e5c966a2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": "br-int", "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:56:17.970239 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Converting VIF {"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": "br-int", "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:56:17.970843 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2d:01,bridge_name='br-int',has_traffic_filtering=True,id=b6e423ea-5da0-4bb9-8d49-e59d822f4e75,network=Network(15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e423ea-5d') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:56:17.971127 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2d:01,bridge_name='br-int',has_traffic_filtering=True,id=b6e423ea-5da0-4bb9-8d49-e59d822f4e75,network=Network(15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e423ea-5d') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:56:17.973048 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:17.973346 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6e423ea-5d, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:56:17.974485 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:17.975522 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:56:17.976213 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:17.976382 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=54a44383-248d-41aa-ad6e-c2f07f22a05e) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:56:17.976997 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:17.977375 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:56:17.979222 np0000001025 nova-compute[97981]: INFO os_vif [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2d:01,bridge_name='br-int',has_traffic_filtering=True,id=b6e423ea-5da0-4bb9-8d49-e59d822f4e75,network=Network(15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e423ea-5d')
May 19 04:56:17.980638 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:56:17.980912 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38784990-34f2-4fa8-a574-265dcda0e395', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:56:17.981084 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:56:17.981447 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:56:17.981709 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38784990-34f2-4fa8-a574-265dcda0e395', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:56:17.981844 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:56:18.009679 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:18.009679 np0000001025 nova-compute[97981]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:18.009679 np0000001025 nova-compute[97981]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277 (non-flash)
May 19 04:56:18.009679 np0000001025 nova-compute[97981]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277 (non-flash)
May 19 04:56:18.009679 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:56:18.009908 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsi session list stdout=tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:18.009908 np0000001025 nova-compute[97981]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:18.009908 np0000001025 nova-compute[97981]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277 (non-flash)
May 19 04:56:18.009908 np0000001025 nova-compute[97981]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277 (non-flash)
May 19 04:56:18.009908 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:56:18.010053 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', '207'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277', '210')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:56:18.010138 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', '208')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:56:18.010988 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', '207')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:56:18.011757 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721850138360>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395'): ({'sdd'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:56:18.011952 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Removing multipathed devices sdd, sde {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:56:18.012199 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Flush multipath device 330000000f52b2e61 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:56:18.067437 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:56:18.109395 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:56:18.157385 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:56:18.157540 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] SCSI volumes sdd, sde have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:56:18.158237 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:56:18.169695 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:56:18.169695 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:56:18.181475 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:18.210376 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 208, target: iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395, portal: 192.168.40.100,3260]
May 19 04:56:18.210376 np0000001025 nova-compute[97981]: Logout of [sid: 208, target: iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395, portal: 192.168.40.100,3260] successful.
May 19 04:56:18.210376 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:18.223059 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:18.233334 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:18.262742 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 207, target: iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395, portal: 192.168.50.100,3260]
May 19 04:56:18.262742 np0000001025 nova-compute[97981]: Logout of [sid: 207, target: iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395, portal: 192.168.50.100,3260] successful.
May 19 04:56:18.262742 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:18.274306 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:18.274603 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:56:18.274763 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] <== disconnect_volume: return (294ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:56:18.274910 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:56:18.275374 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Deleting instance files /opt/stack/data/nova/instances/c1b2acdc-413f-4b94-a80d-cb2e5c966a2e_del
May 19 04:56:18.275983 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Deletion of /opt/stack/data/nova/instances/c1b2acdc-413f-4b94-a80d-cb2e5c966a2e_del complete
May 19 04:56:19.122744 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-18185d11-5e49-4a49-9f66-1fea58b53666 req-2d97164d-c469-4670-9aa8-b5cbc8ec5b02 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Received event network-changed-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:56:19.123168 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-18185d11-5e49-4a49-9f66-1fea58b53666 req-2d97164d-c469-4670-9aa8-b5cbc8ec5b02 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Refreshing instance network info cache due to event network-changed-b6e423ea-5da0-4bb9-8d49-e59d822f4e75. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:56:19.123333 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-18185d11-5e49-4a49-9f66-1fea58b53666 req-2d97164d-c469-4670-9aa8-b5cbc8ec5b02 service nova] Acquiring lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:56:19.123449 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-18185d11-5e49-4a49-9f66-1fea58b53666 req-2d97164d-c469-4670-9aa8-b5cbc8ec5b02 service nova] Acquired lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:56:19.123553 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-18185d11-5e49-4a49-9f66-1fea58b53666 req-2d97164d-c469-4670-9aa8-b5cbc8ec5b02 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Refreshing network info cache for port b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:56:19.426195 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-35e495ce-f7ee-4353-8214-39465b7dc9ce tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.384s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:56:19.625378 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-18185d11-5e49-4a49-9f66-1fea58b53666 req-2d97164d-c469-4670-9aa8-b5cbc8ec5b02 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:56:19.895621 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:56:19.895772 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:56:19.926761 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Deleted allocations for instance c1b2acdc-413f-4b94-a80d-cb2e5c966a2e
May 19 04:56:20.338521 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-18185d11-5e49-4a49-9f66-1fea58b53666 req-2d97164d-c469-4670-9aa8-b5cbc8ec5b02 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:56:20.401207 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Detaching volume d92cf7da-1d62-4a85-888f-f14cae592277
May 19 04:56:20.433665 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:56:20.433665 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:56:20.443341 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Attempting to driver detach volume d92cf7da-1d62-4a85-888f-f14cae592277 from mountpoint /dev/vdb
May 19 04:56:20.460569 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-18185d11-5e49-4a49-9f66-1fea58b53666 req-2d97164d-c469-4670-9aa8-b5cbc8ec5b02 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Updated VIF entry in instance network info cache for port b6e423ea-5da0-4bb9-8d49-e59d822f4e75. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:56:20.460930 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-18185d11-5e49-4a49-9f66-1fea58b53666 req-2d97164d-c469-4670-9aa8-b5cbc8ec5b02 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Updating instance_info_cache with network_info: [{"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": null, "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:56:20.482131 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277', 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd92cf7da-1d62-4a85-888f-f14cae592277', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '1dc1a2a6-1666-417c-999b-fddeb8fb7589', 'attached_at': '', 'detached_at': '', 'volume_id': 'd92cf7da-1d62-4a85-888f-f14cae592277', 'serial': 'd92cf7da-1d62-4a85-888f-f14cae592277'} {{(pid=97981) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 19 04:56:20.486206 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Found disk vdb by alias ua-d92cf7da-1d62-4a85-888f-f14cae592277 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:56:20.491289 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Found disk vdb by alias ua-d92cf7da-1d62-4a85-888f-f14cae592277 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:56:20.491431 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Attempting to detach device vdb from instance 1dc1a2a6-1666-417c-999b-fddeb8fb7589 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:56:20.491673 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:56:20.491673 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:56:20.491673 np0000001025 nova-compute[97981]:   <alias name="ua-d92cf7da-1d62-4a85-888f-f14cae592277"/>
May 19 04:56:20.491673 np0000001025 nova-compute[97981]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 19 04:56:20.491673 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:56:20.491673 np0000001025 nova-compute[97981]:   <serial>d92cf7da-1d62-4a85-888f-f14cae592277</serial>
May 19 04:56:20.491673 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:56:20.491673 np0000001025 nova-compute[97981]:   <encryption format="luks">
May 19 04:56:20.491673 np0000001025 nova-compute[97981]:     <secret type="passphrase" uuid="5badd73d-b53a-4262-8e60-16a9f7f90bb2"/>
May 19 04:56:20.491673 np0000001025 nova-compute[97981]:   </encryption>
May 19 04:56:20.491673 np0000001025 nova-compute[97981]: </disk>
May 19 04:56:20.491673 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:56:20.498417 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Successfully detached device vdb from instance 1dc1a2a6-1666-417c-999b-fddeb8fb7589 from the persistent domain config.
May 19 04:56:20.498721 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] (1/8): Attempting to detach device vdb with device alias ua-d92cf7da-1d62-4a85-888f-f14cae592277 from instance 1dc1a2a6-1666-417c-999b-fddeb8fb7589 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:56:20.499067 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:56:20.499067 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:56:20.499067 np0000001025 nova-compute[97981]:   <alias name="ua-d92cf7da-1d62-4a85-888f-f14cae592277"/>
May 19 04:56:20.499067 np0000001025 nova-compute[97981]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 19 04:56:20.499067 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:56:20.499067 np0000001025 nova-compute[97981]:   <serial>d92cf7da-1d62-4a85-888f-f14cae592277</serial>
May 19 04:56:20.499067 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:56:20.499067 np0000001025 nova-compute[97981]:   <encryption format="luks">
May 19 04:56:20.499067 np0000001025 nova-compute[97981]:     <secret type="passphrase" uuid="5badd73d-b53a-4262-8e60-16a9f7f90bb2"/>
May 19 04:56:20.499067 np0000001025 nova-compute[97981]:   </encryption>
May 19 04:56:20.499067 np0000001025 nova-compute[97981]: </disk>
May 19 04:56:20.499067 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:56:20.548136 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:56:20.548351 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:56:20.963204 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-18185d11-5e49-4a49-9f66-1fea58b53666 req-2d97164d-c469-4670-9aa8-b5cbc8ec5b02 service nova] Releasing lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:56:21.003862 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779166581.0034947, 1dc1a2a6-1666-417c-999b-fddeb8fb7589 => ua-d92cf7da-1d62-4a85-888f-f14cae592277> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:56:21.004677 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d92cf7da-1d62-4a85-888f-f14cae592277 for instance 1dc1a2a6-1666-417c-999b-fddeb8fb7589 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:56:21.006980 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Successfully detached device vdb from instance 1dc1a2a6-1666-417c-999b-fddeb8fb7589 from the live domain config.
May 19 04:56:21.009286 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:56:21.009932 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277', 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd92cf7da-1d62-4a85-888f-f14cae592277', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:56:21.009932 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:56:21.010163 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:56:21.010527 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277', 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd92cf7da-1d62-4a85-888f-f14cae592277', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:56:21.010681 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:56:21.034519 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277 (non-flash)
May 19 04:56:21.034519 np0000001025 nova-compute[97981]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277 (non-flash)
May 19 04:56:21.034519 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:56:21.034669 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277 (non-flash)
May 19 04:56:21.034669 np0000001025 nova-compute[97981]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277 (non-flash)
May 19 04:56:21.034669 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:56:21.034806 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277', '210')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:56:21.034904 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277', '209')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:56:21.035603 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277', '210')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:56:21.036172 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72183430e840>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277'): ({'sdc'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:56:21.036380 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Removing multipathed devices sdc, sdb {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:56:21.036616 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Flush multipath device 3300000003dc92486 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:56:21.050955 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:56:21.073120 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:56:21.124698 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:56:21.165577 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:56:21.165762 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:56:21.166505 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:56:21.177047 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:56:21.177267 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:56:21.188524 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:21.212862 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 209, target: iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277, portal: 192.168.40.100,3260]
May 19 04:56:21.212862 np0000001025 nova-compute[97981]: Logout of [sid: 209, target: iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277, portal: 192.168.40.100,3260] successful.
May 19 04:56:21.212862 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:21.223901 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:21.233738 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:21.266907 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 210, target: iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277, portal: 192.168.50.100,3260]
May 19 04:56:21.266907 np0000001025 nova-compute[97981]: Logout of [sid: 210, target: iqn.2023-03.storpool.com:os--volume-d92cf7da-1d62-4a85-888f-f14cae592277, portal: 192.168.50.100,3260] successful.
May 19 04:56:21.266907 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:21.277189 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:21.278031 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:56:21.278096 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] <== disconnect_volume: return (268ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:56:21.278236 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:56:21.557803 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.124s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:56:21.821998 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lazy-loading 'flavor' on Instance uuid 1dc1a2a6-1666-417c-999b-fddeb8fb7589 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:56:22.063252 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-81142970-8cea-45c6-b747-9d2871f15c89 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 8.193s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:56:22.114731 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:56:22.114903 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:56:22.115034 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Unshelving
May 19 04:56:22.826635 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-bf11fd2f-a223-4cff-b3ce-54959d2b3677 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.931s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:56:22.979071 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:23.122368 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Booting with volume 38784990-34f2-4fa8-a574-265dcda0e395 at /dev/vda
May 19 04:56:23.136317 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:56:23.136461 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:56:23.136612 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:56:23.136742 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:56:23.136875 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:56:23.138419 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Terminating instance
May 19 04:56:23.155380 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:56:23.166009 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:56:23.186297 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:56:23.231071 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:56:23.231324 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:56:23.239806 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:56:23.240738 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fec2:716', 'fe80::1c6c:ff:fe04:9b0e'] 
May 19 04:56:23.240859 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:56:23.240946 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:56:23.241241 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:56:23.241432 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Updating existing volume attachment record: 67b5f1fe-023b-4923-a0bd-05b6259e035f {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:56:23.640956 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:56:23.656126 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:23.673318 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:23.678326 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:23.693330 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:23.700909 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:23.769799 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d15b8b08-518e-4095-b9cf-03aa99bb9957 req-f1cbe3d6-a977-47ee-9b8a-8e3d52a2462c service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Received event network-vif-unplugged-4c752ea3-d17a-43fd-884c-b431a879d355 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:56:23.770073 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d15b8b08-518e-4095-b9cf-03aa99bb9957 req-f1cbe3d6-a977-47ee-9b8a-8e3d52a2462c service nova] Acquiring lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:56:23.770744 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d15b8b08-518e-4095-b9cf-03aa99bb9957 req-f1cbe3d6-a977-47ee-9b8a-8e3d52a2462c service nova] Lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:56:23.770999 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-d15b8b08-518e-4095-b9cf-03aa99bb9957 req-f1cbe3d6-a977-47ee-9b8a-8e3d52a2462c service nova] Lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:56:23.771275 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d15b8b08-518e-4095-b9cf-03aa99bb9957 req-f1cbe3d6-a977-47ee-9b8a-8e3d52a2462c service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] No waiting events found dispatching network-vif-unplugged-4c752ea3-d17a-43fd-884c-b431a879d355 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:56:23.771275 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-d15b8b08-518e-4095-b9cf-03aa99bb9957 req-f1cbe3d6-a977-47ee-9b8a-8e3d52a2462c service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Received event network-vif-unplugged-4c752ea3-d17a-43fd-884c-b431a879d355 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:56:23.950812 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999721492999925 future=<Future at 0x72185019b560 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:56:23.952648 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Instance destroyed successfully.
May 19 04:56:23.953068 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lazy-loading 'resources' on Instance uuid 1dc1a2a6-1666-417c-999b-fddeb8fb7589 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:56:24.455444 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:55:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-375549394',display_name='tempest-TestEncryptedCinderVolumes-server-375549394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testencryptedcindervolumes-server-375549394',id=77,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVofLCVEuPupiOK7uU1vdNDzzJC6TYJ3MrBpeKTHmYhjH68FayDsb6uxXCu0nDELneek0Hp1Xz2uKqAOsDETblgys7W5/fyog9bUeBZYE+0dqs1MXsJ+39D22o1BXFaxA==',key_name='tempest-keypair-892538175',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:55:30Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36ff6589269d4d73acf3d5d205b75622',ramdisk_id='',reservation_id='r-khdw9h8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-282543688',owner_user_name='tempest-TestEncryptedCinderVolumes-282543688-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:55:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6720ecdbe3414d4eac1542d35d21d5ea',uuid=1dc1a2a6-1666-417c-999b-fddeb8fb7589,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c752ea3-d17a-43fd-884c-b431a879d355", "address": "fa:16:3e:c2:07:16", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c752ea3-d1", "ovs_interfaceid": "4c752ea3-d17a-43fd-884c-b431a879d355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:56:24.455642 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Converting VIF {"id": "4c752ea3-d17a-43fd-884c-b431a879d355", "address": "fa:16:3e:c2:07:16", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c752ea3-d1", "ovs_interfaceid": "4c752ea3-d17a-43fd-884c-b431a879d355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:56:24.456213 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:07:16,bridge_name='br-int',has_traffic_filtering=True,id=4c752ea3-d17a-43fd-884c-b431a879d355,network=Network(9c642de3-79c6-4ed4-a828-c4eba2555eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c752ea3-d1') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:56:24.456487 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:07:16,bridge_name='br-int',has_traffic_filtering=True,id=4c752ea3-d17a-43fd-884c-b431a879d355,network=Network(9c642de3-79c6-4ed4-a828-c4eba2555eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c752ea3-d1') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:56:24.457636 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:24.457843 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c752ea3-d1, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:56:24.458811 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:24.459779 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:56:24.459846 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:24.460419 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:24.460556 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e42c42a6-d5e5-4fb6-b4cc-9e98e5ec9cfa) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:56:24.461069 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:24.461613 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:56:24.461789 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:24.463265 np0000001025 nova-compute[97981]: INFO os_vif [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:07:16,bridge_name='br-int',has_traffic_filtering=True,id=4c752ea3-d17a-43fd-884c-b431a879d355,network=Network(9c642de3-79c6-4ed4-a828-c4eba2555eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c752ea3-d1')
May 19 04:56:24.463522 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Deleting instance files /opt/stack/data/nova/instances/1dc1a2a6-1666-417c-999b-fddeb8fb7589_del
May 19 04:56:24.464177 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Deletion of /opt/stack/data/nova/instances/1dc1a2a6-1666-417c-999b-fddeb8fb7589_del complete
May 19 04:56:24.855543 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:56:24.855758 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:56:24.857265 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lazy-loading 'pci_requests' on Instance uuid c1b2acdc-413f-4b94-a80d-cb2e5c966a2e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:56:24.969700 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Took 1.33 seconds to destroy the instance on the hypervisor.
May 19 04:56:24.970223 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:56:24.970474 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:56:24.970617 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:56:24.970923 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:56:25.056852 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:56:25.360361 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lazy-loading 'numa_topology' on Instance uuid c1b2acdc-413f-4b94-a80d-cb2e5c966a2e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:56:25.832533 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4fc4184f-293a-46ec-9be7-a5ee9b277962 req-40dd1126-6749-482b-baae-25f60a7e9474 service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Received event network-vif-unplugged-4c752ea3-d17a-43fd-884c-b431a879d355 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:56:25.832694 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4fc4184f-293a-46ec-9be7-a5ee9b277962 req-40dd1126-6749-482b-baae-25f60a7e9474 service nova] Acquiring lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:56:25.832844 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4fc4184f-293a-46ec-9be7-a5ee9b277962 req-40dd1126-6749-482b-baae-25f60a7e9474 service nova] Lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:56:25.833444 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-4fc4184f-293a-46ec-9be7-a5ee9b277962 req-40dd1126-6749-482b-baae-25f60a7e9474 service nova] Lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:56:25.833444 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4fc4184f-293a-46ec-9be7-a5ee9b277962 req-40dd1126-6749-482b-baae-25f60a7e9474 service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] No waiting events found dispatching network-vif-unplugged-4c752ea3-d17a-43fd-884c-b431a879d355 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:56:25.833444 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4fc4184f-293a-46ec-9be7-a5ee9b277962 req-40dd1126-6749-482b-baae-25f60a7e9474 service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Received event network-vif-unplugged-4c752ea3-d17a-43fd-884c-b431a879d355 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:56:25.833444 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4fc4184f-293a-46ec-9be7-a5ee9b277962 req-40dd1126-6749-482b-baae-25f60a7e9474 service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Received event network-vif-deleted-4c752ea3-d17a-43fd-884c-b431a879d355 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:56:25.833444 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-4fc4184f-293a-46ec-9be7-a5ee9b277962 req-40dd1126-6749-482b-baae-25f60a7e9474 service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Neutron deleted interface 4c752ea3-d17a-43fd-884c-b431a879d355; detaching it from the instance and deleting it from the info cache
May 19 04:56:25.834175 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-4fc4184f-293a-46ec-9be7-a5ee9b277962 req-40dd1126-6749-482b-baae-25f60a7e9474 service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:56:25.862597 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:56:25.862725 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Claim successful on node np0000001025
May 19 04:56:25.923646 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:56:26.336616 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-4fc4184f-293a-46ec-9be7-a5ee9b277962 req-40dd1126-6749-482b-baae-25f60a7e9474 service nova] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Detach interface failed, port_id=4c752ea3-d17a-43fd-884c-b431a879d355, reason: Instance 1dc1a2a6-1666-417c-999b-fddeb8fb7589 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:56:26.425128 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Took 1.45 seconds to deallocate network for instance.
May 19 04:56:26.930806 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:56:26.985474 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:56:26.985690 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:56:27.488030 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:56:27.993985 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.138s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:56:27.994401 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.063s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:56:27.994539 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:56:28.055131 np0000001025 nova-compute[97981]: INFO nova.network.neutron [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Updating port b6e423ea-5da0-4bb9-8d49-e59d822f4e75 with attributes {'binding:host_id': 'np0000001025', 'device_owner': 'compute:nova'}
May 19 04:56:28.140140 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:56:28.140358 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:56:28.491959 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:56:28.492332 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquired lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:56:28.492332 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:56:28.535527 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1fa09ede-8137-4d66-ab32-277b8a825086 req-cfe02f62-1201-4eb0-9ec9-029b1a714bc8 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Received event network-changed-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:56:28.535644 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-1fa09ede-8137-4d66-ab32-277b8a825086 req-cfe02f62-1201-4eb0-9ec9-029b1a714bc8 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Refreshing instance network info cache due to event network-changed-b6e423ea-5da0-4bb9-8d49-e59d822f4e75. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:56:28.536445 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1fa09ede-8137-4d66-ab32-277b8a825086 req-cfe02f62-1201-4eb0-9ec9-029b1a714bc8 service nova] Acquiring lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:56:28.642598 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:56:28.994164 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:56:29.148364 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.154s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:56:29.208269 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Deleted allocations for instance 1dc1a2a6-1666-417c-999b-fddeb8fb7589
May 19 04:56:29.261195 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:56:29.368638 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Updating instance_info_cache with network_info: [{"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": "br-int", "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:56:29.462450 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:29.870481 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Releasing lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:56:29.871768 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:56:29.872166 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1fa09ede-8137-4d66-ab32-277b8a825086 req-cfe02f62-1201-4eb0-9ec9-029b1a714bc8 service nova] Acquired lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:56:29.872330 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1fa09ede-8137-4d66-ab32-277b8a825086 req-cfe02f62-1201-4eb0-9ec9-029b1a714bc8 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Refreshing network info cache for port b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:56:29.873415 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Creating image(s)
May 19 04:56:29.874525 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:56:29.874697 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Ensure instance console log exists: /opt/stack/data/nova/instances/c1b2acdc-413f-4b94-a80d-cb2e5c966a2e/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:56:29.875094 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:56:29.875280 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:56:29.875406 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:56:29.875814 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Start _get_guest_xml network_info=[{"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": "br-int", "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '67b5f1fe-023b-4923-a0bd-05b6259e035f', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38784990-34f2-4fa8-a574-265dcda0e395', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c1b2acdc-413f-4b94-a80d-cb2e5c966a2e', 'attached_at': '', 'detached_at': '', 'volume_id': '38784990-34f2-4fa8-a574-265dcda0e395', 'serial': '38784990-34f2-4fa8-a574-265dcda0e395'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:56:29.877900 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:56:29.878988 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-1644755258', uuid='c1b2acdc-413f-4b94-a80d-cb2e5c966a2e'), owner=OwnerMeta(userid='1c02d167c3764ceaa0671926946d8920', username='tempest-TestShelveInstance-606043442-project-member', projectid='dc4772a09cd1480f9d139120e1f42892', projectname='tempest-TestShelveInstance-606043442'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": "br-int", "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166589.8787038) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:56:29.880024 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:56:29.880303 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:56:29.881097 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:56:29.881280 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:56:29.882177 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:56:29.882415 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:56:29.882536 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:56:29.882620 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:56:29.882750 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:56:29.882875 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:56:29.882997 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:56:29.883170 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:56:29.883266 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:56:29.883381 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:56:29.883482 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:56:29.883588 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:56:29.883711 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lazy-loading 'vcpu_model' on Instance uuid c1b2acdc-413f-4b94-a80d-cb2e5c966a2e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:56:30.212251 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00035350299958736286 future=<Future at 0x7218505c4bf0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:56:30.212478 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:56:30.212789 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] Emitting event <LifecycleEvent: 1779166575.2117887, c1b2acdc-413f-4b94-a80d-cb2e5c966a2e => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:56:30.212867 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=8.737634209000134 future=<Future at 0x72185019b560 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:56:30.213064 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] VM Stopped (Lifecycle Event)
May 19 04:56:30.213977 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=8.736528705000183 future=<Future at 0x72185019b560 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:56:30.216478 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-e1b181fe-6907-438a-a79b-b23a92f5eb02 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "1dc1a2a6-1666-417c-999b-fddeb8fb7589" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.080s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:56:30.375814 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-1fa09ede-8137-4d66-ab32-277b8a825086 req-cfe02f62-1201-4eb0-9ec9-029b1a714bc8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:56:30.385469 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Object Instance<c1b2acdc-413f-4b94-a80d-cb2e5c966a2e> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:56:30.393878 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:56:30.394211 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38784990-34f2-4fa8-a574-265dcda0e395', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:56:30.394352 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:56:30.394651 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:56:30.394815 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38784990-34f2-4fa8-a574-265dcda0e395', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:56:30.406146 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:56:30.406804 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:56:30.407420 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:56:30.407640 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:56:30.408227 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:56:30.408448 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:56:30.419030 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:56:30.419030 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:30.424168 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:56:30.424168 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:30.433756 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395] added
May 19 04:56:30.433756 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:56:30.433756 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:56:30.433756 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:56:30.433756 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:56:30.433756 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:56:30.433756 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:30.434138 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:56:30.434194 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0265(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:56:30.434379 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:56:30.436313 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395] added
May 19 04:56:30.436313 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:56:30.436313 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:56:30.436313 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:56:30.436313 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:56:30.436313 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:56:30.436313 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:30.436505 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:56:30.436671 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0283(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:56:30.436820 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:56:30.652304 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-1fa09ede-8137-4d66-ab32-277b8a825086 req-cfe02f62-1201-4eb0-9ec9-029b1a714bc8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:56:30.716849 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-508d0ddb-8373-4dfc-a54d-c8b6c4d6a0d4 tempest-TestEncryptedCinderVolumes-324201327 tempest-TestEncryptedCinderVolumes-324201327-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:56:30.760545 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1fa09ede-8137-4d66-ab32-277b8a825086 req-cfe02f62-1201-4eb0-9ec9-029b1a714bc8 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Updated VIF entry in instance network info cache for port b6e423ea-5da0-4bb9-8d49-e59d822f4e75. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:56:30.760758 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-1fa09ede-8137-4d66-ab32-277b8a825086 req-cfe02f62-1201-4eb0-9ec9-029b1a714bc8 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Updating instance_info_cache with network_info: [{"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": "br-int", "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:56:31.262639 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-1fa09ede-8137-4d66-ab32-277b8a825086 req-cfe02f62-1201-4eb0-9ec9-029b1a714bc8 service nova] Releasing lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:56:31.434758 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:56:31.437153 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:56:31.446665 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:56:31.446665 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:56:31.452310 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:56:31.452310 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:31.458675 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:31.464478 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:31.470797 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 19 04:56:31.470797 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:56:31.470990 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 19 04:56:31.470990 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:56:31.471101 np0000001025 nova-compute[97981]: WARNING os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 19 04:56:31.471101 np0000001025 nova-compute[97981]: 
May 19 04:56:31.476536 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 19 04:56:31.476536 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:56:31.476697 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 19 04:56:31.476697 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:56:31.476697 np0000001025 nova-compute[97981]: WARNING os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 19 04:56:31.476697 np0000001025 nova-compute[97981]: 
May 19 04:56:32.503402 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395, portal: 192.168.40.100,3260]
May 19 04:56:32.503402 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395, portal: 192.168.40.100,3260] successful.
May 19 04:56:32.503402 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:32.512680 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395, portal: 192.168.50.100,3260]
May 19 04:56:32.512680 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395, portal: 192.168.50.100,3260] successful.
May 19 04:56:32.512680 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:32.513771 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:32.523298 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:32.528750 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:32.528750 np0000001025 nova-compute[97981]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:32.528750 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:56:32.528977 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:32.528977 np0000001025 nova-compute[97981]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:32.528977 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:56:32.529189 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.122s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:56:32.529314 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:56:32.529770 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] HCTL ('7', '-', '-', 0) found on session 211 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:56:32.529868 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:56:32.535084 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:32.535084 np0000001025 nova-compute[97981]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:32.535084 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:56:32.535220 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:32.535220 np0000001025 nova-compute[97981]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:32.535220 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:56:32.535455 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.127s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:56:32.535569 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:56:32.536002 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] HCTL ('8', '-', '-', 0) found on session 212 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:56:32.536124 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:56:32.545014 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Searching for a device in session 211 and hctl ['7', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:56:32.549068 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Searching for a device in session 212 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:56:32.549249 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '38784990-34f2-4fa8-a574-265dcda0e395', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:56:33.545663 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Searching for a device in session 211 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:56:33.546091 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38784990-34f2-4fa8-a574-265dcda0e395', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:56:34.424196 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Found WWN 330000000f52b2e61 for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:56:34.424541 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.030s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:56:34.424702 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] <== connect_volume: return (4030ms) {'type': 'block', 'scsi_wwn': '330000000f52b2e61', 'path': '/dev/dm-0', 'multipath_id': '330000000f52b2e61'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:56:34.424811 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f52b2e61', 'path': '/dev/dm-0', 'multipath_id': '330000000f52b2e61'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:56:34.463424 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:34.929689 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-19T04:55:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1644755258',display_name='tempest-TestShelveInstance-server-1644755258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testshelveinstance-server-1644755258',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1648700680',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:55:47Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='dc4772a09cd1480f9d139120e1f42892',ramdisk_id='',reservation_id='r-e8s6y7hb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-606043442',owner_user_name='tempest-TestShelveInstance-606043442-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:56:23Z,user_data=None,user_id='1c02d167c3764ceaa0671926946d8920',uuid=c1b2acdc-413f-4b94-a80d-cb2e5c966a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": "br-int", "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:56:34.930207 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Converting VIF {"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": "br-int", "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:56:34.930474 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2d:01,bridge_name='br-int',has_traffic_filtering=True,id=b6e423ea-5da0-4bb9-8d49-e59d822f4e75,network=Network(15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e423ea-5d') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:56:34.931169 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lazy-loading 'pci_devices' on Instance uuid c1b2acdc-413f-4b94-a80d-cb2e5c966a2e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:56:35.432832 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Object Instance<c1b2acdc-413f-4b94-a80d-cb2e5c966a2e> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:56:35.434159 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] End _get_guest_xml xml=<domain type="qemu">
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:   <uuid>c1b2acdc-413f-4b94-a80d-cb2e5c966a2e</uuid>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:   <name>instance-0000004e</name>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestShelveInstance-server-1644755258</nova:name>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:56:29</nova:creationTime>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:           <nova:property name="hw_machine_type">pc</nova:property>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:           <nova:property name="hw_video_model">virtio</nova:property>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:         <nova:user uuid="1c02d167c3764ceaa0671926946d8920">tempest-TestShelveInstance-606043442-project-member</nova:user>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:         <nova:project uuid="dc4772a09cd1480f9d139120e1f42892">tempest-TestShelveInstance-606043442</nova:project>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:         <nova:port uuid="b6e423ea-5da0-4bb9-8d49-e59d822f4e75">
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     <system>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <entry name="serial">c1b2acdc-413f-4b94-a80d-cb2e5c966a2e</entry>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <entry name="uuid">c1b2acdc-413f-4b94-a80d-cb2e5c966a2e</entry>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     </system>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:   <os>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:   </os>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:   <features>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:   </features>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:   <devices>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/c1b2acdc-413f-4b94-a80d-cb2e5c966a2e/disk.config"/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     </disk>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <alias name="ua-38784990-34f2-4fa8-a574-265dcda0e395"/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <source dev="/dev/dm-0"/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <serial>38784990-34f2-4fa8-a574-265dcda0e395</serial>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     </disk>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:c0:2d:01"/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <target dev="tapb6e423ea-5d"/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     </interface>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/c1b2acdc-413f-4b94-a80d-cb2e5c966a2e/console.log" append="off"/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     </serial>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     <video>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     </video>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     </rng>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:   </devices>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]: </domain>
May 19 04:56:35.434159 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:56:35.436388 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Preparing to wait for external event network-vif-plugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:56:35.436388 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:56:35.436388 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:56:35.436388 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:56:35.436388 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-19T04:55:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1644755258',display_name='tempest-TestShelveInstance-server-1644755258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testshelveinstance-server-1644755258',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1648700680',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:55:47Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='dc4772a09cd1480f9d139120e1f42892',ramdisk_id='',reservation_id='r-e8s6y7hb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-606043442',owner_user_name='tempest-TestShelveInstance-606043442-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:56:23Z,user_data=None,user_id='1c02d167c3764ceaa0671926946d8920',uuid=c1b2acdc-413f-4b94-a80d-cb2e5c966a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": "br-int", "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:56:35.436388 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Converting VIF {"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": "br-int", "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:56:35.436901 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2d:01,bridge_name='br-int',has_traffic_filtering=True,id=b6e423ea-5da0-4bb9-8d49-e59d822f4e75,network=Network(15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e423ea-5d') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:56:35.437176 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2d:01,bridge_name='br-int',has_traffic_filtering=True,id=b6e423ea-5da0-4bb9-8d49-e59d822f4e75,network=Network(15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e423ea-5d') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:56:35.437674 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:35.437918 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:56:35.438213 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:56:35.438837 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:35.439017 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6675a0df-6c0f-503f-9000-8dc099c8e665', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:56:35.449993 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:35.452924 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:56:35.454901 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:35.455091 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6e423ea-5d, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:56:35.455450 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb6e423ea-5d, col_values=(('qos', UUID('86ef7841-fecb-43fa-9720-159bb8a71b1c')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:56:35.455624 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb6e423ea-5d, col_values=(('external_ids', {'iface-id': 'b6e423ea-5da0-4bb9-8d49-e59d822f4e75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:2d:01', 'vm-uuid': 'c1b2acdc-413f-4b94-a80d-cb2e5c966a2e'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:56:35.456498 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:35.457535 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:56:35.464448 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:35.465542 np0000001025 nova-compute[97981]: INFO os_vif [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2d:01,bridge_name='br-int',has_traffic_filtering=True,id=b6e423ea-5da0-4bb9-8d49-e59d822f4e75,network=Network(15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e423ea-5d')
May 19 04:56:35.615256 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:56:35.615419 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Cleaning up deleted instances with incomplete migration  {{(pid=97981) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 19 04:56:36.117237 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.99 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:56:36.981965 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:56:36.982148 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:56:36.982216 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] No VIF found with MAC fa:16:3e:c0:2d:01, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:56:36.982640 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Using config drive
May 19 04:56:37.484951 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lazy-loading 'ec2_ids' on Instance uuid c1b2acdc-413f-4b94-a80d-cb2e5c966a2e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:56:37.988001 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Object Instance<c1b2acdc-413f-4b94-a80d-cb2e5c966a2e> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:56:37.988133 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lazy-loading 'keypairs' on Instance uuid c1b2acdc-413f-4b94-a80d-cb2e5c966a2e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:56:38.490227 np0000001025 nova-compute[97981]: DEBUG nova.objects.base [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Object Instance<c1b2acdc-413f-4b94-a80d-cb2e5c966a2e> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97981) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 19 04:56:38.492510 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:56:38.600464 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Creating config drive at /opt/stack/data/nova/instances/c1b2acdc-413f-4b94-a80d-cb2e5c966a2e/disk.config
May 19 04:56:38.603361 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c1b2acdc-413f-4b94-a80d-cb2e5c966a2e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwtjtd6y2 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:56:38.658643 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c1b2acdc-413f-4b94-a80d-cb2e5c966a2e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwtjtd6y2" returned: 0 in 0.055s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:56:38.951102 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0005411689999164082 future=<Future at 0x72185019b560 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:56:38.951886 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] Emitting event <LifecycleEvent: 1779166583.9504266, 1dc1a2a6-1666-417c-999b-fddeb8fb7589 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:56:38.952119 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:56:38.952338 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] VM Stopped (Lifecycle Event)
May 19 04:56:39.019313 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:39.040412 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:39.134523 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:39.136627 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:39.185185 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b70210b2-0172-4fad-afdc-41636b979938 req-a582935b-8a9b-422b-a308-cad6c4aaba80 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Received event network-vif-plugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:56:39.185458 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b70210b2-0172-4fad-afdc-41636b979938 req-a582935b-8a9b-422b-a308-cad6c4aaba80 service nova] Acquiring lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:56:39.185695 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b70210b2-0172-4fad-afdc-41636b979938 req-a582935b-8a9b-422b-a308-cad6c4aaba80 service nova] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:56:39.185839 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-b70210b2-0172-4fad-afdc-41636b979938 req-a582935b-8a9b-422b-a308-cad6c4aaba80 service nova] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:56:39.185958 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-b70210b2-0172-4fad-afdc-41636b979938 req-a582935b-8a9b-422b-a308-cad6c4aaba80 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Processing event network-vif-plugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:56:39.319837 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:39.321344 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:39.323269 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:39.339207 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:39.456075 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-fc94744a-dc5e-4daa-8721-d02944246008 tempest-TestVolumeBootPattern-1071176852 tempest-TestVolumeBootPattern-1071176852-project-member] [instance: 1dc1a2a6-1666-417c-999b-fddeb8fb7589] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:56:39.716792 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166599.7164307, c1b2acdc-413f-4b94-a80d-cb2e5c966a2e => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:56:39.717224 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:56:39.717465 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] VM Started (Lifecycle Event)
May 19 04:56:39.719226 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:56:39.721173 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Instance spawned successfully.
May 19 04:56:39.721505 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:56:40.222464 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:56:40.224342 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:56:40.231865 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-9f84cfe5-97fe-4b8d-949f-0e844fc120da tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.117s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:56:40.463139 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:40.726649 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166600.7263281, c1b2acdc-413f-4b94-a80d-cb2e5c966a2e => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:56:40.727148 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] VM Paused (Lifecycle Event)
May 19 04:56:41.229019 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:56:41.233550 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166601.2332788, c1b2acdc-413f-4b94-a80d-cb2e5c966a2e => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:56:41.233679 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] VM Resumed (Lifecycle Event)
May 19 04:56:41.255281 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-58248640-fae0-44c1-ab83-0db517ce5a5d req-1c499aa7-a826-4650-92b2-bed92a0f5d58 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Received event network-vif-plugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:56:41.255281 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-58248640-fae0-44c1-ab83-0db517ce5a5d req-1c499aa7-a826-4650-92b2-bed92a0f5d58 service nova] Acquiring lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:56:41.255281 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-58248640-fae0-44c1-ab83-0db517ce5a5d req-1c499aa7-a826-4650-92b2-bed92a0f5d58 service nova] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:56:41.255743 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-58248640-fae0-44c1-ab83-0db517ce5a5d req-1c499aa7-a826-4650-92b2-bed92a0f5d58 service nova] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:56:41.256193 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-58248640-fae0-44c1-ab83-0db517ce5a5d req-1c499aa7-a826-4650-92b2-bed92a0f5d58 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] No waiting events found dispatching network-vif-plugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:56:41.256471 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-58248640-fae0-44c1-ab83-0db517ce5a5d req-1c499aa7-a826-4650-92b2-bed92a0f5d58 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Received unexpected event network-vif-plugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 for instance with vm_state active and task_state None.
May 19 04:56:41.735886 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:56:41.737755 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:56:44.054314 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:44.112282 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:56:44.112713 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:56:44.112985 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.50 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:56:45.479811 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:45.615215 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:56:45.615616 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:56:46.615471 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:56:46.615976 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:56:47.614809 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:56:47.615113 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:56:47.615441 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:56:48.615130 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:56:48.948676 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "a8015855-2986-4d03-ae6f-a2b7a27fc7b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:56:48.948825 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "a8015855-2986-4d03-ae6f-a2b7a27fc7b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:56:49.067088 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:49.117283 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:56:49.450446 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:56:50.063979 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:56:50.064376 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:56:50.067122 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:56:50.067251 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Claim successful on node np0000001025
May 19 04:56:50.481730 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:51.117354 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:56:51.117679 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Cleaning up deleted instances {{(pid=97981) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 19 04:56:51.193225 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:56:51.193413 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:56:51.621357 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] There are 0 instances to clean {{(pid=97981) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 19 04:56:51.621655 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.50 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:56:51.695956 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:56:52.201766 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.137s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:56:52.202244 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:56:52.707424 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:56:52.707749 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:56:52.708032 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:56:52.708311 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:56:52.792897 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6720ecdbe3414d4eac1542d35d21d5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ff6589269d4d73acf3d5d205b75622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:56:53.158934 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Successfully created port: b465695f-9ee9-4149-b57d-f2ce136d6eaa {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:56:53.210475 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:56:53.579661 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Successfully updated port: b465695f-9ee9-4149-b57d-f2ce136d6eaa {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:56:53.626855 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-05b44daa-d38f-49d2-b6bb-b8abfa526b43 req-d4b948a0-7e64-4c33-a5ab-50f759785709 service nova] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Received event network-changed-b465695f-9ee9-4149-b57d-f2ce136d6eaa {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:56:53.626986 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-05b44daa-d38f-49d2-b6bb-b8abfa526b43 req-d4b948a0-7e64-4c33-a5ab-50f759785709 service nova] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Refreshing instance network info cache due to event network-changed-b465695f-9ee9-4149-b57d-f2ce136d6eaa. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:56:53.627154 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-05b44daa-d38f-49d2-b6bb-b8abfa526b43 req-d4b948a0-7e64-4c33-a5ab-50f759785709 service nova] Acquiring lock "refresh_cache-a8015855-2986-4d03-ae6f-a2b7a27fc7b3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:56:53.627320 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-05b44daa-d38f-49d2-b6bb-b8abfa526b43 req-d4b948a0-7e64-4c33-a5ab-50f759785709 service nova] Acquired lock "refresh_cache-a8015855-2986-4d03-ae6f-a2b7a27fc7b3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:56:53.627421 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-05b44daa-d38f-49d2-b6bb-b8abfa526b43 req-d4b948a0-7e64-4c33-a5ab-50f759785709 service nova] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Refreshing network info cache for port b465695f-9ee9-4149-b57d-f2ce136d6eaa {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:56:53.713966 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:56:54.077138 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:54.081483 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "refresh_cache-a8015855-2986-4d03-ae6f-a2b7a27fc7b3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:56:54.129257 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-05b44daa-d38f-49d2-b6bb-b8abfa526b43 req-d4b948a0-7e64-4c33-a5ab-50f759785709 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:56:54.191837 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-05b44daa-d38f-49d2-b6bb-b8abfa526b43 req-d4b948a0-7e64-4c33-a5ab-50f759785709 service nova] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:56:54.218077 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Booting with volume 60508634-a505-45be-8f7d-86ef43c5cabc at /dev/vda
May 19 04:56:54.262663 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:56:54.274607 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:56:54.300907 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:56:54.329819 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-05b44daa-d38f-49d2-b6bb-b8abfa526b43 req-d4b948a0-7e64-4c33-a5ab-50f759785709 service nova] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:56:54.349514 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:56:54.349951 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:56:54.358181 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:56:54.359464 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fec0:2d01', 'fe80::acfb:13ff:fed0:d3e1'] 
May 19 04:56:54.359649 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:56:54.359784 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:56:54.360086 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:56:54.360372 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Updating existing volume attachment record: c99ee2a9-8662-48c6-bd3e-160d35b58709 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:56:54.833957 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-05b44daa-d38f-49d2-b6bb-b8abfa526b43 req-d4b948a0-7e64-4c33-a5ab-50f759785709 service nova] Releasing lock "refresh_cache-a8015855-2986-4d03-ae6f-a2b7a27fc7b3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:56:54.834685 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquired lock "refresh_cache-a8015855-2986-4d03-ae6f-a2b7a27fc7b3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:56:54.834789 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:56:55.403620 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:56:55.489042 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:55.567639 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:56:55.691463 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Updating instance_info_cache with network_info: [{"id": "b465695f-9ee9-4149-b57d-f2ce136d6eaa", "address": "fa:16:3e:20:82:a3", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb465695f-9e", "ovs_interfaceid": "b465695f-9ee9-4149-b57d-f2ce136d6eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:56:56.119507 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:56:56.119664 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:56:56.119959 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.49 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:56:56.193420 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Releasing lock "refresh_cache-a8015855-2986-4d03-ae6f-a2b7a27fc7b3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:56:56.193714 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Instance network_info: |[{"id": "b465695f-9ee9-4149-b57d-f2ce136d6eaa", "address": "fa:16:3e:20:82:a3", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb465695f-9e", "ovs_interfaceid": "b465695f-9ee9-4149-b57d-f2ce136d6eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:56:56.461642 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:56:56.462792 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:56:56.463034 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Creating image(s)
May 19 04:56:56.463365 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:56:56.463518 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Ensure instance console log exists: /opt/stack/data/nova/instances/a8015855-2986-4d03-ae6f-a2b7a27fc7b3/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:56:56.463732 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:56:56.463949 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:56:56.464067 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:56:56.464559 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Start _get_guest_xml network_info=[{"id": "b465695f-9ee9-4149-b57d-f2ce136d6eaa", "address": "fa:16:3e:20:82:a3", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb465695f-9e", "ovs_interfaceid": "b465695f-9ee9-4149-b57d-f2ce136d6eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'c99ee2a9-8662-48c6-bd3e-160d35b58709', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc', 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '60508634-a505-45be-8f7d-86ef43c5cabc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a8015855-2986-4d03-ae6f-a2b7a27fc7b3', 'attached_at': '', 'detached_at': '', 'volume_id': '60508634-a505-45be-8f7d-86ef43c5cabc', 'serial': '60508634-a505-45be-8f7d-86ef43c5cabc'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:56:56.468917 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:56:56.470072 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-774532575', uuid='a8015855-2986-4d03-ae6f-a2b7a27fc7b3'), owner=OwnerMeta(userid='6720ecdbe3414d4eac1542d35d21d5ea', username='tempest-TestEncryptedCinderVolumes-282543688-project-member', projectid='36ff6589269d4d73acf3d5d205b75622', projectname='tempest-TestEncryptedCinderVolumes-282543688'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b465695f-9ee9-4149-b57d-f2ce136d6eaa", "address": "fa:16:3e:20:82:a3", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb465695f-9e", "ovs_interfaceid": "b465695f-9ee9-4149-b57d-f2ce136d6eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166616.469736) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:56:56.471132 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:56:56.471499 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:56:56.472486 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:56:56.472683 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:56:56.473677 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:56:56.473946 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:56:56.474088 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:56:56.474215 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:56:56.474339 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:56:56.474446 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:56:56.474567 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:56:56.474752 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:56:56.474872 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:56:56.475001 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:56:56.475126 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:56:56.475281 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:56:56.485824 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:56:56.486213 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc', 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '60508634-a505-45be-8f7d-86ef43c5cabc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:56:56.486358 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:56:56.486703 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:56:56.486896 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc', 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '60508634-a505-45be-8f7d-86ef43c5cabc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:56:56.501155 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:56:56.501895 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:56:56.502533 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:56:56.502771 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:56:56.503265 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:56:56.504365 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:56:56.514721 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:56:56.514721 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:56.519720 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:56:56.519720 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:56.528536 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc] added
May 19 04:56:56.528536 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:56:56.528536 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:56:56.528536 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:56:56.528536 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:56:56.528536 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:56:56.528536 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:56.528904 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:56:56.528904 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0261(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:56:56.529072 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:56:56.530671 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc] added
May 19 04:56:56.530671 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:56:56.530671 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:56:56.530671 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:56:56.530671 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:56:56.530671 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:56:56.530671 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:56.530914 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:56:56.530984 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:56:56.531133 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:56:57.529497 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:56:57.531567 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:56:57.541479 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:56:57.541479 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:56:57.546202 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:56:57.546202 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:57.553510 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:57.557660 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:57.566016 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:57.566016 np0000001025 nova-compute[97981]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:57.566016 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:56:57.566190 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:57.566190 np0000001025 nova-compute[97981]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:57.566190 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:56:57.570464 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:57.570464 np0000001025 nova-compute[97981]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:57.570464 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:56:57.570579 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:57.570579 np0000001025 nova-compute[97981]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:57.570579 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:56:57.596807 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc, portal: 192.168.50.100,3260]
May 19 04:56:57.596807 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc, portal: 192.168.50.100,3260] successful.
May 19 04:56:57.596807 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:57.604061 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc, portal: 192.168.40.100,3260]
May 19 04:56:57.604061 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc, portal: 192.168.40.100,3260] successful.
May 19 04:56:57.604061 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:57.608264 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:57.614665 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:56:57.615104 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:56:57.622374 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:57.622374 np0000001025 nova-compute[97981]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:57.622374 np0000001025 nova-compute[97981]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc (non-flash)
May 19 04:56:57.622374 np0000001025 nova-compute[97981]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc (non-flash)
May 19 04:56:57.622374 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:56:57.622525 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:57.622525 np0000001025 nova-compute[97981]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:57.622525 np0000001025 nova-compute[97981]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc (non-flash)
May 19 04:56:57.622525 np0000001025 nova-compute[97981]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc (non-flash)
May 19 04:56:57.622525 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:56:57.622754 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.120s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:56:57.622754 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:56:57.623377 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] HCTL ('9', '-', '-', 0) found on session 215 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:56:57.623488 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:56:57.628596 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:57.628596 np0000001025 nova-compute[97981]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:57.628596 np0000001025 nova-compute[97981]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc (non-flash)
May 19 04:56:57.628596 np0000001025 nova-compute[97981]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc (non-flash)
May 19 04:56:57.628596 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:56:57.628733 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:57.628733 np0000001025 nova-compute[97981]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:56:57.628733 np0000001025 nova-compute[97981]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc (non-flash)
May 19 04:56:57.628733 np0000001025 nova-compute[97981]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc (non-flash)
May 19 04:56:57.628733 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:56:57.628929 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.126s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:56:57.629047 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:56:57.629607 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] HCTL ('10', '-', '-', 0) found on session 216 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:56:57.629714 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:56:57.638759 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Searching for a device in session 215 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:56:57.638759 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '60508634-a505-45be-8f7d-86ef43c5cabc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:56:57.643718 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Searching for a device in session 216 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:56:57.643718 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '60508634-a505-45be-8f7d-86ef43c5cabc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:56:58.119341 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:56:58.119561 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:56:58.119720 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:56:58.119893 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:56:58.503313 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:56:59.088071 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:56:59.138841 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97981) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 19 04:56:59.140319 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:56:59.140991 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:56:59.188640 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:56:59.189035 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=14013MB free_disk=72.70841979980469GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:56:59.189246 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:56:59.189518 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:56:59.518035 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Found WWN 330000000e5260241 for multipath device dm-3 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:56:59.518455 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:56:59.519448 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000e5260241', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '330000000e5260241'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:56:59.519599 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e5260241', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '330000000e5260241'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:56:59.547267 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc', 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '60508634-a505-45be-8f7d-86ef43c5cabc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': 'a8015855-2986-4d03-ae6f-a2b7a27fc7b3', 'attached_at': '', 'detached_at': '', 'volume_id': '60508634-a505-45be-8f7d-86ef43c5cabc', 'serial': '60508634-a505-45be-8f7d-86ef43c5cabc'} {{(pid=97981) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 19 04:56:59.547824 np0000001025 nova-compute[97981]: WARNING stevedore.named [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 19 04:56:59.548010 np0000001025 nova-compute[97981]: WARNING castellan.key_manager [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:56:59.548173 np0000001025 nova-compute[97981]: WARNING nova.keymgr.conf_key_mgr [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:56:59.560711 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Secret XML: <secret ephemeral="no" private="no">
May 19 04:56:59.560711 np0000001025 nova-compute[97981]:   <usage type="volume">
May 19 04:56:59.560711 np0000001025 nova-compute[97981]:     <volume>60508634-a505-45be-8f7d-86ef43c5cabc</volume>
May 19 04:56:59.560711 np0000001025 nova-compute[97981]:   </usage>
May 19 04:56:59.560711 np0000001025 nova-compute[97981]: </secret>
May 19 04:56:59.560711 np0000001025 nova-compute[97981]:  {{(pid=97981) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 19 04:57:00.068201 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-774532575',display_name='tempest-TestEncryptedCinderVolumes-server-774532575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testencryptedcindervolumes-server-774532575',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA410ze8YCe4u0aQqRN7DK7tE+RlkrXnaPJ+kTcfp9spowhXSxOTwnVQ3dJGH9s2vpjJhGWVHtfzElrJfvMHEniTuVA/lwcQsaFNpsSY+VsU4ZoX+Fw7jYVfDjGnBWgj4g==',key_name='tempest-TestEncryptedCinderVolumes-1821693556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36ff6589269d4d73acf3d5d205b75622',ramdisk_id='',reservation_id='r-3x4bxix5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-282543688',owner_user_name='tempest-TestEncryptedCinderVolumes-282543688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:56:54Z,user_data=None,user_id='6720ecdbe3414d4eac1542d35d21d5ea',uuid=a8015855-2986-4d03-ae6f-a2b7a27fc7b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b465695f-9ee9-4149-b57d-f2ce136d6eaa", "address": "fa:16:3e:20:82:a3", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb465695f-9e", "ovs_interfaceid": "b465695f-9ee9-4149-b57d-f2ce136d6eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:57:00.068508 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Converting VIF {"id": "b465695f-9ee9-4149-b57d-f2ce136d6eaa", "address": "fa:16:3e:20:82:a3", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb465695f-9e", "ovs_interfaceid": "b465695f-9ee9-4149-b57d-f2ce136d6eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:57:00.069060 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:82:a3,bridge_name='br-int',has_traffic_filtering=True,id=b465695f-9ee9-4149-b57d-f2ce136d6eaa,network=Network(9c642de3-79c6-4ed4-a828-c4eba2555eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb465695f-9e') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:57:00.070101 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lazy-loading 'pci_devices' on Instance uuid a8015855-2986-4d03-ae6f-a2b7a27fc7b3 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:57:00.247932 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance c1b2acdc-413f-4b94-a80d-cb2e5c966a2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:57:00.248304 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance a8015855-2986-4d03-ae6f-a2b7a27fc7b3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:57:00.248304 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:57:00.248446 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:56:59 up 47 min,  2 users,  load average: 1.58, 2.87, 3.45\n', 'num_instances': '2', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '2', 'num_proj_dc4772a09cd1480f9d139120e1f42892': '1', 'io_workload': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_36ff6589269d4d73acf3d5d205b75622': '1'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:57:00.379173 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:57:00.379422 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:57:00.502857 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:00.574032 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] End _get_guest_xml xml=<domain type="qemu">
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:   <uuid>a8015855-2986-4d03-ae6f-a2b7a27fc7b3</uuid>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:   <name>instance-0000004f</name>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-774532575</nova:name>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:56:56</nova:creationTime>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:         <nova:user uuid="6720ecdbe3414d4eac1542d35d21d5ea">tempest-TestEncryptedCinderVolumes-282543688-project-member</nova:user>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:         <nova:project uuid="36ff6589269d4d73acf3d5d205b75622">tempest-TestEncryptedCinderVolumes-282543688</nova:project>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:         <nova:port uuid="b465695f-9ee9-4149-b57d-f2ce136d6eaa">
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     <system>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <entry name="serial">a8015855-2986-4d03-ae6f-a2b7a27fc7b3</entry>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <entry name="uuid">a8015855-2986-4d03-ae6f-a2b7a27fc7b3</entry>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     </system>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:   <os>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:   </os>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:   <features>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:   </features>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:   <devices>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/a8015855-2986-4d03-ae6f-a2b7a27fc7b3/disk.config"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     </disk>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <alias name="ua-60508634-a505-45be-8f7d-86ef43c5cabc"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <serial>60508634-a505-45be-8f7d-86ef43c5cabc</serial>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <encryption format="luks">
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:         <secret type="passphrase" uuid="75183bf0-94c7-4a77-a73a-3e7e6c535cd7"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       </encryption>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     </disk>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:20:82:a3"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <target dev="tapb465695f-9e"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     </interface>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/a8015855-2986-4d03-ae6f-a2b7a27fc7b3/console.log" append="off"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     </serial>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     <video>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     </video>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     </rng>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:   </devices>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]: </domain>
May 19 04:57:00.574032 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:57:00.577607 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Preparing to wait for external event network-vif-plugged-b465695f-9ee9-4149-b57d-f2ce136d6eaa {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:57:00.577607 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "a8015855-2986-4d03-ae6f-a2b7a27fc7b3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:57:00.577607 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "a8015855-2986-4d03-ae6f-a2b7a27fc7b3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:57:00.577607 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "a8015855-2986-4d03-ae6f-a2b7a27fc7b3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:57:00.577607 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-774532575',display_name='tempest-TestEncryptedCinderVolumes-server-774532575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testencryptedcindervolumes-server-774532575',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA410ze8YCe4u0aQqRN7DK7tE+RlkrXnaPJ+kTcfp9spowhXSxOTwnVQ3dJGH9s2vpjJhGWVHtfzElrJfvMHEniTuVA/lwcQsaFNpsSY+VsU4ZoX+Fw7jYVfDjGnBWgj4g==',key_name='tempest-TestEncryptedCinderVolumes-1821693556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36ff6589269d4d73acf3d5d205b75622',ramdisk_id='',reservation_id='r-3x4bxix5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-282543688',owner_user_name='tempest-TestEncryptedCinderVolumes-282543688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:56:54Z,user_data=None,user_id='6720ecdbe3414d4eac1542d35d21d5ea',uuid=a8015855-2986-4d03-ae6f-a2b7a27fc7b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b465695f-9ee9-4149-b57d-f2ce136d6eaa", "address": "fa:16:3e:20:82:a3", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb465695f-9e", "ovs_interfaceid": "b465695f-9ee9-4149-b57d-f2ce136d6eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:57:00.577607 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Converting VIF {"id": "b465695f-9ee9-4149-b57d-f2ce136d6eaa", "address": "fa:16:3e:20:82:a3", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb465695f-9e", "ovs_interfaceid": "b465695f-9ee9-4149-b57d-f2ce136d6eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:57:00.577607 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:82:a3,bridge_name='br-int',has_traffic_filtering=True,id=b465695f-9ee9-4149-b57d-f2ce136d6eaa,network=Network(9c642de3-79c6-4ed4-a828-c4eba2555eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb465695f-9e') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:57:00.577607 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:82:a3,bridge_name='br-int',has_traffic_filtering=True,id=b465695f-9ee9-4149-b57d-f2ce136d6eaa,network=Network(9c642de3-79c6-4ed4-a828-c4eba2555eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb465695f-9e') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:57:00.577607 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:00.577607 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:57:00.577607 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:57:00.578535 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:00.578723 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15f01184-4067-58d3-b51e-81350ed2046a', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:57:00.579665 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:00.580355 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:57:00.580672 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:00.582483 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:00.582657 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb465695f-9e, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:57:00.582993 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb465695f-9e, col_values=(('qos', UUID('2d507383-49ff-45e6-9f53-fadd73c8d2e4')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:57:00.583194 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb465695f-9e, col_values=(('external_ids', {'iface-id': 'b465695f-9ee9-4149-b57d-f2ce136d6eaa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:82:a3', 'vm-uuid': 'a8015855-2986-4d03-ae6f-a2b7a27fc7b3'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:57:00.583930 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:00.585371 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:57:00.589837 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:00.590821 np0000001025 nova-compute[97981]: INFO os_vif [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:82:a3,bridge_name='br-int',has_traffic_filtering=True,id=b465695f-9ee9-4149-b57d-f2ce136d6eaa,network=Network(9c642de3-79c6-4ed4-a828-c4eba2555eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb465695f-9e')
May 19 04:57:00.882237 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:57:01.388915 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:57:01.389417 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.200s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:57:01.389526 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.99 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:57:02.105588 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:57:02.105727 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:57:02.105897 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] No VIF found with MAC fa:16:3e:20:82:a3, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:57:02.106668 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Using config drive
May 19 04:57:02.612665 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:57:02.746596 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Creating config drive at /opt/stack/data/nova/instances/a8015855-2986-4d03-ae6f-a2b7a27fc7b3/disk.config
May 19 04:57:02.749768 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a8015855-2986-4d03-ae6f-a2b7a27fc7b3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnjjs_jwe {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:57:02.824856 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a8015855-2986-4d03-ae6f-a2b7a27fc7b3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnjjs_jwe" returned: 0 in 0.074s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:57:03.236286 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:03.256644 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:03.258819 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:03.349950 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:03.415774 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-794341ae-970d-4480-93c7-2572a7ea9660 req-0b1aeb40-38ff-4b4b-acc4-684da6f2e11e service nova] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Received event network-vif-plugged-b465695f-9ee9-4149-b57d-f2ce136d6eaa {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:57:03.416211 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-794341ae-970d-4480-93c7-2572a7ea9660 req-0b1aeb40-38ff-4b4b-acc4-684da6f2e11e service nova] Acquiring lock "a8015855-2986-4d03-ae6f-a2b7a27fc7b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:57:03.416576 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-794341ae-970d-4480-93c7-2572a7ea9660 req-0b1aeb40-38ff-4b4b-acc4-684da6f2e11e service nova] Lock "a8015855-2986-4d03-ae6f-a2b7a27fc7b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:57:03.417125 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-794341ae-970d-4480-93c7-2572a7ea9660 req-0b1aeb40-38ff-4b4b-acc4-684da6f2e11e service nova] Lock "a8015855-2986-4d03-ae6f-a2b7a27fc7b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:57:03.417125 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-794341ae-970d-4480-93c7-2572a7ea9660 req-0b1aeb40-38ff-4b4b-acc4-684da6f2e11e service nova] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Processing event network-vif-plugged-b465695f-9ee9-4149-b57d-f2ce136d6eaa {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:57:03.545617 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:03.548501 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:03.550569 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:03.566721 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:03.569265 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:04.100476 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:04.861044 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:57:04.861665 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166624.8612854, a8015855-2986-4d03-ae6f-a2b7a27fc7b3 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:57:04.862518 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] VM Started (Lifecycle Event)
May 19 04:57:04.864402 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:57:04.866592 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Instance spawned successfully.
May 19 04:57:04.867910 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:57:05.366782 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:57:05.369865 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:57:05.375483 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:57:05.375689 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:57:05.376038 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:57:05.376321 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:57:05.376605 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:57:05.376929 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:57:05.477348 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9f778462-9184-4a4c-b581-8cd901645e22 req-013cfdd9-7cca-4868-8fb4-7f8625d81503 service nova] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Received event network-vif-plugged-b465695f-9ee9-4149-b57d-f2ce136d6eaa {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:57:05.477524 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9f778462-9184-4a4c-b581-8cd901645e22 req-013cfdd9-7cca-4868-8fb4-7f8625d81503 service nova] Acquiring lock "a8015855-2986-4d03-ae6f-a2b7a27fc7b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:57:05.478140 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9f778462-9184-4a4c-b581-8cd901645e22 req-013cfdd9-7cca-4868-8fb4-7f8625d81503 service nova] Lock "a8015855-2986-4d03-ae6f-a2b7a27fc7b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:57:05.478439 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-9f778462-9184-4a4c-b581-8cd901645e22 req-013cfdd9-7cca-4868-8fb4-7f8625d81503 service nova] Lock "a8015855-2986-4d03-ae6f-a2b7a27fc7b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:57:05.478596 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-9f778462-9184-4a4c-b581-8cd901645e22 req-013cfdd9-7cca-4868-8fb4-7f8625d81503 service nova] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] No waiting events found dispatching network-vif-plugged-b465695f-9ee9-4149-b57d-f2ce136d6eaa {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:57:05.478767 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-9f778462-9184-4a4c-b581-8cd901645e22 req-013cfdd9-7cca-4868-8fb4-7f8625d81503 service nova] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Received unexpected event network-vif-plugged-b465695f-9ee9-4149-b57d-f2ce136d6eaa for instance with vm_state building and task_state spawning.
May 19 04:57:05.585599 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:05.876986 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:57:05.876986 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166625.8757136, a8015855-2986-4d03-ae6f-a2b7a27fc7b3 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:57:05.876986 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] VM Paused (Lifecycle Event)
May 19 04:57:05.881531 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Took 9.42 seconds to spawn the instance on the hypervisor.
May 19 04:57:05.881760 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:57:06.380248 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:57:06.382316 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166626.3821425, a8015855-2986-4d03-ae6f-a2b7a27fc7b3 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:57:06.382534 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] VM Resumed (Lifecycle Event)
May 19 04:57:06.391334 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Took 16.44 seconds to build instance.
May 19 04:57:06.885282 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:57:06.886977 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:57:06.893708 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "a8015855-2986-4d03-ae6f-a2b7a27fc7b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.945s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:57:08.314497 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-73d13176-20e0-45ce-9c9f-5a5629f379de req-94489666-54b7-4404-bf93-a51a56725ec1 service nova] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Received event network-changed-b465695f-9ee9-4149-b57d-f2ce136d6eaa {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:57:08.314497 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-73d13176-20e0-45ce-9c9f-5a5629f379de req-94489666-54b7-4404-bf93-a51a56725ec1 service nova] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Refreshing instance network info cache due to event network-changed-b465695f-9ee9-4149-b57d-f2ce136d6eaa. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:57:08.314497 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-73d13176-20e0-45ce-9c9f-5a5629f379de req-94489666-54b7-4404-bf93-a51a56725ec1 service nova] Acquiring lock "refresh_cache-a8015855-2986-4d03-ae6f-a2b7a27fc7b3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:57:08.314497 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-73d13176-20e0-45ce-9c9f-5a5629f379de req-94489666-54b7-4404-bf93-a51a56725ec1 service nova] Acquired lock "refresh_cache-a8015855-2986-4d03-ae6f-a2b7a27fc7b3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:57:08.314497 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-73d13176-20e0-45ce-9c9f-5a5629f379de req-94489666-54b7-4404-bf93-a51a56725ec1 service nova] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Refreshing network info cache for port b465695f-9ee9-4149-b57d-f2ce136d6eaa {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:57:08.818234 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-73d13176-20e0-45ce-9c9f-5a5629f379de req-94489666-54b7-4404-bf93-a51a56725ec1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:57:09.070509 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-73d13176-20e0-45ce-9c9f-5a5629f379de req-94489666-54b7-4404-bf93-a51a56725ec1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:57:09.110352 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:09.183395 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-73d13176-20e0-45ce-9c9f-5a5629f379de req-94489666-54b7-4404-bf93-a51a56725ec1 service nova] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Updated VIF entry in instance network info cache for port b465695f-9ee9-4149-b57d-f2ce136d6eaa. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:57:09.183636 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-73d13176-20e0-45ce-9c9f-5a5629f379de req-94489666-54b7-4404-bf93-a51a56725ec1 service nova] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Updating instance_info_cache with network_info: [{"id": "b465695f-9ee9-4149-b57d-f2ce136d6eaa", "address": "fa:16:3e:20:82:a3", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb465695f-9e", "ovs_interfaceid": "b465695f-9ee9-4149-b57d-f2ce136d6eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:57:09.685416 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-73d13176-20e0-45ce-9c9f-5a5629f379de req-94489666-54b7-4404-bf93-a51a56725ec1 service nova] Releasing lock "refresh_cache-a8015855-2986-4d03-ae6f-a2b7a27fc7b3" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:57:10.587292 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:14.117020 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:15.589670 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:17.417093 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:17.561665 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cf56b049-9048-43fd-893c-c16cd494a761 req-1a0e20c4-309c-4f27-b294-d9bc398ef619 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Received event network-changed-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:57:17.562354 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-cf56b049-9048-43fd-893c-c16cd494a761 req-1a0e20c4-309c-4f27-b294-d9bc398ef619 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Refreshing instance network info cache due to event network-changed-b6e423ea-5da0-4bb9-8d49-e59d822f4e75. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:57:17.562730 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cf56b049-9048-43fd-893c-c16cd494a761 req-1a0e20c4-309c-4f27-b294-d9bc398ef619 service nova] Acquiring lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:57:17.562730 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cf56b049-9048-43fd-893c-c16cd494a761 req-1a0e20c4-309c-4f27-b294-d9bc398ef619 service nova] Acquired lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:57:17.562730 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-cf56b049-9048-43fd-893c-c16cd494a761 req-1a0e20c4-309c-4f27-b294-d9bc398ef619 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Refreshing network info cache for port b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:57:18.066465 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-cf56b049-9048-43fd-893c-c16cd494a761 req-1a0e20c4-309c-4f27-b294-d9bc398ef619 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:57:18.073895 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:57:18.074119 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:57:18.074293 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:57:18.074412 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:57:18.074512 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:57:18.079986 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Terminating instance
May 19 04:57:18.315890 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-cf56b049-9048-43fd-893c-c16cd494a761 req-1a0e20c4-309c-4f27-b294-d9bc398ef619 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:57:18.424682 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-cf56b049-9048-43fd-893c-c16cd494a761 req-1a0e20c4-309c-4f27-b294-d9bc398ef619 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Updated VIF entry in instance network info cache for port b6e423ea-5da0-4bb9-8d49-e59d822f4e75. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:57:18.425035 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-cf56b049-9048-43fd-893c-c16cd494a761 req-1a0e20c4-309c-4f27-b294-d9bc398ef619 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Updating instance_info_cache with network_info: [{"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": "br-int", "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:57:18.582713 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:57:18.595967 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:18.598595 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:18.610647 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:18.615295 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:18.632061 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:18.888628 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999655660000371 future=<Future at 0x7218345e1e80 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:57:18.888844 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999404925000363 future=<Future at 0x7218345e1e80 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:57:18.888961 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.99928630400018 future=<Future at 0x7218345e1e80 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:57:18.889759 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Instance destroyed successfully.
May 19 04:57:18.890148 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lazy-loading 'resources' on Instance uuid c1b2acdc-413f-4b94-a80d-cb2e5c966a2e {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:57:18.929391 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-cf56b049-9048-43fd-893c-c16cd494a761 req-1a0e20c4-309c-4f27-b294-d9bc398ef619 service nova] Releasing lock "refresh_cache-c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:57:19.124643 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:19.394027 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-19T04:55:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1644755258',display_name='tempest-TestShelveInstance-server-1644755258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testshelveinstance-server-1644755258',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+YqEICjz9MxMBHak0SAR0UnoboImu3BWh6kqDkFVDd9NL4fr5f8rx/kw8WF+Mxf7rmmEDOIxeCWXt9bBZq+1nbq28my0wgV1vjSrmXUi53sBa8iJQZmphNm//O1bm36g==',key_name='tempest-TestShelveInstance-1648700680',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:56:39Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc4772a09cd1480f9d139120e1f42892',ramdisk_id='',reservation_id='r-e8s6y7hb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-606043442',owner_user_name='tempest-TestShelveInstance-606043442-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:56:40Z,user_data=None,user_id='1c02d167c3764ceaa0671926946d8920',uuid=c1b2acdc-413f-4b94-a80d-cb2e5c966a2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": "br-int", "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:57:19.394298 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Converting VIF {"id": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "address": "fa:16:3e:c0:2d:01", "network": {"id": "15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f", "bridge": "br-int", "label": "tempest-TestShelveInstance-316640802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "dc4772a09cd1480f9d139120e1f42892", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e423ea-5d", "ovs_interfaceid": "b6e423ea-5da0-4bb9-8d49-e59d822f4e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:57:19.394892 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2d:01,bridge_name='br-int',has_traffic_filtering=True,id=b6e423ea-5da0-4bb9-8d49-e59d822f4e75,network=Network(15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e423ea-5d') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:57:19.395160 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2d:01,bridge_name='br-int',has_traffic_filtering=True,id=b6e423ea-5da0-4bb9-8d49-e59d822f4e75,network=Network(15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e423ea-5d') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:57:19.396377 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:19.396572 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6e423ea-5d, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:57:19.397506 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:19.398323 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:57:19.398490 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:19.399056 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:19.399204 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86ef7841-fecb-43fa-9720-159bb8a71b1c) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:57:19.399635 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:19.400034 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:57:19.400395 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:19.402046 np0000001025 nova-compute[97981]: INFO os_vif [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2d:01,bridge_name='br-int',has_traffic_filtering=True,id=b6e423ea-5da0-4bb9-8d49-e59d822f4e75,network=Network(15de8b1c-ec8d-4a7c-a734-ddd0b46ebb2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e423ea-5d')
May 19 04:57:19.403453 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:57:19.403760 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38784990-34f2-4fa8-a574-265dcda0e395', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:57:19.403994 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:57:19.404403 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:57:19.404705 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38784990-34f2-4fa8-a574-265dcda0e395', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:57:19.404893 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:57:19.430298 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:57:19.430298 np0000001025 nova-compute[97981]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:57:19.430298 np0000001025 nova-compute[97981]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc (non-flash)
May 19 04:57:19.430298 np0000001025 nova-compute[97981]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc (non-flash)
May 19 04:57:19.430298 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:57:19.430772 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:57:19.430772 np0000001025 nova-compute[97981]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395 (non-flash)
May 19 04:57:19.430772 np0000001025 nova-compute[97981]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc (non-flash)
May 19 04:57:19.430772 np0000001025 nova-compute[97981]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc (non-flash)
May 19 04:57:19.430772 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:57:19.430772 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', '211'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', '212'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc', '215'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc', '216')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:57:19.430772 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', '211')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:57:19.431462 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395', '212')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:57:19.432057 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x72185025fba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395'): ({'sdc'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:57:19.432265 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Removing multipathed devices sdc, sdb {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:57:19.432461 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Flush multipath device 330000000f52b2e61 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:57:19.491222 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:57:19.543680 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:57:19.589714 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:57:19.589978 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:57:19.590736 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:57:19.602621 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:57:19.602834 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:57:19.617813 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:57:19.633167 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c772763b-60f1-4ce5-b2bd-1331cf455517 req-08c2d029-72df-4d63-9903-3ec7cb31952d service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Received event network-vif-unplugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:57:19.637150 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c772763b-60f1-4ce5-b2bd-1331cf455517 req-08c2d029-72df-4d63-9903-3ec7cb31952d service nova] Acquiring lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:57:19.637150 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c772763b-60f1-4ce5-b2bd-1331cf455517 req-08c2d029-72df-4d63-9903-3ec7cb31952d service nova] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:57:19.637150 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c772763b-60f1-4ce5-b2bd-1331cf455517 req-08c2d029-72df-4d63-9903-3ec7cb31952d service nova] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:57:19.637150 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c772763b-60f1-4ce5-b2bd-1331cf455517 req-08c2d029-72df-4d63-9903-3ec7cb31952d service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] No waiting events found dispatching network-vif-unplugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:57:19.637150 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c772763b-60f1-4ce5-b2bd-1331cf455517 req-08c2d029-72df-4d63-9903-3ec7cb31952d service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Received event network-vif-unplugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:57:19.637150 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c772763b-60f1-4ce5-b2bd-1331cf455517 req-08c2d029-72df-4d63-9903-3ec7cb31952d service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Received event network-vif-unplugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:57:19.637150 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c772763b-60f1-4ce5-b2bd-1331cf455517 req-08c2d029-72df-4d63-9903-3ec7cb31952d service nova] Acquiring lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:57:19.637150 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c772763b-60f1-4ce5-b2bd-1331cf455517 req-08c2d029-72df-4d63-9903-3ec7cb31952d service nova] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:57:19.637150 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c772763b-60f1-4ce5-b2bd-1331cf455517 req-08c2d029-72df-4d63-9903-3ec7cb31952d service nova] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:57:19.637150 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c772763b-60f1-4ce5-b2bd-1331cf455517 req-08c2d029-72df-4d63-9903-3ec7cb31952d service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] No waiting events found dispatching network-vif-unplugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:57:19.637150 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c772763b-60f1-4ce5-b2bd-1331cf455517 req-08c2d029-72df-4d63-9903-3ec7cb31952d service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Received event network-vif-unplugged-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:57:19.650003 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 211, target: iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395, portal: 192.168.40.100,3260]
May 19 04:57:19.650003 np0000001025 nova-compute[97981]: Logout of [sid: 211, target: iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395, portal: 192.168.40.100,3260] successful.
May 19 04:57:19.650003 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:57:19.663283 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:57:19.672661 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:57:19.707057 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 212, target: iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395, portal: 192.168.50.100,3260]
May 19 04:57:19.707057 np0000001025 nova-compute[97981]: Logout of [sid: 212, target: iqn.2023-03.storpool.com:os--volume-38784990-34f2-4fa8-a574-265dcda0e395, portal: 192.168.50.100,3260] successful.
May 19 04:57:19.707057 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:57:19.718523 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:57:19.718732 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:57:19.718850 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] <== disconnect_volume: return (315ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:57:19.718957 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:57:19.719225 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Deleting instance files /opt/stack/data/nova/instances/c1b2acdc-413f-4b94-a80d-cb2e5c966a2e_del
May 19 04:57:19.719678 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Deletion of /opt/stack/data/nova/instances/c1b2acdc-413f-4b94-a80d-cb2e5c966a2e_del complete
May 19 04:57:20.224942 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Took 1.64 seconds to destroy the instance on the hypervisor.
May 19 04:57:20.225550 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:57:20.225898 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:57:20.226014 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:57:20.226290 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:57:20.312584 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:57:20.983273 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:57:21.487291 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Took 1.26 seconds to deallocate network for instance.
May 19 04:57:21.683972 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-6a18aef0-d0d2-43c9-9bd0-60769250c818 req-3d0bece1-ab9f-42e5-97e1-356e1deb0557 service nova] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Received event network-vif-deleted-b6e423ea-5da0-4bb9-8d49-e59d822f4e75 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:57:22.025690 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Took 0.54 seconds to detach 1 volumes for instance.
May 19 04:57:22.027613 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Deleting volume: 38784990-34f2-4fa8-a574-265dcda0e395 {{(pid=97981) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 19 04:57:22.560925 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:57:22.561085 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:57:22.602936 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Refreshing inventories for resource provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 19 04:57:22.641649 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Updating ProviderTree inventory for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 19 04:57:22.641807 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Updating inventory in ProviderTree for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 19 04:57:22.679422 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Refreshing aggregate associations for resource provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6, aggregates: None {{(pid=97981) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 19 04:57:22.721410 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Refreshing trait associations for resource provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6, traits: COMPUTE_SOUND_MODEL_AC97,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ARCH_S390X,COMPUTE_SOUND_MODEL_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SOUND_MODEL_ICH9,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ARCH_MIPSEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_SOUND_MODEL_ICH6,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIF_MODEL_IGB,HW_ARCH_X86_64,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ARCH_X86_64,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ARCH_RISCV64,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_ARCH_AARCH64,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_STORAGE_VIRTIO_FS {{(pid=97981) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 19 04:57:22.835814 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:57:22.835995 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:57:23.338327 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:57:23.844047 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.283s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:57:23.884539 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Deleted allocations for instance c1b2acdc-413f-4b94-a80d-cb2e5c966a2e
May 19 04:57:24.136228 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:24.400829 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:24.892117 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-b4d59205-34b9-4694-b6f2-d76e10cc8784 tempest-TestShelveInstance-606043442 tempest-TestShelveInstance-606043442-project-member] Lock "c1b2acdc-413f-4b94-a80d-cb2e5c966a2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.818s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:57:25.748836 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:27.177049 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:29.137443 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:29.401002 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:30.511160 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:32.569504 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:33.888629 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.00033453499963798095 future=<Future at 0x7218345e1e80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:57:33.889125 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Emitting event <LifecycleEvent: 1779166638.8881679, c1b2acdc-413f-4b94-a80d-cb2e5c966a2e => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:57:33.889320 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:57:33.889479 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] VM Stopped (Lifecycle Event)
May 19 04:57:34.140439 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:34.393001 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: c1b2acdc-413f-4b94-a80d-cb2e5c966a2e] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:57:34.401994 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:34.901001 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:35.489851 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "a8015855-2986-4d03-ae6f-a2b7a27fc7b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:57:35.490046 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "a8015855-2986-4d03-ae6f-a2b7a27fc7b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:57:35.490258 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "a8015855-2986-4d03-ae6f-a2b7a27fc7b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:57:35.490392 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "a8015855-2986-4d03-ae6f-a2b7a27fc7b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:57:35.490559 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "a8015855-2986-4d03-ae6f-a2b7a27fc7b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:57:35.493152 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Terminating instance
May 19 04:57:35.996959 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:57:36.012030 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:36.016461 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:36.034895 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:36.048729 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:36.056736 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:36.311448 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999668834999738 future=<Future at 0x72185027d9a0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:57:36.311519 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999272037999617 future=<Future at 0x72185027d9a0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:57:36.311617 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999158676999741 future=<Future at 0x72185027d9a0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:57:36.313373 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Instance destroyed successfully.
May 19 04:57:36.314438 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lazy-loading 'resources' on Instance uuid a8015855-2986-4d03-ae6f-a2b7a27fc7b3 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:57:36.320580 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:36.817195 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-774532575',display_name='tempest-TestEncryptedCinderVolumes-server-774532575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testencryptedcindervolumes-server-774532575',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA410ze8YCe4u0aQqRN7DK7tE+RlkrXnaPJ+kTcfp9spowhXSxOTwnVQ3dJGH9s2vpjJhGWVHtfzElrJfvMHEniTuVA/lwcQsaFNpsSY+VsU4ZoX+Fw7jYVfDjGnBWgj4g==',key_name='tempest-TestEncryptedCinderVolumes-1821693556',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:57:05Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36ff6589269d4d73acf3d5d205b75622',ramdisk_id='',reservation_id='r-3x4bxix5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-282543688',owner_user_name='tempest-TestEncryptedCinderVolumes-282543688-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:57:06Z,user_data=None,user_id='6720ecdbe3414d4eac1542d35d21d5ea',uuid=a8015855-2986-4d03-ae6f-a2b7a27fc7b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b465695f-9ee9-4149-b57d-f2ce136d6eaa", "address": "fa:16:3e:20:82:a3", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb465695f-9e", "ovs_interfaceid": "b465695f-9ee9-4149-b57d-f2ce136d6eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:57:36.817458 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Converting VIF {"id": "b465695f-9ee9-4149-b57d-f2ce136d6eaa", "address": "fa:16:3e:20:82:a3", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb465695f-9e", "ovs_interfaceid": "b465695f-9ee9-4149-b57d-f2ce136d6eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:57:36.818285 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:82:a3,bridge_name='br-int',has_traffic_filtering=True,id=b465695f-9ee9-4149-b57d-f2ce136d6eaa,network=Network(9c642de3-79c6-4ed4-a828-c4eba2555eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb465695f-9e') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:57:36.818585 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:82:a3,bridge_name='br-int',has_traffic_filtering=True,id=b465695f-9ee9-4149-b57d-f2ce136d6eaa,network=Network(9c642de3-79c6-4ed4-a828-c4eba2555eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb465695f-9e') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:57:36.819725 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:36.820014 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb465695f-9e, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:57:36.821007 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:36.821789 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:57:36.822363 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:36.822995 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:36.823201 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d507383-49ff-45e6-9f53-fadd73c8d2e4) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:57:36.823583 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:36.824007 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:57:36.824263 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:36.825936 np0000001025 nova-compute[97981]: INFO os_vif [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:82:a3,bridge_name='br-int',has_traffic_filtering=True,id=b465695f-9ee9-4149-b57d-f2ce136d6eaa,network=Network(9c642de3-79c6-4ed4-a828-c4eba2555eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb465695f-9e')
May 19 04:57:36.829467 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:57:36.829774 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc', 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '60508634-a505-45be-8f7d-86ef43c5cabc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:57:36.829975 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:57:36.830445 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:57:36.830704 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc', 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '60508634-a505-45be-8f7d-86ef43c5cabc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:57:36.830826 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:57:36.853393 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc (non-flash)
May 19 04:57:36.853393 np0000001025 nova-compute[97981]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc (non-flash)
May 19 04:57:36.853393 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:57:36.853560 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsi session list stdout=tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc (non-flash)
May 19 04:57:36.853560 np0000001025 nova-compute[97981]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc (non-flash)
May 19 04:57:36.853560 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:57:36.853658 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc', '215'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc', '216')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:57:36.853737 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc', '216')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:57:36.854527 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc', '215')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:57:36.855083 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218343574c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc'): ({'sdd'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:57:36.855276 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Removing multipathed devices sdd, sde {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:57:36.855491 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Flush multipath device 330000000e5260241 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:57:36.893356 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:57:36.927752 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:57:36.972683 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:57:36.972914 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] SCSI volumes sdd, sde have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:57:36.973684 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:57:36.984822 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:57:36.985061 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:57:36.996097 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:57:37.020517 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 216, target: iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc, portal: 192.168.40.100,3260]
May 19 04:57:37.020517 np0000001025 nova-compute[97981]: Logout of [sid: 216, target: iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc, portal: 192.168.40.100,3260] successful.
May 19 04:57:37.020517 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:57:37.032087 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:57:37.042742 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:57:37.068349 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 215, target: iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc, portal: 192.168.50.100,3260]
May 19 04:57:37.068349 np0000001025 nova-compute[97981]: Logout of [sid: 215, target: iqn.2023-03.storpool.com:os--volume-60508634-a505-45be-8f7d-86ef43c5cabc, portal: 192.168.50.100,3260] successful.
May 19 04:57:37.068349 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:57:37.080045 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:57:37.081143 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:57:37.081313 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] <== disconnect_volume: return (251ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:57:37.081433 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:57:37.081679 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Deleting instance files /opt/stack/data/nova/instances/a8015855-2986-4d03-ae6f-a2b7a27fc7b3_del
May 19 04:57:37.082141 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Deletion of /opt/stack/data/nova/instances/a8015855-2986-4d03-ae6f-a2b7a27fc7b3_del complete
May 19 04:57:37.588223 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Took 1.59 seconds to destroy the instance on the hypervisor.
May 19 04:57:37.589509 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:57:37.589716 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:57:37.589791 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:57:37.589984 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:57:37.647058 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:57:38.011843 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-af062843-88a3-422c-87d1-7468e80f4438 req-b169323c-1616-4249-a4f6-1ea69d773895 service nova] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Received event network-vif-deleted-b465695f-9ee9-4149-b57d-f2ce136d6eaa {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:57:38.011943 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-af062843-88a3-422c-87d1-7468e80f4438 req-b169323c-1616-4249-a4f6-1ea69d773895 service nova] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Neutron deleted interface b465695f-9ee9-4149-b57d-f2ce136d6eaa; detaching it from the instance and deleting it from the info cache
May 19 04:57:38.012095 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-af062843-88a3-422c-87d1-7468e80f4438 req-b169323c-1616-4249-a4f6-1ea69d773895 service nova] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:57:38.466954 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:57:38.515449 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-af062843-88a3-422c-87d1-7468e80f4438 req-b169323c-1616-4249-a4f6-1ea69d773895 service nova] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Detach interface failed, port_id=b465695f-9ee9-4149-b57d-f2ce136d6eaa, reason: Instance a8015855-2986-4d03-ae6f-a2b7a27fc7b3 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:57:38.968854 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Took 1.38 seconds to deallocate network for instance.
May 19 04:57:39.154820 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:39.506674 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Took 0.54 seconds to detach 1 volumes for instance.
May 19 04:57:39.638098 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "288173b9-6744-4786-a21a-d987d2384714" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:57:39.638324 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:57:40.011183 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:57:40.011378 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:57:40.131893 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:57:40.132059 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:57:40.140430 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:57:40.634348 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:57:40.684744 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:57:41.140307 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.129s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:57:41.141938 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.456s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:57:41.145416 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:57:41.146149 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Claim successful on node np0000001025
May 19 04:57:41.183001 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Deleted allocations for instance a8015855-2986-4d03-ae6f-a2b7a27fc7b3
May 19 04:57:41.836738 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:42.191342 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-6c03d826-842f-48e5-923b-275c11e353d6 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "a8015855-2986-4d03-ae6f-a2b7a27fc7b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.701s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:57:42.238166 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:57:42.238355 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:57:42.740510 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:57:43.245877 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.105s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:57:43.246354 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:57:43.752253 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:57:43.752486 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:57:43.752731 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:57:43.752971 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:57:43.818533 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '792818385dd84e84ace907c921ff2862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f79a8a618f64839bf927ffe9d9115a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:57:44.155978 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:44.244033 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Successfully created port: a6a22052-4a44-4bdc-84a5-1193b6daf8da {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:57:44.255117 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:57:44.656237 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Successfully updated port: a6a22052-4a44-4bdc-84a5-1193b6daf8da {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:57:44.698300 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c562d570-7b1e-40ba-abf2-90d9580d51ae req-f4111837-7a53-4330-b13b-b3321c6c0385 service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] Received event network-changed-a6a22052-4a44-4bdc-84a5-1193b6daf8da {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:57:44.698654 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c562d570-7b1e-40ba-abf2-90d9580d51ae req-f4111837-7a53-4330-b13b-b3321c6c0385 service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] Refreshing instance network info cache due to event network-changed-a6a22052-4a44-4bdc-84a5-1193b6daf8da. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:57:44.698844 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c562d570-7b1e-40ba-abf2-90d9580d51ae req-f4111837-7a53-4330-b13b-b3321c6c0385 service nova] Acquiring lock "refresh_cache-288173b9-6744-4786-a21a-d987d2384714" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:57:44.698954 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c562d570-7b1e-40ba-abf2-90d9580d51ae req-f4111837-7a53-4330-b13b-b3321c6c0385 service nova] Acquired lock "refresh_cache-288173b9-6744-4786-a21a-d987d2384714" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:57:44.699154 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c562d570-7b1e-40ba-abf2-90d9580d51ae req-f4111837-7a53-4330-b13b-b3321c6c0385 service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] Refreshing network info cache for port a6a22052-4a44-4bdc-84a5-1193b6daf8da {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:57:44.758079 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:57:45.159071 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "refresh_cache-288173b9-6744-4786-a21a-d987d2384714" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:57:45.201000 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-c562d570-7b1e-40ba-abf2-90d9580d51ae req-f4111837-7a53-4330-b13b-b3321c6c0385 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:57:45.255015 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c562d570-7b1e-40ba-abf2-90d9580d51ae req-f4111837-7a53-4330-b13b-b3321c6c0385 service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:57:45.368984 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-c562d570-7b1e-40ba-abf2-90d9580d51ae req-f4111837-7a53-4330-b13b-b3321c6c0385 service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:57:45.767987 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:57:45.768970 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:57:45.769248 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Creating image(s)
May 19 04:57:45.769788 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "/opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:57:45.769964 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "/opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:57:45.770473 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "/opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:57:45.771118 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:57:45.773921 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:57:45.774955 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:57:45.871305 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c562d570-7b1e-40ba-abf2-90d9580d51ae req-f4111837-7a53-4330-b13b-b3321c6c0385 service nova] Releasing lock "refresh_cache-288173b9-6744-4786-a21a-d987d2384714" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:57:45.871789 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquired lock "refresh_cache-288173b9-6744-4786-a21a-d987d2384714" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:57:45.872051 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:57:45.873832 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.099s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:57:45.874279 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "443595db815316abd1bec06724e43d59ec87f94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:57:45.874731 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:57:45.875207 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:57:45.879027 np0000001025 nova-compute[97981]: DEBUG oslo_utils.imageutils.format_inspector [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97981) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 19 04:57:45.879405 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:57:45.973492 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.094s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:57:45.973931 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/disk 1073741824 {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:57:46.032211 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c,backing_fmt=raw /opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/disk 1073741824" returned: 0 in 0.058s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:57:46.032643 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "443595db815316abd1bec06724e43d59ec87f94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.158s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:57:46.032942 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:57:46.120441 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/443595db815316abd1bec06724e43d59ec87f94c --force-share --output=json" returned: 0 in 0.087s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:57:46.120959 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Checking if we can resize image /opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/disk. size=1073741824 {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 19 04:57:46.121290 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:57:46.214969 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:57:46.215572 np0000001025 nova-compute[97981]: DEBUG nova.virt.disk.api [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Cannot resize image /opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/disk to a smaller size. {{(pid=97981) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 19 04:57:46.216256 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Created local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 19 04:57:46.216447 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Ensure instance console log exists: /opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:57:46.216736 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:57:46.216990 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:57:46.217176 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:57:46.443502 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:57:46.571611 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:57:46.679146 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Updating instance_info_cache with network_info: [{"id": "a6a22052-4a44-4bdc-84a5-1193b6daf8da", "address": "fa:16:3e:7c:e1:c1", "network": {"id": "2e467758-9914-49ea-95cd-58e0b9e52cbe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-673449942-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f79a8a618f64839bf927ffe9d9115a4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a22052-4a", "ovs_interfaceid": "a6a22052-4a44-4bdc-84a5-1193b6daf8da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:57:46.844712 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:47.181371 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Releasing lock "refresh_cache-288173b9-6744-4786-a21a-d987d2384714" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:57:47.181579 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Instance network_info: |[{"id": "a6a22052-4a44-4bdc-84a5-1193b6daf8da", "address": "fa:16:3e:7c:e1:c1", "network": {"id": "2e467758-9914-49ea-95cd-58e0b9e52cbe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-673449942-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f79a8a618f64839bf927ffe9d9115a4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a22052-4a", "ovs_interfaceid": "a6a22052-4a44-4bdc-84a5-1193b6daf8da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:57:47.183168 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Start _get_guest_xml network_info=[{"id": "a6a22052-4a44-4bdc-84a5-1193b6daf8da", "address": "fa:16:3e:7c:e1:c1", "network": {"id": "2e467758-9914-49ea-95cd-58e0b9e52cbe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-673449942-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f79a8a618f64839bf927ffe9d9115a4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a22052-4a", "ovs_interfaceid": "a6a22052-4a44-4bdc-84a5-1193b6daf8da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'image_id': '76f2afbb-2235-45f3-9168-d64aadd6e71e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:57:47.187388 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:57:47.188515 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='76f2afbb-2235-45f3-9168-d64aadd6e71e', instance_meta=NovaInstanceMeta(name='tempest-SnapshotDataIntegrityTests-server-915673572', uuid='288173b9-6744-4786-a21a-d987d2384714'), owner=OwnerMeta(userid='792818385dd84e84ace907c921ff2862', username='tempest-SnapshotDataIntegrityTests-901230178-project-member', projectid='6f79a8a618f64839bf927ffe9d9115a4', projectname='tempest-SnapshotDataIntegrityTests-901230178'), image=ImageMeta(id='76f2afbb-2235-45f3-9168-d64aadd6e71e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a6a22052-4a44-4bdc-84a5-1193b6daf8da", "address": "fa:16:3e:7c:e1:c1", "network": {"id": "2e467758-9914-49ea-95cd-58e0b9e52cbe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-673449942-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f79a8a618f64839bf927ffe9d9115a4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a22052-4a", "ovs_interfaceid": "a6a22052-4a44-4bdc-84a5-1193b6daf8da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166667.1882246) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:57:47.189466 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:57:47.189741 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:57:47.190463 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:57:47.190617 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:57:47.191615 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:57:47.191871 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-19T04:31:50Z,direct_url=<?>,disk_format='qcow2',id=76f2afbb-2235-45f3-9168-d64aadd6e71e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='579b33395d4a41479b805cf02294060a',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-19T04:31:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:57:47.191991 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:57:47.192102 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:57:47.192252 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:57:47.192334 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:57:47.192428 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:57:47.192580 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:57:47.192669 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:57:47.192769 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:57:47.192862 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:57:47.193003 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:57:47.203176 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-915673572',display_name='tempest-SnapshotDataIntegrityTests-server-915673572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-snapshotdataintegritytests-server-915673572',id=80,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArwCDFZvH70uQgAKENHwHNbE0ik68bnrZDiAMFHiXbfoRve22xBcd2lZzRuVCzUonPNZVBdhN8Ft4stfog1PuKDs9jfzEt0mApY2oxGZ+yJKt8y5oJWpKmD2VmNjFKHHA==',key_name='tempest-keypair-981225345',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f79a8a618f64839bf927ffe9d9115a4',ramdisk_id='',reservation_id='r-4ih6j2bc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-901230178',owner_user_name='tempest-SnapshotDataIntegrityTests-901230178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:57:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='792818385dd84e84ace907c921ff2862',uuid=288173b9-6744-4786-a21a-d987d2384714,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6a22052-4a44-4bdc-84a5-1193b6daf8da", "address": "fa:16:3e:7c:e1:c1", "network": {"id": "2e467758-9914-49ea-95cd-58e0b9e52cbe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-673449942-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f79a8a618f64839bf927ffe9d9115a4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a22052-4a", "ovs_interfaceid": "a6a22052-4a44-4bdc-84a5-1193b6daf8da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:57:47.203386 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Converting VIF {"id": "a6a22052-4a44-4bdc-84a5-1193b6daf8da", "address": "fa:16:3e:7c:e1:c1", "network": {"id": "2e467758-9914-49ea-95cd-58e0b9e52cbe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-673449942-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f79a8a618f64839bf927ffe9d9115a4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a22052-4a", "ovs_interfaceid": "a6a22052-4a44-4bdc-84a5-1193b6daf8da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:57:47.203852 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e1:c1,bridge_name='br-int',has_traffic_filtering=True,id=a6a22052-4a44-4bdc-84a5-1193b6daf8da,network=Network(2e467758-9914-49ea-95cd-58e0b9e52cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a22052-4a') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:57:47.204384 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lazy-loading 'pci_devices' on Instance uuid 288173b9-6744-4786-a21a-d987d2384714 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:57:47.706825 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] End _get_guest_xml xml=<domain type="qemu">
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:   <uuid>288173b9-6744-4786-a21a-d987d2384714</uuid>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:   <name>instance-00000050</name>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-915673572</nova:name>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:57:47</nova:creationTime>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <nova:image uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e">
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:         <nova:containerFormat>bare</nova:containerFormat>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:         <nova:user uuid="792818385dd84e84ace907c921ff2862">tempest-SnapshotDataIntegrityTests-901230178-project-member</nova:user>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:         <nova:project uuid="6f79a8a618f64839bf927ffe9d9115a4">tempest-SnapshotDataIntegrityTests-901230178</nova:project>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <nova:root type="image" uuid="76f2afbb-2235-45f3-9168-d64aadd6e71e"/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:         <nova:port uuid="a6a22052-4a44-4bdc-84a5-1193b6daf8da">
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     <system>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <entry name="serial">288173b9-6744-4786-a21a-d987d2384714</entry>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <entry name="uuid">288173b9-6744-4786-a21a-d987d2384714</entry>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     </system>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:   <os>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:   </os>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:   <features>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:   </features>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:   <devices>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     <disk type="file" device="disk">
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <driver name="qemu" type="qcow2" cache="none"/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/disk"/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     </disk>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/disk.config"/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     </disk>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:7c:e1:c1"/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <target dev="tapa6a22052-4a"/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     </interface>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/console.log" append="off"/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     </serial>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     <video>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     </video>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     </rng>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:   </devices>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]: </domain>
May 19 04:57:47.706825 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:57:47.710562 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Preparing to wait for external event network-vif-plugged-a6a22052-4a44-4bdc-84a5-1193b6daf8da {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:57:47.710562 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "288173b9-6744-4786-a21a-d987d2384714-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:57:47.710562 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:57:47.710562 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:57:47.710562 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-915673572',display_name='tempest-SnapshotDataIntegrityTests-server-915673572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-snapshotdataintegritytests-server-915673572',id=80,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArwCDFZvH70uQgAKENHwHNbE0ik68bnrZDiAMFHiXbfoRve22xBcd2lZzRuVCzUonPNZVBdhN8Ft4stfog1PuKDs9jfzEt0mApY2oxGZ+yJKt8y5oJWpKmD2VmNjFKHHA==',key_name='tempest-keypair-981225345',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f79a8a618f64839bf927ffe9d9115a4',ramdisk_id='',reservation_id='r-4ih6j2bc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-901230178',owner_user_name='tempest-SnapshotDataIntegrityTests-901230178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:57:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='792818385dd84e84ace907c921ff2862',uuid=288173b9-6744-4786-a21a-d987d2384714,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6a22052-4a44-4bdc-84a5-1193b6daf8da", "address": "fa:16:3e:7c:e1:c1", "network": {"id": "2e467758-9914-49ea-95cd-58e0b9e52cbe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-673449942-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f79a8a618f64839bf927ffe9d9115a4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a22052-4a", "ovs_interfaceid": "a6a22052-4a44-4bdc-84a5-1193b6daf8da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:57:47.710562 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Converting VIF {"id": "a6a22052-4a44-4bdc-84a5-1193b6daf8da", "address": "fa:16:3e:7c:e1:c1", "network": {"id": "2e467758-9914-49ea-95cd-58e0b9e52cbe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-673449942-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f79a8a618f64839bf927ffe9d9115a4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a22052-4a", "ovs_interfaceid": "a6a22052-4a44-4bdc-84a5-1193b6daf8da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:57:47.710562 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e1:c1,bridge_name='br-int',has_traffic_filtering=True,id=a6a22052-4a44-4bdc-84a5-1193b6daf8da,network=Network(2e467758-9914-49ea-95cd-58e0b9e52cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a22052-4a') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:57:47.710562 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e1:c1,bridge_name='br-int',has_traffic_filtering=True,id=a6a22052-4a44-4bdc-84a5-1193b6daf8da,network=Network(2e467758-9914-49ea-95cd-58e0b9e52cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a22052-4a') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:57:47.710562 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:47.710562 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:57:47.710562 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:57:47.711716 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:47.711716 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd64d01d3-5ca2-5ad2-9e8b-5f4959aa657c', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:57:47.712552 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:47.713284 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:57:47.715047 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:47.715256 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6a22052-4a, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:57:47.715596 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6a22052-4a, col_values=(('qos', UUID('c7091231-f9a1-43c1-b416-04acbadf19ae')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:57:47.715823 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6a22052-4a, col_values=(('external_ids', {'iface-id': 'a6a22052-4a44-4bdc-84a5-1193b6daf8da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:e1:c1', 'vm-uuid': '288173b9-6744-4786-a21a-d987d2384714'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:57:47.716586 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:47.717688 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:57:47.721970 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:47.722751 np0000001025 nova-compute[97981]: INFO os_vif [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e1:c1,bridge_name='br-int',has_traffic_filtering=True,id=a6a22052-4a44-4bdc-84a5-1193b6daf8da,network=Network(2e467758-9914-49ea-95cd-58e0b9e52cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a22052-4a')
May 19 04:57:48.384676 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:57:48.384969 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:57:48.385229 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:57:48.385530 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.23 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:57:48.615301 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:57:48.615573 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:57:48.615842 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:57:49.171799 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:49.238499 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:57:49.238634 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:57:49.238733 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] No VIF found with MAC fa:16:3e:7c:e1:c1, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:57:49.239175 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Using config drive
May 19 04:57:49.614778 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:57:49.615118 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 8.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:57:49.744379 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:57:49.847426 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Creating config drive at /opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/disk.config
May 19 04:57:49.851020 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2oy7qh4s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:57:49.904644 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2oy7qh4s" returned: 0 in 0.053s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:57:50.295976 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:50.297625 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:50.314244 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:50.315547 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:50.395025 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:50.437601 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-578e09b6-c9f8-4c2b-b233-97f3fdb3d8fc req-259deaa0-fc39-40a9-8db4-49d1992f055a service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] Received event network-vif-plugged-a6a22052-4a44-4bdc-84a5-1193b6daf8da {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:57:50.437960 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-578e09b6-c9f8-4c2b-b233-97f3fdb3d8fc req-259deaa0-fc39-40a9-8db4-49d1992f055a service nova] Acquiring lock "288173b9-6744-4786-a21a-d987d2384714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:57:50.439488 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-578e09b6-c9f8-4c2b-b233-97f3fdb3d8fc req-259deaa0-fc39-40a9-8db4-49d1992f055a service nova] Lock "288173b9-6744-4786-a21a-d987d2384714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:57:50.439707 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-578e09b6-c9f8-4c2b-b233-97f3fdb3d8fc req-259deaa0-fc39-40a9-8db4-49d1992f055a service nova] Lock "288173b9-6744-4786-a21a-d987d2384714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:57:50.439854 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-578e09b6-c9f8-4c2b-b233-97f3fdb3d8fc req-259deaa0-fc39-40a9-8db4-49d1992f055a service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] Processing event network-vif-plugged-a6a22052-4a44-4bdc-84a5-1193b6daf8da {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:57:50.588809 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:50.591316 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:50.595436 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:50.611031 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:50.898563 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:57:50.989083 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166670.9886827, 288173b9-6744-4786-a21a-d987d2384714 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:57:50.989250 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 288173b9-6744-4786-a21a-d987d2384714] VM Started (Lifecycle Event)
May 19 04:57:50.990654 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:57:50.992704 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:57:50.994526 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 288173b9-6744-4786-a21a-d987d2384714] Instance spawned successfully.
May 19 04:57:50.994760 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:57:51.311318 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0004835830000047281 future=<Future at 0x72185027d9a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:57:51.311922 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Emitting event <LifecycleEvent: 1779166656.3107202, a8015855-2986-4d03-ae6f-a2b7a27fc7b3 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:57:51.312166 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:57:51.312299 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] VM Stopped (Lifecycle Event)
May 19 04:57:51.491669 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 288173b9-6744-4786-a21a-d987d2384714] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:57:51.493742 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 288173b9-6744-4786-a21a-d987d2384714] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:57:51.500059 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:57:51.500214 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:57:51.500501 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:57:51.500729 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:57:51.500942 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:57:51.501243 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:57:51.814790 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: a8015855-2986-4d03-ae6f-a2b7a27fc7b3] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:57:51.996057 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 288173b9-6744-4786-a21a-d987d2384714] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:57:51.996419 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166671.996181, 288173b9-6744-4786-a21a-d987d2384714 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:57:51.996479 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 288173b9-6744-4786-a21a-d987d2384714] VM Paused (Lifecycle Event)
May 19 04:57:52.005620 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Took 6.24 seconds to spawn the instance on the hypervisor.
May 19 04:57:52.005842 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:57:52.486486 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-15432047-8b40-450c-b9f1-69b2393dc725 req-a895d9bd-771a-4d81-afa8-1a941f2513dc service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] Received event network-vif-plugged-a6a22052-4a44-4bdc-84a5-1193b6daf8da {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:57:52.486929 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-15432047-8b40-450c-b9f1-69b2393dc725 req-a895d9bd-771a-4d81-afa8-1a941f2513dc service nova] Acquiring lock "288173b9-6744-4786-a21a-d987d2384714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:57:52.487060 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-15432047-8b40-450c-b9f1-69b2393dc725 req-a895d9bd-771a-4d81-afa8-1a941f2513dc service nova] Lock "288173b9-6744-4786-a21a-d987d2384714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:57:52.487226 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-15432047-8b40-450c-b9f1-69b2393dc725 req-a895d9bd-771a-4d81-afa8-1a941f2513dc service nova] Lock "288173b9-6744-4786-a21a-d987d2384714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:57:52.487357 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-15432047-8b40-450c-b9f1-69b2393dc725 req-a895d9bd-771a-4d81-afa8-1a941f2513dc service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] No waiting events found dispatching network-vif-plugged-a6a22052-4a44-4bdc-84a5-1193b6daf8da {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:57:52.487475 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-15432047-8b40-450c-b9f1-69b2393dc725 req-a895d9bd-771a-4d81-afa8-1a941f2513dc service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] Received unexpected event network-vif-plugged-a6a22052-4a44-4bdc-84a5-1193b6daf8da for instance with vm_state active and task_state None.
May 19 04:57:52.498580 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 288173b9-6744-4786-a21a-d987d2384714] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:57:52.500399 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166672.500232, 288173b9-6744-4786-a21a-d987d2384714 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:57:52.500494 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 288173b9-6744-4786-a21a-d987d2384714] VM Resumed (Lifecycle Event)
May 19 04:57:52.513008 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Took 11.87 seconds to build instance.
May 19 04:57:52.727765 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:53.002371 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 288173b9-6744-4786-a21a-d987d2384714] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:57:53.004342 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 288173b9-6744-4786-a21a-d987d2384714] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:57:53.014301 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-69c47705-1310-42c0-93d0-bf9a5d865231 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.376s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:57:54.182351 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:54.551463 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-df05e688-00c7-460e-9d38-d2f2dd9f365b req-d89f0350-148b-4c68-b960-dc3042206877 service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] Received event network-changed-a6a22052-4a44-4bdc-84a5-1193b6daf8da {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:57:54.551463 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-df05e688-00c7-460e-9d38-d2f2dd9f365b req-d89f0350-148b-4c68-b960-dc3042206877 service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] Refreshing instance network info cache due to event network-changed-a6a22052-4a44-4bdc-84a5-1193b6daf8da. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:57:54.551463 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-df05e688-00c7-460e-9d38-d2f2dd9f365b req-d89f0350-148b-4c68-b960-dc3042206877 service nova] Acquiring lock "refresh_cache-288173b9-6744-4786-a21a-d987d2384714" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:57:54.552641 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-df05e688-00c7-460e-9d38-d2f2dd9f365b req-d89f0350-148b-4c68-b960-dc3042206877 service nova] Acquired lock "refresh_cache-288173b9-6744-4786-a21a-d987d2384714" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:57:54.552882 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-df05e688-00c7-460e-9d38-d2f2dd9f365b req-d89f0350-148b-4c68-b960-dc3042206877 service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] Refreshing network info cache for port a6a22052-4a44-4bdc-84a5-1193b6daf8da {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:57:55.058287 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-df05e688-00c7-460e-9d38-d2f2dd9f365b req-d89f0350-148b-4c68-b960-dc3042206877 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:57:55.372128 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-df05e688-00c7-460e-9d38-d2f2dd9f365b req-d89f0350-148b-4c68-b960-dc3042206877 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:57:55.504190 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-df05e688-00c7-460e-9d38-d2f2dd9f365b req-d89f0350-148b-4c68-b960-dc3042206877 service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] Updated VIF entry in instance network info cache for port a6a22052-4a44-4bdc-84a5-1193b6daf8da. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:57:55.504190 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-df05e688-00c7-460e-9d38-d2f2dd9f365b req-d89f0350-148b-4c68-b960-dc3042206877 service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] Updating instance_info_cache with network_info: [{"id": "a6a22052-4a44-4bdc-84a5-1193b6daf8da", "address": "fa:16:3e:7c:e1:c1", "network": {"id": "2e467758-9914-49ea-95cd-58e0b9e52cbe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-673449942-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f79a8a618f64839bf927ffe9d9115a4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a22052-4a", "ovs_interfaceid": "a6a22052-4a44-4bdc-84a5-1193b6daf8da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:57:55.659407 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:57:55.659589 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:57:56.005243 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-df05e688-00c7-460e-9d38-d2f2dd9f365b req-d89f0350-148b-4c68-b960-dc3042206877 service nova] Releasing lock "refresh_cache-288173b9-6744-4786-a21a-d987d2384714" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:57:56.161533 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Starting instance... {{(pid=97981) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 19 04:57:56.712014 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:57:56.712396 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:57:56.715317 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97981) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 19 04:57:56.715458 np0000001025 nova-compute[97981]: INFO nova.compute.claims [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Claim successful on node np0000001025
May 19 04:57:57.615045 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:57:57.615211 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:57:57.615389 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:57:57.730844 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:57.840783 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:57:57.840966 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:57:58.343353 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:57:58.610683 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:57:58.611008 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:57:58.848808 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.136s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:57:58.849391 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Start building networks asynchronously for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 19 04:57:59.195199 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:57:59.353980 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Allocating IP information in the background. {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 19 04:57:59.354279 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] allocate_for_instance() {{(pid=97981) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 19 04:57:59.354538 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:57:59.354790 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:57:59.420261 np0000001025 nova-compute[97981]: DEBUG nova.policy [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6720ecdbe3414d4eac1542d35d21d5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ff6589269d4d73acf3d5d205b75622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97981) authorize /opt/stack/nova/nova/policy.py:192}}
May 19 04:57:59.615186 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:57:59.856830 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 19 04:57:59.866874 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Successfully created port: 49803331-0062-4f3f-a824-149d029f0c72 {{(pid=97981) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 19 04:58:00.119038 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:58:00.119283 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:58:00.119452 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:58:00.119633 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:58:00.288796 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Successfully updated port: 49803331-0062-4f3f-a824-149d029f0c72 {{(pid=97981) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 19 04:58:00.331968 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-578c134c-6c64-447c-b7b5-9999435fd1f1 req-404563d6-a68c-4b4a-a619-ea859da65619 service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Received event network-changed-49803331-0062-4f3f-a824-149d029f0c72 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:58:00.332117 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-578c134c-6c64-447c-b7b5-9999435fd1f1 req-404563d6-a68c-4b4a-a619-ea859da65619 service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Refreshing instance network info cache due to event network-changed-49803331-0062-4f3f-a824-149d029f0c72. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:58:00.332307 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-578c134c-6c64-447c-b7b5-9999435fd1f1 req-404563d6-a68c-4b4a-a619-ea859da65619 service nova] Acquiring lock "refresh_cache-85380be6-22af-4a62-b4d1-878ffd8bb7b6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:58:00.332434 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-578c134c-6c64-447c-b7b5-9999435fd1f1 req-404563d6-a68c-4b4a-a619-ea859da65619 service nova] Acquired lock "refresh_cache-85380be6-22af-4a62-b4d1-878ffd8bb7b6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:58:00.333027 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-578c134c-6c64-447c-b7b5-9999435fd1f1 req-404563d6-a68c-4b4a-a619-ea859da65619 service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Refreshing network info cache for port 49803331-0062-4f3f-a824-149d029f0c72 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:58:00.360094 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Start building block device mappings for instance. {{(pid=97981) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 19 04:58:00.790619 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "refresh_cache-85380be6-22af-4a62-b4d1-878ffd8bb7b6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:58:00.834759 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-578c134c-6c64-447c-b7b5-9999435fd1f1 req-404563d6-a68c-4b4a-a619-ea859da65619 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:58:00.864911 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Booting with volume 57b63e50-2e88-4755-8ecc-20e2e4561fdd at /dev/vda
May 19 04:58:00.896372 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-578c134c-6c64-447c-b7b5-9999435fd1f1 req-404563d6-a68c-4b4a-a619-ea859da65619 service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:58:00.916153 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:58:00.926711 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:58:00.945040 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:58:00.993211 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:58:00.993670 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:58:01.001741 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:58:01.002718 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fe7c:e1c1', 'fe80::467:79ff:fe7f:c2ac'] 
May 19 04:58:01.002848 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:58:01.002998 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:58:01.003270 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:58:01.003511 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Updating existing volume attachment record: 9029b48c-3a42-48bd-b3d8-0c63557b2e8c {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:58:01.040711 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-578c134c-6c64-447c-b7b5-9999435fd1f1 req-404563d6-a68c-4b4a-a619-ea859da65619 service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:58:01.140876 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:58:01.230393 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:58:01.231068 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:58:01.326192 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:58:01.330453 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:58:01.331800 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:58:01.381513 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:58:01.381874 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=14038MB free_disk=72.69196701049805GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:58:01.382034 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:58:01.382294 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:58:01.543125 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-578c134c-6c64-447c-b7b5-9999435fd1f1 req-404563d6-a68c-4b4a-a619-ea859da65619 service nova] Releasing lock "refresh_cache-85380be6-22af-4a62-b4d1-878ffd8bb7b6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:58:01.544561 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquired lock "refresh_cache-85380be6-22af-4a62-b4d1-878ffd8bb7b6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:58:01.546378 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Building network info cache for instance {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2050}}
May 19 04:58:02.109930 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Instance cache missing network info. {{(pid=97981) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
May 19 04:58:02.256130 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:58:02.373529 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Updating instance_info_cache with network_info: [{"id": "49803331-0062-4f3f-a824-149d029f0c72", "address": "fa:16:3e:91:e6:b3", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49803331-00", "ovs_interfaceid": "49803331-0062-4f3f-a824-149d029f0c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:58:02.435576 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 288173b9-6744-4786-a21a-d987d2384714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:58:02.435697 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 85380be6-22af-4a62-b4d1-878ffd8bb7b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:58:02.435891 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:58:02.436057 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:58:01 up 48 min,  2 users,  load average: 1.61, 2.65, 3.34\n', 'num_instances': '2', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '2', 'num_proj_6f79a8a618f64839bf927ffe9d9115a4': '1', 'io_workload': '1', 'num_vm_building': '1', 'num_task_block_device_mapping': '1', 'num_proj_36ff6589269d4d73acf3d5d205b75622': '1'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:58:02.557524 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:58:02.557754 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:58:02.734701 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:02.876163 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Releasing lock "refresh_cache-85380be6-22af-4a62-b4d1-878ffd8bb7b6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:58:02.876488 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Instance network_info: |[{"id": "49803331-0062-4f3f-a824-149d029f0c72", "address": "fa:16:3e:91:e6:b3", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49803331-00", "ovs_interfaceid": "49803331-0062-4f3f-a824-149d029f0c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97981) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 19 04:58:03.060121 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:58:03.095357 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Start spawning the instance on the hypervisor. {{(pid=97981) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 19 04:58:03.096555 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Creating instance directory {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 19 04:58:03.096799 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Creating image(s)
May 19 04:58:03.097085 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Did not create local disks {{(pid=97981) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 19 04:58:03.097274 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Ensure instance console log exists: /opt/stack/data/nova/instances/85380be6-22af-4a62-b4d1-878ffd8bb7b6/console.log {{(pid=97981) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 19 04:58:03.097505 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:58:03.097691 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:58:03.097843 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:58:03.098390 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Start _get_guest_xml network_info=[{"id": "49803331-0062-4f3f-a824-149d029f0c72", "address": "fa:16:3e:91:e6:b3", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49803331-00", "ovs_interfaceid": "49803331-0062-4f3f-a824-149d029f0c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '9029b48c-3a42-48bd-b3d8-0c63557b2e8c', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '85380be6-22af-4a62-b4d1-878ffd8bb7b6', 'attached_at': '', 'detached_at': '', 'volume_id': '57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'serial': '57b63e50-2e88-4755-8ecc-20e2e4561fdd'}, 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 19 04:58:03.100513 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:58:03.101455 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1908692194', uuid='85380be6-22af-4a62-b4d1-878ffd8bb7b6'), owner=OwnerMeta(userid='6720ecdbe3414d4eac1542d35d21d5ea', username='tempest-TestEncryptedCinderVolumes-282543688-project-member', projectid='36ff6589269d4d73acf3d5d205b75622', projectname='tempest-TestEncryptedCinderVolumes-282543688'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "49803331-0062-4f3f-a824-149d029f0c72", "address": "fa:16:3e:91:e6:b3", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49803331-00", "ovs_interfaceid": "49803331-0062-4f3f-a824-149d029f0c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779166683.1011536) {{(pid=97981) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 19 04:58:03.102459 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V1... {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 19 04:58:03.102717 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] CPU controller missing on host. {{(pid=97981) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 19 04:58:03.103608 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Searching host: 'np0000001025' for CPU controller through CGroups V2... {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 19 04:58:03.103792 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] CPU controller found on host. {{(pid=97981) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 19 04:58:03.104569 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97981) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 19 04:58:03.104804 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-19T04:32:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 19 04:58:03.104923 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Flavor limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 19 04:58:03.105008 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Image limits 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 19 04:58:03.105126 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Flavor pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 19 04:58:03.105246 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Image pref 0:0:0 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 19 04:58:03.105309 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 19 04:58:03.105444 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 19 04:58:03.105531 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 19 04:58:03.105642 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Got 1 possible topologies {{(pid=97981) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 19 04:58:03.105758 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 19 04:58:03.105871 np0000001025 nova-compute[97981]: DEBUG nova.virt.hardware [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97981) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 19 04:58:03.115674 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:58:03.116130 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:58:03.116255 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:58:03.116564 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:58:03.116788 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:58:03.126975 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:58:03.127417 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:58:03.127717 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:58:03.127905 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:58:03.130052 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:58:03.130052 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:58:03.137399 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:58:03.137399 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:03.142505 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:58:03.142505 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:03.151999 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd] added
May 19 04:58:03.151999 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:58:03.151999 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:58:03.151999 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:58:03.151999 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:58:03.151999 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:58:03.151999 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:03.152249 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:58:03.152319 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0244(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:58:03.152457 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:58:03.156561 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd] added
May 19 04:58:03.156561 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:58:03.156561 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:58:03.156561 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:58:03.156561 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:58:03.156561 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:58:03.156561 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:03.156796 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:58:03.156890 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0284(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:58:03.157052 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:58:03.566066 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:58:03.566244 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.184s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:58:03.566564 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.99 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:58:04.152955 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:58:04.157429 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:58:04.165827 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:58:04.165827 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:58:04.173014 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:58:04.173014 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:04.182012 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:04.187304 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:04.194283 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 19 04:58:04.194283 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:58:04.194476 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 19 04:58:04.194476 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:58:04.194600 np0000001025 nova-compute[97981]: WARNING os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 19 04:58:04.194600 np0000001025 nova-compute[97981]: 
May 19 04:58:04.201398 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:04.205581 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 19 04:58:04.205581 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:58:04.205727 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 19 04:58:04.205727 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:58:04.205829 np0000001025 nova-compute[97981]: WARNING os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 19 04:58:04.205829 np0000001025 nova-compute[97981]: 
May 19 04:58:05.229479 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd, portal: 192.168.40.100,3260]
May 19 04:58:05.229479 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd, portal: 192.168.40.100,3260] successful.
May 19 04:58:05.229479 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:05.234465 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd, portal: 192.168.50.100,3260]
May 19 04:58:05.234465 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd, portal: 192.168.50.100,3260] successful.
May 19 04:58:05.234465 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:05.242903 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:05.251234 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:05.256357 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:05.256357 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:05.256357 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:58:05.256519 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:05.256519 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:05.256519 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:58:05.256692 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.129s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:58:05.256787 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:58:05.257319 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] HCTL ('7', '-', '-', 0) found on session 219 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:58:05.257422 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:58:05.264064 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:05.264064 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:05.264064 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:58:05.264218 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:05.264218 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:05.264218 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:58:05.264469 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.136s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:58:05.264576 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:58:05.265044 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] HCTL ('8', '-', '-', 0) found on session 220 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:58:05.265163 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:58:05.272498 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Searching for a device in session 219 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:58:05.272695 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:58:05.283326 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Searching for a device in session 220 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:58:05.283326 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:58:06.128976 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:58:07.145320 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Found WWN 3300000008a171aec for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:58:07.145726 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.029s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:58:07.146740 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] <== connect_volume: return (4030ms) {'type': 'block', 'scsi_wwn': '3300000008a171aec', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000008a171aec'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:58:07.146908 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008a171aec', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000008a171aec'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:58:07.177976 np0000001025 nova-compute[97981]: DEBUG os_brick.encryptors [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '85380be6-22af-4a62-b4d1-878ffd8bb7b6', 'attached_at': '', 'detached_at': '', 'volume_id': '57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'serial': '57b63e50-2e88-4755-8ecc-20e2e4561fdd'} {{(pid=97981) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 19 04:58:07.178496 np0000001025 nova-compute[97981]: WARNING stevedore.named [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 19 04:58:07.178723 np0000001025 nova-compute[97981]: WARNING castellan.key_manager [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:58:07.178873 np0000001025 nova-compute[97981]: WARNING nova.keymgr.conf_key_mgr [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 19 04:58:07.191848 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.host [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Secret XML: <secret ephemeral="no" private="no">
May 19 04:58:07.191848 np0000001025 nova-compute[97981]:   <usage type="volume">
May 19 04:58:07.191848 np0000001025 nova-compute[97981]:     <volume>57b63e50-2e88-4755-8ecc-20e2e4561fdd</volume>
May 19 04:58:07.191848 np0000001025 nova-compute[97981]:   </usage>
May 19 04:58:07.191848 np0000001025 nova-compute[97981]: </secret>
May 19 04:58:07.191848 np0000001025 nova-compute[97981]:  {{(pid=97981) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 19 04:58:07.699330 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:57:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1908692194',display_name='tempest-TestEncryptedCinderVolumes-server-1908692194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testencryptedcindervolumes-server-1908692194',id=81,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA410ze8YCe4u0aQqRN7DK7tE+RlkrXnaPJ+kTcfp9spowhXSxOTwnVQ3dJGH9s2vpjJhGWVHtfzElrJfvMHEniTuVA/lwcQsaFNpsSY+VsU4ZoX+Fw7jYVfDjGnBWgj4g==',key_name='tempest-TestEncryptedCinderVolumes-1821693556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36ff6589269d4d73acf3d5d205b75622',ramdisk_id='',reservation_id='r-6y4tv2j9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-282543688',owner_user_name='tempest-TestEncryptedCinderVolumes-282543688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:58:00Z,user_data=None,user_id='6720ecdbe3414d4eac1542d35d21d5ea',uuid=85380be6-22af-4a62-b4d1-878ffd8bb7b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49803331-0062-4f3f-a824-149d029f0c72", "address": "fa:16:3e:91:e6:b3", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49803331-00", "ovs_interfaceid": "49803331-0062-4f3f-a824-149d029f0c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97981) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 19 04:58:07.699563 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Converting VIF {"id": "49803331-0062-4f3f-a824-149d029f0c72", "address": "fa:16:3e:91:e6:b3", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49803331-00", "ovs_interfaceid": "49803331-0062-4f3f-a824-149d029f0c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:58:07.699977 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:e6:b3,bridge_name='br-int',has_traffic_filtering=True,id=49803331-0062-4f3f-a824-149d029f0c72,network=Network(9c642de3-79c6-4ed4-a828-c4eba2555eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49803331-00') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:58:07.700848 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lazy-loading 'pci_devices' on Instance uuid 85380be6-22af-4a62-b4d1-878ffd8bb7b6 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:58:07.736575 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:08.203227 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] End _get_guest_xml xml=<domain type="qemu">
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:   <uuid>85380be6-22af-4a62-b4d1-878ffd8bb7b6</uuid>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:   <name>instance-00000051</name>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:   <memory>196608</memory>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:   <vcpu>1</vcpu>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:   <metadata>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <nova:package version="33.1.0"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1908692194</nova:name>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <nova:creationTime>2026-05-19 04:58:03</nova:creationTime>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <nova:flavor name="m1.nano" id="42">
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:         <nova:memory>192</nova:memory>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:         <nova:disk>1</nova:disk>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:         <nova:swap>0</nova:swap>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:         <nova:ephemeral>0</nova:ephemeral>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:         <nova:vcpus>1</nova:vcpus>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:         <nova:extraSpecs>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:         </nova:extraSpecs>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       </nova:flavor>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <nova:image uuid="">
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:         <nova:minDisk>1</nova:minDisk>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:         <nova:minRam>0</nova:minRam>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:         <nova:properties>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:         </nova:properties>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       </nova:image>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <nova:owner>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:         <nova:user uuid="6720ecdbe3414d4eac1542d35d21d5ea">tempest-TestEncryptedCinderVolumes-282543688-project-member</nova:user>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:         <nova:project uuid="36ff6589269d4d73acf3d5d205b75622">tempest-TestEncryptedCinderVolumes-282543688</nova:project>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       </nova:owner>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <nova:root type="volume" uuid=""/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <nova:ports>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:         <nova:port uuid="49803331-0062-4f3f-a824-149d029f0c72">
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:         </nova:port>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       </nova:ports>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     </nova:instance>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:   </metadata>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:   <sysinfo type="smbios">
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     <system>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <entry name="product">OpenStack Nova</entry>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <entry name="version">33.1.0</entry>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <entry name="serial">85380be6-22af-4a62-b4d1-878ffd8bb7b6</entry>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <entry name="uuid">85380be6-22af-4a62-b4d1-878ffd8bb7b6</entry>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <entry name="family">Virtual Machine</entry>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     </system>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:   </sysinfo>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:   <os>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     <type arch="x86_64" machine="pc">hvm</type>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     <boot dev="hd"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     <smbios mode="sysinfo"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:   </os>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:   <features>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     <acpi/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     <tcg>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <tb-cache unit="MiB">128</tb-cache>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     </tcg>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     <vmcoreinfo/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:   </features>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:   <iothreads>1</iothreads>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:   <clock offset="utc"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:   <cpu mode="custom" match="exact">
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     <model>Nehalem</model>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     <topology sockets="1" cores="1" threads="1"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:   </cpu>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:   <devices>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     <disk type="file" device="cdrom">
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <source file="/opt/stack/data/nova/instances/85380be6-22af-4a62-b4d1-878ffd8bb7b6/disk.config"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <target dev="hda" bus="ide"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     </disk>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     <disk type="block" device="disk">
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <alias name="ua-57b63e50-2e88-4755-8ecc-20e2e4561fdd"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <target dev="vda" bus="virtio"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <serial>57b63e50-2e88-4755-8ecc-20e2e4561fdd</serial>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <encryption format="luks">
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:         <secret type="passphrase" uuid="4a19c2f4-a334-4277-a389-b8ebcd0387b3"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       </encryption>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     </disk>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     <interface type="ethernet">
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <mac address="fa:16:3e:91:e6:b3"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <driver name="qemu"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <mtu size="1372"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <target dev="tap49803331-00"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     </interface>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     <serial type="pty">
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <log file="/opt/stack/data/nova/instances/85380be6-22af-4a62-b4d1-878ffd8bb7b6/console.log" append="off"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     </serial>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     <video>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <model type="virtio"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     </video>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     <rng model="virtio">
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <backend model="random">/dev/urandom</backend>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     </rng>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     <controller type="usb" index="0" model="none"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:       <stats period="10"/>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:     </memballoon>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:   </devices>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]: </domain>
May 19 04:58:08.203227 np0000001025 nova-compute[97981]:  {{(pid=97981) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 19 04:58:08.205306 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Preparing to wait for external event network-vif-plugged-49803331-0062-4f3f-a824-149d029f0c72 {{(pid=97981) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 19 04:58:08.205306 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:58:08.205306 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:58:08.205306 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:58:08.205306 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-19T04:57:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1908692194',display_name='tempest-TestEncryptedCinderVolumes-server-1908692194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testencryptedcindervolumes-server-1908692194',id=81,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA410ze8YCe4u0aQqRN7DK7tE+RlkrXnaPJ+kTcfp9spowhXSxOTwnVQ3dJGH9s2vpjJhGWVHtfzElrJfvMHEniTuVA/lwcQsaFNpsSY+VsU4ZoX+Fw7jYVfDjGnBWgj4g==',key_name='tempest-TestEncryptedCinderVolumes-1821693556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36ff6589269d4d73acf3d5d205b75622',ramdisk_id='',reservation_id='r-6y4tv2j9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-282543688',owner_user_name='tempest-TestEncryptedCinderVolumes-282543688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-19T04:58:00Z,user_data=None,user_id='6720ecdbe3414d4eac1542d35d21d5ea',uuid=85380be6-22af-4a62-b4d1-878ffd8bb7b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49803331-0062-4f3f-a824-149d029f0c72", "address": "fa:16:3e:91:e6:b3", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49803331-00", "ovs_interfaceid": "49803331-0062-4f3f-a824-149d029f0c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 19 04:58:08.205306 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Converting VIF {"id": "49803331-0062-4f3f-a824-149d029f0c72", "address": "fa:16:3e:91:e6:b3", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49803331-00", "ovs_interfaceid": "49803331-0062-4f3f-a824-149d029f0c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:58:08.205711 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:e6:b3,bridge_name='br-int',has_traffic_filtering=True,id=49803331-0062-4f3f-a824-149d029f0c72,network=Network(9c642de3-79c6-4ed4-a828-c4eba2555eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49803331-00') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:58:08.205987 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:e6:b3,bridge_name='br-int',has_traffic_filtering=True,id=49803331-0062-4f3f-a824-149d029f0c72,network=Network(9c642de3-79c6-4ed4-a828-c4eba2555eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49803331-00') {{(pid=97981) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 19 04:58:08.206318 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:08.206513 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:58:08.206736 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 19 04:58:08.207333 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:08.207459 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e255bdb8-f315-5072-abfd-646b32b5d1e4', '_type': 'linux-noop'}}, row=False) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:58:08.208193 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:08.208967 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:58:08.209043 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:08.210669 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:08.210776 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49803331-00, may_exist=True, interface_attrs={}) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:58:08.211024 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49803331-00, col_values=(('qos', UUID('9a77e4b2-fbd1-434c-b5d1-73c2d9e3973e')),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:58:08.211197 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49803331-00, col_values=(('external_ids', {'iface-id': '49803331-0062-4f3f-a824-149d029f0c72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:e6:b3', 'vm-uuid': '85380be6-22af-4a62-b4d1-878ffd8bb7b6'}),), if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:58:08.211946 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:08.213062 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:58:08.217307 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:08.218127 np0000001025 nova-compute[97981]: INFO os_vif [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:e6:b3,bridge_name='br-int',has_traffic_filtering=True,id=49803331-0062-4f3f-a824-149d029f0c72,network=Network(9c642de3-79c6-4ed4-a828-c4eba2555eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49803331-00')
May 19 04:58:09.216073 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:09.732758 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:58:09.732922 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:58:09.732977 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] No VIF found with MAC fa:16:3e:91:e6:b3, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:58:09.733455 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Using config drive
May 19 04:58:10.239003 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:58:10.339379 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Creating config drive at /opt/stack/data/nova/instances/85380be6-22af-4a62-b4d1-878ffd8bb7b6/disk.config
May 19 04:58:10.342173 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/85380be6-22af-4a62-b4d1-878ffd8bb7b6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdp997eae {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:58:10.394637 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/85380be6-22af-4a62-b4d1-878ffd8bb7b6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdp997eae" returned: 0 in 0.052s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:58:10.763179 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:10.779686 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:10.781814 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:10.868583 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:10.910786 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-23ade7cc-0663-48f2-8b94-f9d067578238 req-514ad07c-f5d3-4940-9509-951f5d4d3599 service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Received event network-vif-plugged-49803331-0062-4f3f-a824-149d029f0c72 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:58:10.911029 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-23ade7cc-0663-48f2-8b94-f9d067578238 req-514ad07c-f5d3-4940-9509-951f5d4d3599 service nova] Acquiring lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:58:10.911569 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-23ade7cc-0663-48f2-8b94-f9d067578238 req-514ad07c-f5d3-4940-9509-951f5d4d3599 service nova] Lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:58:10.911799 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-23ade7cc-0663-48f2-8b94-f9d067578238 req-514ad07c-f5d3-4940-9509-951f5d4d3599 service nova] Lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:58:10.911871 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-23ade7cc-0663-48f2-8b94-f9d067578238 req-514ad07c-f5d3-4940-9509-951f5d4d3599 service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Processing event network-vif-plugged-49803331-0062-4f3f-a824-149d029f0c72 {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 19 04:58:11.037452 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:11.039184 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:11.052904 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:12.390664 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166692.3902588, 85380be6-22af-4a62-b4d1-878ffd8bb7b6 => Started> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:58:12.391019 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97981) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 19 04:58:12.391333 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] VM Started (Lifecycle Event)
May 19 04:58:12.393214 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Guest created on hypervisor {{(pid=97981) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 19 04:58:12.397382 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Instance spawned successfully.
May 19 04:58:12.397685 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 19 04:58:12.894689 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:58:12.896609 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:58:12.905390 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Found default for hw_cdrom_bus of ide {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:58:12.905536 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Found default for hw_disk_bus of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:58:12.905781 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Found default for hw_input_bus of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:58:12.906013 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Found default for hw_pointer_model of None {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:58:12.906259 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Found default for hw_video_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:58:12.906495 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Found default for hw_vif_model of virtio {{(pid=97981) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 19 04:58:12.981553 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-89d8d212-26f5-4563-a432-cae4194e4d0d req-2d42fbb4-e2f5-4453-8f5d-52fee39221cc service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Received event network-vif-plugged-49803331-0062-4f3f-a824-149d029f0c72 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:58:12.983390 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-89d8d212-26f5-4563-a432-cae4194e4d0d req-2d42fbb4-e2f5-4453-8f5d-52fee39221cc service nova] Acquiring lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:58:12.983575 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-89d8d212-26f5-4563-a432-cae4194e4d0d req-2d42fbb4-e2f5-4453-8f5d-52fee39221cc service nova] Lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:58:12.983687 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-89d8d212-26f5-4563-a432-cae4194e4d0d req-2d42fbb4-e2f5-4453-8f5d-52fee39221cc service nova] Lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:58:12.983832 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-89d8d212-26f5-4563-a432-cae4194e4d0d req-2d42fbb4-e2f5-4453-8f5d-52fee39221cc service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] No waiting events found dispatching network-vif-plugged-49803331-0062-4f3f-a824-149d029f0c72 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:58:12.983960 np0000001025 nova-compute[97981]: WARNING nova.compute.manager [req-89d8d212-26f5-4563-a432-cae4194e4d0d req-2d42fbb4-e2f5-4453-8f5d-52fee39221cc service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Received unexpected event network-vif-plugged-49803331-0062-4f3f-a824-149d029f0c72 for instance with vm_state building and task_state spawning.
May 19 04:58:13.211922 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:13.400424 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] During sync_power_state the instance has a pending task (spawning). Skip.
May 19 04:58:13.400424 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166693.3991563, 85380be6-22af-4a62-b4d1-878ffd8bb7b6 => Paused> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:58:13.400424 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] VM Paused (Lifecycle Event)
May 19 04:58:13.411529 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Took 10.32 seconds to spawn the instance on the hypervisor.
May 19 04:58:13.411817 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:58:13.902695 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:58:13.904240 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Emitting event <LifecycleEvent: 1779166693.9039583, 85380be6-22af-4a62-b4d1-878ffd8bb7b6 => Resumed> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:58:13.904534 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] VM Resumed (Lifecycle Event)
May 19 04:58:13.923455 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Took 17.26 seconds to build instance.
May 19 04:58:14.238357 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:14.407411 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:58:14.409089 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97981) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 19 04:58:14.424938 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5c708a77-05bc-4324-b8c0-70139412d54f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.765s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:58:15.904064 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f901e963-2434-4ea9-aecc-37768d9c2e9e req-bf5bbfaf-2192-4d1d-aad7-9a6dae9bb0c2 service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Received event network-changed-49803331-0062-4f3f-a824-149d029f0c72 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:58:15.904534 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-f901e963-2434-4ea9-aecc-37768d9c2e9e req-bf5bbfaf-2192-4d1d-aad7-9a6dae9bb0c2 service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Refreshing instance network info cache due to event network-changed-49803331-0062-4f3f-a824-149d029f0c72. {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 19 04:58:15.904633 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f901e963-2434-4ea9-aecc-37768d9c2e9e req-bf5bbfaf-2192-4d1d-aad7-9a6dae9bb0c2 service nova] Acquiring lock "refresh_cache-85380be6-22af-4a62-b4d1-878ffd8bb7b6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 19 04:58:15.904675 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f901e963-2434-4ea9-aecc-37768d9c2e9e req-bf5bbfaf-2192-4d1d-aad7-9a6dae9bb0c2 service nova] Acquired lock "refresh_cache-85380be6-22af-4a62-b4d1-878ffd8bb7b6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 19 04:58:15.904794 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-f901e963-2434-4ea9-aecc-37768d9c2e9e req-bf5bbfaf-2192-4d1d-aad7-9a6dae9bb0c2 service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Refreshing network info cache for port 49803331-0062-4f3f-a824-149d029f0c72 {{(pid=97981) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2047}}
May 19 04:58:16.408812 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-f901e963-2434-4ea9-aecc-37768d9c2e9e req-bf5bbfaf-2192-4d1d-aad7-9a6dae9bb0c2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:58:16.727600 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [req-f901e963-2434-4ea9-aecc-37768d9c2e9e req-bf5bbfaf-2192-4d1d-aad7-9a6dae9bb0c2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:58:16.870015 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-f901e963-2434-4ea9-aecc-37768d9c2e9e req-bf5bbfaf-2192-4d1d-aad7-9a6dae9bb0c2 service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Updated VIF entry in instance network info cache for port 49803331-0062-4f3f-a824-149d029f0c72. {{(pid=97981) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
May 19 04:58:16.870358 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-f901e963-2434-4ea9-aecc-37768d9c2e9e req-bf5bbfaf-2192-4d1d-aad7-9a6dae9bb0c2 service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Updating instance_info_cache with network_info: [{"id": "49803331-0062-4f3f-a824-149d029f0c72", "address": "fa:16:3e:91:e6:b3", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49803331-00", "ovs_interfaceid": "49803331-0062-4f3f-a824-149d029f0c72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:58:17.372210 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-f901e963-2434-4ea9-aecc-37768d9c2e9e req-bf5bbfaf-2192-4d1d-aad7-9a6dae9bb0c2 service nova] Releasing lock "refresh_cache-85380be6-22af-4a62-b4d1-878ffd8bb7b6" {{(pid=97981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 19 04:58:18.213990 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:19.244524 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:21.349517 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "288173b9-6744-4786-a21a-d987d2384714" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:58:21.349904 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:58:21.852502 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lazy-loading 'flavor' on Instance uuid 288173b9-6744-4786-a21a-d987d2384714 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:58:22.857479 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:58:23.214590 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:23.986042 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "288173b9-6744-4786-a21a-d987d2384714" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:58:23.986607 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:58:23.986607 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Attaching volume 02a4e4ee-0e13-44fb-8d99-6152f880210f to /dev/vdb
May 19 04:58:24.020979 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:58:24.032209 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:58:24.050819 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:58:24.094447 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:58:24.094675 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:58:24.102878 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:58:24.103795 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fe7c:e1c1', 'fe80::467:79ff:fe7f:c2ac', 'fe80::fc16:3eff:fe91:e6b3', 'fe80::1c6c:ff:fe04:9b0e'] 
May 19 04:58:24.103902 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:58:24.103991 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:58:24.104243 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:58:24.104483 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Updating existing volume attachment record: 5a9b23f2-de9f-4bf0-ad5d-2d75a481b809 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:58:24.259405 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:24.651375 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:58:24.651671 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f', 'iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '02a4e4ee-0e13-44fb-8d99-6152f880210f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:58:24.651852 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:58:24.652296 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:58:24.652465 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f', 'iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '02a4e4ee-0e13-44fb-8d99-6152f880210f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:58:24.662668 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:58:24.663056 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:58:24.663636 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:58:24.663903 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:58:24.664078 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:58:24.664274 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:58:24.673703 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:58:24.673703 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:24.677614 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:58:24.677614 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:24.683648 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f] added
May 19 04:58:24.683648 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:58:24.683648 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:58:24.683648 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:58:24.683648 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:58:24.683648 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:58:24.683648 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:24.683925 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:58:24.683925 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.02(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:58:24.684170 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:58:24.688043 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f] added
May 19 04:58:24.688043 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:58:24.688043 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:58:24.688043 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:58:24.688043 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:58:24.688043 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:58:24.688043 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:24.688346 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:58:24.688346 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0243(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:58:24.688553 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:58:25.684512 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:58:25.689752 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:58:25.696442 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:58:25.696442 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:58:25.700484 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:58:25.700484 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:25.710514 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:25.715220 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:25.724556 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:25.724556 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:25.724556 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:58:25.724823 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:25.724823 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:25.724823 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:58:25.733863 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:25.733863 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:25.733863 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:58:25.734067 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:25.734067 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:25.734067 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:58:25.758862 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f, portal: 192.168.40.100,3260]
May 19 04:58:25.758862 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f, portal: 192.168.40.100,3260] successful.
May 19 04:58:25.758862 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:25.771509 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:25.781524 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f, portal: 192.168.50.100,3260]
May 19 04:58:25.781524 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f, portal: 192.168.50.100,3260] successful.
May 19 04:58:25.781524 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:25.787068 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:25.787068 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:25.787068 np0000001025 nova-compute[97981]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f (non-flash)
May 19 04:58:25.787068 np0000001025 nova-compute[97981]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f (non-flash)
May 19 04:58:25.787068 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:58:25.787335 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:25.787335 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:25.787335 np0000001025 nova-compute[97981]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f (non-flash)
May 19 04:58:25.787335 np0000001025 nova-compute[97981]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f (non-flash)
May 19 04:58:25.787335 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:58:25.787686 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.124s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:58:25.787865 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:58:25.788743 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] HCTL ('9', '-', '-', 0) found on session 221 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:58:25.788908 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:58:25.794206 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:25.807198 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Searching for a device in session 221 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:58:25.807198 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '02a4e4ee-0e13-44fb-8d99-6152f880210f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:58:25.807747 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:25.807747 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:25.807747 np0000001025 nova-compute[97981]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f (non-flash)
May 19 04:58:25.807747 np0000001025 nova-compute[97981]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f (non-flash)
May 19 04:58:25.807747 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:58:25.807864 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:25.807864 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:25.807864 np0000001025 nova-compute[97981]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f (non-flash)
May 19 04:58:25.807864 np0000001025 nova-compute[97981]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f (non-flash)
May 19 04:58:25.807864 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:58:25.808124 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:58:25.808261 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:58:25.808799 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] HCTL ('10', '-', '-', 0) found on session 222 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:58:25.808920 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:58:25.823714 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Searching for a device in session 222 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:58:25.824003 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '02a4e4ee-0e13-44fb-8d99-6152f880210f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:58:26.664393 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:58:27.678965 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Found WWN 33000000094429369 for multipath device dm-1 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:58:27.679418 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.027s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:58:27.679418 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] <== connect_volume: return (3027ms) {'type': 'block', 'scsi_wwn': '33000000094429369', 'path': '/dev/dm-1', 'multipath_id': '33000000094429369'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:58:27.679577 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000094429369', 'path': '/dev/dm-1', 'multipath_id': '33000000094429369'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:58:27.682224 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lazy-loading 'flavor' on Instance uuid 288173b9-6744-4786-a21a-d987d2384714 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:58:28.185788 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Attempting to attach volume 02a4e4ee-0e13-44fb-8d99-6152f880210f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:58:28.187001 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:58:28.187001 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:58:28.187001 np0000001025 nova-compute[97981]:   <alias name="ua-02a4e4ee-0e13-44fb-8d99-6152f880210f"/>
May 19 04:58:28.187001 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-1"/>
May 19 04:58:28.187001 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:58:28.187001 np0000001025 nova-compute[97981]:   <serial>02a4e4ee-0e13-44fb-8d99-6152f880210f</serial>
May 19 04:58:28.187001 np0000001025 nova-compute[97981]: </disk>
May 19 04:58:28.187001 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:58:28.215368 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:29.273085 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:29.827742 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:58:29.827863 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:58:29.827959 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:58:29.828047 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] No VIF found with MAC fa:16:3e:7c:e1:c1, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:58:31.368043 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-145e65f8-c5ac-4ea5-94c0-4239d35dd338 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.382s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:58:33.215722 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:34.295230 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:38.217562 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:39.308247 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:40.417677 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "288173b9-6744-4786-a21a-d987d2384714" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:58:40.417677 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:58:40.919260 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Detaching volume 02a4e4ee-0e13-44fb-8d99-6152f880210f
May 19 04:58:40.962713 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Attempting to driver detach volume 02a4e4ee-0e13-44fb-8d99-6152f880210f from mountpoint /dev/vdb
May 19 04:58:40.972569 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Found disk vdb by alias ua-02a4e4ee-0e13-44fb-8d99-6152f880210f {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:58:40.974122 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Found disk vdb by alias ua-02a4e4ee-0e13-44fb-8d99-6152f880210f {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:58:40.974298 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Attempting to detach device vdb from instance 288173b9-6744-4786-a21a-d987d2384714 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:58:40.974555 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:58:40.974555 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:58:40.974555 np0000001025 nova-compute[97981]:   <alias name="ua-02a4e4ee-0e13-44fb-8d99-6152f880210f"/>
May 19 04:58:40.974555 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-1"/>
May 19 04:58:40.974555 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:58:40.974555 np0000001025 nova-compute[97981]:   <serial>02a4e4ee-0e13-44fb-8d99-6152f880210f</serial>
May 19 04:58:40.974555 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:58:40.974555 np0000001025 nova-compute[97981]: </disk>
May 19 04:58:40.974555 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:58:40.980861 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Successfully detached device vdb from instance 288173b9-6744-4786-a21a-d987d2384714 from the persistent domain config.
May 19 04:58:40.981348 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] (1/8): Attempting to detach device vdb with device alias ua-02a4e4ee-0e13-44fb-8d99-6152f880210f from instance 288173b9-6744-4786-a21a-d987d2384714 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:58:40.981667 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:58:40.981667 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:58:40.981667 np0000001025 nova-compute[97981]:   <alias name="ua-02a4e4ee-0e13-44fb-8d99-6152f880210f"/>
May 19 04:58:40.981667 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-1"/>
May 19 04:58:40.981667 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:58:40.981667 np0000001025 nova-compute[97981]:   <serial>02a4e4ee-0e13-44fb-8d99-6152f880210f</serial>
May 19 04:58:40.981667 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:58:40.981667 np0000001025 nova-compute[97981]: </disk>
May 19 04:58:40.981667 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:58:41.442362 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779166721.441835, 288173b9-6744-4786-a21a-d987d2384714 => ua-02a4e4ee-0e13-44fb-8d99-6152f880210f> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:58:41.443277 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-02a4e4ee-0e13-44fb-8d99-6152f880210f for instance 288173b9-6744-4786-a21a-d987d2384714 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:58:41.445342 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Successfully detached device vdb from instance 288173b9-6744-4786-a21a-d987d2384714 from the live domain config.
May 19 04:58:41.446213 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:58:41.446463 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f', 'iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '02a4e4ee-0e13-44fb-8d99-6152f880210f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:58:41.446573 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:58:41.446833 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:58:41.447084 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f', 'iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '02a4e4ee-0e13-44fb-8d99-6152f880210f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:58:41.447273 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:58:41.470092 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:41.470092 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:41.470092 np0000001025 nova-compute[97981]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f (non-flash)
May 19 04:58:41.470092 np0000001025 nova-compute[97981]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f (non-flash)
May 19 04:58:41.470092 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:58:41.470413 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:41.470413 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:41.470413 np0000001025 nova-compute[97981]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f (non-flash)
May 19 04:58:41.470413 np0000001025 nova-compute[97981]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f (non-flash)
May 19 04:58:41.470413 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:58:41.470413 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd', '219'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd', '220'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f', '221'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f', '222')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:58:41.470413 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f', '221')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:58:41.471140 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f', '222')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:58:41.471735 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218500f45e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f'): ({'sde'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:58:41.471904 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Removing multipathed devices sde, sdd {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:58:41.472187 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Flush multipath device 33000000094429369 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:58:41.508362 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:58:41.555517 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:58:41.594391 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:58:41.594514 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:58:41.595151 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:58:41.605004 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:58:41.605211 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:58:41.616074 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:41.646863 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 221, target: iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f, portal: 192.168.40.100,3260]
May 19 04:58:41.646863 np0000001025 nova-compute[97981]: Logout of [sid: 221, target: iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f, portal: 192.168.40.100,3260] successful.
May 19 04:58:41.646863 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:41.659867 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:41.669832 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:41.695881 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 222, target: iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f, portal: 192.168.50.100,3260]
May 19 04:58:41.695881 np0000001025 nova-compute[97981]: Logout of [sid: 222, target: iqn.2023-03.storpool.com:os--volume-02a4e4ee-0e13-44fb-8d99-6152f880210f, portal: 192.168.50.100,3260] successful.
May 19 04:58:41.695881 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:41.706683 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:41.706904 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:58:41.707043 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] <== disconnect_volume: return (260ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:58:41.707225 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:58:42.249416 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lazy-loading 'flavor' on Instance uuid 288173b9-6744-4786-a21a-d987d2384714 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:58:43.218030 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:43.255333 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-f1d96839-6ef3-4d77-96ee-2db44c9c9cff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.838s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:58:44.316860 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:44.851894 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "288173b9-6744-4786-a21a-d987d2384714" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:58:44.852236 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:58:45.354867 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lazy-loading 'flavor' on Instance uuid 288173b9-6744-4786-a21a-d987d2384714 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:58:46.359554 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:58:47.443074 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "288173b9-6744-4786-a21a-d987d2384714" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:58:47.443628 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:58:47.443628 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Attaching volume 595d8f24-60ea-4532-9b74-e8221d099cf5 to /dev/vdb
May 19 04:58:47.480246 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:58:47.490049 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:58:47.508785 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:58:47.551805 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:58:47.552124 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:58:47.559317 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:58:47.560267 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fe7c:e1c1', 'fe80::467:79ff:fe7f:c2ac', 'fe80::fc16:3eff:fe91:e6b3', 'fe80::1c6c:ff:fe04:9b0e'] 
May 19 04:58:47.560380 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:58:47.560476 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:58:47.560690 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] <== get_connector_properties: return (79ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:58:47.560913 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Updating existing volume attachment record: 482ae18c-6b25-4abd-a2e6-a4755fddb8a0 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:58:48.105033 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:58:48.105468 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5', 'iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '595d8f24-60ea-4532-9b74-e8221d099cf5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:58:48.105628 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:58:48.106037 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:58:48.106282 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5', 'iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '595d8f24-60ea-4532-9b74-e8221d099cf5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:58:48.116783 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:58:48.117409 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:58:48.117792 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:58:48.118003 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:58:48.118340 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:58:48.118515 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:58:48.128298 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:58:48.128298 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:48.132524 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:58:48.132524 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:48.138315 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5] added
May 19 04:58:48.138315 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:58:48.138315 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:58:48.138315 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:58:48.138315 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:58:48.138315 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:58:48.138315 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:48.138605 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:58:48.138605 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0205(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:58:48.138710 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:58:48.141664 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5] added
May 19 04:58:48.141664 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:58:48.141664 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:58:48.141664 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:58:48.141664 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:58:48.141664 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:58:48.141664 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:48.141829 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:58:48.141906 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0234(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:58:48.142025 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:58:48.219275 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:49.139100 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:58:49.142355 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:58:49.150684 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:58:49.150684 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:58:49.156897 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:58:49.156897 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:49.162474 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:49.168833 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:49.174590 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:49.174590 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:49.174590 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:58:49.174727 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:49.174727 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:49.174727 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:58:49.179927 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:49.179927 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:49.179927 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:58:49.180091 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:49.180091 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:49.180091 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:58:49.205331 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5, portal: 192.168.40.100,3260]
May 19 04:58:49.205331 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5, portal: 192.168.40.100,3260] successful.
May 19 04:58:49.205331 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:49.216612 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:49.225439 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5, portal: 192.168.50.100,3260]
May 19 04:58:49.225439 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5, portal: 192.168.50.100,3260] successful.
May 19 04:58:49.225439 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:49.230921 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:49.230921 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:49.230921 np0000001025 nova-compute[97981]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5 (non-flash)
May 19 04:58:49.230921 np0000001025 nova-compute[97981]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5 (non-flash)
May 19 04:58:49.230921 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:58:49.231135 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:49.231135 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:49.231135 np0000001025 nova-compute[97981]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5 (non-flash)
May 19 04:58:49.231135 np0000001025 nova-compute[97981]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5 (non-flash)
May 19 04:58:49.231135 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:58:49.231328 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.114s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:58:49.231420 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:58:49.231981 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] HCTL ('9', '-', '-', 0) found on session 223 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:58:49.232182 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:58:49.237236 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:49.246789 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Searching for a device in session 223 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:58:49.246789 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '595d8f24-60ea-4532-9b74-e8221d099cf5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:58:49.250799 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:49.250799 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:49.250799 np0000001025 nova-compute[97981]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5 (non-flash)
May 19 04:58:49.250799 np0000001025 nova-compute[97981]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5 (non-flash)
May 19 04:58:49.250799 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:58:49.250956 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:49.250956 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:49.250956 np0000001025 nova-compute[97981]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5 (non-flash)
May 19 04:58:49.250956 np0000001025 nova-compute[97981]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5 (non-flash)
May 19 04:58:49.250956 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:58:49.251281 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.133s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:58:49.251417 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:58:49.251992 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] HCTL ('10', '-', '-', 0) found on session 224 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:58:49.252123 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:58:49.264982 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Searching for a device in session 224 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:58:49.264982 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '595d8f24-60ea-4532-9b74-e8221d099cf5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:58:49.329131 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:49.561843 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:58:49.562250 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:58:49.562481 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:58:49.562740 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:58:49.563025 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.05 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:58:50.118559 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:58:50.615137 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:58:50.615543 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:58:50.615620 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 8.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:58:51.133436 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Found WWN 33000000018e9a3df for multipath device dm-1 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:58:51.133706 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:58:51.133858 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] <== connect_volume: return (3028ms) {'type': 'block', 'scsi_wwn': '33000000018e9a3df', 'path': '/dev/dm-1', 'multipath_id': '33000000018e9a3df'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:58:51.133973 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000018e9a3df', 'path': '/dev/dm-1', 'multipath_id': '33000000018e9a3df'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:58:51.136553 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lazy-loading 'flavor' on Instance uuid 288173b9-6744-4786-a21a-d987d2384714 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:58:51.639926 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Attempting to attach volume 595d8f24-60ea-4532-9b74-e8221d099cf5 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:58:51.641388 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:58:51.641388 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:58:51.641388 np0000001025 nova-compute[97981]:   <alias name="ua-595d8f24-60ea-4532-9b74-e8221d099cf5"/>
May 19 04:58:51.641388 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-1"/>
May 19 04:58:51.641388 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:58:51.641388 np0000001025 nova-compute[97981]:   <serial>595d8f24-60ea-4532-9b74-e8221d099cf5</serial>
May 19 04:58:51.641388 np0000001025 nova-compute[97981]: </disk>
May 19 04:58:51.641388 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:58:53.001008 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:58:53.001477 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:58:53.001477 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:58:53.001627 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:58:53.001737 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:58:53.003991 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Terminating instance
May 19 04:58:53.221523 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:53.273221 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:58:53.273340 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:58:53.273445 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:58:53.273552 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] No VIF found with MAC fa:16:3e:7c:e1:c1, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:58:53.506871 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:58:53.520474 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:53.522625 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:53.536636 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:53.540398 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:53.556099 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:53.637872 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5034c223-9157-4ba4-920a-63e55c4bedd4 req-114d0adb-17e4-403a-a8e1-e40d91c936a5 service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Received event network-vif-unplugged-49803331-0062-4f3f-a824-149d029f0c72 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:58:53.638102 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5034c223-9157-4ba4-920a-63e55c4bedd4 req-114d0adb-17e4-403a-a8e1-e40d91c936a5 service nova] Acquiring lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:58:53.638512 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5034c223-9157-4ba4-920a-63e55c4bedd4 req-114d0adb-17e4-403a-a8e1-e40d91c936a5 service nova] Lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:58:53.638690 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-5034c223-9157-4ba4-920a-63e55c4bedd4 req-114d0adb-17e4-403a-a8e1-e40d91c936a5 service nova] Lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:58:53.638815 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5034c223-9157-4ba4-920a-63e55c4bedd4 req-114d0adb-17e4-403a-a8e1-e40d91c936a5 service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] No waiting events found dispatching network-vif-unplugged-49803331-0062-4f3f-a824-149d029f0c72 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:58:53.638961 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-5034c223-9157-4ba4-920a-63e55c4bedd4 req-114d0adb-17e4-403a-a8e1-e40d91c936a5 service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Received event network-vif-unplugged-49803331-0062-4f3f-a824-149d029f0c72 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:58:53.699355 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:53.822926 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999645251999937 future=<Future at 0x721834241400 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:58:53.823285 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999245277999762 future=<Future at 0x721834241400 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:58:53.823416 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999128763000044 future=<Future at 0x721834241400 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:58:53.825100 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Instance destroyed successfully.
May 19 04:58:53.825509 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lazy-loading 'resources' on Instance uuid 85380be6-22af-4a62-b4d1-878ffd8bb7b6 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:58:54.327617 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:57:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1908692194',display_name='tempest-TestEncryptedCinderVolumes-server-1908692194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-testencryptedcindervolumes-server-1908692194',id=81,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA410ze8YCe4u0aQqRN7DK7tE+RlkrXnaPJ+kTcfp9spowhXSxOTwnVQ3dJGH9s2vpjJhGWVHtfzElrJfvMHEniTuVA/lwcQsaFNpsSY+VsU4ZoX+Fw7jYVfDjGnBWgj4g==',key_name='tempest-TestEncryptedCinderVolumes-1821693556',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:58:13Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36ff6589269d4d73acf3d5d205b75622',ramdisk_id='',reservation_id='r-6y4tv2j9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-282543688',owner_user_name='tempest-TestEncryptedCinderVolumes-282543688-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:58:13Z,user_data=None,user_id='6720ecdbe3414d4eac1542d35d21d5ea',uuid=85380be6-22af-4a62-b4d1-878ffd8bb7b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49803331-0062-4f3f-a824-149d029f0c72", "address": "fa:16:3e:91:e6:b3", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49803331-00", "ovs_interfaceid": "49803331-0062-4f3f-a824-149d029f0c72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:58:54.328165 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Converting VIF {"id": "49803331-0062-4f3f-a824-149d029f0c72", "address": "fa:16:3e:91:e6:b3", "network": {"id": "9c642de3-79c6-4ed4-a828-c4eba2555eaf", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1708300095-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36ff6589269d4d73acf3d5d205b75622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49803331-00", "ovs_interfaceid": "49803331-0062-4f3f-a824-149d029f0c72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:58:54.328422 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:e6:b3,bridge_name='br-int',has_traffic_filtering=True,id=49803331-0062-4f3f-a824-149d029f0c72,network=Network(9c642de3-79c6-4ed4-a828-c4eba2555eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49803331-00') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:58:54.328635 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:e6:b3,bridge_name='br-int',has_traffic_filtering=True,id=49803331-0062-4f3f-a824-149d029f0c72,network=Network(9c642de3-79c6-4ed4-a828-c4eba2555eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49803331-00') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:58:54.336339 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:54.337747 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:54.337907 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49803331-00, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:58:54.338801 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:54.339512 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:58:54.340391 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:54.340527 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a77e4b2-fbd1-434c-b5d1-73c2d9e3973e) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:58:54.340989 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:54.341572 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:58:54.341657 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:54.343195 np0000001025 nova-compute[97981]: INFO os_vif [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:e6:b3,bridge_name='br-int',has_traffic_filtering=True,id=49803331-0062-4f3f-a824-149d029f0c72,network=Network(9c642de3-79c6-4ed4-a828-c4eba2555eaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49803331-00')
May 19 04:58:54.346089 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:58:54.346447 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:58:54.346597 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:58:54.346942 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:58:54.347326 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '57b63e50-2e88-4755-8ecc-20e2e4561fdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:58:54.347475 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:58:54.372010 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:54.372010 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:54.372010 np0000001025 nova-compute[97981]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5 (non-flash)
May 19 04:58:54.372010 np0000001025 nova-compute[97981]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5 (non-flash)
May 19 04:58:54.372010 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:58:54.372282 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:54.372282 np0000001025 nova-compute[97981]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd (non-flash)
May 19 04:58:54.372282 np0000001025 nova-compute[97981]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5 (non-flash)
May 19 04:58:54.372282 np0000001025 nova-compute[97981]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5 (non-flash)
May 19 04:58:54.372282 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:58:54.372282 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd', '219'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd', '220'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5', '223'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5', '224')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:58:54.372505 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd', '219')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:58:54.373064 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd', '220')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:58:54.373679 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218342a1080>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd'): ({'sdc'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:58:54.373851 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Removing multipathed devices sdc, sdb {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:58:54.374052 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Flush multipath device 3300000008a171aec {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:58:54.407416 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:58:54.452502 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:58:54.495699 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:58:54.495918 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:58:54.496760 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:58:54.510481 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:58:54.510652 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:58:54.522281 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:54.550285 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 219, target: iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd, portal: 192.168.40.100,3260]
May 19 04:58:54.550285 np0000001025 nova-compute[97981]: Logout of [sid: 219, target: iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd, portal: 192.168.40.100,3260] successful.
May 19 04:58:54.550285 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:54.565527 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:54.578142 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:54.603977 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 220, target: iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd, portal: 192.168.50.100,3260]
May 19 04:58:54.603977 np0000001025 nova-compute[97981]: Logout of [sid: 220, target: iqn.2023-03.storpool.com:os--volume-57b63e50-2e88-4755-8ecc-20e2e4561fdd, portal: 192.168.50.100,3260] successful.
May 19 04:58:54.603977 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:54.619578 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:54.620864 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:58:54.621017 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] <== disconnect_volume: return (274ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:58:54.621192 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:58:54.621503 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Deleting instance files /opt/stack/data/nova/instances/85380be6-22af-4a62-b4d1-878ffd8bb7b6_del
May 19 04:58:54.621978 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Deletion of /opt/stack/data/nova/instances/85380be6-22af-4a62-b4d1-878ffd8bb7b6_del complete
May 19 04:58:54.820365 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-54e94e8d-9afc-4d94-8b11-9138648806ff tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.377s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:58:55.128322 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Took 1.62 seconds to destroy the instance on the hypervisor.
May 19 04:58:55.128843 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:58:55.129077 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:58:55.129268 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:58:55.129505 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:58:55.190727 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:58:55.692654 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3fb89609-6d65-4d33-8ae6-19fe08fb1d9c req-a52f8eca-d2e9-4601-bf28-7f83413e5d63 service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Received event network-vif-unplugged-49803331-0062-4f3f-a824-149d029f0c72 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:58:55.693099 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3fb89609-6d65-4d33-8ae6-19fe08fb1d9c req-a52f8eca-d2e9-4601-bf28-7f83413e5d63 service nova] Acquiring lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:58:55.693966 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3fb89609-6d65-4d33-8ae6-19fe08fb1d9c req-a52f8eca-d2e9-4601-bf28-7f83413e5d63 service nova] Lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:58:55.694172 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-3fb89609-6d65-4d33-8ae6-19fe08fb1d9c req-a52f8eca-d2e9-4601-bf28-7f83413e5d63 service nova] Lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:58:55.694374 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3fb89609-6d65-4d33-8ae6-19fe08fb1d9c req-a52f8eca-d2e9-4601-bf28-7f83413e5d63 service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] No waiting events found dispatching network-vif-unplugged-49803331-0062-4f3f-a824-149d029f0c72 {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:58:55.694531 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3fb89609-6d65-4d33-8ae6-19fe08fb1d9c req-a52f8eca-d2e9-4601-bf28-7f83413e5d63 service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Received event network-vif-unplugged-49803331-0062-4f3f-a824-149d029f0c72 for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:58:55.694722 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3fb89609-6d65-4d33-8ae6-19fe08fb1d9c req-a52f8eca-d2e9-4601-bf28-7f83413e5d63 service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Received event network-vif-deleted-49803331-0062-4f3f-a824-149d029f0c72 {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:58:55.695057 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-3fb89609-6d65-4d33-8ae6-19fe08fb1d9c req-a52f8eca-d2e9-4601-bf28-7f83413e5d63 service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Neutron deleted interface 49803331-0062-4f3f-a824-149d029f0c72; detaching it from the instance and deleting it from the info cache
May 19 04:58:55.695057 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-3fb89609-6d65-4d33-8ae6-19fe08fb1d9c req-a52f8eca-d2e9-4601-bf28-7f83413e5d63 service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:58:56.045300 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:58:56.198739 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-3fb89609-6d65-4d33-8ae6-19fe08fb1d9c req-a52f8eca-d2e9-4601-bf28-7f83413e5d63 service nova] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Detach interface failed, port_id=49803331-0062-4f3f-a824-149d029f0c72, reason: Instance 85380be6-22af-4a62-b4d1-878ffd8bb7b6 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:58:56.547523 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Took 1.42 seconds to deallocate network for instance.
May 19 04:58:57.089611 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Took 0.54 seconds to detach 1 volumes for instance.
May 19 04:58:57.595428 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:58:57.595593 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:58:57.719442 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:58:57.719628 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:58:58.208622 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "288173b9-6744-4786-a21a-d987d2384714" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:58:58.209049 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:58:58.222026 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:58:58.614921 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:58:58.615185 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:58:58.615474 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:58:58.710847 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Detaching volume 595d8f24-60ea-4532-9b74-e8221d099cf5
May 19 04:58:58.729145 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.133s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:58:58.744437 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Attempting to driver detach volume 595d8f24-60ea-4532-9b74-e8221d099cf5 from mountpoint /dev/vdb
May 19 04:58:58.748998 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Found disk vdb by alias ua-595d8f24-60ea-4532-9b74-e8221d099cf5 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:58:58.750041 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Found disk vdb by alias ua-595d8f24-60ea-4532-9b74-e8221d099cf5 {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:58:58.750210 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Attempting to detach device vdb from instance 288173b9-6744-4786-a21a-d987d2384714 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:58:58.750450 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:58:58.750450 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:58:58.750450 np0000001025 nova-compute[97981]:   <alias name="ua-595d8f24-60ea-4532-9b74-e8221d099cf5"/>
May 19 04:58:58.750450 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-1"/>
May 19 04:58:58.750450 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:58:58.750450 np0000001025 nova-compute[97981]:   <serial>595d8f24-60ea-4532-9b74-e8221d099cf5</serial>
May 19 04:58:58.750450 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:58:58.750450 np0000001025 nova-compute[97981]: </disk>
May 19 04:58:58.750450 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:58:58.755523 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Successfully detached device vdb from instance 288173b9-6744-4786-a21a-d987d2384714 from the persistent domain config.
May 19 04:58:58.755639 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] (1/8): Attempting to detach device vdb with device alias ua-595d8f24-60ea-4532-9b74-e8221d099cf5 from instance 288173b9-6744-4786-a21a-d987d2384714 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:58:58.755856 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:58:58.755856 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:58:58.755856 np0000001025 nova-compute[97981]:   <alias name="ua-595d8f24-60ea-4532-9b74-e8221d099cf5"/>
May 19 04:58:58.755856 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-1"/>
May 19 04:58:58.755856 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:58:58.755856 np0000001025 nova-compute[97981]:   <serial>595d8f24-60ea-4532-9b74-e8221d099cf5</serial>
May 19 04:58:58.755856 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:58:58.755856 np0000001025 nova-compute[97981]: </disk>
May 19 04:58:58.755856 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:58:58.771583 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Deleted allocations for instance 85380be6-22af-4a62-b4d1-878ffd8bb7b6
May 19 04:58:59.214790 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779166739.2144208, 288173b9-6744-4786-a21a-d987d2384714 => ua-595d8f24-60ea-4532-9b74-e8221d099cf5> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:58:59.215797 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-595d8f24-60ea-4532-9b74-e8221d099cf5 for instance 288173b9-6744-4786-a21a-d987d2384714 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:58:59.217995 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Successfully detached device vdb from instance 288173b9-6744-4786-a21a-d987d2384714 from the live domain config.
May 19 04:58:59.219150 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:58:59.219447 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5', 'iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '595d8f24-60ea-4532-9b74-e8221d099cf5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:58:59.219578 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:58:59.219861 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:58:59.220085 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5', 'iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '595d8f24-60ea-4532-9b74-e8221d099cf5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:58:59.220230 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:58:59.242567 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5 (non-flash)
May 19 04:58:59.242567 np0000001025 nova-compute[97981]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5 (non-flash)
May 19 04:58:59.242567 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:58:59.242842 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsi session list stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5 (non-flash)
May 19 04:58:59.242842 np0000001025 nova-compute[97981]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5 (non-flash)
May 19 04:58:59.242842 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:58:59.242842 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5', '223'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5', '224')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:58:59.242842 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5', '223')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:58:59.243535 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5', '224')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:58:59.244076 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218500f5120>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5'): ({'sde'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:58:59.244283 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Removing multipathed devices sde, sdd {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:58:59.244496 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Flush multipath device 33000000018e9a3df {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:58:59.277804 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:58:59.322783 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:58:59.345071 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:58:59.386799 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:58:59.386984 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:58:59.387586 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:58:59.399650 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:58:59.399895 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:58:59.413047 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:59.440290 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 223, target: iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5, portal: 192.168.40.100,3260]
May 19 04:58:59.440290 np0000001025 nova-compute[97981]: Logout of [sid: 223, target: iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5, portal: 192.168.40.100,3260] successful.
May 19 04:58:59.440290 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:59.453343 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:59.465051 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:59.497371 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 224, target: iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5, portal: 192.168.50.100,3260]
May 19 04:58:59.497371 np0000001025 nova-compute[97981]: Logout of [sid: 224, target: iqn.2023-03.storpool.com:os--volume-595d8f24-60ea-4532-9b74-e8221d099cf5, portal: 192.168.50.100,3260] successful.
May 19 04:58:59.497371 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:59.507959 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:58:59.508214 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:58:59.508331 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] <== disconnect_volume: return (288ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:58:59.508434 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:58:59.614861 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:58:59.779194 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-68b62236-a1ce-42c1-b6fe-ce391aabd177 tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Lock "85380be6-22af-4a62-b4d1-878ffd8bb7b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.778s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:59:00.055182 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lazy-loading 'flavor' on Instance uuid 288173b9-6744-4786-a21a-d987d2384714 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:59:00.120384 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:59:00.120548 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:59:00.120720 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:59:00.120829 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 04:59:01.060306 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-7d6e8851-db69-42e3-ace0-cb592df6f33f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.851s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:59:01.140120 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:59:01.231134 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:59:01.231629 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/disk --force-share --output=json {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:59:01.322079 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:59:01.326595 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 04:59:01.328943 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:59:01.375361 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 04:59:01.375773 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=13999MB free_disk=72.65225982666016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 04:59:01.375910 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:59:01.376222 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:59:02.446543 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Instance 288173b9-6744-4786-a21a-d987d2384714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97981) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 19 04:59:02.446857 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 04:59:02.447051 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:59:01 up 49 min,  2 users,  load average: 1.10, 2.33, 3.18\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_6f79a8a618f64839bf927ffe9d9115a4': '1', 'io_workload': '0'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 04:59:02.560872 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:59:02.561253 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:59:02.607961 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "288173b9-6744-4786-a21a-d987d2384714" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:59:02.608135 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:59:03.064256 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:59:03.111608 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lazy-loading 'flavor' on Instance uuid 288173b9-6744-4786-a21a-d987d2384714 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:59:03.570822 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 04:59:03.571292 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.195s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:59:03.571418 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.99 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:59:03.572554 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:04.116643 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:59:04.346469 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:05.040752 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:05.192035 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "288173b9-6744-4786-a21a-d987d2384714" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:59:05.192292 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:59:05.192535 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Attaching volume 254978a0-abef-4763-ae80-1eac9044397a to /dev/vdb
May 19 04:59:05.228366 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:59:05.239796 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:59:05.264553 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:59:05.309044 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:59:05.309446 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:59:05.319474 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:59:05.320638 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fe7c:e1c1', 'fe80::467:79ff:fe7f:c2ac'] 
May 19 04:59:05.320838 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:59:05.320955 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:59:05.321392 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:59:05.321707 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Updating existing volume attachment record: 7f08dcdd-e183-4009-8bac-c2bbf1dc05d7 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:59:05.872272 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:59:05.872620 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a', 'iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '254978a0-abef-4763-ae80-1eac9044397a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:59:05.872814 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:59:05.873324 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:59:05.873598 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a', 'iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '254978a0-abef-4763-ae80-1eac9044397a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:59:05.887152 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:59:05.887525 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:59:05.887936 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:59:05.888125 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:59:05.888484 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:59:05.888651 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:59:05.898326 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:59:05.898326 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:05.903161 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:59:05.903161 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:05.909404 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a] added
May 19 04:59:05.909404 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:59:05.909404 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:59:05.909404 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:59:05.909404 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:59:05.909404 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:59:05.909404 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:05.909727 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:59:05.909796 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0216(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:59:05.910000 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:59:05.916495 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a] added
May 19 04:59:05.916495 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:59:05.916495 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:59:05.916495 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:59:05.916495 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:59:05.916495 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:59:05.916495 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:05.916724 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:59:05.916724 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0281(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:59:05.916923 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:59:06.910441 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:59:06.917410 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:59:06.923550 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:59:06.923550 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:59:06.929310 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:59:06.929310 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:06.935745 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:06.941071 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:06.945897 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 19 04:59:06.945897 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:59:06.946050 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 19 04:59:06.946050 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:59:06.946223 np0000001025 nova-compute[97981]: WARNING os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 19 04:59:06.946223 np0000001025 nova-compute[97981]: 
May 19 04:59:06.951971 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 19 04:59:06.951971 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:59:06.952167 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 19 04:59:06.952167 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:59:06.952292 np0000001025 nova-compute[97981]: WARNING os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 19 04:59:06.952292 np0000001025 nova-compute[97981]: 
May 19 04:59:06.972124 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a, portal: 192.168.40.100,3260]
May 19 04:59:06.972124 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a, portal: 192.168.40.100,3260] successful.
May 19 04:59:06.972124 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:06.983754 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:06.991793 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a, portal: 192.168.50.100,3260]
May 19 04:59:06.991793 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a, portal: 192.168.50.100,3260] successful.
May 19 04:59:06.991793 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:06.996381 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a (non-flash)
May 19 04:59:06.996381 np0000001025 nova-compute[97981]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a (non-flash)
May 19 04:59:06.996381 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:59:06.996521 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a (non-flash)
May 19 04:59:06.996521 np0000001025 nova-compute[97981]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a (non-flash)
May 19 04:59:06.996521 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:59:06.996731 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.109s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:59:06.996830 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:59:06.997309 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] HCTL ('7', '-', '-', 0) found on session 225 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:59:06.997409 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:59:07.003276 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:07.011598 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Searching for a device in session 225 and hctl ['7', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:59:07.016429 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a (non-flash)
May 19 04:59:07.016429 np0000001025 nova-compute[97981]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a (non-flash)
May 19 04:59:07.016429 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:59:07.016553 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a (non-flash)
May 19 04:59:07.016553 np0000001025 nova-compute[97981]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a (non-flash)
May 19 04:59:07.016553 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:59:07.016776 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.128s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:59:07.016877 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:59:07.017306 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] HCTL ('8', '-', '-', 0) found on session 226 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:59:07.017414 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:59:07.030986 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Searching for a device in session 226 and hctl ['8', '*', '*', 0] yield: None {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:59:08.012346 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Searching for a device in session 225 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:59:08.012816 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '254978a0-abef-4763-ae80-1eac9044397a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:59:08.030732 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Searching for a device in session 226 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:59:08.030892 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '254978a0-abef-4763-ae80-1eac9044397a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:59:08.823130 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0004964869999639632 future=<Future at 0x721834241400 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:59:08.823316 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:59:08.823549 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Emitting event <LifecycleEvent: 1779166733.8224514, 85380be6-22af-4a62-b4d1-878ffd8bb7b6 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 04:59:08.823690 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] VM Stopped (Lifecycle Event)
May 19 04:59:08.888670 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:59:09.326665 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 85380be6-22af-4a62-b4d1-878ffd8bb7b6] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 04:59:09.370940 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:09.907593 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Found WWN 330000000408f2488 for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:59:09.907931 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.035s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:59:09.908189 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] <== connect_volume: return (4035ms) {'type': 'block', 'scsi_wwn': '330000000408f2488', 'path': '/dev/dm-0', 'multipath_id': '330000000408f2488'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:59:09.908370 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000408f2488', 'path': '/dev/dm-0', 'multipath_id': '330000000408f2488'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:59:09.911367 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lazy-loading 'flavor' on Instance uuid 288173b9-6744-4786-a21a-d987d2384714 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:59:10.414641 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Attempting to attach volume 254978a0-abef-4763-ae80-1eac9044397a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:59:10.416159 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:59:10.416159 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:59:10.416159 np0000001025 nova-compute[97981]:   <alias name="ua-254978a0-abef-4763-ae80-1eac9044397a"/>
May 19 04:59:10.416159 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:59:10.416159 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:59:10.416159 np0000001025 nova-compute[97981]:   <serial>254978a0-abef-4763-ae80-1eac9044397a</serial>
May 19 04:59:10.416159 np0000001025 nova-compute[97981]: </disk>
May 19 04:59:10.416159 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:59:12.047811 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:59:12.048253 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:59:12.048253 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:59:12.048253 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] No VIF found with MAC fa:16:3e:7c:e1:c1, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:59:13.589003 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-57520e3c-df1c-40f7-be0b-b65db1601419 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.397s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:59:14.355977 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:14.372329 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:16.837534 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "288173b9-6744-4786-a21a-d987d2384714" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:59:16.837994 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:59:17.339775 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Detaching volume 254978a0-abef-4763-ae80-1eac9044397a
May 19 04:59:17.421804 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Attempting to driver detach volume 254978a0-abef-4763-ae80-1eac9044397a from mountpoint /dev/vdb
May 19 04:59:17.425655 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Found disk vdb by alias ua-254978a0-abef-4763-ae80-1eac9044397a {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:59:17.426795 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Found disk vdb by alias ua-254978a0-abef-4763-ae80-1eac9044397a {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:59:17.426974 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Attempting to detach device vdb from instance 288173b9-6744-4786-a21a-d987d2384714 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:59:17.427216 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:59:17.427216 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:59:17.427216 np0000001025 nova-compute[97981]:   <alias name="ua-254978a0-abef-4763-ae80-1eac9044397a"/>
May 19 04:59:17.427216 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:59:17.427216 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:59:17.427216 np0000001025 nova-compute[97981]:   <serial>254978a0-abef-4763-ae80-1eac9044397a</serial>
May 19 04:59:17.427216 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:59:17.427216 np0000001025 nova-compute[97981]: </disk>
May 19 04:59:17.427216 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:59:17.431560 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Successfully detached device vdb from instance 288173b9-6744-4786-a21a-d987d2384714 from the persistent domain config.
May 19 04:59:17.431658 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] (1/8): Attempting to detach device vdb with device alias ua-254978a0-abef-4763-ae80-1eac9044397a from instance 288173b9-6744-4786-a21a-d987d2384714 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:59:17.431984 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:59:17.431984 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:59:17.431984 np0000001025 nova-compute[97981]:   <alias name="ua-254978a0-abef-4763-ae80-1eac9044397a"/>
May 19 04:59:17.431984 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:59:17.431984 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:59:17.431984 np0000001025 nova-compute[97981]:   <serial>254978a0-abef-4763-ae80-1eac9044397a</serial>
May 19 04:59:17.431984 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:59:17.431984 np0000001025 nova-compute[97981]: </disk>
May 19 04:59:17.431984 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:59:17.877334 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779166757.8769977, 288173b9-6744-4786-a21a-d987d2384714 => ua-254978a0-abef-4763-ae80-1eac9044397a> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:59:17.878181 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-254978a0-abef-4763-ae80-1eac9044397a for instance 288173b9-6744-4786-a21a-d987d2384714 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:59:17.879986 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Successfully detached device vdb from instance 288173b9-6744-4786-a21a-d987d2384714 from the live domain config.
May 19 04:59:17.880893 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:59:17.881160 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a', 'iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '254978a0-abef-4763-ae80-1eac9044397a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:59:17.881260 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:59:17.881560 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:59:17.881792 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a', 'iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '254978a0-abef-4763-ae80-1eac9044397a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:59:17.881923 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:59:17.902986 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a (non-flash)
May 19 04:59:17.902986 np0000001025 nova-compute[97981]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a (non-flash)
May 19 04:59:17.902986 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:59:17.902986 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a (non-flash)
May 19 04:59:17.902986 np0000001025 nova-compute[97981]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a (non-flash)
May 19 04:59:17.902986 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:59:17.903278 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a', '225'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a', '226')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:59:17.903278 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a', '225')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:59:17.903855 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a', '226')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:59:17.904416 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7218342794e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a'): ({'sdc'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:59:17.904623 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Removing multipathed devices sdc, sdb {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:59:17.904808 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Flush multipath device 330000000408f2488 {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:59:17.948086 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:59:17.986808 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:59:18.029653 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:59:18.029822 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:59:18.030424 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:59:18.040982 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:59:18.041189 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:59:18.054220 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:18.080350 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 225, target: iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a, portal: 192.168.40.100,3260]
May 19 04:59:18.080350 np0000001025 nova-compute[97981]: Logout of [sid: 225, target: iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a, portal: 192.168.40.100,3260] successful.
May 19 04:59:18.080350 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:18.092953 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:18.103888 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:18.131252 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 226, target: iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a, portal: 192.168.50.100,3260]
May 19 04:59:18.131252 np0000001025 nova-compute[97981]: Logout of [sid: 226, target: iqn.2023-03.storpool.com:os--volume-254978a0-abef-4763-ae80-1eac9044397a, portal: 192.168.50.100,3260] successful.
May 19 04:59:18.131252 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:18.145256 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:18.145487 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:59:18.145623 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] <== disconnect_volume: return (263ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:59:18.145739 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:59:18.689075 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lazy-loading 'flavor' on Instance uuid 288173b9-6744-4786-a21a-d987d2384714 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:59:19.365898 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:19.373143 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:19.694575 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-2448e5d4-22a2-482e-a961-97846c95de6c tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.857s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:59:21.150656 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "288173b9-6744-4786-a21a-d987d2384714" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:59:21.150993 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:59:21.654240 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lazy-loading 'flavor' on Instance uuid 288173b9-6744-4786-a21a-d987d2384714 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:59:22.658511 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:59:23.721048 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "288173b9-6744-4786-a21a-d987d2384714" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:59:23.721503 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:59:23.721605 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Attaching volume f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee to /dev/vdb
May 19 04:59:23.759005 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001025', 'execute': None}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:59:23.769520 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.scaleio [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97981) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 19 04:59:23.789645 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Running cmd (subprocess): nvme version {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 04:59:23.834180 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] 'nvme version' failed. Not Retrying. {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 19 04:59:23.834447 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] nvme not present on system {{(pid=97981) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 19 04:59:23.843833 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97981) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 19 04:59:23.845027 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.lightos [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:feab:4c68', '192.168.40.6', 'fe80::f816:3eff:fe82:7f49', '192.168.50.6', 'fe80::f816:3eff:febf:77c5', '192.168.10.6', 'fe80::f816:3eff:feb8:9a2c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::ec64:4fff:fe44:fe4c', 'fe80::fc16:3eff:fe7c:e1c1', 'fe80::467:79ff:fe7f:c2ac'] 
May 19 04:59:23.845228 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 19 04:59:23.845392 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.lightos [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] LIGHTOS: no hostnqn found. {{(pid=97981) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 19 04:59:23.845847 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001025', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:735cd3e07ae2', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'a17133d4-4f5c-43fc-9abf-8886a3512454', 'nvme_native_multipath': False} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:59:23.846240 np0000001025 nova-compute[97981]: DEBUG nova.virt.block_device [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Updating existing volume attachment record: 77c0482d-5aef-4674-aca5-acb698488b19 {{(pid=97981) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 19 04:59:24.374385 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:59:24.374655 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:59:24.374716 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=97981) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 19 04:59:24.374790 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97981) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 19 04:59:24.376623 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:24.377289 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97981) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 19 04:59:24.398592 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Calling os-brick to attach iSCSI Volume {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 19 04:59:24.399027 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee', 'iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:59:24.399253 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:59:24.399769 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:59:24.400066 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee', 'iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 19 04:59:24.411671 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:59:24.412314 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:59:24.412875 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:59:24.413121 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:59:24.413436 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:59:24.413678 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:59:24.424511 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:59:24.424511 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:24.430635 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 19 04:59:24.430635 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:24.436909 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee] added
May 19 04:59:24.436909 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:59:24.436909 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:59:24.436909 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:59:24.436909 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:59:24.436909 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:59:24.436909 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:24.437176 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:59:24.437336 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0242(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:59:24.437523 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:59:24.444315 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee] added
May 19 04:59:24.444315 np0000001025 nova-compute[97981]:  stderr=iscsiadm: Config file line 363 does not have value
May 19 04:59:24.444315 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:59:24.444315 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:59:24.444315 np0000001025 nova-compute[97981]: iscsiadm: Config file line 363 does not have value
May 19 04:59:24.444315 np0000001025 nova-compute[97981]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 19 04:59:24.444315 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:24.444474 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97981) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 19 04:59:24.444586 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 19 04:59:24.444763 np0000001025 nova-compute[97981]: DEBUG os_brick.utils [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97981) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 19 04:59:25.438165 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 19 04:59:25.445214 np0000001025 nova-compute[97981]: INFO os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.40.100
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:59:25.450639 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:59:25.450639 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.name = iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.tpgt = -1
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.startup = manual
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.leading_login = No
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.iscsi_ifacename = default
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.net_ifacename = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.ipaddress = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.prefix_len = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.hwaddress = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.transport_name = tcp
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.initiatorname = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.state = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.vlan_id = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.vlan_priority = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.vlan_state = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.iface_num = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.mtu = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.port = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.bootproto = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.subnet_mask = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.gateway = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id_state = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.dhcp_alt_client_id = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.dhcp_dns = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.dhcp_learn_iqn = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.dhcp_req_vendor_id_state = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id_state = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.dhcp_vendor_id = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.dhcp_slp_da = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.fragmentation = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.gratuitous_arp = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.incoming_forwarding = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.tos_state = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.tos = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.ttl = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.delayed_ack = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.tcp_nagle = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.tcp_wsf_state = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.tcp_wsf = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.tcp_timer_scale = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.tcp_timestamp = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.redirect = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.def_task_mgmt_timeout = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.header_digest = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.data_digest = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.immediate_data = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.initial_r2t = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.data_seq_inorder = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.data_pdu_inorder = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.erl = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.max_receive_data_len = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.first_burst_len = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.max_outstanding_r2t = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.max_burst_len = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.chap_auth = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.bidi_chap = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.strict_login_compliance = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.discovery_auth = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: iface.discovery_logout = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.discovery_address = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.discovery_port = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.discovery_type = fw
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.initial_cmdsn = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.initial_login_retry_max = 8
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.xmit_thread_priority = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.cmds_max = 128
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.queue_depth = 32
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.nr_sessions = 1
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.auth.authmethod = None
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.auth.username = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.auth.password = ***
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.auth.username_in = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.auth.password_in = <empty>
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.auth.chap_algs = SHA256
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.timeo.replacement_timeout = 120
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.err_timeo.abort_timeout = 15
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.err_timeo.lu_reset_timeout = 30
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.err_timeo.tgt_reset_timeout = 30
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.err_timeo.host_reset_timeout = 60
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.iscsi.FastAbort = Yes
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.iscsi.InitialR2T = No
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.iscsi.ImmediateData = Yes
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.iscsi.FirstBurstLength = 262144
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.iscsi.MaxBurstLength = 16776192
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Retain = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.iscsi.DefaultTime2Wait = 2
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.iscsi.MaxConnections = 1
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.iscsi.MaxOutstandingR2T = 1
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.iscsi.ERL = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.scan = auto
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.session.reopen_max = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.conn[0].address = 192.168.50.100
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.conn[0].port = 3260
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.conn[0].startup = manual
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.conn[0].tcp.window_size = 524288
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.conn[0].tcp.type_of_service = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.conn[0].timeo.logout_timeout = 15
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.conn[0].timeo.login_timeout = 15
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.conn[0].timeo.auth_timeout = 45
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_interval = 5
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.conn[0].timeo.noop_out_timeout = 5
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.conn[0].iscsi.HeaderDigest = None
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.conn[0].iscsi.DataDigest = None
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.conn[0].iscsi.IFMarker = No
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: node.conn[0].iscsi.OFMarker = No
May 19 04:59:25.459452 np0000001025 nova-compute[97981]: # END RECORD
May 19 04:59:25.459452 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:25.466365 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:25.471407 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:25.479068 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 19 04:59:25.479068 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:59:25.479293 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 19 04:59:25.479293 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:59:25.479434 np0000001025 nova-compute[97981]: WARNING os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 19 04:59:25.479434 np0000001025 nova-compute[97981]: 
May 19 04:59:25.485237 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 19 04:59:25.485237 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:59:25.485406 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 19 04:59:25.485406 np0000001025 nova-compute[97981]:  {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:59:25.485568 np0000001025 nova-compute[97981]: WARNING os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 19 04:59:25.485568 np0000001025 nova-compute[97981]: 
May 19 04:59:25.508653 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee, portal: 192.168.40.100,3260]
May 19 04:59:25.508653 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee, portal: 192.168.40.100,3260] successful.
May 19 04:59:25.508653 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:25.521863 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:25.530940 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee, portal: 192.168.50.100,3260]
May 19 04:59:25.530940 np0000001025 nova-compute[97981]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee, portal: 192.168.50.100,3260] successful.
May 19 04:59:25.530940 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:25.536199 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee (non-flash)
May 19 04:59:25.536199 np0000001025 nova-compute[97981]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee (non-flash)
May 19 04:59:25.536199 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:59:25.536199 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee (non-flash)
May 19 04:59:25.536199 np0000001025 nova-compute[97981]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee (non-flash)
May 19 04:59:25.536199 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:59:25.536486 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.124s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:59:25.536583 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Connected to 192.168.40.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:59:25.537024 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] HCTL ('7', '-', '-', 0) found on session 227 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:59:25.537191 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:59:25.544736 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:25.552281 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Searching for a device in session 227 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:59:25.552281 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:59:25.556713 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee (non-flash)
May 19 04:59:25.556713 np0000001025 nova-compute[97981]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee (non-flash)
May 19 04:59:25.556713 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:59:25.556849 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee (non-flash)
May 19 04:59:25.556849 np0000001025 nova-compute[97981]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee (non-flash)
May 19 04:59:25.556849 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:59:25.557126 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:59:25.557254 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Connected to 192.168.50.100:3260 {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 19 04:59:25.557668 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] HCTL ('8', '-', '-', 0) found on session 228 with lun 0 {{(pid=97981) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 19 04:59:25.557764 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97981) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 19 04:59:25.570883 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Searching for a device in session 228 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97981) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 19 04:59:25.571075 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97981) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 19 04:59:26.413545 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 19 04:59:27.428634 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Found WWN 3300000008b477cbd for multipath device dm-0 {{(pid=97981) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 19 04:59:27.429041 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:59:27.429089 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '3300000008b477cbd', 'path': '/dev/dm-0', 'multipath_id': '3300000008b477cbd'} {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:59:27.429212 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008b477cbd', 'path': '/dev/dm-0', 'multipath_id': '3300000008b477cbd'} {{(pid=97981) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 19 04:59:27.431857 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lazy-loading 'flavor' on Instance uuid 288173b9-6744-4786-a21a-d987d2384714 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:59:27.934927 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Attempting to attach volume f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97981) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 19 04:59:27.936221 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] attach device xml: <disk type="block" device="disk">
May 19 04:59:27.936221 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:59:27.936221 np0000001025 nova-compute[97981]:   <alias name="ua-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee"/>
May 19 04:59:27.936221 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:59:27.936221 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:59:27.936221 np0000001025 nova-compute[97981]:   <serial>f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee</serial>
May 19 04:59:27.936221 np0000001025 nova-compute[97981]: </disk>
May 19 04:59:27.936221 np0000001025 nova-compute[97981]:  {{(pid=97981) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 19 04:59:29.382511 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:59:29.382884 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:59:29.382884 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=97981) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 19 04:59:29.382884 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97981) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 19 04:59:29.391351 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:29.391512 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97981) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 19 04:59:29.563768 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] No BDM found with device name vda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:59:29.563908 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:59:29.564006 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] No BDM found with device name hda, not building metadata. {{(pid=97981) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 19 04:59:29.564076 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] No VIF found with MAC fa:16:3e:7c:e1:c1, not building metadata {{(pid=97981) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 19 04:59:31.106576 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-81b02d58-ecaa-4c9e-bcfc-70714b2fc005 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.385s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:59:34.385104 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:34.392173 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:34.493175 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "288173b9-6744-4786-a21a-d987d2384714" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:59:34.493175 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:59:34.995163 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Detaching volume f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee
May 19 04:59:35.027231 np0000001025 nova-compute[97981]: INFO nova.virt.block_device [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Attempting to driver detach volume f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee from mountpoint /dev/vdb
May 19 04:59:35.030793 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Found disk vdb by alias ua-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:59:35.032130 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Found disk vdb by alias ua-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee {{(pid=97981) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 19 04:59:35.032130 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Attempting to detach device vdb from instance 288173b9-6744-4786-a21a-d987d2384714 from the persistent domain config. {{(pid=97981) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 19 04:59:35.032130 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:59:35.032130 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:59:35.032130 np0000001025 nova-compute[97981]:   <alias name="ua-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee"/>
May 19 04:59:35.032130 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:59:35.032130 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:59:35.032130 np0000001025 nova-compute[97981]:   <serial>f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee</serial>
May 19 04:59:35.032130 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:59:35.032130 np0000001025 nova-compute[97981]: </disk>
May 19 04:59:35.032130 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:59:35.037135 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Successfully detached device vdb from instance 288173b9-6744-4786-a21a-d987d2384714 from the persistent domain config.
May 19 04:59:35.037135 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] (1/8): Attempting to detach device vdb with device alias ua-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee from instance 288173b9-6744-4786-a21a-d987d2384714 from the live domain config. {{(pid=97981) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 19 04:59:35.037439 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.guest [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] detach device xml: <disk type="block" device="disk">
May 19 04:59:35.037439 np0000001025 nova-compute[97981]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 19 04:59:35.037439 np0000001025 nova-compute[97981]:   <alias name="ua-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee"/>
May 19 04:59:35.037439 np0000001025 nova-compute[97981]:   <source dev="/dev/dm-0"/>
May 19 04:59:35.037439 np0000001025 nova-compute[97981]:   <target dev="vdb" bus="virtio"/>
May 19 04:59:35.037439 np0000001025 nova-compute[97981]:   <serial>f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee</serial>
May 19 04:59:35.037439 np0000001025 nova-compute[97981]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 19 04:59:35.037439 np0000001025 nova-compute[97981]: </disk>
May 19 04:59:35.037439 np0000001025 nova-compute[97981]:  {{(pid=97981) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 19 04:59:35.502530 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Received event <DeviceRemovedEvent: 1779166775.5021315, 288173b9-6744-4786-a21a-d987d2384714 => ua-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee> from libvirt while the driver is waiting for it; dispatched. {{(pid=97981) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 19 04:59:35.503399 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee for instance 288173b9-6744-4786-a21a-d987d2384714 {{(pid=97981) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 19 04:59:35.505520 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Successfully detached device vdb from instance 288173b9-6744-4786-a21a-d987d2384714 from the live domain config.
May 19 04:59:35.506458 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] calling os-brick to detach iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 19 04:59:35.506704 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x72185023bf80>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee', 'iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 19 04:59:35.506820 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 19 04:59:35.507175 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 19 04:59:35.507424 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee', 'iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 19 04:59:35.507540 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee', 0)] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 19 04:59:35.525560 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee (non-flash)
May 19 04:59:35.525560 np0000001025 nova-compute[97981]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee (non-flash)
May 19 04:59:35.525560 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 19 04:59:35.525949 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee (non-flash)
May 19 04:59:35.525949 np0000001025 nova-compute[97981]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee (non-flash)
May 19 04:59:35.525949 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 19 04:59:35.526113 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee', '227'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee', '228')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 19 04:59:35.526261 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee', '227')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:59:35.527081 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee', '228')] {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 19 04:59:35.527911 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x721850275120>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee'): ({'sdc'}, set())}) {{(pid=97981) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 19 04:59:35.528157 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Removing multipathed devices sdc, sdb {{(pid=97981) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 19 04:59:35.528411 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Flush multipath device 3300000008b477cbd {{(pid=97981) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 19 04:59:35.558180 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:59:35.593387 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97981) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 19 04:59:35.638342 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 19 04:59:35.638484 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97981) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 19 04:59:35.639042 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 19 04:59:35.649834 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.linuxscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97981) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 19 04:59:35.650009 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee')] {{(pid=97981) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 19 04:59:35.660057 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:35.684695 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 227, target: iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee, portal: 192.168.40.100,3260]
May 19 04:59:35.684695 np0000001025 nova-compute[97981]: Logout of [sid: 227, target: iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee, portal: 192.168.40.100,3260] successful.
May 19 04:59:35.684695 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:35.694547 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:35.704328 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:35.735897 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 228, target: iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee, portal: 192.168.50.100,3260]
May 19 04:59:35.735897 np0000001025 nova-compute[97981]: Logout of [sid: 228, target: iqn.2023-03.storpool.com:os--volume-f4f8a54f-d6ab-4cf1-b757-bbc92eb743ee, portal: 192.168.50.100,3260] successful.
May 19 04:59:35.735897 np0000001025 nova-compute[97981]:  stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:35.746065 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97981) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 19 04:59:35.746315 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.base [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.239s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 19 04:59:35.746448 np0000001025 nova-compute[97981]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] <== disconnect_volume: return (239ms) None {{(pid=97981) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 19 04:59:35.746583 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Disconnected iSCSI Volume {{(pid=97981) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 19 04:59:36.286068 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lazy-loading 'flavor' on Instance uuid 288173b9-6744-4786-a21a-d987d2384714 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:59:37.291367 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-5abe3c94-d10b-4cba-8c31-052580b171e5 tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.798s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:59:39.395880 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:44.398533 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:45.424031 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "288173b9-6744-4786-a21a-d987d2384714" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:59:45.424459 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:59:45.424459 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "288173b9-6744-4786-a21a-d987d2384714-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:59:45.424459 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:59:45.424543 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:59:45.426370 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Terminating instance
May 19 04:59:45.928981 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Start destroying the instance on the hypervisor. {{(pid=97981) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 19 04:59:45.941887 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:45.958944 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:45.960773 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:45.970521 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:45.977615 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:46.062756 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-88b4eb97-2c77-4d6f-9352-29869086b897 req-eabd2c89-ca88-4a65-8abb-3f302f50e7b6 service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] Received event network-vif-unplugged-a6a22052-4a44-4bdc-84a5-1193b6daf8da {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:59:46.062912 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-88b4eb97-2c77-4d6f-9352-29869086b897 req-eabd2c89-ca88-4a65-8abb-3f302f50e7b6 service nova] Acquiring lock "288173b9-6744-4786-a21a-d987d2384714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:59:46.063036 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-88b4eb97-2c77-4d6f-9352-29869086b897 req-eabd2c89-ca88-4a65-8abb-3f302f50e7b6 service nova] Lock "288173b9-6744-4786-a21a-d987d2384714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:59:46.063366 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-88b4eb97-2c77-4d6f-9352-29869086b897 req-eabd2c89-ca88-4a65-8abb-3f302f50e7b6 service nova] Lock "288173b9-6744-4786-a21a-d987d2384714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:59:46.063479 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-88b4eb97-2c77-4d6f-9352-29869086b897 req-eabd2c89-ca88-4a65-8abb-3f302f50e7b6 service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] No waiting events found dispatching network-vif-unplugged-a6a22052-4a44-4bdc-84a5-1193b6daf8da {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:59:46.063589 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-88b4eb97-2c77-4d6f-9352-29869086b897 req-eabd2c89-ca88-4a65-8abb-3f302f50e7b6 service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] Received event network-vif-unplugged-a6a22052-4a44-4bdc-84a5-1193b6daf8da for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:59:46.238958 np0000001025 nova-compute[97981]: DEBUG nova.utils [None req-c4a603d5-3e35-467e-83da-2afee99981d3 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999705793999965 future=<Future at 0x7218500fb3e0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:59:46.239391 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999239186999603 future=<Future at 0x7218500fb3e0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:59:46.239501 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=14.999102051999671 future=<Future at 0x7218500fb3e0 state=pending>) {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 04:59:46.240795 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [-] [instance: 288173b9-6744-4786-a21a-d987d2384714] Instance destroyed successfully.
May 19 04:59:46.241187 np0000001025 nova-compute[97981]: DEBUG nova.objects.instance [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lazy-loading 'resources' on Instance uuid 288173b9-6744-4786-a21a-d987d2384714 {{(pid=97981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 19 04:59:46.743517 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.vif [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-19T04:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-915673572',display_name='tempest-SnapshotDataIntegrityTests-server-915673572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001025',hostname='tempest-snapshotdataintegritytests-server-915673572',id=80,image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArwCDFZvH70uQgAKENHwHNbE0ik68bnrZDiAMFHiXbfoRve22xBcd2lZzRuVCzUonPNZVBdhN8Ft4stfog1PuKDs9jfzEt0mApY2oxGZ+yJKt8y5oJWpKmD2VmNjFKHHA==',key_name='tempest-keypair-981225345',keypairs=<?>,launch_index=0,launched_at=2026-05-19T04:57:52Z,launched_on='np0000001025',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001025',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f79a8a618f64839bf927ffe9d9115a4',ramdisk_id='',reservation_id='r-4ih6j2bc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76f2afbb-2235-45f3-9168-d64aadd6e71e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-901230178',owner_user_name='tempest-SnapshotDataIntegrityTests-901230178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-19T04:57:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='792818385dd84e84ace907c921ff2862',uuid=288173b9-6744-4786-a21a-d987d2384714,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6a22052-4a44-4bdc-84a5-1193b6daf8da", "address": "fa:16:3e:7c:e1:c1", "network": {"id": "2e467758-9914-49ea-95cd-58e0b9e52cbe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-673449942-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f79a8a618f64839bf927ffe9d9115a4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a22052-4a", "ovs_interfaceid": "a6a22052-4a44-4bdc-84a5-1193b6daf8da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 19 04:59:46.744016 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Converting VIF {"id": "a6a22052-4a44-4bdc-84a5-1193b6daf8da", "address": "fa:16:3e:7c:e1:c1", "network": {"id": "2e467758-9914-49ea-95cd-58e0b9e52cbe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-673449942-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f79a8a618f64839bf927ffe9d9115a4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a22052-4a", "ovs_interfaceid": "a6a22052-4a44-4bdc-84a5-1193b6daf8da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 19 04:59:46.744587 np0000001025 nova-compute[97981]: DEBUG nova.network.os_vif_util [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:e1:c1,bridge_name='br-int',has_traffic_filtering=True,id=a6a22052-4a44-4bdc-84a5-1193b6daf8da,network=Network(2e467758-9914-49ea-95cd-58e0b9e52cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a22052-4a') {{(pid=97981) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 19 04:59:46.744861 np0000001025 nova-compute[97981]: DEBUG os_vif [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:e1:c1,bridge_name='br-int',has_traffic_filtering=True,id=a6a22052-4a44-4bdc-84a5-1193b6daf8da,network=Network(2e467758-9914-49ea-95cd-58e0b9e52cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a22052-4a') {{(pid=97981) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 19 04:59:46.746375 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:46.746650 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6a22052-4a, bridge=br-int, if_exists=True) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:59:46.747580 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:46.748336 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:59:46.748782 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:46.749480 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:46.749480 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7091231-f9a1-43c1-b416-04acbadf19ae) {{(pid=97981) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 19 04:59:46.749665 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:46.750128 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 04:59:46.751784 np0000001025 nova-compute[97981]: INFO os_vif [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:e1:c1,bridge_name='br-int',has_traffic_filtering=True,id=a6a22052-4a44-4bdc-84a5-1193b6daf8da,network=Network(2e467758-9914-49ea-95cd-58e0b9e52cbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a22052-4a')
May 19 04:59:46.752087 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Deleting instance files /opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714_del
May 19 04:59:46.752934 np0000001025 nova-compute[97981]: INFO nova.virt.libvirt.driver [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Deletion of /opt/stack/data/nova/instances/288173b9-6744-4786-a21a-d987d2384714_del complete
May 19 04:59:47.258590 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Took 1.33 seconds to destroy the instance on the hypervisor.
May 19 04:59:47.259140 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._common.loopingcall [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97981) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 19 04:59:47.259447 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [-] [instance: 288173b9-6744-4786-a21a-d987d2384714] Deallocating network for instance {{(pid=97981) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 19 04:59:47.259555 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 288173b9-6744-4786-a21a-d987d2384714] deallocate_for_instance() {{(pid=97981) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1843}}
May 19 04:59:47.259792 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:59:47.344231 np0000001025 nova-compute[97981]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 19 04:59:47.668948 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-db11e7d3-73db-41f3-97e2-efb6946dd296 req-dc9cda5f-81d0-4e85-ba2c-79f00eed6f61 service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] Received event network-vif-deleted-a6a22052-4a44-4bdc-84a5-1193b6daf8da {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:59:47.669143 np0000001025 nova-compute[97981]: INFO nova.compute.manager [req-db11e7d3-73db-41f3-97e2-efb6946dd296 req-dc9cda5f-81d0-4e85-ba2c-79f00eed6f61 service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] Neutron deleted interface a6a22052-4a44-4bdc-84a5-1193b6daf8da; detaching it from the instance and deleting it from the info cache
May 19 04:59:47.669321 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [req-db11e7d3-73db-41f3-97e2-efb6946dd296 req-dc9cda5f-81d0-4e85-ba2c-79f00eed6f61 service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:59:48.119807 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c4f9c727-0c8c-4a27-abe3-7dbeab970ee7 req-0c294a4e-b536-45ad-8e62-fae430ace9bc service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] Received event network-vif-unplugged-a6a22052-4a44-4bdc-84a5-1193b6daf8da {{(pid=97981) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 19 04:59:48.120144 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c4f9c727-0c8c-4a27-abe3-7dbeab970ee7 req-0c294a4e-b536-45ad-8e62-fae430ace9bc service nova] Acquiring lock "288173b9-6744-4786-a21a-d987d2384714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:59:48.120144 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c4f9c727-0c8c-4a27-abe3-7dbeab970ee7 req-0c294a4e-b536-45ad-8e62-fae430ace9bc service nova] Lock "288173b9-6744-4786-a21a-d987d2384714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:59:48.120275 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [req-c4f9c727-0c8c-4a27-abe3-7dbeab970ee7 req-0c294a4e-b536-45ad-8e62-fae430ace9bc service nova] Lock "288173b9-6744-4786-a21a-d987d2384714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:59:48.120354 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c4f9c727-0c8c-4a27-abe3-7dbeab970ee7 req-0c294a4e-b536-45ad-8e62-fae430ace9bc service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] No waiting events found dispatching network-vif-unplugged-a6a22052-4a44-4bdc-84a5-1193b6daf8da {{(pid=97981) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 19 04:59:48.120455 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-c4f9c727-0c8c-4a27-abe3-7dbeab970ee7 req-0c294a4e-b536-45ad-8e62-fae430ace9bc service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] Received event network-vif-unplugged-a6a22052-4a44-4bdc-84a5-1193b6daf8da for instance with task_state deleting. {{(pid=97981) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 19 04:59:48.129101 np0000001025 nova-compute[97981]: DEBUG nova.network.neutron [-] [instance: 288173b9-6744-4786-a21a-d987d2384714] Updating instance_info_cache with network_info: [] {{(pid=97981) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 19 04:59:48.172882 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [req-db11e7d3-73db-41f3-97e2-efb6946dd296 req-dc9cda5f-81d0-4e85-ba2c-79f00eed6f61 service nova] [instance: 288173b9-6744-4786-a21a-d987d2384714] Detach interface failed, port_id=a6a22052-4a44-4bdc-84a5-1193b6daf8da, reason: Instance 288173b9-6744-4786-a21a-d987d2384714 could not be found. {{(pid=97981) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 19 04:59:48.630837 np0000001025 nova-compute[97981]: INFO nova.compute.manager [-] [instance: 288173b9-6744-4786-a21a-d987d2384714] Took 1.37 seconds to deallocate network for instance.
May 19 04:59:49.135526 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 04:59:49.136051 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 04:59:49.217730 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 04:59:49.217925 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 04:59:49.567388 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:59:49.567695 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:59:49.568055 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.05 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:59:49.615182 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:59:49.615485 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:59:49.615748 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:59:49.720271 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 04:59:50.226500 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.091s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:59:50.278709 np0000001025 nova-compute[97981]: INFO nova.scheduler.client.report [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Deleted allocations for instance 288173b9-6744-4786-a21a-d987d2384714
May 19 04:59:50.890640 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:59:51.286324 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-c7b579b9-6871-43fe-a3e0-3d764a26d04f tempest-SnapshotDataIntegrityTests-901230178 tempest-SnapshotDataIntegrityTests-901230178-project-member] Lock "288173b9-6744-4786-a21a-d987d2384714" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.862s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 04:59:51.615401 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:59:51.615670 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:59:51.751542 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:52.614936 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:59:52.615385 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 04:59:53.400243 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:54.999386 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:55.222961 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:56.760411 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 04:59:59.614878 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 04:59:59.615468 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 04:59:59.615468 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 05:00:00.614985 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 05:00:01.118935 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 05:00:01.119182 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 05:00:01.119381 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 05:00:01.119549 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 05:00:01.129478 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 05:00:01.130225 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 05:00:01.174924 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 05:00:01.175326 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=14577MB free_disk=72.67746353149414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 05:00:01.175483 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 05:00:01.175726 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 05:00:01.239182 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x721852b3c050>>, remaining_delay=-0.0005004640001970984 future=<Future at 0x7218500fb3e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x721853c707a0> {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 05:00:01.239626 np0000001025 nova-compute[97981]: DEBUG nova.virt.driver [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] Emitting event <LifecycleEvent: 1779166786.2385314, 288173b9-6744-4786-a21a-d987d2384714 => Stopped> {{(pid=97981) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 19 05:00:01.239775 np0000001025 nova-compute[97981]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97981) _log /opt/stack/nova/nova/utils.py:1500}}
May 19 05:00:01.239930 np0000001025 nova-compute[97981]: INFO nova.compute.manager [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] VM Stopped (Lifecycle Event)
May 19 05:00:01.742438 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-f943dc0b-4a1b-4cab-be4b-93e6cbf2da9f tempest-TestEncryptedCinderVolumes-282543688 tempest-TestEncryptedCinderVolumes-282543688-project-member] [instance: 288173b9-6744-4786-a21a-d987d2384714] Checking state {{(pid=97981) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 19 05:00:01.761846 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 05:00:02.221346 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 05:00:02.221515 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:00:01 up 50 min,  1 user,  load average: 0.77, 2.02, 3.02\n'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 05:00:02.262125 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 05:00:02.262317 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 05:00:02.764792 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 05:00:03.272335 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 05:00:03.272544 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.097s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 05:00:03.272856 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 05:00:04.268158 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 05:00:04.268628 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 41.34 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 05:00:06.764089 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 05:00:11.766379 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 05:00:16.767997 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 05:00:21.769487 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 05:00:26.771362 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 05:00:31.773428 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 05:00:36.773835 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 05:00:36.774338 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 05:00:36.774338 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5000 ms, sending inactivity probe {{(pid=97981) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 19 05:00:36.774338 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97981) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 19 05:00:36.774582 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97981) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 19 05:00:41.774953 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 19 05:00:45.610466 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 05:00:45.610928 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 05:00:46.614786 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 05:00:46.615224 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 05:00:46.776365 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 05:00:50.615172 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 05:00:50.615553 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 05:00:50.615553 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 05:00:51.778301 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 05:00:53.615214 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 05:00:53.615524 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 05:00:54.614914 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 05:00:54.615293 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 05:00:56.780361 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 05:01:00.615022 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager.update_available_resource {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 05:01:01.119087 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 05:01:01.119680 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 05:01:01.119854 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 05:01:01.120013 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Auditing locally available compute resources for np0000001025 (node: np0000001025) {{(pid=97981) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 19 05:01:01.130826 np0000001025 nova-compute[97981]: WARNING nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 19 05:01:01.131663 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 19 05:01:01.178269 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.processutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=97981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 19 05:01:01.178662 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Hypervisor/Node resource view: name=np0000001025 free_ram=14473MB free_disk=72.66360473632812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=97981) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 19 05:01:01.178850 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 19 05:01:01.179066 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 19 05:01:01.781374 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 05:01:02.227189 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 19 05:01:02.227334 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Final resource view: name=np0000001025 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:01:01 up 51 min,  2 users,  load average: 0.33, 1.66, 2.83\n'} {{(pid=97981) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 19 05:01:02.266887 np0000001025 nova-compute[97981]: DEBUG nova.virt.libvirt.driver [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97981) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 19 05:01:02.267082 np0000001025 nova-compute[97981]: DEBUG nova.compute.provider_tree [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed in ProviderTree for provider: 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 {{(pid=97981) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 19 05:01:02.769410 np0000001025 nova-compute[97981]: DEBUG nova.scheduler.client.report [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Inventory has not changed for provider 086d5ca1-60c6-4d3b-acd3-87b1868e2eb6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97981) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 19 05:01:03.275027 np0000001025 nova-compute[97981]: DEBUG nova.compute.resource_tracker [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Compute_service record updated for np0000001025:np0000001025 {{(pid=97981) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 19 05:01:03.275441 np0000001025 nova-compute[97981]: DEBUG oslo_concurrency.lockutils [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.096s {{(pid=97981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 19 05:01:03.275559 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 05:01:04.275656 np0000001025 nova-compute[97981]: DEBUG oslo_service.periodic_task [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 19 05:01:04.276093 np0000001025 nova-compute[97981]: DEBUG nova.compute.manager [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97981) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 19 05:01:04.276093 np0000001025 nova-compute[97981]: DEBUG oslo.service.backend._threading.loopingcall [None req-da97c8c5-7ba4-49be-8dde-e6a8fc09ec6a None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 39.34 seconds {{(pid=97981) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 19 05:01:06.783566 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 19 05:01:11.784700 np0000001025 nova-compute[97981]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=97981) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}